Sep 06 19:27:16.465083 ip-10-0-135-174 systemd[1]: Starting Kubernetes Kubelet...
Sep 06 19:27:16.919599 ip-10-0-135-174 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 19:27:16.919599 ip-10-0-135-174 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 06 19:27:16.919599 ip-10-0-135-174 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 19:27:16.919599 ip-10-0-135-174 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 06 19:27:16.919599 ip-10-0-135-174 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 19:27:16.922603 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.922493    2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 06 19:27:16.928296 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928267    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 19:27:16.928296 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928289    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 19:27:16.928296 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928295    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 19:27:16.928296 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928299    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 19:27:16.928296 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928302    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 19:27:16.928296 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928305    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 19:27:16.928296 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928308    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 19:27:16.928558 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928311    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 19:27:16.928558 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928314    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 19:27:16.928558 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928317    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 19:27:16.928558 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928320    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 19:27:16.928558 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928322    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 19:27:16.928558 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928325    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 19:27:16.928558 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928329    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 19:27:16.928558 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928334    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 19:27:16.928558 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928338    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 19:27:16.928558 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928341    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 19:27:16.928558 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928344    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 19:27:16.928558 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928346    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 19:27:16.928558 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928349    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 19:27:16.928558 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928351    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 19:27:16.928558 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928354    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 19:27:16.928558 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928356    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 19:27:16.928558 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928359    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 19:27:16.928558 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928361    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 19:27:16.928558 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928364    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 19:27:16.929039 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928366    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 19:27:16.929039 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928369    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 19:27:16.929039 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928371    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 19:27:16.929039 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928381    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 19:27:16.929039 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928384    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 19:27:16.929039 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928387    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 19:27:16.929039 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928390    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 19:27:16.929039 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928392    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 19:27:16.929039 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928395    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 19:27:16.929039 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928398    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 19:27:16.929039 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928401    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 19:27:16.929039 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928403    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 19:27:16.929039 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928405    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 19:27:16.929039 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928409    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 19:27:16.929039 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928412    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 19:27:16.929039 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928415    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 19:27:16.929039 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928418    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 19:27:16.929039 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928422    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 19:27:16.929039 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928425    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 19:27:16.929039 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928427    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 19:27:16.929516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928430    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 19:27:16.929516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928432    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 19:27:16.929516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928435    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 19:27:16.929516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928437    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 19:27:16.929516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928440    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 19:27:16.929516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928442    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 19:27:16.929516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928445    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 19:27:16.929516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928447    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 19:27:16.929516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928450    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 19:27:16.929516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928452    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 19:27:16.929516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928456    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 19:27:16.929516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928458    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 19:27:16.929516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928461    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 19:27:16.929516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928464    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 19:27:16.929516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928467    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 19:27:16.929516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928469    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 19:27:16.929516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928472    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 19:27:16.929516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928474    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 19:27:16.929516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928476    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 19:27:16.930036 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928479    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 19:27:16.930036 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928482    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 19:27:16.930036 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928484    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 19:27:16.930036 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928487    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 19:27:16.930036 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928489    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 19:27:16.930036 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928494    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 19:27:16.930036 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928497    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 19:27:16.930036 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928501    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 19:27:16.930036 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928504    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 19:27:16.930036 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928506    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 19:27:16.930036 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928509    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 19:27:16.930036 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928512    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 19:27:16.930036 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928514    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 19:27:16.930036 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928516    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 19:27:16.930036 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928520    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 19:27:16.930036 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928524    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 19:27:16.930036 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928527    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 19:27:16.930036 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928530    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 19:27:16.930036 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928532    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 19:27:16.930498 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928535    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 19:27:16.930498 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928537    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 19:27:16.930498 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928540    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 19:27:16.930498 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928542    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 19:27:16.930498 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928545    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 19:27:16.930498 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928548    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 19:27:16.930498 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928550    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 19:27:16.930498 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928553    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 19:27:16.930498 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928555    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 19:27:16.930498 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928558    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 19:27:16.930498 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928560    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 19:27:16.930498 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928563    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 19:27:16.930498 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928566    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 19:27:16.930498 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928568    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 19:27:16.930498 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.928571    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 19:27:16.930498 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929360    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 19:27:16.930498 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929368    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 19:27:16.930498 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929371    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 19:27:16.930498 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929373    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 19:27:16.930498 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929377    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 19:27:16.931042 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929381    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 19:27:16.931042 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929384    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 19:27:16.931042 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929387    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 19:27:16.931042 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929390    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 19:27:16.931042 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929393    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 19:27:16.931042 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929395    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 19:27:16.931042 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929398    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 19:27:16.931042 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929401    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 19:27:16.931042 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929403    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 19:27:16.931042 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929406    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 19:27:16.931042 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929409    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 19:27:16.931042 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929411    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 19:27:16.931042 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929414    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 19:27:16.931042 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929416    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 19:27:16.931042 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929418    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 19:27:16.931042 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929421    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 19:27:16.931042 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929423    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 19:27:16.931042 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929426    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 19:27:16.931042 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929429    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 19:27:16.931042 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929432    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 19:27:16.931548 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929434    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 19:27:16.931548 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929436    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 19:27:16.931548 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929439    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 19:27:16.931548 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929441    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 19:27:16.931548 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929444    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 19:27:16.931548 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929446    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 19:27:16.931548 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929449    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 19:27:16.931548 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929452    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 19:27:16.931548 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929454    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 19:27:16.931548 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929457    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 19:27:16.931548 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929459    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 19:27:16.931548 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929462    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 19:27:16.931548 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929464    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 19:27:16.931548 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929467    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 19:27:16.931548 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929470    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 19:27:16.931548 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929473    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 19:27:16.931548 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929476    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 19:27:16.931548 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929479    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 19:27:16.931548 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929481    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 19:27:16.931548 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929484    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 19:27:16.932099 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929486    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 19:27:16.932099 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929489    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 19:27:16.932099 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929494    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 19:27:16.932099 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929498    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 19:27:16.932099 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929501    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 19:27:16.932099 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929503    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 19:27:16.932099 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929506    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 19:27:16.932099 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929508    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 19:27:16.932099 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929510    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 19:27:16.932099 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929513    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 19:27:16.932099 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929516    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 19:27:16.932099 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929519    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 19:27:16.932099 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929521    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 19:27:16.932099 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929524    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 19:27:16.932099 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929527    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 19:27:16.932099 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929529    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 19:27:16.932099 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929532    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 19:27:16.932099 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929535    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 19:27:16.932099 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929538    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 19:27:16.932099 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929541    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 19:27:16.932575 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929544    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 19:27:16.932575 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929546    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 19:27:16.932575 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929549    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 19:27:16.932575 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929552    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 19:27:16.932575 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929555    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 19:27:16.932575 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929559    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 19:27:16.932575 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929562    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 19:27:16.932575 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929565    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 19:27:16.932575 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929568    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 19:27:16.932575 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929571    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 19:27:16.932575 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929573    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 19:27:16.932575 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929576    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 19:27:16.932575 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929579    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 19:27:16.932575 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929581    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 19:27:16.932575 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929584    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 19:27:16.932575 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929586    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 19:27:16.932575 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929589    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 19:27:16.932575 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929592    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 19:27:16.932575 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929594    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 19:27:16.932575 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929596    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 19:27:16.933086 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929600    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 19:27:16.933086 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929603    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 19:27:16.933086 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929605    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 19:27:16.933086 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929607    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 19:27:16.933086 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929610    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 19:27:16.933086 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929613    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 19:27:16.933086 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929615    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 19:27:16.933086 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929618    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 19:27:16.933086 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929622    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 19:27:16.933086 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929624    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 19:27:16.933086 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929627    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 19:27:16.933086 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929630    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 19:27:16.933086 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929632    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 19:27:16.933086 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.929635    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 19:27:16.933086 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930071    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 19:27:16.933086 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930077    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 19:27:16.933086 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930080    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 19:27:16.933086 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930083    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 19:27:16.933086 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930086    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 19:27:16.933552 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930088    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 19:27:16.933552 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930091    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 19:27:16.933552 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930095    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 19:27:16.933552 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930098    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 19:27:16.933552 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930101    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 19:27:16.933552 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930104    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 19:27:16.933552 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930106    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 19:27:16.933552 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930109    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 19:27:16.933552 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930113    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 19:27:16.933552 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930116    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 19:27:16.933552 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930120    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 19:27:16.933552 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930123    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 19:27:16.933552 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930126    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 19:27:16.933552 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930128    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 19:27:16.933552 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930131    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 19:27:16.933552 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930134    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 19:27:16.933552 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930136    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 19:27:16.933552 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930140    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 19:27:16.933552 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930143    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 19:27:16.934056 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930146    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 19:27:16.934056 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930148    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 19:27:16.934056 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930151    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 19:27:16.934056 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930154    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 19:27:16.934056 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930157    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 19:27:16.934056 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930159    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 19:27:16.934056 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930162    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 19:27:16.934056 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930164    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 19:27:16.934056 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930167    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 19:27:16.934056 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930170    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 19:27:16.934056 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930173    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 19:27:16.934056 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930175    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 19:27:16.934056 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930178    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 19:27:16.934056 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930180    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 19:27:16.934056 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930182    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 19:27:16.934056 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930185    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 19:27:16.934056 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930188    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 19:27:16.934056 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930192    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 19:27:16.934056 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930195    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 19:27:16.934516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930199    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 19:27:16.934516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930202    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 19:27:16.934516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930205    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 19:27:16.934516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930208    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 19:27:16.934516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930210    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 19:27:16.934516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930213    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 19:27:16.934516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930216    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 19:27:16.934516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930219    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 19:27:16.934516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930221    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 19:27:16.934516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930223    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 19:27:16.934516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930226    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 19:27:16.934516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930228    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 19:27:16.934516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930231    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 19:27:16.934516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930234    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 19:27:16.934516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930237    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 19:27:16.934516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930239    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 19:27:16.934516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930245    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 19:27:16.934516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930247    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 19:27:16.934516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930250    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 19:27:16.934516 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930252    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 19:27:16.935023 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930254    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 19:27:16.935023 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930257    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 19:27:16.935023 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930260    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 19:27:16.935023 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930262    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 19:27:16.935023 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930264    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 19:27:16.935023 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930267    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 19:27:16.935023 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930269    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 19:27:16.935023 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930272    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 19:27:16.935023 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930274    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 19:27:16.935023 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930277    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 19:27:16.935023 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930280    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 19:27:16.935023 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930282    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 19:27:16.935023 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930285    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 19:27:16.935023 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930287    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 19:27:16.935023 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930289    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 19:27:16.935023 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930292    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 19:27:16.935023 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930294    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 19:27:16.935023 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930297    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 19:27:16.935023 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930299    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 19:27:16.935582 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930303    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 19:27:16.935582 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930305    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 19:27:16.935582 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930308    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 19:27:16.935582 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930310    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 19:27:16.935582 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930312    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 19:27:16.935582 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930315    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 19:27:16.935582 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930319    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 19:27:16.935582 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930323    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 19:27:16.935582 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930325    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 19:27:16.935582 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930329    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 19:27:16.935582 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930331    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 19:27:16.935582 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930334    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 19:27:16.935582 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930337    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 19:27:16.935582 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930339    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 19:27:16.935582 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930342    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 19:27:16.935582 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930344    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 19:27:16.935582 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.930346    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 19:27:16.935582 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930425    2568 flags.go:64] FLAG: --address="0.0.0.0"
Sep 06 19:27:16.935582 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930465    2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 06 19:27:16.935582 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930472    2568 flags.go:64] FLAG: --anonymous-auth="true"
Sep 06 19:27:16.935582 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930477    2568 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 06 19:27:16.936115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930481    2568 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 06 19:27:16.936115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930485    2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 06 19:27:16.936115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930489    2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 06 19:27:16.936115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930493    2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 06 19:27:16.936115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930496    2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 06 19:27:16.936115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930499    2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 06 19:27:16.936115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930503    2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 06 19:27:16.936115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930506    2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 06 19:27:16.936115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930510    2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 06 19:27:16.936115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930513    2568 flags.go:64] FLAG: --cgroup-root=""
Sep 06 19:27:16.936115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930516    2568 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 06 19:27:16.936115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930519    2568 flags.go:64] FLAG: --client-ca-file=""
Sep 06 19:27:16.936115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930522    2568 flags.go:64] FLAG: --cloud-provider="external"
Sep 06 19:27:16.936115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930525    2568 flags.go:64] FLAG: --cluster-dns="[]"
Sep 06 19:27:16.936115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930529    2568 flags.go:64] FLAG: --cluster-domain=""
Sep 06 19:27:16.936115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930532    2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 06 19:27:16.936115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930535    2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 06 19:27:16.936115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930538    2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 06 19:27:16.936115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930543    2568 flags.go:64] FLAG: --container-log-max-files="5"
Sep 06 19:27:16.936115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930547    2568 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 06 19:27:16.936115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930552    2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 06 19:27:16.936115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930555    2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 06 19:27:16.936115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930558    2568 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930561    2568 flags.go:64] FLAG: --contention-profiling="false"
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930564    2568 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930567    2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930570    2568 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930573    2568 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930577    2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930580    2568 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930583    2568 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930586    2568 flags.go:64] FLAG: --enable-load-reader="false"
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930589    2568 flags.go:64] FLAG: --enable-server="true"
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.930592    2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931167    2568 flags.go:64] FLAG: --event-burst="100"
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931171    2568 flags.go:64] FLAG: --event-qps="50"
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931174    2568 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931178    2568 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931181    2568 flags.go:64] FLAG: --eviction-hard=""
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931185    2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931188    2568 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931192    2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931195    2568 flags.go:64] FLAG: --eviction-soft=""
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931198    2568 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931201    2568 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931204    2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931207    2568 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 06 19:27:16.936680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931210    2568 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931213    2568 flags.go:64] FLAG: --fail-swap-on="true"
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931216    2568 flags.go:64] FLAG: --feature-gates=""
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931220    2568 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931224    2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931229    2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931233    2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931236    2568 flags.go:64] FLAG: --healthz-port="10248"
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931239    2568 flags.go:64] FLAG: --help="false"
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931242    2568 flags.go:64] FLAG: --hostname-override="ip-10-0-135-174.ec2.internal"
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931245    2568 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931248    2568 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931260    2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931264    2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931268    2568 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931271    2568 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931273    2568 flags.go:64] FLAG: --image-service-endpoint=""
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931276    2568 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931279    2568 flags.go:64] FLAG: --kube-api-burst="100"
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931282    2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931285    2568 flags.go:64] FLAG: --kube-api-qps="50"
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931288    2568 flags.go:64] FLAG: --kube-reserved=""
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931291    2568 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931294    2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 06 19:27:16.937313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931297    2568 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931300    2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931302    2568 flags.go:64] FLAG: --lock-file=""
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931305    2568 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931308    2568 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931311    2568 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931317    2568 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931320    2568 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931323    2568 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931325    2568 flags.go:64] FLAG: --logging-format="text"
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931328    2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931332    2568 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931335    2568 flags.go:64] FLAG: --manifest-url=""
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931341    2568 flags.go:64] FLAG: --manifest-url-header=""
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931349    2568 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931352    2568 flags.go:64] FLAG: --max-open-files="1000000"
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931356    2568 flags.go:64] FLAG: --max-pods="110"
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931359    2568 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931362    2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931365    2568 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931368    2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931371    2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931374    2568 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931377    2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931385    2568 flags.go:64] FLAG: --node-status-max-images="50"
Sep 06 19:27:16.937906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931388    2568 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931391    2568 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931394    2568 flags.go:64] FLAG: --pod-cidr=""
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931397    2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931403    2568 flags.go:64] FLAG: --pod-manifest-path=""
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931406    2568 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931409    2568 flags.go:64] FLAG: --pods-per-core="0"
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931412    2568 flags.go:64] FLAG: --port="10250"
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931414    2568 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931417    2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-063552b85345f828f"
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931420    2568 flags.go:64] FLAG: --qos-reserved=""
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931423    2568 flags.go:64] FLAG: --read-only-port="10255"
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931426    2568 flags.go:64] FLAG: --register-node="true"
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931429    2568 flags.go:64] FLAG: --register-with-taints=""
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931433    2568 flags.go:64] FLAG: --registry-burst="10"
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931436    2568 flags.go:64] FLAG: --registry-qps="5"
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931438    2568 flags.go:64] FLAG: --reserved-cpus=""
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931441    2568 flags.go:64] FLAG: --reserved-memory=""
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931445    2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931449    2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931452    2568 flags.go:64] FLAG: --rotate-certificates="false"
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931459    2568 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931462    2568 flags.go:64] FLAG: --runonce="false"
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931465    2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931468    2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 06 19:27:16.938500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931471    2568 flags.go:64] FLAG: --seccomp-default="false"
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931474    2568 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931477    2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931481    2568 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931484    2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931487    2568 flags.go:64] FLAG: --storage-driver-password="root"
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931490    2568 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931492    2568 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931496    2568 flags.go:64] FLAG: --storage-driver-user="root"
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931499    2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931502    2568 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931505    2568 flags.go:64] FLAG: --system-cgroups=""
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931508    2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931514    2568 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931516    2568 flags.go:64] FLAG: --tls-cert-file=""
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931519    2568 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931524    2568 flags.go:64] FLAG: --tls-min-version=""
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931527    2568 flags.go:64] FLAG: --tls-private-key-file=""
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931529    2568 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931532    2568 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931535    2568 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931538    2568 flags.go:64] FLAG: --v="2"
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931542    2568 flags.go:64] FLAG: --version="false"
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931547    2568 flags.go:64] FLAG: --vmodule=""
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931550    2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 06 19:27:16.939147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.931556    2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 06 19:27:16.939759 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931679    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 19:27:16.939759 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931683    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 19:27:16.939759 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931686    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 19:27:16.939759 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931690    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 19:27:16.939759 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931693    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 19:27:16.939759 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931696    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 19:27:16.939759 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931699    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 19:27:16.939759 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931701    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 19:27:16.939759 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931704    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 19:27:16.939759 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931706    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 19:27:16.939759 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931709    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 19:27:16.939759 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931711    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 19:27:16.939759 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931714    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 19:27:16.939759 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931717    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 19:27:16.939759 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931719    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 19:27:16.939759 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931721    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 19:27:16.939759 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931724    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 19:27:16.939759 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931726    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 19:27:16.939759 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931729    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 19:27:16.939759 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931732    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 19:27:16.940268 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931734    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 19:27:16.940268 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931737    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 19:27:16.940268 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931740    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 19:27:16.940268 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931742    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 19:27:16.940268 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931745    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 19:27:16.940268 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931748    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 19:27:16.940268 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931750    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 19:27:16.940268 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931752    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 19:27:16.940268 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931756    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 19:27:16.940268 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931759    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 19:27:16.940268 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931761    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 19:27:16.940268 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931765    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 19:27:16.940268 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931768    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 19:27:16.940268 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931770    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 19:27:16.940268 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931772    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 19:27:16.940268 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931790    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 19:27:16.940268 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931793    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 19:27:16.940268 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931796    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 19:27:16.940268 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931799    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 19:27:16.940268 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931802    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 19:27:16.940797 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931805    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 19:27:16.940797 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931807    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 19:27:16.940797 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931810    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 19:27:16.940797 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931812    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 19:27:16.940797 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931815    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 19:27:16.940797 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931818    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 19:27:16.940797 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931821    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 19:27:16.940797 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931823    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 19:27:16.940797 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931826    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 19:27:16.940797 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931828    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 19:27:16.940797 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931831    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 19:27:16.940797 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931834    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 19:27:16.940797 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931838    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 19:27:16.940797 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931841    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 19:27:16.940797 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931843    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 19:27:16.940797 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931846    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 19:27:16.940797 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931848    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 19:27:16.940797 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931851    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 19:27:16.940797 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931853    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 19:27:16.941310 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931856    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 19:27:16.941310 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931859    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 19:27:16.941310 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931861    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 19:27:16.941310 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931864    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 19:27:16.941310 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931868    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 19:27:16.941310 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931870    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 19:27:16.941310 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931873    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 19:27:16.941310 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931875    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 19:27:16.941310 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931878    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 19:27:16.941310 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931881    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 19:27:16.941310 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931884    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 19:27:16.941310 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931886    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 19:27:16.941310 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931889    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 19:27:16.941310 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931893    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 19:27:16.941310 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931896    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 19:27:16.941310 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931899    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 19:27:16.941310 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931902    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 19:27:16.941310 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931904    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 19:27:16.941310 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931907    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 19:27:16.941791 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931909    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 19:27:16.941791 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931912    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 19:27:16.941791 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931914    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 19:27:16.941791 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931916    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 19:27:16.941791 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931919    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 19:27:16.941791 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931921    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 19:27:16.941791 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931924    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 19:27:16.941791 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931926    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 19:27:16.941791 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931929    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 19:27:16.941791 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931931    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 19:27:16.941791 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931933    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 19:27:16.941791 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931936    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 19:27:16.941791 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931938    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 19:27:16.941791 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931940    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 19:27:16.941791 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931944    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 19:27:16.941791 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931948    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 19:27:16.941791 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931951    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 19:27:16.941791 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931955    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 19:27:16.941791 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931958    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 19:27:16.941791 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931961    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 19:27:16.942311 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.931963    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 19:27:16.942311 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.932795    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 19:27:16.942998 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.942974    2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 06 19:27:16.943031 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.943006    2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 06 19:27:16.943031 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.943028    2568 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 06 19:27:16.943091 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.943034    2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 06 19:27:16.943121 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943095    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 19:27:16.943121 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943102    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 19:27:16.943121 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943106    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 19:27:16.943121 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943109    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 19:27:16.943121 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943111    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 19:27:16.943121 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943114    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 19:27:16.943121 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943117    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 19:27:16.943121 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943120    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 19:27:16.943121 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943123    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 19:27:16.943121 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943126    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 19:27:16.943371 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943129    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 19:27:16.943371 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943132    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 19:27:16.943371 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943135    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 19:27:16.943371 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943138    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 19:27:16.943371 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943140    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 19:27:16.943371 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943142    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 19:27:16.943371 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943145    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 19:27:16.943371 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943148    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 19:27:16.943371 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943150    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 19:27:16.943371 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943152    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 19:27:16.943371 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943155    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 19:27:16.943371 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943157    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 19:27:16.943371 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943160    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 19:27:16.943371 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943162    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 19:27:16.943371 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943164    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 19:27:16.943371 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943167    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 19:27:16.943371 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943169    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 19:27:16.943371 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943171    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 19:27:16.943371 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943174    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 19:27:16.943842 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943176    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 19:27:16.943842 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943184    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 19:27:16.943842 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943187    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 19:27:16.943842 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943190    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 19:27:16.943842 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943192    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 19:27:16.943842 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943194    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 19:27:16.943842 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943197    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 19:27:16.943842 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943199    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 19:27:16.943842 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943202    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 19:27:16.943842 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943204    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 19:27:16.943842 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943206    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 19:27:16.943842 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943209    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 19:27:16.943842 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943211    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 19:27:16.943842 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943214    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 19:27:16.943842 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943217    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 19:27:16.943842 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943219    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 19:27:16.943842 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943222    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 19:27:16.943842 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943224    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 19:27:16.943842 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943227    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 19:27:16.943842 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943229    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 19:27:16.944357 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943232    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 19:27:16.944357 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943234    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 19:27:16.944357 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943236    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 19:27:16.944357 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943239    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 19:27:16.944357 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943241    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 19:27:16.944357 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943244    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 19:27:16.944357 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943246    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 19:27:16.944357 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943248    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 19:27:16.944357 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943259    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 19:27:16.944357 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943262    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 19:27:16.944357 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943264    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 19:27:16.944357 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943269    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 19:27:16.944357 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943272    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 19:27:16.944357 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943275    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 19:27:16.944357 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943286    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 19:27:16.944357 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943289    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 19:27:16.944357 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943292    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 19:27:16.944357 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943294    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 19:27:16.944357 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943297    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 19:27:16.944357 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943300    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 19:27:16.944854 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943302    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 19:27:16.944854 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943304    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 19:27:16.944854 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943307    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 19:27:16.944854 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943310    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 19:27:16.944854 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943312    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 19:27:16.944854 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943315    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 19:27:16.944854 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943318    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 19:27:16.944854 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943320    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 19:27:16.944854 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943323    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 19:27:16.944854 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943326    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 19:27:16.944854 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943328    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 19:27:16.944854 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943331    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 19:27:16.944854 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943335    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 19:27:16.944854 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943339    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 19:27:16.944854 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943341    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 19:27:16.944854 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943343    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 19:27:16.944854 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943346    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 19:27:16.944854 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943348    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 19:27:16.944854 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943351    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 19:27:16.945325 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943354    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 19:27:16.945325 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943357    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 19:27:16.945325 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943359    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 19:27:16.945325 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943362    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 19:27:16.945325 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943364    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 19:27:16.945325 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943366    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 19:27:16.945325 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943369    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 19:27:16.945325 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943372    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 19:27:16.945325 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943381    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 19:27:16.945325 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943383    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 19:27:16.945325 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943386    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 19:27:16.945325 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.943391    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 19:27:16.945325 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943555    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 19:27:16.945325 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943559    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 19:27:16.945325 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943562    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 19:27:16.945685 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943565    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 19:27:16.945685 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943569    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 19:27:16.945685 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943571    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 19:27:16.945685 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943574    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 19:27:16.945685 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943577    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 19:27:16.945685 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943580    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 19:27:16.945685 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943582    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 19:27:16.945685 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943585    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 19:27:16.945685 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943587    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 19:27:16.945685 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943590    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 19:27:16.945685 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943592    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 19:27:16.945685 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943594    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 19:27:16.945685 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943597    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 19:27:16.945685 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943600    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 19:27:16.945685 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943602    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 19:27:16.945685 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943605    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 19:27:16.945685 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943607    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 19:27:16.945685 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943609    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 19:27:16.945685 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943612    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 19:27:16.945685 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943614    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 19:27:16.946179 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943617    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 19:27:16.946179 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943619    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 19:27:16.946179 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943622    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 19:27:16.946179 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943626    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 19:27:16.946179 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943629    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 19:27:16.946179 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943632    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 19:27:16.946179 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943641    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 19:27:16.946179 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943644    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 19:27:16.946179 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943646    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 19:27:16.946179 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943649    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 19:27:16.946179 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943651    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 19:27:16.946179 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943654    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 19:27:16.946179 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943656    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 19:27:16.946179 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943659    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 19:27:16.946179 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943661    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 19:27:16.946179 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943664    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 19:27:16.946179 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943668    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 19:27:16.946179 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943676    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 19:27:16.946179 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943679    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 19:27:16.946179 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943681    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 19:27:16.946676 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943684    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 19:27:16.946676 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943686    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 19:27:16.946676 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943689    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 19:27:16.946676 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943693    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 19:27:16.946676 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943696    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 19:27:16.946676 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943699    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 19:27:16.946676 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943701    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 19:27:16.946676 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943704    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 19:27:16.946676 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943707    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 19:27:16.946676 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943709    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 19:27:16.946676 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943711    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 19:27:16.946676 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943714    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 19:27:16.946676 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943716    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 19:27:16.946676 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943719    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 19:27:16.946676 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943721    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 19:27:16.946676 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943723    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 19:27:16.946676 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943727    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 19:27:16.946676 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943730    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 19:27:16.946676 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943733    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 19:27:16.947289 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943742    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 19:27:16.947289 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943744    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 19:27:16.947289 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943747    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 19:27:16.947289 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943749    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 19:27:16.947289 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943753    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 19:27:16.947289 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943756    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 19:27:16.947289 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943758    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 19:27:16.947289 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943761    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 19:27:16.947289 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943764    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 19:27:16.947289 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943768    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 19:27:16.947289 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943770    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 19:27:16.947289 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943773    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 19:27:16.947289 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943791    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 19:27:16.947289 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943794    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 19:27:16.947289 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943797    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 19:27:16.947289 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943799    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 19:27:16.947289 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943802    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 19:27:16.947289 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943804    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 19:27:16.947289 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943807    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 19:27:16.947289 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943809    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 19:27:16.947796 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943812    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 19:27:16.947796 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943814    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 19:27:16.947796 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943817    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 19:27:16.947796 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943819    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 19:27:16.947796 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943822    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 19:27:16.947796 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943824    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 19:27:16.947796 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943826    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 19:27:16.947796 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943829    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 19:27:16.947796 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943831    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 19:27:16.947796 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943834    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 19:27:16.947796 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943836    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 19:27:16.947796 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943838    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 19:27:16.947796 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943841    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 19:27:16.947796 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943850    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 19:27:16.947796 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943853    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 19:27:16.947796 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943855    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 19:27:16.947796 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:16.943857    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 19:27:16.948225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.943863    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 19:27:16.948225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.944008    2568 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 06 19:27:16.948225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.946476    2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 06 19:27:16.948225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.947496    2568 server.go:1019] "Starting client certificate rotation"
Sep 06 19:27:16.948225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.947627    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 06 19:27:16.948225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.947694    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 06 19:27:16.951867 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.951757    2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 06 19:27:16.957873 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.957850    2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 06 19:27:16.968172 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.968144    2568 log.go:25] "Validated CRI v1 runtime API"
Sep 06 19:27:16.971607 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.971586    2568 log.go:25] "Validated CRI v1 image API"
Sep 06 19:27:16.972545 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.972524    2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 06 19:27:16.977926 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.977901    2568 fs.go:135] Filesystem UUIDs: map[6cd64f93-6500-426d-b49c-2d5110524ce2:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a2cd9b16-bd65-412e-9f5c-48d4ae6a325f:/dev/nvme0n1p4]
Sep 06 19:27:16.978028 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.977923    2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 06 19:27:16.981875 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.981850    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 06 19:27:16.982560 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.982443    2568 manager.go:216] Machine: {Timestamp:2026-09-06 19:27:16.981875162 +0000 UTC m=+0.386834224 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100503 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2511a7b94c69dd395f77f8d3773851 SystemUUID:ec2511a7-b94c-69dd-395f-77f8d3773851 BootID:d5bdc4da-e0d8-42d9-95e7-f61d4b6a537f Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d3:f2:6f:61:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d3:f2:6f:61:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:fe:ef:cc:00:4f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 06 19:27:16.982560 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.982555    2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 06 19:27:16.982720 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.982680    2568 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 06 19:27:16.985237 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.985205    2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 06 19:27:16.985407 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.985240    2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-174.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 06 19:27:16.986084 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.986071    2568 topology_manager.go:138] "Creating topology manager with none policy"
Sep 06 19:27:16.986137 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.986090    2568 container_manager_linux.go:309] "Creating device plugin manager"
Sep 06 19:27:16.986137 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.986101    2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 06 19:27:16.987801 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.987789    2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 06 19:27:16.988944 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.988932    2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 06 19:27:16.993250 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.993236    2568 state_mem.go:36] "Initialized new in-memory state store"
Sep 06 19:27:16.993391 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.993378    2568 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 06 19:27:16.993459 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.993427    2568 kubelet.go:486] "Attempting to sync node with API server"
Sep 06 19:27:16.993459 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.993448    2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 06 19:27:16.993543 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.993480    2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 06 19:27:16.993543 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.993494    2568 kubelet.go:398] "Adding apiserver pod source"
Sep 06 19:27:16.993543 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.993508    2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 06 19:27:16.994025 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.993986    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 06 19:27:16.994106 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:16.994052    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 06 19:27:17.000454 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.000431    2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 06 19:27:17.003717 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.003693    2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 06 19:27:17.003828 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.003735    2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 06 19:27:17.005647 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.005628    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 06 19:27:17.005647 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.005650    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 06 19:27:17.005837 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.005659    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 06 19:27:17.005837 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.005667    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 06 19:27:17.005837 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.005678    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 06 19:27:17.005837 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.005686    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 06 19:27:17.005837 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.005704    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 06 19:27:17.005837 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.005713    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 06 19:27:17.005837 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.005724    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 06 19:27:17.005837 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.005732    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 06 19:27:17.005837 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.005751    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 06 19:27:17.005837 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.005760    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 06 19:27:17.006617 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.006604    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 06 19:27:17.006680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.006620    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 06 19:27:17.008475 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.008300    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-174.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 06 19:27:17.008475 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.008421    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 06 19:27:17.013479 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.013461    2568 server.go:1268] "Started kubelet"
Sep 06 19:27:17.013576 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.013512    2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 06 19:27:17.013689 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.013658    2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 06 19:27:17.013734 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.013714    2568 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 06 19:27:17.014316 ip-10-0-135-174 systemd[1]: Started Kubernetes Kubelet.
Sep 06 19:27:17.015481 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.015396    2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 06 19:27:17.015716 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.015703    2568 server.go:310] "Adding debug handlers to kubelet server"
Sep 06 19:27:17.018518 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.018498    2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 06 19:27:17.019648 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.019631    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-174.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 06 19:27:17.020684 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.019646    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-174.ec2.internal.18d2d1f175d06882  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-174.ec2.internal,UID:ip-10-0-135-174.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-174.ec2.internal,},FirstTimestamp:2026-09-06 19:27:17.013424258 +0000 UTC m=+0.418383319,LastTimestamp:2026-09-06 19:27:17.013424258 +0000 UTC m=+0.418383319,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-174.ec2.internal,}"
Sep 06 19:27:17.023102 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.023086    2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 06 19:27:17.023184 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.023107    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 06 19:27:17.023228 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.023217    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
Sep 06 19:27:17.023806 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.023722    2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 06 19:27:17.023806 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.023794    2568 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 06 19:27:17.023953 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.023810    2568 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 06 19:27:17.023953 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.023936    2568 reconstruct.go:97] "Volume reconstruction finished"
Sep 06 19:27:17.023953 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.023951    2568 reconciler.go:29] "Reconciler: start to sync state"
Sep 06 19:27:17.024359 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.024291    2568 factory.go:153] Registering CRI-O factory
Sep 06 19:27:17.024359 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.024306    2568 factory.go:223] Registration of the crio container factory successfully
Sep 06 19:27:17.024359 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.024353    2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 06 19:27:17.024359 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.024360    2568 factory.go:55] Registering systemd factory
Sep 06 19:27:17.024622 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.024366    2568 factory.go:223] Registration of the systemd container factory successfully
Sep 06 19:27:17.024622 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.024379    2568 factory.go:103] Registering Raw factory
Sep 06 19:27:17.024622 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.024388    2568 manager.go:1196] Started watching for new ooms in manager
Sep 06 19:27:17.024852 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.024837    2568 manager.go:349] Starting recovery of all containers
Sep 06 19:27:17.027199 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.027162    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 06 19:27:17.027331 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.027305    2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-174.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 06 19:27:17.036660 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.036639    2568 manager.go:354] Recovery completed
Sep 06 19:27:17.042581 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.042564    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 19:27:17.044409 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.044387    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 19:27:17.044510 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.044422    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 19:27:17.044510 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.044433    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientPID"
Sep 06 19:27:17.045082 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.045059    2568 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 06 19:27:17.045082 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.045067    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 19:27:17.045082 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.045073    2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 06 19:27:17.045237 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.045091    2568 state_mem.go:36] "Initialized new in-memory state store"
Sep 06 19:27:17.045862 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.045847    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 19:27:17.045912 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.045871    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 19:27:17.045912 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.045881    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientPID"
Sep 06 19:27:17.046050 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.045979    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-174.ec2.internal.18d2d1f177a92cd7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-174.ec2.internal,UID:ip-10-0-135-174.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-174.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-174.ec2.internal,},FirstTimestamp:2026-09-06 19:27:17.044407511 +0000 UTC m=+0.449366573,LastTimestamp:2026-09-06 19:27:17.044407511 +0000 UTC m=+0.449366573,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-174.ec2.internal,}"
Sep 06 19:27:17.047399 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.047385    2568 policy_none.go:49] "None policy: Start"
Sep 06 19:27:17.047464 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.047404    2568 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 06 19:27:17.047464 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.047417    2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 06 19:27:17.049415 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.049403    2568 policy_none.go:47] "Start"
Sep 06 19:27:17.056303 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.055249    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-174.ec2.internal.18d2d1f177a979db  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-174.ec2.internal,UID:ip-10-0-135-174.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-174.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-174.ec2.internal,},FirstTimestamp:2026-09-06 19:27:17.044427227 +0000 UTC m=+0.449386288,LastTimestamp:2026-09-06 19:27:17.044427227 +0000 UTC m=+0.449386288,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-174.ec2.internal,}"
Sep 06 19:27:17.065592 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.065526    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-174.ec2.internal.18d2d1f177a9a158  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-174.ec2.internal,UID:ip-10-0-135-174.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-174.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-174.ec2.internal,},FirstTimestamp:2026-09-06 19:27:17.044437336 +0000 UTC m=+0.449396394,LastTimestamp:2026-09-06 19:27:17.044437336 +0000 UTC m=+0.449396394,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-174.ec2.internal,}"
Sep 06 19:27:17.073070 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.072990    2568 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-174.ec2.internal.18d2d1f177a92cd7\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-174.ec2.internal.18d2d1f177a92cd7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-174.ec2.internal,UID:ip-10-0-135-174.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-174.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-174.ec2.internal,},FirstTimestamp:2026-09-06 19:27:17.044407511 +0000 UTC m=+0.449366573,LastTimestamp:2026-09-06 19:27:17.045862926 +0000 UTC m=+0.450821986,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-174.ec2.internal,}"
Sep 06 19:27:17.074327 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.074306    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h858g"
Sep 06 19:27:17.082276 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.082213    2568 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-174.ec2.internal.18d2d1f177a979db\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-174.ec2.internal.18d2d1f177a979db  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-174.ec2.internal,UID:ip-10-0-135-174.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-174.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-174.ec2.internal,},FirstTimestamp:2026-09-06 19:27:17.044427227 +0000 UTC m=+0.449386288,LastTimestamp:2026-09-06 19:27:17.045876051 +0000 UTC m=+0.450835111,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-174.ec2.internal,}"
Sep 06 19:27:17.084604 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.084586    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h858g"
Sep 06 19:27:17.091245 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.091155    2568 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-174.ec2.internal.18d2d1f177a9a158\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-174.ec2.internal.18d2d1f177a9a158  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-174.ec2.internal,UID:ip-10-0-135-174.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-174.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-174.ec2.internal,},FirstTimestamp:2026-09-06 19:27:17.044437336 +0000 UTC m=+0.449396394,LastTimestamp:2026-09-06 19:27:17.045885704 +0000 UTC m=+0.450844764,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-174.ec2.internal,}"
Sep 06 19:27:17.110879 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.091400    2568 manager.go:337] "Starting Device Plugin manager"
Sep 06 19:27:17.110879 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.091432    2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 06 19:27:17.110879 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.091441    2568 server.go:87] "Starting device plugin registration server"
Sep 06 19:27:17.110879 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.091692    2568 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 06 19:27:17.110879 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.091702    2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 06 19:27:17.110879 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.091818    2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 06 19:27:17.110879 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.091895    2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 06 19:27:17.110879 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.091905    2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 06 19:27:17.110879 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.092525    2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 06 19:27:17.110879 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.092582    2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-174.ec2.internal\" not found"
Sep 06 19:27:17.110879 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.107194    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 06 19:27:17.110879 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.108460    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 06 19:27:17.110879 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.108520    2568 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 06 19:27:17.110879 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.108546    2568 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 06 19:27:17.110879 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.108591    2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 06 19:27:17.110879 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.110435    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 19:27:17.191876 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.191798    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 19:27:17.192793 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.192751    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 19:27:17.192907 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.192799    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 19:27:17.192907 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.192814    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientPID"
Sep 06 19:27:17.192907 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.192839    2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-174.ec2.internal"
Sep 06 19:27:17.203131 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.203109    2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-174.ec2.internal"
Sep 06 19:27:17.203208 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.203137    2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-174.ec2.internal\": node \"ip-10-0-135-174.ec2.internal\" not found"
Sep 06 19:27:17.208826 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.208804    2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal"]
Sep 06 19:27:17.208909 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.208866    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 19:27:17.210213 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.210200    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 19:27:17.210306 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.210229    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 19:27:17.210306 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.210243    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientPID"
Sep 06 19:27:17.212499 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.212487    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 19:27:17.212635 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.212618    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal"
Sep 06 19:27:17.212673 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.212650    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 19:27:17.213206 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.213190    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 19:27:17.213298 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.213217    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 19:27:17.213298 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.213231    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientPID"
Sep 06 19:27:17.213298 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.213291    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 19:27:17.213389 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.213312    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 19:27:17.213389 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.213325    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientPID"
Sep 06 19:27:17.215402 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.215387    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal"
Sep 06 19:27:17.215493 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.215412    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 19:27:17.216131 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.216116    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 19:27:17.216213 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.216146    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 19:27:17.216213 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.216158    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientPID"
Sep 06 19:27:17.218401 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.218387    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
Sep 06 19:27:17.225013 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.224997    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b96bbae1cab1e6122a35206690d262db-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal\" (UID: \"b96bbae1cab1e6122a35206690d262db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal"
Sep 06 19:27:17.225096 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.225019    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b96bbae1cab1e6122a35206690d262db-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal\" (UID: \"b96bbae1cab1e6122a35206690d262db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal"
Sep 06 19:27:17.225096 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.225043    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c6a01d943a52353eb13a1aeaca47347-config\") pod \"kube-apiserver-proxy-ip-10-0-135-174.ec2.internal\" (UID: \"8c6a01d943a52353eb13a1aeaca47347\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal"
Sep 06 19:27:17.239365 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.239345    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-174.ec2.internal\" not found" node="ip-10-0-135-174.ec2.internal"
Sep 06 19:27:17.243862 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.243849    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-174.ec2.internal\" not found" node="ip-10-0-135-174.ec2.internal"
Sep 06 19:27:17.318760 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.318729    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
Sep 06 19:27:17.325836 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.325814    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b96bbae1cab1e6122a35206690d262db-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal\" (UID: \"b96bbae1cab1e6122a35206690d262db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal"
Sep 06 19:27:17.325898 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.325840    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b96bbae1cab1e6122a35206690d262db-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal\" (UID: \"b96bbae1cab1e6122a35206690d262db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal"
Sep 06 19:27:17.325898 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.325856    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c6a01d943a52353eb13a1aeaca47347-config\") pod \"kube-apiserver-proxy-ip-10-0-135-174.ec2.internal\" (UID: \"8c6a01d943a52353eb13a1aeaca47347\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal"
Sep 06 19:27:17.325959 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.325914    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b96bbae1cab1e6122a35206690d262db-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal\" (UID: \"b96bbae1cab1e6122a35206690d262db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal"
Sep 06 19:27:17.325959 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.325918    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b96bbae1cab1e6122a35206690d262db-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal\" (UID: \"b96bbae1cab1e6122a35206690d262db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal"
Sep 06 19:27:17.325959 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.325922    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c6a01d943a52353eb13a1aeaca47347-config\") pod \"kube-apiserver-proxy-ip-10-0-135-174.ec2.internal\" (UID: \"8c6a01d943a52353eb13a1aeaca47347\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal"
Sep 06 19:27:17.418938 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.418893    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
Sep 06 19:27:17.519715 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.519646    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
Sep 06 19:27:17.542162 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.542126    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal"
Sep 06 19:27:17.548633 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.548615    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal"
Sep 06 19:27:17.620286 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.620238    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
Sep 06 19:27:17.720858 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.720815    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
Sep 06 19:27:17.821372 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.821286    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
Sep 06 19:27:17.880110 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.880083    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 19:27:17.921831 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:17.921801    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
Sep 06 19:27:17.947316 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.947285    2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 06 19:27:17.947493 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.947476    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 06 19:27:17.947537 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:17.947486    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 06 19:27:18.022431 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:18.022401    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
Sep 06 19:27:18.090865 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:18.090764    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-05 19:22:16 +0000 UTC" deadline="2028-03-25 22:06:28.650404739 +0000 UTC"
Sep 06 19:27:18.090865 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:18.090818    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13586h39m10.559589839s"
Sep 06 19:27:18.112456 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:18.112421    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c6a01d943a52353eb13a1aeaca47347.slice/crio-0b647633a375a7e141bf634bcacb00ecf88332a81fa064a2d7356c9b99b13fb8 WatchSource:0}: Error finding container 0b647633a375a7e141bf634bcacb00ecf88332a81fa064a2d7356c9b99b13fb8: Status 404 returned error can't find the container with id 0b647633a375a7e141bf634bcacb00ecf88332a81fa064a2d7356c9b99b13fb8
Sep 06 19:27:18.113201 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:18.113176    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb96bbae1cab1e6122a35206690d262db.slice/crio-d27a8bae158486637cc3b9ba630202fbfa1bc330879d0fce1afc2cbca9ef62c0 WatchSource:0}: Error finding container d27a8bae158486637cc3b9ba630202fbfa1bc330879d0fce1afc2cbca9ef62c0: Status 404 returned error can't find the container with id d27a8bae158486637cc3b9ba630202fbfa1bc330879d0fce1afc2cbca9ef62c0
Sep 06 19:27:18.120068 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:18.120053    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 19:27:18.122828 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:18.122811    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
Sep 06 19:27:18.162916 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:18.162881    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 19:27:18.164250 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:18.164234    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 19:27:18.164340 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:18.164270    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 19:27:18.164340 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:18.164285    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientPID"
Sep 06 19:27:18.221082 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:18.221053    2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 19:27:18.223888 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:18.223870    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal"
Sep 06 19:27:18.234146 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:18.234124    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 06 19:27:18.236303 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:18.236285    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal"
Sep 06 19:27:18.243852 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:18.243831    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 06 19:27:18.580491 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:18.580458    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 19:27:18.995265 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:18.995233    2568 apiserver.go:52] "Watching apiserver"
Sep 06 19:27:19.003080 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.003046    2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 06 19:27:19.003508 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.003484    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-qhj8h","openshift-multus/network-metrics-daemon-cb2dz","openshift-network-diagnostics/network-check-target-m2kz7","openshift-network-operator/iptables-alerter-9mcqc","openshift-ovn-kubernetes/ovnkube-node-gfqzm","kube-system/global-pull-secret-syncer-x5xzv","kube-system/konnectivity-agent-c5cf6","kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm","openshift-cluster-node-tuning-operator/tuned-2xw9v","openshift-image-registry/node-ca-4mk76","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal","openshift-multus/multus-additional-cni-plugins-t6h6w","openshift-dns/node-resolver-z2s8x"]
Sep 06 19:27:19.005982 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.005955    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c5cf6"
Sep 06 19:27:19.008069 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.008046    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pfx8g\""
Sep 06 19:27:19.008251 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.008236    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 06 19:27:19.008380 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.008368    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 06 19:27:19.008559 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.008547    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t6h6w"
Sep 06 19:27:19.010428 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.010130    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:19.010428 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:19.010201    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2kz7" podUID="9704ea38-52ce-4441-abd1-644d157c0285"
Sep 06 19:27:19.012205 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.012031    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 06 19:27:19.012205 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.012148    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9mcqc"
Sep 06 19:27:19.013015 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.012734    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 06 19:27:19.013015 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.012731    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 06 19:27:19.013015 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.012753    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 06 19:27:19.013015 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.012811    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ssxfn\""
Sep 06 19:27:19.014474 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.014460    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.015373 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.014813    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 06 19:27:19.015373 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.014937    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 06 19:27:19.015373 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.014953    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 06 19:27:19.015373 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.015230    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q8fg6\""
Sep 06 19:27:19.016998 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.016973    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:19.017069 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:19.017036    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x5xzv" podUID="54e739ed-02ca-4f6a-82d8-bf2966672a28"
Sep 06 19:27:19.017129 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.017115    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 06 19:27:19.017870 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.017844    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kj5rk\""
Sep 06 19:27:19.017955 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.017846    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 06 19:27:19.017955 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.017922    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 06 19:27:19.017955 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.017873    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 06 19:27:19.018184 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.018165    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 06 19:27:19.018184 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.018174    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 06 19:27:19.018328 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.018260    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 06 19:27:19.019211 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.019194    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm"
Sep 06 19:27:19.021294 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.021276    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.021388 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.021368    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 06 19:27:19.024262 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.024245    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 06 19:27:19.024491 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.024476    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 06 19:27:19.024692 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.024677    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bzjtn\""
Sep 06 19:27:19.025165 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.025145    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 06 19:27:19.025541 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.025527    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:19.025632 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:19.025610    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cb2dz" podUID="0ace7f43-c761-489f-b523-b01650e632df"
Sep 06 19:27:19.026132 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.025973    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 06 19:27:19.026132 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.026021    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fm62m\""
Sep 06 19:27:19.028097 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.028079    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.030319 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.030302    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4mk76"
Sep 06 19:27:19.032445 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.032427    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z2s8x"
Sep 06 19:27:19.032602 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.032584    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 06 19:27:19.033004 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.032986    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-c7jfw\""
Sep 06 19:27:19.033088 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033039    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 06 19:27:19.033141 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033111    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k54l6\""
Sep 06 19:27:19.033243 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033231    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 06 19:27:19.033317 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033273    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxqkt\" (UniqueName: \"kubernetes.io/projected/2346b60e-3d7d-4274-8866-2ad191a05139-kube-api-access-xxqkt\") pod \"iptables-alerter-9mcqc\" (UID: \"2346b60e-3d7d-4274-8866-2ad191a05139\") " pod="openshift-network-operator/iptables-alerter-9mcqc"
Sep 06 19:27:19.033317 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033293    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 06 19:27:19.033317 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033307    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-log-socket\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.033448 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033322    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-lib-modules\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.033448 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033335    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-host\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.033448 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033379    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/054ee4ba-941f-46c5-9ac3-0daa28ed1dad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t6h6w\" (UID: \"054ee4ba-941f-46c5-9ac3-0daa28ed1dad\") " pod="openshift-multus/multus-additional-cni-plugins-t6h6w"
Sep 06 19:27:19.033448 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033410    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs\") pod \"network-metrics-daemon-cb2dz\" (UID: \"0ace7f43-c761-489f-b523-b01650e632df\") " pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:19.033448 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033438    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-host-run-ovn-kubernetes\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.033617 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033463    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-etc-sysctl-conf\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.033617 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033485    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-559mh\" (UniqueName: \"kubernetes.io/projected/2331a34f-8aa2-42e9-9ce8-29dc923273ce-kube-api-access-559mh\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.033617 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033507    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-run-ovn\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.033617 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033548    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 06 19:27:19.033617 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033556    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2346b60e-3d7d-4274-8866-2ad191a05139-host-slash\") pod \"iptables-alerter-9mcqc\" (UID: \"2346b60e-3d7d-4274-8866-2ad191a05139\") " pod="openshift-network-operator/iptables-alerter-9mcqc"
Sep 06 19:27:19.033617 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033607    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/054ee4ba-941f-46c5-9ac3-0daa28ed1dad-cni-binary-copy\") pod \"multus-additional-cni-plugins-t6h6w\" (UID: \"054ee4ba-941f-46c5-9ac3-0daa28ed1dad\") " pod="openshift-multus/multus-additional-cni-plugins-t6h6w"
Sep 06 19:27:19.033867 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033630    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qhrf\" (UniqueName: \"kubernetes.io/projected/ee688dc3-9182-4cb7-890c-92326ef296cb-kube-api-access-9qhrf\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.033867 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033652    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret\") pod \"global-pull-secret-syncer-x5xzv\" (UID: \"54e739ed-02ca-4f6a-82d8-bf2966672a28\") " pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:19.033867 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033672    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-system-cni-dir\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.033867 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033704    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-etc-kubernetes\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.033867 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033738    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-var-lib-kubelet\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.033867 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033787    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55ck8\" (UniqueName: \"kubernetes.io/projected/054ee4ba-941f-46c5-9ac3-0daa28ed1dad-kube-api-access-55ck8\") pod \"multus-additional-cni-plugins-t6h6w\" (UID: \"054ee4ba-941f-46c5-9ac3-0daa28ed1dad\") " pod="openshift-multus/multus-additional-cni-plugins-t6h6w"
Sep 06 19:27:19.033867 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033823    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-var-lib-openvswitch\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.034074 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.033997    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee688dc3-9182-4cb7-890c-92326ef296cb-env-overrides\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.034074 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034023    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96jdc\" (UniqueName: \"kubernetes.io/projected/7e811c90-31e0-4422-acbc-1606d33ede56-kube-api-access-96jdc\") pod \"aws-ebs-csi-driver-node-fjqtm\" (UID: \"7e811c90-31e0-4422-acbc-1606d33ede56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm"
Sep 06 19:27:19.034074 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034052    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-host-var-lib-cni-multus\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.034201 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034108    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/de2ce0c6-0449-42b3-a783-7bd9bce82ee7-konnectivity-ca\") pod \"konnectivity-agent-c5cf6\" (UID: \"de2ce0c6-0449-42b3-a783-7bd9bce82ee7\") " pod="kube-system/konnectivity-agent-c5cf6"
Sep 06 19:27:19.034201 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034144    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-run\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.034201 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034172    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.034328 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034215    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7e811c90-31e0-4422-acbc-1606d33ede56-sys-fs\") pod \"aws-ebs-csi-driver-node-fjqtm\" (UID: \"7e811c90-31e0-4422-acbc-1606d33ede56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm"
Sep 06 19:27:19.034328 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034239    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-cnibin\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.034328 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034259    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/054ee4ba-941f-46c5-9ac3-0daa28ed1dad-system-cni-dir\") pod \"multus-additional-cni-plugins-t6h6w\" (UID: \"054ee4ba-941f-46c5-9ac3-0daa28ed1dad\") " pod="openshift-multus/multus-additional-cni-plugins-t6h6w"
Sep 06 19:27:19.034328 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034282    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-run-systemd\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.034328 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034311    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-run-openvswitch\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.034497 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034329    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-host-cni-bin\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.034497 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034348    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-hostroot\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.034497 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034361    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/de2ce0c6-0449-42b3-a783-7bd9bce82ee7-agent-certs\") pod \"konnectivity-agent-c5cf6\" (UID: \"de2ce0c6-0449-42b3-a783-7bd9bce82ee7\") " pod="kube-system/konnectivity-agent-c5cf6"
Sep 06 19:27:19.034497 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034379    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-etc-systemd\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.034497 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034392    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-host-kubelet\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.034497 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034407    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-host-run-netns\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.034497 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034425    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee688dc3-9182-4cb7-890c-92326ef296cb-ovnkube-script-lib\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.034497 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034454    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7e811c90-31e0-4422-acbc-1606d33ede56-socket-dir\") pod \"aws-ebs-csi-driver-node-fjqtm\" (UID: \"7e811c90-31e0-4422-acbc-1606d33ede56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm"
Sep 06 19:27:19.034497 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034481    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e02983e8-bb51-4194-b599-083a466312d6-cni-binary-copy\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.034835 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034501    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e02983e8-bb51-4194-b599-083a466312d6-multus-daemon-config\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.034835 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034520    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/054ee4ba-941f-46c5-9ac3-0daa28ed1dad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t6h6w\" (UID: \"054ee4ba-941f-46c5-9ac3-0daa28ed1dad\") " pod="openshift-multus/multus-additional-cni-plugins-t6h6w"
Sep 06 19:27:19.034835 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034542    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-host-cni-netd\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.034835 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034556    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54e739ed-02ca-4f6a-82d8-bf2966672a28-kubelet-config\") pod \"global-pull-secret-syncer-x5xzv\" (UID: \"54e739ed-02ca-4f6a-82d8-bf2966672a28\") " pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:19.034835 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034569    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-node-log\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.034835 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034581    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee688dc3-9182-4cb7-890c-92326ef296cb-ovnkube-config\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.034835 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034604    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/054ee4ba-941f-46c5-9ac3-0daa28ed1dad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t6h6w\" (UID: \"054ee4ba-941f-46c5-9ac3-0daa28ed1dad\") " pod="openshift-multus/multus-additional-cni-plugins-t6h6w"
Sep 06 19:27:19.034835 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034625    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-sys\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.034835 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034646    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-etc-modprobe-d\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.034835 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034662    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-etc-sysctl-d\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.034835 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034677    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-systemd-units\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.034835 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034708    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-host-slash\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.034835 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034737    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2346b60e-3d7d-4274-8866-2ad191a05139-iptables-alerter-script\") pod \"iptables-alerter-9mcqc\" (UID: \"2346b60e-3d7d-4274-8866-2ad191a05139\") " pod="openshift-network-operator/iptables-alerter-9mcqc"
Sep 06 19:27:19.034835 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034758    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-etc-sysconfig\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.034835 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034796    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2331a34f-8aa2-42e9-9ce8-29dc923273ce-etc-tuned\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.034835 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034810    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2331a34f-8aa2-42e9-9ce8-29dc923273ce-tmp\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.035465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034823    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7e811c90-31e0-4422-acbc-1606d33ede56-registration-dir\") pod \"aws-ebs-csi-driver-node-fjqtm\" (UID: \"7e811c90-31e0-4422-acbc-1606d33ede56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm"
Sep 06 19:27:19.035465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034839    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7e811c90-31e0-4422-acbc-1606d33ede56-device-dir\") pod \"aws-ebs-csi-driver-node-fjqtm\" (UID: \"7e811c90-31e0-4422-acbc-1606d33ede56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm"
Sep 06 19:27:19.035465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034861    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-multus-socket-dir-parent\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.035465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034877    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-host-run-k8s-cni-cncf-io\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.035465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034902    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54e739ed-02ca-4f6a-82d8-bf2966672a28-dbus\") pod \"global-pull-secret-syncer-x5xzv\" (UID: \"54e739ed-02ca-4f6a-82d8-bf2966672a28\") " pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:19.035465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034929    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/054ee4ba-941f-46c5-9ac3-0daa28ed1dad-cnibin\") pod \"multus-additional-cni-plugins-t6h6w\" (UID: \"054ee4ba-941f-46c5-9ac3-0daa28ed1dad\") " pod="openshift-multus/multus-additional-cni-plugins-t6h6w"
Sep 06 19:27:19.035465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034953    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7gq7\" (UniqueName: \"kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7\") pod \"network-check-target-m2kz7\" (UID: \"9704ea38-52ce-4441-abd1-644d157c0285\") " pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:19.035465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034975    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee688dc3-9182-4cb7-890c-92326ef296cb-ovn-node-metrics-cert\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.035465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.034996    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7e811c90-31e0-4422-acbc-1606d33ede56-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fjqtm\" (UID: \"7e811c90-31e0-4422-acbc-1606d33ede56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm"
Sep 06 19:27:19.035465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.035023    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-host-run-netns\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.035465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.035046    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-host-var-lib-kubelet\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.035465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.035067    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-multus-conf-dir\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.035465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.035089    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-etc-openvswitch\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.035465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.035110    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-multus-cni-dir\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.035465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.035132    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-host-var-lib-cni-bin\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.035465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.035155    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7e811c90-31e0-4422-acbc-1606d33ede56-etc-selinux\") pod \"aws-ebs-csi-driver-node-fjqtm\" (UID: \"7e811c90-31e0-4422-acbc-1606d33ede56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm"
Sep 06 19:27:19.036086 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.035187    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-host-run-multus-certs\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.036086 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.035214    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-etc-kubernetes\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.036086 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.035234    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97tkk\" (UniqueName: \"kubernetes.io/projected/e02983e8-bb51-4194-b599-083a466312d6-kube-api-access-97tkk\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.036086 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.035263    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwftr\" (UniqueName: \"kubernetes.io/projected/0ace7f43-c761-489f-b523-b01650e632df-kube-api-access-lwftr\") pod \"network-metrics-daemon-cb2dz\" (UID: \"0ace7f43-c761-489f-b523-b01650e632df\") " pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:19.037482 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.037454    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 06 19:27:19.037482 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.037457    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 06 19:27:19.037621 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.037498    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-w9q45\""
Sep 06 19:27:19.052234 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.052209    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 06 19:27:19.068950 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.068925    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-76bll"
Sep 06 19:27:19.077098 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.077079    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-76bll"
Sep 06 19:27:19.113345 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.113290    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal" event={"ID":"8c6a01d943a52353eb13a1aeaca47347","Type":"ContainerStarted","Data":"0b647633a375a7e141bf634bcacb00ecf88332a81fa064a2d7356c9b99b13fb8"}
Sep 06 19:27:19.114425 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.114397    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal" event={"ID":"b96bbae1cab1e6122a35206690d262db","Type":"ContainerStarted","Data":"d27a8bae158486637cc3b9ba630202fbfa1bc330879d0fce1afc2cbca9ef62c0"}
Sep 06 19:27:19.124481 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.124456    2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 06 19:27:19.136073 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136046    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee688dc3-9182-4cb7-890c-92326ef296cb-ovn-node-metrics-cert\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.136204 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136082    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7e811c90-31e0-4422-acbc-1606d33ede56-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fjqtm\" (UID: \"7e811c90-31e0-4422-acbc-1606d33ede56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm"
Sep 06 19:27:19.136204 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136115    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-host-run-netns\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.136204 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136147    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-host-var-lib-kubelet\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.136204 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136175    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-multus-conf-dir\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.136393 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136217    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/36bfe5b6-eb77-43e5-952f-f69db221e46a-serviceca\") pod \"node-ca-4mk76\" (UID: \"36bfe5b6-eb77-43e5-952f-f69db221e46a\") " pod="openshift-image-registry/node-ca-4mk76"
Sep 06 19:27:19.136393 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136246    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-etc-openvswitch\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.136393 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136268    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-multus-cni-dir\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.136393 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136283    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-host-var-lib-cni-bin\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.136393 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136297    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnssp\" (UniqueName: \"kubernetes.io/projected/becacc1b-0eeb-4404-908e-585e7edaa25b-kube-api-access-nnssp\") pod \"node-resolver-z2s8x\" (UID: \"becacc1b-0eeb-4404-908e-585e7edaa25b\") " pod="openshift-dns/node-resolver-z2s8x"
Sep 06 19:27:19.136393 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136311    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7e811c90-31e0-4422-acbc-1606d33ede56-etc-selinux\") pod \"aws-ebs-csi-driver-node-fjqtm\" (UID: \"7e811c90-31e0-4422-acbc-1606d33ede56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm"
Sep 06 19:27:19.136393 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136325    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-host-run-multus-certs\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.136393 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136344    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-etc-kubernetes\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.136393 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136358    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97tkk\" (UniqueName: \"kubernetes.io/projected/e02983e8-bb51-4194-b599-083a466312d6-kube-api-access-97tkk\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.136393 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136372    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwftr\" (UniqueName: \"kubernetes.io/projected/0ace7f43-c761-489f-b523-b01650e632df-kube-api-access-lwftr\") pod \"network-metrics-daemon-cb2dz\" (UID: \"0ace7f43-c761-489f-b523-b01650e632df\") " pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:19.136393 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136385    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxqkt\" (UniqueName: \"kubernetes.io/projected/2346b60e-3d7d-4274-8866-2ad191a05139-kube-api-access-xxqkt\") pod \"iptables-alerter-9mcqc\" (UID: \"2346b60e-3d7d-4274-8866-2ad191a05139\") " pod="openshift-network-operator/iptables-alerter-9mcqc"
Sep 06 19:27:19.136893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136398    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-log-socket\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.136893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136439    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/becacc1b-0eeb-4404-908e-585e7edaa25b-tmp-dir\") pod \"node-resolver-z2s8x\" (UID: \"becacc1b-0eeb-4404-908e-585e7edaa25b\") " pod="openshift-dns/node-resolver-z2s8x"
Sep 06 19:27:19.136893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136463    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-lib-modules\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.136893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136477    2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 06 19:27:19.136893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136490    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-host\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.136893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136515    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/054ee4ba-941f-46c5-9ac3-0daa28ed1dad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t6h6w\" (UID: \"054ee4ba-941f-46c5-9ac3-0daa28ed1dad\") " pod="openshift-multus/multus-additional-cni-plugins-t6h6w"
Sep 06 19:27:19.136893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136547    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs\") pod \"network-metrics-daemon-cb2dz\" (UID: \"0ace7f43-c761-489f-b523-b01650e632df\") " pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:19.136893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136569    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-host-run-ovn-kubernetes\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.136893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136586    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-etc-sysctl-conf\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.136893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136601    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-559mh\" (UniqueName: \"kubernetes.io/projected/2331a34f-8aa2-42e9-9ce8-29dc923273ce-kube-api-access-559mh\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.136893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136637    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7e811c90-31e0-4422-acbc-1606d33ede56-etc-selinux\") pod \"aws-ebs-csi-driver-node-fjqtm\" (UID: \"7e811c90-31e0-4422-acbc-1606d33ede56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm"
Sep 06 19:27:19.136893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136645    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-run-ovn\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.136893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136687    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-run-ovn\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.136893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136691    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9nx4\" (UniqueName: \"kubernetes.io/projected/36bfe5b6-eb77-43e5-952f-f69db221e46a-kube-api-access-m9nx4\") pod \"node-ca-4mk76\" (UID: \"36bfe5b6-eb77-43e5-952f-f69db221e46a\") " pod="openshift-image-registry/node-ca-4mk76"
Sep 06 19:27:19.136893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136740    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-host-run-multus-certs\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.136893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136747    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7e811c90-31e0-4422-acbc-1606d33ede56-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fjqtm\" (UID: \"7e811c90-31e0-4422-acbc-1606d33ede56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm"
Sep 06 19:27:19.136893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136791    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-etc-kubernetes\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.137657 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.136837    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-host\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.137657 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.137348    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-log-socket\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.137657 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.137385    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/054ee4ba-941f-46c5-9ac3-0daa28ed1dad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t6h6w\" (UID: \"054ee4ba-941f-46c5-9ac3-0daa28ed1dad\") " pod="openshift-multus/multus-additional-cni-plugins-t6h6w"
Sep 06 19:27:19.137657 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.137464    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-lib-modules\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.137657 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.137511    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-host-var-lib-kubelet\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.137657 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:19.137512    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:27:19.137657 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:19.137578    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs podName:0ace7f43-c761-489f-b523-b01650e632df nodeName:}" failed. No retries permitted until 2026-09-06 19:27:19.637556578 +0000 UTC m=+3.042515643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs") pod "network-metrics-daemon-cb2dz" (UID: "0ace7f43-c761-489f-b523-b01650e632df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:27:19.137657 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.137612    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-multus-conf-dir\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.138066 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.137665    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-multus-cni-dir\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.138066 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.137678    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2346b60e-3d7d-4274-8866-2ad191a05139-host-slash\") pod \"iptables-alerter-9mcqc\" (UID: \"2346b60e-3d7d-4274-8866-2ad191a05139\") " pod="openshift-network-operator/iptables-alerter-9mcqc"
Sep 06 19:27:19.138066 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.137684    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-host-run-netns\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.138066 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.137706    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/054ee4ba-941f-46c5-9ac3-0daa28ed1dad-cni-binary-copy\") pod \"multus-additional-cni-plugins-t6h6w\" (UID: \"054ee4ba-941f-46c5-9ac3-0daa28ed1dad\") " pod="openshift-multus/multus-additional-cni-plugins-t6h6w"
Sep 06 19:27:19.138066 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.137719    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-host-var-lib-cni-bin\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.138066 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.137792    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qhrf\" (UniqueName: \"kubernetes.io/projected/ee688dc3-9182-4cb7-890c-92326ef296cb-kube-api-access-9qhrf\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.138066 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.137818    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-etc-openvswitch\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.138066 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.137821    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret\") pod \"global-pull-secret-syncer-x5xzv\" (UID: \"54e739ed-02ca-4f6a-82d8-bf2966672a28\") " pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:19.138066 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.137870    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-host-run-ovn-kubernetes\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.138066 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:19.137878    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 19:27:19.138066 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.137830    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-etc-sysctl-conf\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.138066 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.137905    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-system-cni-dir\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.138066 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.137948    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2346b60e-3d7d-4274-8866-2ad191a05139-host-slash\") pod \"iptables-alerter-9mcqc\" (UID: \"2346b60e-3d7d-4274-8866-2ad191a05139\") " pod="openshift-network-operator/iptables-alerter-9mcqc"
Sep 06 19:27:19.138066 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.137978    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-etc-kubernetes\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.138066 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.137999    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-var-lib-kubelet\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.138066 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.138027    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-etc-kubernetes\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.138066 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.138069    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55ck8\" (UniqueName: \"kubernetes.io/projected/054ee4ba-941f-46c5-9ac3-0daa28ed1dad-kube-api-access-55ck8\") pod \"multus-additional-cni-plugins-t6h6w\" (UID: \"054ee4ba-941f-46c5-9ac3-0daa28ed1dad\") " pod="openshift-multus/multus-additional-cni-plugins-t6h6w"
Sep 06 19:27:19.138662 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.138092    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-var-lib-openvswitch\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.138662 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.138127    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee688dc3-9182-4cb7-890c-92326ef296cb-env-overrides\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.138662 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.138152    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96jdc\" (UniqueName: \"kubernetes.io/projected/7e811c90-31e0-4422-acbc-1606d33ede56-kube-api-access-96jdc\") pod \"aws-ebs-csi-driver-node-fjqtm\" (UID: \"7e811c90-31e0-4422-acbc-1606d33ede56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm"
Sep 06 19:27:19.138662 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:19.138183    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret podName:54e739ed-02ca-4f6a-82d8-bf2966672a28 nodeName:}" failed. No retries permitted until 2026-09-06 19:27:19.638164929 +0000 UTC m=+3.043123976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret") pod "global-pull-secret-syncer-x5xzv" (UID: "54e739ed-02ca-4f6a-82d8-bf2966672a28") : object "kube-system"/"original-pull-secret" not registered
Sep 06 19:27:19.138662 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.138206    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-host-var-lib-cni-multus\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.138662 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.138252    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/054ee4ba-941f-46c5-9ac3-0daa28ed1dad-cni-binary-copy\") pod \"multus-additional-cni-plugins-t6h6w\" (UID: \"054ee4ba-941f-46c5-9ac3-0daa28ed1dad\") " pod="openshift-multus/multus-additional-cni-plugins-t6h6w"
Sep 06 19:27:19.138662 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.138300    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-var-lib-openvswitch\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.138662 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.138299    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/de2ce0c6-0449-42b3-a783-7bd9bce82ee7-konnectivity-ca\") pod \"konnectivity-agent-c5cf6\" (UID: \"de2ce0c6-0449-42b3-a783-7bd9bce82ee7\") " pod="kube-system/konnectivity-agent-c5cf6"
Sep 06 19:27:19.138662 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.138335    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-run\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.138662 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.138346    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-var-lib-kubelet\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.138662 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.138356    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-system-cni-dir\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.138662 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.138359    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.138662 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.138385    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7e811c90-31e0-4422-acbc-1606d33ede56-sys-fs\") pod \"aws-ebs-csi-driver-node-fjqtm\" (UID: \"7e811c90-31e0-4422-acbc-1606d33ede56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm"
Sep 06 19:27:19.138662 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.138408    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-cnibin\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.138662 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.138431    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/054ee4ba-941f-46c5-9ac3-0daa28ed1dad-system-cni-dir\") pod \"multus-additional-cni-plugins-t6h6w\" (UID: \"054ee4ba-941f-46c5-9ac3-0daa28ed1dad\") " pod="openshift-multus/multus-additional-cni-plugins-t6h6w"
Sep 06 19:27:19.138662 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.138407    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-host-var-lib-cni-multus\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.142946 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.139201    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.142946 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.139403    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-run-systemd\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.142946 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.139452    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-run-openvswitch\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.142946 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.139465    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-run\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.142946 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.139486    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-host-cni-bin\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.142946 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.139514    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-hostroot\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.142946 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.139573    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/de2ce0c6-0449-42b3-a783-7bd9bce82ee7-agent-certs\") pod \"konnectivity-agent-c5cf6\" (UID: \"de2ce0c6-0449-42b3-a783-7bd9bce82ee7\") " pod="kube-system/konnectivity-agent-c5cf6"
Sep 06 19:27:19.142946 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.139599    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-etc-systemd\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.142946 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.139634    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-host-kubelet\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.142946 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.139643    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee688dc3-9182-4cb7-890c-92326ef296cb-env-overrides\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.142946 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.139662    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-host-run-netns\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.142946 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.139708    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-run-systemd\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.142946 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.139742    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-hostroot\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.142946 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.139880    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/054ee4ba-941f-46c5-9ac3-0daa28ed1dad-system-cni-dir\") pod \"multus-additional-cni-plugins-t6h6w\" (UID: \"054ee4ba-941f-46c5-9ac3-0daa28ed1dad\") " pod="openshift-multus/multus-additional-cni-plugins-t6h6w"
Sep 06 19:27:19.142946 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.139899    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee688dc3-9182-4cb7-890c-92326ef296cb-ovnkube-script-lib\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.142946 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.140008    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/de2ce0c6-0449-42b3-a783-7bd9bce82ee7-konnectivity-ca\") pod \"konnectivity-agent-c5cf6\" (UID: \"de2ce0c6-0449-42b3-a783-7bd9bce82ee7\") " pod="kube-system/konnectivity-agent-c5cf6"
Sep 06 19:27:19.142946 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.140014    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7e811c90-31e0-4422-acbc-1606d33ede56-socket-dir\") pod \"aws-ebs-csi-driver-node-fjqtm\" (UID: \"7e811c90-31e0-4422-acbc-1606d33ede56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm"
Sep 06 19:27:19.142946 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.140073    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e02983e8-bb51-4194-b599-083a466312d6-cni-binary-copy\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.144225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.140075    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-etc-systemd\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.144225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.140178    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7e811c90-31e0-4422-acbc-1606d33ede56-socket-dir\") pod \"aws-ebs-csi-driver-node-fjqtm\" (UID: \"7e811c90-31e0-4422-acbc-1606d33ede56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm"
Sep 06 19:27:19.144225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.140218    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-host-run-netns\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.144225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.140239    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e02983e8-bb51-4194-b599-083a466312d6-multus-daemon-config\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.144225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.140245    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-host-kubelet\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.144225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.140249    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-run-openvswitch\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.144225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.140271    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/054ee4ba-941f-46c5-9ac3-0daa28ed1dad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t6h6w\" (UID: \"054ee4ba-941f-46c5-9ac3-0daa28ed1dad\") " pod="openshift-multus/multus-additional-cni-plugins-t6h6w"
Sep 06 19:27:19.144225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.140285    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-host-cni-bin\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.144225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.140302    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-host-cni-netd\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.144225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.140339    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54e739ed-02ca-4f6a-82d8-bf2966672a28-kubelet-config\") pod \"global-pull-secret-syncer-x5xzv\" (UID: \"54e739ed-02ca-4f6a-82d8-bf2966672a28\") " pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:19.144225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.140869    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e02983e8-bb51-4194-b599-083a466312d6-cni-binary-copy\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.144225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.140959    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-host-cni-netd\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.144225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.141002    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-cnibin\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.144225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.141062    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54e739ed-02ca-4f6a-82d8-bf2966672a28-kubelet-config\") pod \"global-pull-secret-syncer-x5xzv\" (UID: \"54e739ed-02ca-4f6a-82d8-bf2966672a28\") " pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:19.144225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.141056    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/054ee4ba-941f-46c5-9ac3-0daa28ed1dad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t6h6w\" (UID: \"054ee4ba-941f-46c5-9ac3-0daa28ed1dad\") " pod="openshift-multus/multus-additional-cni-plugins-t6h6w"
Sep 06 19:27:19.144225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.141178    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e02983e8-bb51-4194-b599-083a466312d6-multus-daemon-config\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.144225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.141275    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7e811c90-31e0-4422-acbc-1606d33ede56-sys-fs\") pod \"aws-ebs-csi-driver-node-fjqtm\" (UID: \"7e811c90-31e0-4422-acbc-1606d33ede56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm"
Sep 06 19:27:19.144225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.141419    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/becacc1b-0eeb-4404-908e-585e7edaa25b-hosts-file\") pod \"node-resolver-z2s8x\" (UID: \"becacc1b-0eeb-4404-908e-585e7edaa25b\") " pod="openshift-dns/node-resolver-z2s8x"
Sep 06 19:27:19.145483 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.141459    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-node-log\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.145483 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.141489    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee688dc3-9182-4cb7-890c-92326ef296cb-ovnkube-config\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.145483 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.141570    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/054ee4ba-941f-46c5-9ac3-0daa28ed1dad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t6h6w\" (UID: \"054ee4ba-941f-46c5-9ac3-0daa28ed1dad\") " pod="openshift-multus/multus-additional-cni-plugins-t6h6w"
Sep 06 19:27:19.145483 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.141593    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-sys\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.145483 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.141598    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee688dc3-9182-4cb7-890c-92326ef296cb-ovnkube-script-lib\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.145483 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.141619    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-etc-modprobe-d\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.145483 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.141651    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-node-log\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.145483 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.141671    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-etc-sysctl-d\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.145483 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.141698    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-systemd-units\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.145483 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.141741    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-etc-modprobe-d\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.145483 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.141725    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-host-slash\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.145483 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.141817    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-systemd-units\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.145483 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.141843    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-etc-sysctl-d\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.145483 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.141853    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee688dc3-9182-4cb7-890c-92326ef296cb-host-slash\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.145483 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.141878    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2346b60e-3d7d-4274-8866-2ad191a05139-iptables-alerter-script\") pod \"iptables-alerter-9mcqc\" (UID: \"2346b60e-3d7d-4274-8866-2ad191a05139\") " pod="openshift-network-operator/iptables-alerter-9mcqc"
Sep 06 19:27:19.145483 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.141912    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-etc-sysconfig\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.145483 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.141971    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2331a34f-8aa2-42e9-9ce8-29dc923273ce-etc-tuned\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.145483 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.142000    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2331a34f-8aa2-42e9-9ce8-29dc923273ce-tmp\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.146355 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.142024    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7e811c90-31e0-4422-acbc-1606d33ede56-registration-dir\") pod \"aws-ebs-csi-driver-node-fjqtm\" (UID: \"7e811c90-31e0-4422-acbc-1606d33ede56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm"
Sep 06 19:27:19.146355 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.142076    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7e811c90-31e0-4422-acbc-1606d33ede56-device-dir\") pod \"aws-ebs-csi-driver-node-fjqtm\" (UID: \"7e811c90-31e0-4422-acbc-1606d33ede56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm"
Sep 06 19:27:19.146355 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.142106    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-multus-socket-dir-parent\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.146355 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.142138    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-host-run-k8s-cni-cncf-io\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.146355 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.142289    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54e739ed-02ca-4f6a-82d8-bf2966672a28-dbus\") pod \"global-pull-secret-syncer-x5xzv\" (UID: \"54e739ed-02ca-4f6a-82d8-bf2966672a28\") " pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:19.146355 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.142355    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36bfe5b6-eb77-43e5-952f-f69db221e46a-host\") pod \"node-ca-4mk76\" (UID: \"36bfe5b6-eb77-43e5-952f-f69db221e46a\") " pod="openshift-image-registry/node-ca-4mk76"
Sep 06 19:27:19.146355 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.142407    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee688dc3-9182-4cb7-890c-92326ef296cb-ovnkube-config\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.146355 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.142429    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-host-run-k8s-cni-cncf-io\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.146355 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.142449    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-sys\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.146355 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.142480    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/054ee4ba-941f-46c5-9ac3-0daa28ed1dad-cnibin\") pod \"multus-additional-cni-plugins-t6h6w\" (UID: \"054ee4ba-941f-46c5-9ac3-0daa28ed1dad\") " pod="openshift-multus/multus-additional-cni-plugins-t6h6w"
Sep 06 19:27:19.146355 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.142545    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7gq7\" (UniqueName: \"kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7\") pod \"network-check-target-m2kz7\" (UID: \"9704ea38-52ce-4441-abd1-644d157c0285\") " pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:19.146355 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.142912    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/054ee4ba-941f-46c5-9ac3-0daa28ed1dad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t6h6w\" (UID: \"054ee4ba-941f-46c5-9ac3-0daa28ed1dad\") " pod="openshift-multus/multus-additional-cni-plugins-t6h6w"
Sep 06 19:27:19.146355 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.142941    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2346b60e-3d7d-4274-8866-2ad191a05139-iptables-alerter-script\") pod \"iptables-alerter-9mcqc\" (UID: \"2346b60e-3d7d-4274-8866-2ad191a05139\") " pod="openshift-network-operator/iptables-alerter-9mcqc"
Sep 06 19:27:19.146355 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.143005    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7e811c90-31e0-4422-acbc-1606d33ede56-device-dir\") pod \"aws-ebs-csi-driver-node-fjqtm\" (UID: \"7e811c90-31e0-4422-acbc-1606d33ede56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm"
Sep 06 19:27:19.146355 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.143022    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/054ee4ba-941f-46c5-9ac3-0daa28ed1dad-cnibin\") pod \"multus-additional-cni-plugins-t6h6w\" (UID: \"054ee4ba-941f-46c5-9ac3-0daa28ed1dad\") " pod="openshift-multus/multus-additional-cni-plugins-t6h6w"
Sep 06 19:27:19.146355 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.143048    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7e811c90-31e0-4422-acbc-1606d33ede56-registration-dir\") pod \"aws-ebs-csi-driver-node-fjqtm\" (UID: \"7e811c90-31e0-4422-acbc-1606d33ede56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm"
Sep 06 19:27:19.146355 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.143055    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e02983e8-bb51-4194-b599-083a466312d6-multus-socket-dir-parent\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.147346 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.143087    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2331a34f-8aa2-42e9-9ce8-29dc923273ce-etc-sysconfig\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.147346 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.143122    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54e739ed-02ca-4f6a-82d8-bf2966672a28-dbus\") pod \"global-pull-secret-syncer-x5xzv\" (UID: \"54e739ed-02ca-4f6a-82d8-bf2966672a28\") " pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:19.147346 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.143826    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee688dc3-9182-4cb7-890c-92326ef296cb-ovn-node-metrics-cert\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.147346 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.145410    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2331a34f-8aa2-42e9-9ce8-29dc923273ce-etc-tuned\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.147346 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.145505    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2331a34f-8aa2-42e9-9ce8-29dc923273ce-tmp\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.147346 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.146485    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/de2ce0c6-0449-42b3-a783-7bd9bce82ee7-agent-certs\") pod \"konnectivity-agent-c5cf6\" (UID: \"de2ce0c6-0449-42b3-a783-7bd9bce82ee7\") " pod="kube-system/konnectivity-agent-c5cf6"
Sep 06 19:27:19.148053 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.148030    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96jdc\" (UniqueName: \"kubernetes.io/projected/7e811c90-31e0-4422-acbc-1606d33ede56-kube-api-access-96jdc\") pod \"aws-ebs-csi-driver-node-fjqtm\" (UID: \"7e811c90-31e0-4422-acbc-1606d33ede56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm"
Sep 06 19:27:19.148136 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.148084    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55ck8\" (UniqueName: \"kubernetes.io/projected/054ee4ba-941f-46c5-9ac3-0daa28ed1dad-kube-api-access-55ck8\") pod \"multus-additional-cni-plugins-t6h6w\" (UID: \"054ee4ba-941f-46c5-9ac3-0daa28ed1dad\") " pod="openshift-multus/multus-additional-cni-plugins-t6h6w"
Sep 06 19:27:19.148244 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:19.148228    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 19:27:19.148311 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:19.148247    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 19:27:19.148311 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:19.148273    2568 projected.go:196] Error preparing data for projected volume kube-api-access-j7gq7 for pod openshift-network-diagnostics/network-check-target-m2kz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:27:19.148398 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:19.148321    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7 podName:9704ea38-52ce-4441-abd1-644d157c0285 nodeName:}" failed. No retries permitted until 2026-09-06 19:27:19.648306708 +0000 UTC m=+3.053265758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j7gq7" (UniqueName: "kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7") pod "network-check-target-m2kz7" (UID: "9704ea38-52ce-4441-abd1-644d157c0285") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:27:19.148721 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.148704    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97tkk\" (UniqueName: \"kubernetes.io/projected/e02983e8-bb51-4194-b599-083a466312d6-kube-api-access-97tkk\") pod \"multus-qhj8h\" (UID: \"e02983e8-bb51-4194-b599-083a466312d6\") " pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.149088 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.149056    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-559mh\" (UniqueName: \"kubernetes.io/projected/2331a34f-8aa2-42e9-9ce8-29dc923273ce-kube-api-access-559mh\") pod \"tuned-2xw9v\" (UID: \"2331a34f-8aa2-42e9-9ce8-29dc923273ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.149158 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.149132    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxqkt\" (UniqueName: \"kubernetes.io/projected/2346b60e-3d7d-4274-8866-2ad191a05139-kube-api-access-xxqkt\") pod \"iptables-alerter-9mcqc\" (UID: \"2346b60e-3d7d-4274-8866-2ad191a05139\") " pod="openshift-network-operator/iptables-alerter-9mcqc"
Sep 06 19:27:19.149984 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.149962    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwftr\" (UniqueName: \"kubernetes.io/projected/0ace7f43-c761-489f-b523-b01650e632df-kube-api-access-lwftr\") pod \"network-metrics-daemon-cb2dz\" (UID: \"0ace7f43-c761-489f-b523-b01650e632df\") " pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:19.150489 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.150471    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qhrf\" (UniqueName: \"kubernetes.io/projected/ee688dc3-9182-4cb7-890c-92326ef296cb-kube-api-access-9qhrf\") pod \"ovnkube-node-gfqzm\" (UID: \"ee688dc3-9182-4cb7-890c-92326ef296cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.243263 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.243232    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/36bfe5b6-eb77-43e5-952f-f69db221e46a-serviceca\") pod \"node-ca-4mk76\" (UID: \"36bfe5b6-eb77-43e5-952f-f69db221e46a\") " pod="openshift-image-registry/node-ca-4mk76"
Sep 06 19:27:19.243263 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.243268    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnssp\" (UniqueName: \"kubernetes.io/projected/becacc1b-0eeb-4404-908e-585e7edaa25b-kube-api-access-nnssp\") pod \"node-resolver-z2s8x\" (UID: \"becacc1b-0eeb-4404-908e-585e7edaa25b\") " pod="openshift-dns/node-resolver-z2s8x"
Sep 06 19:27:19.243467 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.243301    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/becacc1b-0eeb-4404-908e-585e7edaa25b-tmp-dir\") pod \"node-resolver-z2s8x\" (UID: \"becacc1b-0eeb-4404-908e-585e7edaa25b\") " pod="openshift-dns/node-resolver-z2s8x"
Sep 06 19:27:19.243467 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.243340    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9nx4\" (UniqueName: \"kubernetes.io/projected/36bfe5b6-eb77-43e5-952f-f69db221e46a-kube-api-access-m9nx4\") pod \"node-ca-4mk76\" (UID: \"36bfe5b6-eb77-43e5-952f-f69db221e46a\") " pod="openshift-image-registry/node-ca-4mk76"
Sep 06 19:27:19.243467 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.243384    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/becacc1b-0eeb-4404-908e-585e7edaa25b-hosts-file\") pod \"node-resolver-z2s8x\" (UID: \"becacc1b-0eeb-4404-908e-585e7edaa25b\") " pod="openshift-dns/node-resolver-z2s8x"
Sep 06 19:27:19.243467 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.243405    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36bfe5b6-eb77-43e5-952f-f69db221e46a-host\") pod \"node-ca-4mk76\" (UID: \"36bfe5b6-eb77-43e5-952f-f69db221e46a\") " pod="openshift-image-registry/node-ca-4mk76"
Sep 06 19:27:19.243632 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.243478    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36bfe5b6-eb77-43e5-952f-f69db221e46a-host\") pod \"node-ca-4mk76\" (UID: \"36bfe5b6-eb77-43e5-952f-f69db221e46a\") " pod="openshift-image-registry/node-ca-4mk76"
Sep 06 19:27:19.244042 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.243789    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/becacc1b-0eeb-4404-908e-585e7edaa25b-hosts-file\") pod \"node-resolver-z2s8x\" (UID: \"becacc1b-0eeb-4404-908e-585e7edaa25b\") " pod="openshift-dns/node-resolver-z2s8x"
Sep 06 19:27:19.244042 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.243934    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/36bfe5b6-eb77-43e5-952f-f69db221e46a-serviceca\") pod \"node-ca-4mk76\" (UID: \"36bfe5b6-eb77-43e5-952f-f69db221e46a\") " pod="openshift-image-registry/node-ca-4mk76"
Sep 06 19:27:19.244042 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.244004    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/becacc1b-0eeb-4404-908e-585e7edaa25b-tmp-dir\") pod \"node-resolver-z2s8x\" (UID: \"becacc1b-0eeb-4404-908e-585e7edaa25b\") " pod="openshift-dns/node-resolver-z2s8x"
Sep 06 19:27:19.250936 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.250874    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnssp\" (UniqueName: \"kubernetes.io/projected/becacc1b-0eeb-4404-908e-585e7edaa25b-kube-api-access-nnssp\") pod \"node-resolver-z2s8x\" (UID: \"becacc1b-0eeb-4404-908e-585e7edaa25b\") " pod="openshift-dns/node-resolver-z2s8x"
Sep 06 19:27:19.250936 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.250916    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9nx4\" (UniqueName: \"kubernetes.io/projected/36bfe5b6-eb77-43e5-952f-f69db221e46a-kube-api-access-m9nx4\") pod \"node-ca-4mk76\" (UID: \"36bfe5b6-eb77-43e5-952f-f69db221e46a\") " pod="openshift-image-registry/node-ca-4mk76"
Sep 06 19:27:19.303937 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.303911    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 19:27:19.315705 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.315682    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c5cf6"
Sep 06 19:27:19.324950 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.324919    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t6h6w"
Sep 06 19:27:19.334710 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.334687    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9mcqc"
Sep 06 19:27:19.340059 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.340042    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:19.347718 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.347701    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm"
Sep 06 19:27:19.354358 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.354342    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qhj8h"
Sep 06 19:27:19.361040 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.361017    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2xw9v"
Sep 06 19:27:19.367686 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.367662    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4mk76"
Sep 06 19:27:19.372296 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.372279    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z2s8x"
Sep 06 19:27:19.644727 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.644701    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs\") pod \"network-metrics-daemon-cb2dz\" (UID: \"0ace7f43-c761-489f-b523-b01650e632df\") " pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:19.644727 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.644732    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret\") pod \"global-pull-secret-syncer-x5xzv\" (UID: \"54e739ed-02ca-4f6a-82d8-bf2966672a28\") " pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:19.644969 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:19.644860    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:27:19.644969 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:19.644905    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs podName:0ace7f43-c761-489f-b523-b01650e632df nodeName:}" failed. No retries permitted until 2026-09-06 19:27:20.644894144 +0000 UTC m=+4.049853201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs") pod "network-metrics-daemon-cb2dz" (UID: "0ace7f43-c761-489f-b523-b01650e632df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:27:19.644969 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:19.644860    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 19:27:19.644969 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:19.644941    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret podName:54e739ed-02ca-4f6a-82d8-bf2966672a28 nodeName:}" failed. No retries permitted until 2026-09-06 19:27:20.644933024 +0000 UTC m=+4.049892082 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret") pod "global-pull-secret-syncer-x5xzv" (UID: "54e739ed-02ca-4f6a-82d8-bf2966672a28") : object "kube-system"/"original-pull-secret" not registered
Sep 06 19:27:19.745503 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:19.745465    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7gq7\" (UniqueName: \"kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7\") pod \"network-check-target-m2kz7\" (UID: \"9704ea38-52ce-4441-abd1-644d157c0285\") " pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:19.745673 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:19.745640    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 19:27:19.745673 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:19.745663    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 19:27:19.745799 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:19.745675    2568 projected.go:196] Error preparing data for projected volume kube-api-access-j7gq7 for pod openshift-network-diagnostics/network-check-target-m2kz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:27:19.745799 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:19.745740    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7 podName:9704ea38-52ce-4441-abd1-644d157c0285 nodeName:}" failed. No retries permitted until 2026-09-06 19:27:20.745722952 +0000 UTC m=+4.150682010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j7gq7" (UniqueName: "kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7") pod "network-check-target-m2kz7" (UID: "9704ea38-52ce-4441-abd1-644d157c0285") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:27:19.927310 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:19.927259    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod054ee4ba_941f_46c5_9ac3_0daa28ed1dad.slice/crio-304d0a4a3973f988925440e154ffd78f54b72cfde349eaee9f751570231d201e WatchSource:0}: Error finding container 304d0a4a3973f988925440e154ffd78f54b72cfde349eaee9f751570231d201e: Status 404 returned error can't find the container with id 304d0a4a3973f988925440e154ffd78f54b72cfde349eaee9f751570231d201e
Sep 06 19:27:19.928542 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:19.928497    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36bfe5b6_eb77_43e5_952f_f69db221e46a.slice/crio-ce260e8d4ac895061cf76368e143c6c1f8f6e8e45c53cb0ed15a86a305e69aff WatchSource:0}: Error finding container ce260e8d4ac895061cf76368e143c6c1f8f6e8e45c53cb0ed15a86a305e69aff: Status 404 returned error can't find the container with id ce260e8d4ac895061cf76368e143c6c1f8f6e8e45c53cb0ed15a86a305e69aff
Sep 06 19:27:19.929134 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:19.929112    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee688dc3_9182_4cb7_890c_92326ef296cb.slice/crio-1c5d48e5b007359fd1c8bfade5f5dff00effcda4e2d7f02beacdf2f45829dc6a WatchSource:0}: Error finding container 1c5d48e5b007359fd1c8bfade5f5dff00effcda4e2d7f02beacdf2f45829dc6a: Status 404 returned error can't find the container with id 1c5d48e5b007359fd1c8bfade5f5dff00effcda4e2d7f02beacdf2f45829dc6a
Sep 06 19:27:19.929874 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:19.929810    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2331a34f_8aa2_42e9_9ce8_29dc923273ce.slice/crio-a6cd787969095295cc8b5ede37650225a0b67aa6a4c11fcd283fdcabc24e4258 WatchSource:0}: Error finding container a6cd787969095295cc8b5ede37650225a0b67aa6a4c11fcd283fdcabc24e4258: Status 404 returned error can't find the container with id a6cd787969095295cc8b5ede37650225a0b67aa6a4c11fcd283fdcabc24e4258
Sep 06 19:27:19.932028 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:19.932011    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode02983e8_bb51_4194_b599_083a466312d6.slice/crio-4d4a6445481c2c99ec351e30209c5d3ae8bc5156acc959ca5ecb3e2ee0ff03be WatchSource:0}: Error finding container 4d4a6445481c2c99ec351e30209c5d3ae8bc5156acc959ca5ecb3e2ee0ff03be: Status 404 returned error can't find the container with id 4d4a6445481c2c99ec351e30209c5d3ae8bc5156acc959ca5ecb3e2ee0ff03be
Sep 06 19:27:19.933461 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:19.933437    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e811c90_31e0_4422_acbc_1606d33ede56.slice/crio-574372caac5f02d74de353be61720fe5d16255537c7031ad18f0a18fcb6a43b0 WatchSource:0}: Error finding container 574372caac5f02d74de353be61720fe5d16255537c7031ad18f0a18fcb6a43b0: Status 404 returned error can't find the container with id 574372caac5f02d74de353be61720fe5d16255537c7031ad18f0a18fcb6a43b0
Sep 06 19:27:20.080858 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:20.080602    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 19:22:18 +0000 UTC" deadline="2028-05-08 18:15:58.467967609 +0000 UTC"
Sep 06 19:27:20.080858 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:20.080857    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14638h48m38.387117587s"
Sep 06 19:27:20.117972 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:20.117937    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9mcqc" event={"ID":"2346b60e-3d7d-4274-8866-2ad191a05139","Type":"ContainerStarted","Data":"ad8e9ddc5e84e2602229811912ecee2e2366d007cccca3167b32fdf63c04ae67"}
Sep 06 19:27:20.119188 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:20.119164    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qhj8h" event={"ID":"e02983e8-bb51-4194-b599-083a466312d6","Type":"ContainerStarted","Data":"4d4a6445481c2c99ec351e30209c5d3ae8bc5156acc959ca5ecb3e2ee0ff03be"}
Sep 06 19:27:20.120336 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:20.120318    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm" event={"ID":"ee688dc3-9182-4cb7-890c-92326ef296cb","Type":"ContainerStarted","Data":"1c5d48e5b007359fd1c8bfade5f5dff00effcda4e2d7f02beacdf2f45829dc6a"}
Sep 06 19:27:20.122262 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:20.122232    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal" event={"ID":"8c6a01d943a52353eb13a1aeaca47347","Type":"ContainerStarted","Data":"cb3dfe8c31813982e7439c54328f119803651454ac85f29dcf52ffc828af86d1"}
Sep 06 19:27:20.123568 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:20.123547    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm" event={"ID":"7e811c90-31e0-4422-acbc-1606d33ede56","Type":"ContainerStarted","Data":"574372caac5f02d74de353be61720fe5d16255537c7031ad18f0a18fcb6a43b0"}
Sep 06 19:27:20.124849 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:20.124825    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c5cf6" event={"ID":"de2ce0c6-0449-42b3-a783-7bd9bce82ee7","Type":"ContainerStarted","Data":"f3b7fb1917f52306ddba1048d3be971ca3ebc79d408cba255accc03e65f73d7a"}
Sep 06 19:27:20.126161 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:20.126139    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z2s8x" event={"ID":"becacc1b-0eeb-4404-908e-585e7edaa25b","Type":"ContainerStarted","Data":"a196c58d673583fc5e69383168c4298bfe24639a93b4006b45e31ba959c4722c"}
Sep 06 19:27:20.127383 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:20.127350    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2xw9v" event={"ID":"2331a34f-8aa2-42e9-9ce8-29dc923273ce","Type":"ContainerStarted","Data":"a6cd787969095295cc8b5ede37650225a0b67aa6a4c11fcd283fdcabc24e4258"}
Sep 06 19:27:20.128570 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:20.128547    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4mk76" event={"ID":"36bfe5b6-eb77-43e5-952f-f69db221e46a","Type":"ContainerStarted","Data":"ce260e8d4ac895061cf76368e143c6c1f8f6e8e45c53cb0ed15a86a305e69aff"}
Sep 06 19:27:20.129759 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:20.129736    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6h6w" event={"ID":"054ee4ba-941f-46c5-9ac3-0daa28ed1dad","Type":"ContainerStarted","Data":"304d0a4a3973f988925440e154ffd78f54b72cfde349eaee9f751570231d201e"}
Sep 06 19:27:20.138861 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:20.136764    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal" podStartSLOduration=2.136747569 podStartE2EDuration="2.136747569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:27:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:27:20.135835327 +0000 UTC m=+3.540794393" watchObservedRunningTime="2026-09-06 19:27:20.136747569 +0000 UTC m=+3.541706636"
Sep 06 19:27:20.652737 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:20.652693    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs\") pod \"network-metrics-daemon-cb2dz\" (UID: \"0ace7f43-c761-489f-b523-b01650e632df\") " pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:20.652945 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:20.652756    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret\") pod \"global-pull-secret-syncer-x5xzv\" (UID: \"54e739ed-02ca-4f6a-82d8-bf2966672a28\") " pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:20.652945 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:20.652934    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 19:27:20.653070 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:20.653019    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret podName:54e739ed-02ca-4f6a-82d8-bf2966672a28 nodeName:}" failed. No retries permitted until 2026-09-06 19:27:22.6530007 +0000 UTC m=+6.057959761 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret") pod "global-pull-secret-syncer-x5xzv" (UID: "54e739ed-02ca-4f6a-82d8-bf2966672a28") : object "kube-system"/"original-pull-secret" not registered
Sep 06 19:27:20.653457 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:20.653435    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:27:20.653530 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:20.653494    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs podName:0ace7f43-c761-489f-b523-b01650e632df nodeName:}" failed. No retries permitted until 2026-09-06 19:27:22.653478366 +0000 UTC m=+6.058437416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs") pod "network-metrics-daemon-cb2dz" (UID: "0ace7f43-c761-489f-b523-b01650e632df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:27:20.753540 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:20.753455    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7gq7\" (UniqueName: \"kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7\") pod \"network-check-target-m2kz7\" (UID: \"9704ea38-52ce-4441-abd1-644d157c0285\") " pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:20.753715 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:20.753624    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 19:27:20.753715 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:20.753648    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 19:27:20.753715 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:20.753661    2568 projected.go:196] Error preparing data for projected volume kube-api-access-j7gq7 for pod openshift-network-diagnostics/network-check-target-m2kz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:27:20.753899 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:20.753730    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7 podName:9704ea38-52ce-4441-abd1-644d157c0285 nodeName:}" failed. No retries permitted until 2026-09-06 19:27:22.753711827 +0000 UTC m=+6.158670877 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j7gq7" (UniqueName: "kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7") pod "network-check-target-m2kz7" (UID: "9704ea38-52ce-4441-abd1-644d157c0285") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:27:20.866408 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:20.866365    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 19:27:21.081908 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:21.081793    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 19:22:18 +0000 UTC" deadline="2028-04-18 17:09:23.459956956 +0000 UTC"
Sep 06 19:27:21.081908 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:21.081858    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14157h42m2.378103083s"
Sep 06 19:27:21.110279 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:21.109791    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:21.110279 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:21.109790    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:21.110279 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:21.109925    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2kz7" podUID="9704ea38-52ce-4441-abd1-644d157c0285"
Sep 06 19:27:21.110279 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:21.109940    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:21.110279 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:21.110038    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x5xzv" podUID="54e739ed-02ca-4f6a-82d8-bf2966672a28"
Sep 06 19:27:21.110279 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:21.110139    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cb2dz" podUID="0ace7f43-c761-489f-b523-b01650e632df"
Sep 06 19:27:21.140729 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:21.140691    2568 generic.go:356] "Generic (PLEG): container finished" podID="b96bbae1cab1e6122a35206690d262db" containerID="d03d3650b9f77e3b1f0f4d5d35532a4b5d5e7ee352e710f5a2645673f78ac3c8" exitCode=0
Sep 06 19:27:21.140931 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:21.140817    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal" event={"ID":"b96bbae1cab1e6122a35206690d262db","Type":"ContainerDied","Data":"d03d3650b9f77e3b1f0f4d5d35532a4b5d5e7ee352e710f5a2645673f78ac3c8"}
Sep 06 19:27:22.159487 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:22.159451    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal" event={"ID":"b96bbae1cab1e6122a35206690d262db","Type":"ContainerStarted","Data":"44da5a8594bea0c7055c3b41a975ab82200bfcee924db3dfba381bbdf66926b7"}
Sep 06 19:27:22.669645 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:22.669607    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs\") pod \"network-metrics-daemon-cb2dz\" (UID: \"0ace7f43-c761-489f-b523-b01650e632df\") " pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:22.669888 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:22.669659    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret\") pod \"global-pull-secret-syncer-x5xzv\" (UID: \"54e739ed-02ca-4f6a-82d8-bf2966672a28\") " pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:22.669888 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:22.669802    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 19:27:22.669888 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:22.669849    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:27:22.669888 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:22.669868    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret podName:54e739ed-02ca-4f6a-82d8-bf2966672a28 nodeName:}" failed. No retries permitted until 2026-09-06 19:27:26.669848609 +0000 UTC m=+10.074807671 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret") pod "global-pull-secret-syncer-x5xzv" (UID: "54e739ed-02ca-4f6a-82d8-bf2966672a28") : object "kube-system"/"original-pull-secret" not registered
Sep 06 19:27:22.670135 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:22.669915    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs podName:0ace7f43-c761-489f-b523-b01650e632df nodeName:}" failed. No retries permitted until 2026-09-06 19:27:26.669898388 +0000 UTC m=+10.074857448 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs") pod "network-metrics-daemon-cb2dz" (UID: "0ace7f43-c761-489f-b523-b01650e632df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:27:22.770247 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:22.770206    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7gq7\" (UniqueName: \"kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7\") pod \"network-check-target-m2kz7\" (UID: \"9704ea38-52ce-4441-abd1-644d157c0285\") " pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:22.770467 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:22.770435    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 19:27:22.770467 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:22.770464    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 19:27:22.770650 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:22.770477    2568 projected.go:196] Error preparing data for projected volume kube-api-access-j7gq7 for pod openshift-network-diagnostics/network-check-target-m2kz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:27:22.770650 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:22.770536    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7 podName:9704ea38-52ce-4441-abd1-644d157c0285 nodeName:}" failed. No retries permitted until 2026-09-06 19:27:26.770518416 +0000 UTC m=+10.175477477 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j7gq7" (UniqueName: "kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7") pod "network-check-target-m2kz7" (UID: "9704ea38-52ce-4441-abd1-644d157c0285") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:27:23.110929 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:23.110846    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:23.111100 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:23.110995    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cb2dz" podUID="0ace7f43-c761-489f-b523-b01650e632df"
Sep 06 19:27:23.111395 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:23.111377    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:23.111487 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:23.111472    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2kz7" podUID="9704ea38-52ce-4441-abd1-644d157c0285"
Sep 06 19:27:23.111541 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:23.111518    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:23.111585 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:23.111568    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x5xzv" podUID="54e739ed-02ca-4f6a-82d8-bf2966672a28"
Sep 06 19:27:25.109944 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:25.109906    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:25.110347 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:25.109906    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:25.110347 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:25.110036    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:25.110347 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:25.110027    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2kz7" podUID="9704ea38-52ce-4441-abd1-644d157c0285"
Sep 06 19:27:25.110347 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:25.110159    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x5xzv" podUID="54e739ed-02ca-4f6a-82d8-bf2966672a28"
Sep 06 19:27:25.110347 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:25.110258    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cb2dz" podUID="0ace7f43-c761-489f-b523-b01650e632df"
Sep 06 19:27:26.705003 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:26.704964    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs\") pod \"network-metrics-daemon-cb2dz\" (UID: \"0ace7f43-c761-489f-b523-b01650e632df\") " pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:26.705456 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:26.705023    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret\") pod \"global-pull-secret-syncer-x5xzv\" (UID: \"54e739ed-02ca-4f6a-82d8-bf2966672a28\") " pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:26.705456 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:26.705174    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 19:27:26.705456 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:26.705232    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret podName:54e739ed-02ca-4f6a-82d8-bf2966672a28 nodeName:}" failed. No retries permitted until 2026-09-06 19:27:34.705217041 +0000 UTC m=+18.110176088 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret") pod "global-pull-secret-syncer-x5xzv" (UID: "54e739ed-02ca-4f6a-82d8-bf2966672a28") : object "kube-system"/"original-pull-secret" not registered
Sep 06 19:27:26.705633 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:26.705538    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:27:26.705633 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:26.705578    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs podName:0ace7f43-c761-489f-b523-b01650e632df nodeName:}" failed. No retries permitted until 2026-09-06 19:27:34.705563909 +0000 UTC m=+18.110522956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs") pod "network-metrics-daemon-cb2dz" (UID: "0ace7f43-c761-489f-b523-b01650e632df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:27:26.806019 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:26.805945    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7gq7\" (UniqueName: \"kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7\") pod \"network-check-target-m2kz7\" (UID: \"9704ea38-52ce-4441-abd1-644d157c0285\") " pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:26.806187 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:26.806096    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 19:27:26.806187 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:26.806123    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 19:27:26.806187 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:26.806136    2568 projected.go:196] Error preparing data for projected volume kube-api-access-j7gq7 for pod openshift-network-diagnostics/network-check-target-m2kz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:27:26.806378 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:26.806207    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7 podName:9704ea38-52ce-4441-abd1-644d157c0285 nodeName:}" failed. No retries permitted until 2026-09-06 19:27:34.806186276 +0000 UTC m=+18.211145324 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j7gq7" (UniqueName: "kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7") pod "network-check-target-m2kz7" (UID: "9704ea38-52ce-4441-abd1-644d157c0285") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:27:27.112348 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:27.111574    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:27.112348 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:27.111705    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cb2dz" podUID="0ace7f43-c761-489f-b523-b01650e632df"
Sep 06 19:27:27.112348 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:27.112062    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:27.112348 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:27.112158    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2kz7" podUID="9704ea38-52ce-4441-abd1-644d157c0285"
Sep 06 19:27:27.112348 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:27.112203    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:27.112348 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:27.112268    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x5xzv" podUID="54e739ed-02ca-4f6a-82d8-bf2966672a28"
Sep 06 19:27:29.112316 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:29.112281    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:29.112316 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:29.112300    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:29.112814 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:29.112397    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cb2dz" podUID="0ace7f43-c761-489f-b523-b01650e632df"
Sep 06 19:27:29.112814 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:29.112452    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:29.112814 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:29.112551    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x5xzv" podUID="54e739ed-02ca-4f6a-82d8-bf2966672a28"
Sep 06 19:27:29.112814 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:29.112627    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2kz7" podUID="9704ea38-52ce-4441-abd1-644d157c0285"
Sep 06 19:27:31.108861 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:31.108749    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:31.108861 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:31.108812    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:31.109375 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:31.108909    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:31.109375 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:31.108911    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x5xzv" podUID="54e739ed-02ca-4f6a-82d8-bf2966672a28"
Sep 06 19:27:31.109375 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:31.109059    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cb2dz" podUID="0ace7f43-c761-489f-b523-b01650e632df"
Sep 06 19:27:31.109375 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:31.109139    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2kz7" podUID="9704ea38-52ce-4441-abd1-644d157c0285"
Sep 06 19:27:33.109151 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:33.109112    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:33.109636 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:33.109117    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:33.109636 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:33.109229    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2kz7" podUID="9704ea38-52ce-4441-abd1-644d157c0285"
Sep 06 19:27:33.109636 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:33.109240    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:33.109636 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:33.109302    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x5xzv" podUID="54e739ed-02ca-4f6a-82d8-bf2966672a28"
Sep 06 19:27:33.109636 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:33.109361    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cb2dz" podUID="0ace7f43-c761-489f-b523-b01650e632df"
Sep 06 19:27:34.771811 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:34.771753    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret\") pod \"global-pull-secret-syncer-x5xzv\" (UID: \"54e739ed-02ca-4f6a-82d8-bf2966672a28\") " pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:34.772316 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:34.771871    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs\") pod \"network-metrics-daemon-cb2dz\" (UID: \"0ace7f43-c761-489f-b523-b01650e632df\") " pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:34.772316 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:34.771914    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 19:27:34.772316 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:34.771947    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:27:34.772316 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:34.771986    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret podName:54e739ed-02ca-4f6a-82d8-bf2966672a28 nodeName:}" failed. No retries permitted until 2026-09-06 19:27:50.771968343 +0000 UTC m=+34.176927390 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret") pod "global-pull-secret-syncer-x5xzv" (UID: "54e739ed-02ca-4f6a-82d8-bf2966672a28") : object "kube-system"/"original-pull-secret" not registered
Sep 06 19:27:34.772316 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:34.772003    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs podName:0ace7f43-c761-489f-b523-b01650e632df nodeName:}" failed. No retries permitted until 2026-09-06 19:27:50.771996485 +0000 UTC m=+34.176955532 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs") pod "network-metrics-daemon-cb2dz" (UID: "0ace7f43-c761-489f-b523-b01650e632df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:27:34.873111 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:34.873067    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7gq7\" (UniqueName: \"kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7\") pod \"network-check-target-m2kz7\" (UID: \"9704ea38-52ce-4441-abd1-644d157c0285\") " pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:34.873289 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:34.873268    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 19:27:34.873343 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:34.873295    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 19:27:34.873343 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:34.873306    2568 projected.go:196] Error preparing data for projected volume kube-api-access-j7gq7 for pod openshift-network-diagnostics/network-check-target-m2kz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:27:34.873418 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:34.873388    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7 podName:9704ea38-52ce-4441-abd1-644d157c0285 nodeName:}" failed. No retries permitted until 2026-09-06 19:27:50.873364746 +0000 UTC m=+34.278323818 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j7gq7" (UniqueName: "kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7") pod "network-check-target-m2kz7" (UID: "9704ea38-52ce-4441-abd1-644d157c0285") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:27:35.108852 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:35.108824    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:35.108852 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:35.108854    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:35.109084 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:35.108940    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:35.109084 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:35.108955    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2kz7" podUID="9704ea38-52ce-4441-abd1-644d157c0285"
Sep 06 19:27:35.109195 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:35.109087    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cb2dz" podUID="0ace7f43-c761-489f-b523-b01650e632df"
Sep 06 19:27:35.109195 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:35.109185    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x5xzv" podUID="54e739ed-02ca-4f6a-82d8-bf2966672a28"
Sep 06 19:27:37.109856 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:37.109813    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:37.110263 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:37.109920    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2kz7" podUID="9704ea38-52ce-4441-abd1-644d157c0285"
Sep 06 19:27:37.110342 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:37.110309    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:37.110417 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:37.110398    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x5xzv" podUID="54e739ed-02ca-4f6a-82d8-bf2966672a28"
Sep 06 19:27:37.110488 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:37.110467    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:37.110635 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:37.110606    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cb2dz" podUID="0ace7f43-c761-489f-b523-b01650e632df"
Sep 06 19:27:39.110365 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.109866    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:39.110365 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.109868    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:39.111487 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.109910    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:39.111487 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:39.110389    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cb2dz" podUID="0ace7f43-c761-489f-b523-b01650e632df"
Sep 06 19:27:39.111487 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:39.110417    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2kz7" podUID="9704ea38-52ce-4441-abd1-644d157c0285"
Sep 06 19:27:39.111487 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:39.110511    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x5xzv" podUID="54e739ed-02ca-4f6a-82d8-bf2966672a28"
Sep 06 19:27:39.196532 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.196496    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z2s8x" event={"ID":"becacc1b-0eeb-4404-908e-585e7edaa25b","Type":"ContainerStarted","Data":"c1370b1fbd5dd0a305519bb9595fe8cbc70fdac5e39f73e1323dccef4357c828"}
Sep 06 19:27:39.198101 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.198074    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2xw9v" event={"ID":"2331a34f-8aa2-42e9-9ce8-29dc923273ce","Type":"ContainerStarted","Data":"5f72c4bec9de4cff9b7e8cb1d125fcf8d5134b7eacadce474b31e157b8e7ee09"}
Sep 06 19:27:39.199896 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.199861    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4mk76" event={"ID":"36bfe5b6-eb77-43e5-952f-f69db221e46a","Type":"ContainerStarted","Data":"b6529a19e29ae331b431d5b7ca237e72b020aefc88a5e242bb77b530469a04a6"}
Sep 06 19:27:39.201525 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.201497    2568 generic.go:356] "Generic (PLEG): container finished" podID="054ee4ba-941f-46c5-9ac3-0daa28ed1dad" containerID="5605d968c1fdf2df7402760dd02395afef45f80ca5d93a408380d5800fc856b5" exitCode=0
Sep 06 19:27:39.201632 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.201582    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6h6w" event={"ID":"054ee4ba-941f-46c5-9ac3-0daa28ed1dad","Type":"ContainerDied","Data":"5605d968c1fdf2df7402760dd02395afef45f80ca5d93a408380d5800fc856b5"}
Sep 06 19:27:39.203448 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.203427    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qhj8h" event={"ID":"e02983e8-bb51-4194-b599-083a466312d6","Type":"ContainerStarted","Data":"a0b0570431f948d9a9d2d0712cc955eda4d0feddf3509f155286371fdeda2b95"}
Sep 06 19:27:39.206794 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.206752    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm" event={"ID":"ee688dc3-9182-4cb7-890c-92326ef296cb","Type":"ContainerStarted","Data":"9a92bd229268ad01a250cfce20e5bbf9093672f4e62ba7fc716ae434cc795c64"}
Sep 06 19:27:39.206887 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.206845    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm" event={"ID":"ee688dc3-9182-4cb7-890c-92326ef296cb","Type":"ContainerStarted","Data":"6c134759162b7232f337c6393406f4acf825c5fd5ed89dc8bbab3d52f7993b2a"}
Sep 06 19:27:39.206887 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.206878    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm" event={"ID":"ee688dc3-9182-4cb7-890c-92326ef296cb","Type":"ContainerStarted","Data":"888894f81a66959f3d8f573da0dbab97017e223fa525bcb3955533ff4f937bfd"}
Sep 06 19:27:39.206989 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.206907    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm" event={"ID":"ee688dc3-9182-4cb7-890c-92326ef296cb","Type":"ContainerStarted","Data":"b2ca6acc4b3dc855fff00ee8ea4c242759c7ebd6956cb045b814d9f4fcbbb459"}
Sep 06 19:27:39.206989 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.206936    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm" event={"ID":"ee688dc3-9182-4cb7-890c-92326ef296cb","Type":"ContainerStarted","Data":"e60da922ac456be02941bca1908a3fe0c354dcd2a2cb52e8dd71789d47cc2655"}
Sep 06 19:27:39.206989 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.206975    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm" event={"ID":"ee688dc3-9182-4cb7-890c-92326ef296cb","Type":"ContainerStarted","Data":"eaf19fdece53c36271ce9954d996f407352edba8d6af57bfd118fbec5b55a728"}
Sep 06 19:27:39.208552 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.208530    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm" event={"ID":"7e811c90-31e0-4422-acbc-1606d33ede56","Type":"ContainerStarted","Data":"063fe6168a41256fe7c3b4519a6a65be6915e618e834153de7bf8cd0f7365c8b"}
Sep 06 19:27:39.210128 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.210102    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c5cf6" event={"ID":"de2ce0c6-0449-42b3-a783-7bd9bce82ee7","Type":"ContainerStarted","Data":"0d802971dd67d8432dc4b01d42da43d726186cfaa1b7870a74a6862d3ec9dac1"}
Sep 06 19:27:39.213692 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.213655    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z2s8x" podStartSLOduration=3.8313335349999997 podStartE2EDuration="22.213643388s" totalImagesPullingTime="18.382309853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:27:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:27:39.213641675 +0000 UTC m=+22.618600745" watchObservedRunningTime="2026-09-06 19:27:39.213643388 +0000 UTC m=+22.618602457"
Sep 06 19:27:39.214452 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.214418    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal" podStartSLOduration=21.214409461 podStartE2EDuration="21.214409461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:27:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:27:22.173942383 +0000 UTC m=+5.578901453" watchObservedRunningTime="2026-09-06 19:27:39.214409461 +0000 UTC m=+22.619368530"
Sep 06 19:27:39.227338 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.226750    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4mk76" podStartSLOduration=3.834749424 podStartE2EDuration="22.226733172s" totalImagesPullingTime="18.391983748s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:27:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:27:39.226685153 +0000 UTC m=+22.631644222" watchObservedRunningTime="2026-09-06 19:27:39.226733172 +0000 UTC m=+22.631692242"
Sep 06 19:27:39.262107 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.262054    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qhj8h" podStartSLOduration=3.857269864 podStartE2EDuration="22.262038836s" totalImagesPullingTime="18.404768972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:27:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:27:39.26170876 +0000 UTC m=+22.666667872" watchObservedRunningTime="2026-09-06 19:27:39.262038836 +0000 UTC m=+22.666997905"
Sep 06 19:27:39.277886 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.277838    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2xw9v" podStartSLOduration=3.886580929 podStartE2EDuration="22.277822712s" totalImagesPullingTime="18.391241783s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:27:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:27:39.277058288 +0000 UTC m=+22.682017358" watchObservedRunningTime="2026-09-06 19:27:39.277822712 +0000 UTC m=+22.682781781"
Sep 06 19:27:39.291316 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.291263    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-c5cf6" podStartSLOduration=7.670377471 podStartE2EDuration="22.291242882s" totalImagesPullingTime="14.620865411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:27:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:27:39.290999982 +0000 UTC m=+22.695959053" watchObservedRunningTime="2026-09-06 19:27:39.291242882 +0000 UTC m=+22.696201950"
Sep 06 19:27:39.545910 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:39.545864    2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 06 19:27:40.110120 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:40.110008    2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-06T19:27:39.545882285Z","UUID":"f8506272-1994-4ee8-8281-7a2d413fff69","Handler":null,"Name":"","Endpoint":""}
Sep 06 19:27:40.111733 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:40.111710    2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 06 19:27:40.112126 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:40.111746    2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 06 19:27:40.215228 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:40.215143    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9mcqc" event={"ID":"2346b60e-3d7d-4274-8866-2ad191a05139","Type":"ContainerStarted","Data":"ee68187a48091b193e578fe802f4869bf1a0d9c3e06a95c2d343456d760e3070"}
Sep 06 19:27:40.218262 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:40.218231    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm" event={"ID":"7e811c90-31e0-4422-acbc-1606d33ede56","Type":"ContainerStarted","Data":"f13af8087278e0bd6c5e6f267e83ff53d5f4e17d17e9d98eed6a55eb1a275e84"}
Sep 06 19:27:40.230162 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:40.230108    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9mcqc" podStartSLOduration=4.8466563449999995 podStartE2EDuration="23.230090398s" totalImagesPullingTime="18.383434053s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:27:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:27:40.229771396 +0000 UTC m=+23.634730466" watchObservedRunningTime="2026-09-06 19:27:40.230090398 +0000 UTC m=+23.635049468"
Sep 06 19:27:41.109186 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:41.109147    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:41.109365 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:41.109289    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x5xzv" podUID="54e739ed-02ca-4f6a-82d8-bf2966672a28"
Sep 06 19:27:41.109736 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:41.109717    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:41.109875 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:41.109849    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cb2dz" podUID="0ace7f43-c761-489f-b523-b01650e632df"
Sep 06 19:27:41.110001 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:41.109983    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:41.110102 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:41.110042    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2kz7" podUID="9704ea38-52ce-4441-abd1-644d157c0285"
Sep 06 19:27:41.224875 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:41.224759    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm" event={"ID":"ee688dc3-9182-4cb7-890c-92326ef296cb","Type":"ContainerStarted","Data":"741e0029a9cfe58d3b645fd68c749ef3cf3a16ffe8bed7c9d9874fbe3d4ed1a7"}
Sep 06 19:27:41.227194 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:41.227161    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm" event={"ID":"7e811c90-31e0-4422-acbc-1606d33ede56","Type":"ContainerStarted","Data":"95229291db7124563759891e8276219ec6ec09ace53e94dc608ee1d091de7440"}
Sep 06 19:27:41.244039 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:41.243983    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjqtm" podStartSLOduration=4.092201488 podStartE2EDuration="24.243966802s" totalImagesPullingTime="20.151765314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:27:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:27:41.243804204 +0000 UTC m=+24.648763270" watchObservedRunningTime="2026-09-06 19:27:41.243966802 +0000 UTC m=+24.648925871"
Sep 06 19:27:41.731551 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:41.731518    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-c5cf6"
Sep 06 19:27:43.112602 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:43.112571    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:43.113016 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:43.112621    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:43.113016 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:43.112718    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:43.113016 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:43.112736    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cb2dz" podUID="0ace7f43-c761-489f-b523-b01650e632df"
Sep 06 19:27:43.113016 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:43.112808    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2kz7" podUID="9704ea38-52ce-4441-abd1-644d157c0285"
Sep 06 19:27:43.113016 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:43.112915    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x5xzv" podUID="54e739ed-02ca-4f6a-82d8-bf2966672a28"
Sep 06 19:27:43.495882 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:43.495647    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-c5cf6"
Sep 06 19:27:43.496536 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:43.496515    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-c5cf6"
Sep 06 19:27:44.237363 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:44.237331    2568 generic.go:356] "Generic (PLEG): container finished" podID="054ee4ba-941f-46c5-9ac3-0daa28ed1dad" containerID="b5702924dfd8136e67331d88c7079f20aa85746c3cd27b808a8bd2ce8c5008a7" exitCode=0
Sep 06 19:27:44.238228 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:44.237415    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6h6w" event={"ID":"054ee4ba-941f-46c5-9ac3-0daa28ed1dad","Type":"ContainerDied","Data":"b5702924dfd8136e67331d88c7079f20aa85746c3cd27b808a8bd2ce8c5008a7"}
Sep 06 19:27:44.241542 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:44.241494    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm" event={"ID":"ee688dc3-9182-4cb7-890c-92326ef296cb","Type":"ContainerStarted","Data":"7f6de51342848269054f138c24b0ff2b473c57810f3874dd6ca547a762e4889e"}
Sep 06 19:27:44.242178 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:44.242161    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c5cf6"
Sep 06 19:27:44.284540 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:44.284489    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm" podStartSLOduration=8.699828834 podStartE2EDuration="27.284474661s" totalImagesPullingTime="18.584645827s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:27:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:27:44.282746348 +0000 UTC m=+27.687705416" watchObservedRunningTime="2026-09-06 19:27:44.284474661 +0000 UTC m=+27.689433770"
Sep 06 19:27:45.109719 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:45.109556    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:45.109877 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:45.109565    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:45.109877 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:45.109829    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cb2dz" podUID="0ace7f43-c761-489f-b523-b01650e632df"
Sep 06 19:27:45.109877 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:45.109576    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:45.110025 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:45.109915    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x5xzv" podUID="54e739ed-02ca-4f6a-82d8-bf2966672a28"
Sep 06 19:27:45.110025 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:45.109957    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2kz7" podUID="9704ea38-52ce-4441-abd1-644d157c0285"
Sep 06 19:27:45.153415 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:45.153380    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x5xzv"]
Sep 06 19:27:45.154952 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:45.154767    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cb2dz"]
Sep 06 19:27:45.156071 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:45.156000    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m2kz7"]
Sep 06 19:27:45.245274 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:45.245161    2568 generic.go:356] "Generic (PLEG): container finished" podID="054ee4ba-941f-46c5-9ac3-0daa28ed1dad" containerID="6902f9bf82bb44cec7a719e8a1ec95d3b3816d8be1242c5ed0aec2af208170a1" exitCode=0
Sep 06 19:27:45.245274 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:45.245208    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6h6w" event={"ID":"054ee4ba-941f-46c5-9ac3-0daa28ed1dad","Type":"ContainerDied","Data":"6902f9bf82bb44cec7a719e8a1ec95d3b3816d8be1242c5ed0aec2af208170a1"}
Sep 06 19:27:45.245915 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:45.245365    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:45.245915 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:45.245549    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:45.245915 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:45.245652    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:45.245915 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:45.245647    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cb2dz" podUID="0ace7f43-c761-489f-b523-b01650e632df"
Sep 06 19:27:45.245915 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:45.245743    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x5xzv" podUID="54e739ed-02ca-4f6a-82d8-bf2966672a28"
Sep 06 19:27:45.246138 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:45.246096    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:45.246188 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:45.246170    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:45.246243 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:45.246187    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2kz7" podUID="9704ea38-52ce-4441-abd1-644d157c0285"
Sep 06 19:27:45.246243 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:45.246232    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:45.262038 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:45.262009    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:45.262161 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:45.262119    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:27:46.250893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:46.250808    2568 generic.go:356] "Generic (PLEG): container finished" podID="054ee4ba-941f-46c5-9ac3-0daa28ed1dad" containerID="6515837ba2452b9f0577e6a23aa189e09a92940119b941b8a6057a671c2bf704" exitCode=0
Sep 06 19:27:46.250893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:46.250881    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6h6w" event={"ID":"054ee4ba-941f-46c5-9ac3-0daa28ed1dad","Type":"ContainerDied","Data":"6515837ba2452b9f0577e6a23aa189e09a92940119b941b8a6057a671c2bf704"}
Sep 06 19:27:47.110274 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:47.110242    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:47.110274 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:47.110276    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:47.110490 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:47.110341    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2kz7" podUID="9704ea38-52ce-4441-abd1-644d157c0285"
Sep 06 19:27:47.110490 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:47.110408    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cb2dz" podUID="0ace7f43-c761-489f-b523-b01650e632df"
Sep 06 19:27:47.110490 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:47.110455    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:47.110638 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:47.110503    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x5xzv" podUID="54e739ed-02ca-4f6a-82d8-bf2966672a28"
Sep 06 19:27:49.109651 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:49.109420    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:49.110156 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:49.109435    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:49.110156 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:49.109449    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:49.110156 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:49.109759    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x5xzv" podUID="54e739ed-02ca-4f6a-82d8-bf2966672a28"
Sep 06 19:27:49.110156 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:49.109860    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cb2dz" podUID="0ace7f43-c761-489f-b523-b01650e632df"
Sep 06 19:27:49.110156 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:49.109924    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2kz7" podUID="9704ea38-52ce-4441-abd1-644d157c0285"
Sep 06 19:27:50.790876 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:50.790824    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs\") pod \"network-metrics-daemon-cb2dz\" (UID: \"0ace7f43-c761-489f-b523-b01650e632df\") " pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:50.791325 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:50.790889    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret\") pod \"global-pull-secret-syncer-x5xzv\" (UID: \"54e739ed-02ca-4f6a-82d8-bf2966672a28\") " pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:50.791325 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:50.790976    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:27:50.791325 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:50.791018    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 19:27:50.791325 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:50.791047    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs podName:0ace7f43-c761-489f-b523-b01650e632df nodeName:}" failed. No retries permitted until 2026-09-06 19:28:22.791030801 +0000 UTC m=+66.195989848 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs") pod "network-metrics-daemon-cb2dz" (UID: "0ace7f43-c761-489f-b523-b01650e632df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 19:27:50.791325 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:50.791079    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret podName:54e739ed-02ca-4f6a-82d8-bf2966672a28 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:22.791057745 +0000 UTC m=+66.196016793 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret") pod "global-pull-secret-syncer-x5xzv" (UID: "54e739ed-02ca-4f6a-82d8-bf2966672a28") : object "kube-system"/"original-pull-secret" not registered
Sep 06 19:27:50.882552 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:50.882509    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:27:50.891454 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:50.891427    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7gq7\" (UniqueName: \"kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7\") pod \"network-check-target-m2kz7\" (UID: \"9704ea38-52ce-4441-abd1-644d157c0285\") " pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:50.891587 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:50.891573    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 19:27:50.891625 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:50.891592    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 19:27:50.891625 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:50.891601    2568 projected.go:196] Error preparing data for projected volume kube-api-access-j7gq7 for pod openshift-network-diagnostics/network-check-target-m2kz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:27:50.891689 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:50.891650    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7 podName:9704ea38-52ce-4441-abd1-644d157c0285 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:22.891633051 +0000 UTC m=+66.296592098 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j7gq7" (UniqueName: "kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7") pod "network-check-target-m2kz7" (UID: "9704ea38-52ce-4441-abd1-644d157c0285") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 19:27:50.959202 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:50.959165    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:27:51.111851 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.111824    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:51.112006 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.111824    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:51.112006 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.111938    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:51.112006 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:51.111937    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2kz7" podUID="9704ea38-52ce-4441-abd1-644d157c0285"
Sep 06 19:27:51.112129 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:51.112042    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cb2dz" podUID="0ace7f43-c761-489f-b523-b01650e632df"
Sep 06 19:27:51.112129 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:51.112094    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x5xzv" podUID="54e739ed-02ca-4f6a-82d8-bf2966672a28"
Sep 06 19:27:51.266661 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.266626    2568 generic.go:356] "Generic (PLEG): container finished" podID="054ee4ba-941f-46c5-9ac3-0daa28ed1dad" containerID="c93118cff67212e0871fb41d3b66f4875e83cce6ca0401a8d0ab2654de8e7e1e" exitCode=0
Sep 06 19:27:51.266845 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.266688    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6h6w" event={"ID":"054ee4ba-941f-46c5-9ac3-0daa28ed1dad","Type":"ContainerDied","Data":"c93118cff67212e0871fb41d3b66f4875e83cce6ca0401a8d0ab2654de8e7e1e"}
Sep 06 19:27:51.378374 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.378338    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeReady"
Sep 06 19:27:51.378536 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.378476    2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 06 19:27:51.419514 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.419484    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j88s9"]
Sep 06 19:27:51.442492 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.442417    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-56494"]
Sep 06 19:27:51.442625 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.442556    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j88s9"
Sep 06 19:27:51.445330 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.445307    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 06 19:27:51.445474 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.445453    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 06 19:27:51.445561 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.445479    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 06 19:27:51.445561 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.445548    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8xksm\""
Sep 06 19:27:51.458501 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.458374    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j88s9"]
Sep 06 19:27:51.458501 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.458455    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-56494"
Sep 06 19:27:51.458501 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.458473    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-56494"]
Sep 06 19:27:51.461177 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.461148    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 06 19:27:51.461301 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.461184    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kglk6\""
Sep 06 19:27:51.461301 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.461149    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 06 19:27:51.536535 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.536492    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:27:51.597509 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.597470    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls\") pod \"dns-default-56494\" (UID: \"28ba1dda-1c3b-4df4-b791-d138a97959a4\") " pod="openshift-dns/dns-default-56494"
Sep 06 19:27:51.597696 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.597538    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28ba1dda-1c3b-4df4-b791-d138a97959a4-tmp-dir\") pod \"dns-default-56494\" (UID: \"28ba1dda-1c3b-4df4-b791-d138a97959a4\") " pod="openshift-dns/dns-default-56494"
Sep 06 19:27:51.597696 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.597593    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-892gf\" (UniqueName: \"kubernetes.io/projected/74bff902-740b-408e-9a44-55fbc457e249-kube-api-access-892gf\") pod \"ingress-canary-j88s9\" (UID: \"74bff902-740b-408e-9a44-55fbc457e249\") " pod="openshift-ingress-canary/ingress-canary-j88s9"
Sep 06 19:27:51.597696 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.597622    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/28ba1dda-1c3b-4df4-b791-d138a97959a4-config-volume\") pod \"dns-default-56494\" (UID: \"28ba1dda-1c3b-4df4-b791-d138a97959a4\") " pod="openshift-dns/dns-default-56494"
Sep 06 19:27:51.597696 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.597655    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xh49\" (UniqueName: \"kubernetes.io/projected/28ba1dda-1c3b-4df4-b791-d138a97959a4-kube-api-access-9xh49\") pod \"dns-default-56494\" (UID: \"28ba1dda-1c3b-4df4-b791-d138a97959a4\") " pod="openshift-dns/dns-default-56494"
Sep 06 19:27:51.597696 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.597674    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74bff902-740b-408e-9a44-55fbc457e249-cert\") pod \"ingress-canary-j88s9\" (UID: \"74bff902-740b-408e-9a44-55fbc457e249\") " pod="openshift-ingress-canary/ingress-canary-j88s9"
Sep 06 19:27:51.636914 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.636884    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:27:51.698657 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.698570    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls\") pod \"dns-default-56494\" (UID: \"28ba1dda-1c3b-4df4-b791-d138a97959a4\") " pod="openshift-dns/dns-default-56494"
Sep 06 19:27:51.698657 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.698628    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28ba1dda-1c3b-4df4-b791-d138a97959a4-tmp-dir\") pod \"dns-default-56494\" (UID: \"28ba1dda-1c3b-4df4-b791-d138a97959a4\") " pod="openshift-dns/dns-default-56494"
Sep 06 19:27:51.698886 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.698673    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-892gf\" (UniqueName: \"kubernetes.io/projected/74bff902-740b-408e-9a44-55fbc457e249-kube-api-access-892gf\") pod \"ingress-canary-j88s9\" (UID: \"74bff902-740b-408e-9a44-55fbc457e249\") " pod="openshift-ingress-canary/ingress-canary-j88s9"
Sep 06 19:27:51.698886 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.698704    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/28ba1dda-1c3b-4df4-b791-d138a97959a4-config-volume\") pod \"dns-default-56494\" (UID: \"28ba1dda-1c3b-4df4-b791-d138a97959a4\") " pod="openshift-dns/dns-default-56494"
Sep 06 19:27:51.698886 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.698729    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xh49\" (UniqueName: \"kubernetes.io/projected/28ba1dda-1c3b-4df4-b791-d138a97959a4-kube-api-access-9xh49\") pod \"dns-default-56494\" (UID: \"28ba1dda-1c3b-4df4-b791-d138a97959a4\") " pod="openshift-dns/dns-default-56494"
Sep 06 19:27:51.698886 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:51.698757    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 19:27:51.698886 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.698815    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74bff902-740b-408e-9a44-55fbc457e249-cert\") pod \"ingress-canary-j88s9\" (UID: \"74bff902-740b-408e-9a44-55fbc457e249\") " pod="openshift-ingress-canary/ingress-canary-j88s9"
Sep 06 19:27:51.698886 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:51.698868    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls podName:28ba1dda-1c3b-4df4-b791-d138a97959a4 nodeName:}" failed. No retries permitted until 2026-09-06 19:27:52.198846539 +0000 UTC m=+35.603805587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls") pod "dns-default-56494" (UID: "28ba1dda-1c3b-4df4-b791-d138a97959a4") : secret "dns-default-metrics-tls" not found
Sep 06 19:27:51.699146 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.699053    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28ba1dda-1c3b-4df4-b791-d138a97959a4-tmp-dir\") pod \"dns-default-56494\" (UID: \"28ba1dda-1c3b-4df4-b791-d138a97959a4\") " pod="openshift-dns/dns-default-56494"
Sep 06 19:27:51.699322 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.699304    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/28ba1dda-1c3b-4df4-b791-d138a97959a4-config-volume\") pod \"dns-default-56494\" (UID: \"28ba1dda-1c3b-4df4-b791-d138a97959a4\") " pod="openshift-dns/dns-default-56494"
Sep 06 19:27:51.703180 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.703158    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74bff902-740b-408e-9a44-55fbc457e249-cert\") pod \"ingress-canary-j88s9\" (UID: \"74bff902-740b-408e-9a44-55fbc457e249\") " pod="openshift-ingress-canary/ingress-canary-j88s9"
Sep 06 19:27:51.708861 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.708839    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xh49\" (UniqueName: \"kubernetes.io/projected/28ba1dda-1c3b-4df4-b791-d138a97959a4-kube-api-access-9xh49\") pod \"dns-default-56494\" (UID: \"28ba1dda-1c3b-4df4-b791-d138a97959a4\") " pod="openshift-dns/dns-default-56494"
Sep 06 19:27:51.709170 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.709139    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-892gf\" (UniqueName: \"kubernetes.io/projected/74bff902-740b-408e-9a44-55fbc457e249-kube-api-access-892gf\") pod \"ingress-canary-j88s9\" (UID: \"74bff902-740b-408e-9a44-55fbc457e249\") " pod="openshift-ingress-canary/ingress-canary-j88s9"
Sep 06 19:27:51.752098 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:51.752072    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j88s9"
Sep 06 19:27:52.064669 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:52.064445    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j88s9"]
Sep 06 19:27:52.068273 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:27:52.068242    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74bff902_740b_408e_9a44_55fbc457e249.slice/crio-0badd8396023133cbb39034becd011ffc6fa0d953e93817f8e9ee40be6ecee6b WatchSource:0}: Error finding container 0badd8396023133cbb39034becd011ffc6fa0d953e93817f8e9ee40be6ecee6b: Status 404 returned error can't find the container with id 0badd8396023133cbb39034becd011ffc6fa0d953e93817f8e9ee40be6ecee6b
Sep 06 19:27:52.202977 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:52.202936    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls\") pod \"dns-default-56494\" (UID: \"28ba1dda-1c3b-4df4-b791-d138a97959a4\") " pod="openshift-dns/dns-default-56494"
Sep 06 19:27:52.203164 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:52.203091    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 19:27:52.203164 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:52.203164    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls podName:28ba1dda-1c3b-4df4-b791-d138a97959a4 nodeName:}" failed. No retries permitted until 2026-09-06 19:27:53.203146028 +0000 UTC m=+36.608105075 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls") pod "dns-default-56494" (UID: "28ba1dda-1c3b-4df4-b791-d138a97959a4") : secret "dns-default-metrics-tls" not found
Sep 06 19:27:52.272227 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:52.272189    2568 generic.go:356] "Generic (PLEG): container finished" podID="054ee4ba-941f-46c5-9ac3-0daa28ed1dad" containerID="73496d950c9905d066af974eb42d3357fb1c63ead6628fa4b28721c243f0aa2c" exitCode=0
Sep 06 19:27:52.272384 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:52.272267    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6h6w" event={"ID":"054ee4ba-941f-46c5-9ac3-0daa28ed1dad","Type":"ContainerDied","Data":"73496d950c9905d066af974eb42d3357fb1c63ead6628fa4b28721c243f0aa2c"}
Sep 06 19:27:52.273485 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:52.273460    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j88s9" event={"ID":"74bff902-740b-408e-9a44-55fbc457e249","Type":"ContainerStarted","Data":"0badd8396023133cbb39034becd011ffc6fa0d953e93817f8e9ee40be6ecee6b"}
Sep 06 19:27:53.113483 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:53.113450    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:27:53.113943 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:53.113450    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:27:53.113943 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:53.113450    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:27:53.116404 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:53.116382    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 06 19:27:53.117587 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:53.117567    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9bdz9\""
Sep 06 19:27:53.117716 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:53.117606    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 06 19:27:53.117716 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:53.117669    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 06 19:27:53.117716 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:53.117567    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 06 19:27:53.117716 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:53.117668    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-26tb5\""
Sep 06 19:27:53.211751 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:53.211713    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls\") pod \"dns-default-56494\" (UID: \"28ba1dda-1c3b-4df4-b791-d138a97959a4\") " pod="openshift-dns/dns-default-56494"
Sep 06 19:27:53.211962 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:53.211889    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 19:27:53.212021 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:53.211974    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls podName:28ba1dda-1c3b-4df4-b791-d138a97959a4 nodeName:}" failed. No retries permitted until 2026-09-06 19:27:55.211958306 +0000 UTC m=+38.616917352 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls") pod "dns-default-56494" (UID: "28ba1dda-1c3b-4df4-b791-d138a97959a4") : secret "dns-default-metrics-tls" not found
Sep 06 19:27:53.280898 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:53.280856    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6h6w" event={"ID":"054ee4ba-941f-46c5-9ac3-0daa28ed1dad","Type":"ContainerStarted","Data":"81055b2941752db1e96030fb89874c949661b1de655ec2169012742411f59bd0"}
Sep 06 19:27:53.300789 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:53.300707    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-t6h6w" podStartSLOduration=8.053629076 podStartE2EDuration="36.300686598s" totalImagesPullingTime="28.247057522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:27:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:27:53.298844446 +0000 UTC m=+36.703803516" watchObservedRunningTime="2026-09-06 19:27:53.300686598 +0000 UTC m=+36.705645666"
Sep 06 19:27:53.418372 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:53.418335    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:27:53.467910 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:53.467867    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:27:54.282309 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:54.282275    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:27:54.332003 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:54.331968    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:27:55.227151 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:55.227106    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls\") pod \"dns-default-56494\" (UID: \"28ba1dda-1c3b-4df4-b791-d138a97959a4\") " pod="openshift-dns/dns-default-56494"
Sep 06 19:27:55.227315 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:55.227262    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 19:27:55.227367 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:55.227329    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls podName:28ba1dda-1c3b-4df4-b791-d138a97959a4 nodeName:}" failed. No retries permitted until 2026-09-06 19:27:59.227313863 +0000 UTC m=+42.632272910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls") pod "dns-default-56494" (UID: "28ba1dda-1c3b-4df4-b791-d138a97959a4") : secret "dns-default-metrics-tls" not found
Sep 06 19:27:55.287310 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:55.287279    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j88s9" event={"ID":"74bff902-740b-408e-9a44-55fbc457e249","Type":"ContainerStarted","Data":"2b64fad8be9e2d37db75c180c9d3db2ae28443f7238707830841e730ac76d4da"}
Sep 06 19:27:55.303344 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:55.303294    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j88s9" podStartSLOduration=1.830663859 podStartE2EDuration="4.303277534s" totalImagesPullingTime="2.472613675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:27:55.302182013 +0000 UTC m=+38.707141081" watchObservedRunningTime="2026-09-06 19:27:55.303277534 +0000 UTC m=+38.708236601"
Sep 06 19:27:56.279014 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:56.278981    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:27:56.331014 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:56.330979    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:27:56.792565 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:56.792326    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:27:56.843844 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:56.843805    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:27:59.259096 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:27:59.259052    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls\") pod \"dns-default-56494\" (UID: \"28ba1dda-1c3b-4df4-b791-d138a97959a4\") " pod="openshift-dns/dns-default-56494"
Sep 06 19:27:59.259458 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:59.259194    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 19:27:59.259458 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:27:59.259253    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls podName:28ba1dda-1c3b-4df4-b791-d138a97959a4 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:07.259238282 +0000 UTC m=+50.664197328 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls") pod "dns-default-56494" (UID: "28ba1dda-1c3b-4df4-b791-d138a97959a4") : secret "dns-default-metrics-tls" not found
Sep 06 19:28:00.021276 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:00.021230    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:00.088070 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:00.088033    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:00.184791 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:00.184740    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:00.236266 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:00.236236    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:01.086107 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:01.086078    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:01.136569 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:01.136539    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:03.026241 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:03.026190    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:04.011269 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:04.011223    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:04.058195 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:04.058162    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:07.314160 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:07.314111    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls\") pod \"dns-default-56494\" (UID: \"28ba1dda-1c3b-4df4-b791-d138a97959a4\") " pod="openshift-dns/dns-default-56494"
Sep 06 19:28:07.314619 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:07.314251    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 19:28:07.314619 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:07.314307    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls podName:28ba1dda-1c3b-4df4-b791-d138a97959a4 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:23.314292786 +0000 UTC m=+66.719251832 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls") pod "dns-default-56494" (UID: "28ba1dda-1c3b-4df4-b791-d138a97959a4") : secret "dns-default-metrics-tls" not found
Sep 06 19:28:12.159556 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:12.159523    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:12.209939 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:12.209909    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:14.165916 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:14.165882    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:14.215400 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:14.215335    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:17.056429 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:17.056397    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:17.258706 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:17.258667    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:17.264287 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:17.264263    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gfqzm"
Sep 06 19:28:17.359846 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:17.359742    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:17.460709 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:17.460678    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:17.526414 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:17.526378    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:21.303220 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.303182    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-zzvsc"]
Sep 06 19:28:21.329693 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.329658    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-zzvsc"]
Sep 06 19:28:21.329871 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.329762    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-zzvsc"
Sep 06 19:28:21.332348 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.332327    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 06 19:28:21.332495 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.332410    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8xdfd\""
Sep 06 19:28:21.333288 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.333267    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 06 19:28:21.401708 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.401667    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkqd6\" (UniqueName: \"kubernetes.io/projected/8028b46f-2528-461f-9953-160fd19dbbae-kube-api-access-lkqd6\") pod \"volume-data-source-validator-695c895bd6-zzvsc\" (UID: \"8028b46f-2528-461f-9953-160fd19dbbae\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-zzvsc"
Sep 06 19:28:21.409443 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.409373    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-277g4"]
Sep 06 19:28:21.418887 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.418851    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-277g4"
Sep 06 19:28:21.419430 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.419410    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-277g4"]
Sep 06 19:28:21.421425 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.421401    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 06 19:28:21.421885 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.421854    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 06 19:28:21.421885 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.421869    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-s2mb9\""
Sep 06 19:28:21.422037 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.421901    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 06 19:28:21.422037 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.422009    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 06 19:28:21.502330 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.502289    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpb7g\" (UniqueName: \"kubernetes.io/projected/5865d485-e5a8-415b-92df-9651566354e9-kube-api-access-jpb7g\") pod \"service-ca-operator-859f94c4b-277g4\" (UID: \"5865d485-e5a8-415b-92df-9651566354e9\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-277g4"
Sep 06 19:28:21.502663 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.502472    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkqd6\" (UniqueName: \"kubernetes.io/projected/8028b46f-2528-461f-9953-160fd19dbbae-kube-api-access-lkqd6\") pod \"volume-data-source-validator-695c895bd6-zzvsc\" (UID: \"8028b46f-2528-461f-9953-160fd19dbbae\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-zzvsc"
Sep 06 19:28:21.502663 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.502544    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5865d485-e5a8-415b-92df-9651566354e9-config\") pod \"service-ca-operator-859f94c4b-277g4\" (UID: \"5865d485-e5a8-415b-92df-9651566354e9\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-277g4"
Sep 06 19:28:21.502663 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.502582    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5865d485-e5a8-415b-92df-9651566354e9-serving-cert\") pod \"service-ca-operator-859f94c4b-277g4\" (UID: \"5865d485-e5a8-415b-92df-9651566354e9\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-277g4"
Sep 06 19:28:21.507276 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.507251    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-r9x9b"]
Sep 06 19:28:21.521240 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.521218    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkqd6\" (UniqueName: \"kubernetes.io/projected/8028b46f-2528-461f-9953-160fd19dbbae-kube-api-access-lkqd6\") pod \"volume-data-source-validator-695c895bd6-zzvsc\" (UID: \"8028b46f-2528-461f-9953-160fd19dbbae\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-zzvsc"
Sep 06 19:28:21.521449 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.521432    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76594964b-r2b8l"]
Sep 06 19:28:21.521547 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.521535    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-r9x9b"
Sep 06 19:28:21.526193 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.526170    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 06 19:28:21.526496 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.526250    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 06 19:28:21.526496 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.526375    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 06 19:28:21.526496 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.526263    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 06 19:28:21.526673 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.526304    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nd5n8\""
Sep 06 19:28:21.541679 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.541648    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-r9x9b"]
Sep 06 19:28:21.541855 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.541689    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76594964b-r2b8l"]
Sep 06 19:28:21.541855 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.541764    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.544367 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.544346    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 06 19:28:21.544691 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.544678    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 06 19:28:21.544893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.544880    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sn49m\""
Sep 06 19:28:21.544995 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.544913    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 06 19:28:21.550947 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.550919    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 06 19:28:21.603651 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.603560    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5865d485-e5a8-415b-92df-9651566354e9-serving-cert\") pod \"service-ca-operator-859f94c4b-277g4\" (UID: \"5865d485-e5a8-415b-92df-9651566354e9\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-277g4"
Sep 06 19:28:21.603651 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.603594    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-r9x9b\" (UID: \"51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-r9x9b"
Sep 06 19:28:21.603651 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.603612    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-tls\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.603651 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.603636    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c31deca-9cbc-4806-9a33-d7dffdb06af2-ca-trust-extracted\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.604047 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.603659    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpb7g\" (UniqueName: \"kubernetes.io/projected/5865d485-e5a8-415b-92df-9651566354e9-kube-api-access-jpb7g\") pod \"service-ca-operator-859f94c4b-277g4\" (UID: \"5865d485-e5a8-415b-92df-9651566354e9\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-277g4"
Sep 06 19:28:21.604047 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.603674    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-bound-sa-token\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.604047 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.603853    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c31deca-9cbc-4806-9a33-d7dffdb06af2-installation-pull-secrets\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.604047 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.603917    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6whd7\" (UniqueName: \"kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-kube-api-access-6whd7\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.604047 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.603963    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-r9x9b\" (UID: \"51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-r9x9b"
Sep 06 19:28:21.604047 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.603995    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c31deca-9cbc-4806-9a33-d7dffdb06af2-image-registry-private-configuration\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.604047 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.604022    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5865d485-e5a8-415b-92df-9651566354e9-config\") pod \"service-ca-operator-859f94c4b-277g4\" (UID: \"5865d485-e5a8-415b-92df-9651566354e9\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-277g4"
Sep 06 19:28:21.604308 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.604056    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psbz2\" (UniqueName: \"kubernetes.io/projected/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-kube-api-access-psbz2\") pod \"cluster-monitoring-operator-6cdcc96965-r9x9b\" (UID: \"51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-r9x9b"
Sep 06 19:28:21.604308 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.604084    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c31deca-9cbc-4806-9a33-d7dffdb06af2-trusted-ca\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.604308 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.604105    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-certificates\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.604450 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.604434    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5865d485-e5a8-415b-92df-9651566354e9-config\") pod \"service-ca-operator-859f94c4b-277g4\" (UID: \"5865d485-e5a8-415b-92df-9651566354e9\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-277g4"
Sep 06 19:28:21.606050 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.606024    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5865d485-e5a8-415b-92df-9651566354e9-serving-cert\") pod \"service-ca-operator-859f94c4b-277g4\" (UID: \"5865d485-e5a8-415b-92df-9651566354e9\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-277g4"
Sep 06 19:28:21.614387 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.614363    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpb7g\" (UniqueName: \"kubernetes.io/projected/5865d485-e5a8-415b-92df-9651566354e9-kube-api-access-jpb7g\") pod \"service-ca-operator-859f94c4b-277g4\" (UID: \"5865d485-e5a8-415b-92df-9651566354e9\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-277g4"
Sep 06 19:28:21.638600 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.638561    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-zzvsc"
Sep 06 19:28:21.655116 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.655075    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:21.705148 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.705117    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-r9x9b\" (UID: \"51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-r9x9b"
Sep 06 19:28:21.705323 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.705147    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c31deca-9cbc-4806-9a33-d7dffdb06af2-image-registry-private-configuration\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.705371 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.705330    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psbz2\" (UniqueName: \"kubernetes.io/projected/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-kube-api-access-psbz2\") pod \"cluster-monitoring-operator-6cdcc96965-r9x9b\" (UID: \"51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-r9x9b"
Sep 06 19:28:21.705419 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.705367    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c31deca-9cbc-4806-9a33-d7dffdb06af2-trusted-ca\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.705419 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.705405    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-certificates\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.705516 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.705445    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-r9x9b\" (UID: \"51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-r9x9b"
Sep 06 19:28:21.705516 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.705469    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-tls\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.705516 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.705503    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c31deca-9cbc-4806-9a33-d7dffdb06af2-ca-trust-extracted\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.705678 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.705538    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-bound-sa-token\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.705678 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.705588    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c31deca-9cbc-4806-9a33-d7dffdb06af2-installation-pull-secrets\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.705678 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.705633    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6whd7\" (UniqueName: \"kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-kube-api-access-6whd7\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.705678 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:21.705659    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 19:28:21.705880 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:21.705737    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-cluster-monitoring-operator-tls podName:51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:22.205716994 +0000 UTC m=+65.610676062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-r9x9b" (UID: "51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808") : secret "cluster-monitoring-operator-tls" not found
Sep 06 19:28:21.706015 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.705983    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-r9x9b\" (UID: \"51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-r9x9b"
Sep 06 19:28:21.706095 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:21.705995    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 19:28:21.706095 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:21.706047    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76594964b-r2b8l: secret "image-registry-tls" not found
Sep 06 19:28:21.706196 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:21.706110    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-tls podName:2c31deca-9cbc-4806-9a33-d7dffdb06af2 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:22.206092832 +0000 UTC m=+65.611051883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-tls") pod "image-registry-76594964b-r2b8l" (UID: "2c31deca-9cbc-4806-9a33-d7dffdb06af2") : secret "image-registry-tls" not found
Sep 06 19:28:21.706967 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.706598    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c31deca-9cbc-4806-9a33-d7dffdb06af2-ca-trust-extracted\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.706967 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.706610    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c31deca-9cbc-4806-9a33-d7dffdb06af2-trusted-ca\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.707121 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.707066    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-certificates\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.708771 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.708755    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c31deca-9cbc-4806-9a33-d7dffdb06af2-installation-pull-secrets\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.709245 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.709194    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c31deca-9cbc-4806-9a33-d7dffdb06af2-image-registry-private-configuration\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.709352 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.709232    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:21.715075 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.715049    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-bound-sa-token\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.715367 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.715339    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6whd7\" (UniqueName: \"kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-kube-api-access-6whd7\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:21.716236 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.716217    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psbz2\" (UniqueName: \"kubernetes.io/projected/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-kube-api-access-psbz2\") pod \"cluster-monitoring-operator-6cdcc96965-r9x9b\" (UID: \"51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-r9x9b"
Sep 06 19:28:21.728374 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.728186    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-277g4"
Sep 06 19:28:21.809718 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.809689    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:21.929740 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:21.929707    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-zzvsc"]
Sep 06 19:28:21.933968 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:28:21.933942    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8028b46f_2528_461f_9953_160fd19dbbae.slice/crio-3ec44d0310b2aa7418b4b2a9e466a279f3de20808c3ed83720e07623afbd8ecb WatchSource:0}: Error finding container 3ec44d0310b2aa7418b4b2a9e466a279f3de20808c3ed83720e07623afbd8ecb: Status 404 returned error can't find the container with id 3ec44d0310b2aa7418b4b2a9e466a279f3de20808c3ed83720e07623afbd8ecb
Sep 06 19:28:22.025222 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:22.025191    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-277g4"]
Sep 06 19:28:22.028211 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:28:22.028186    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5865d485_e5a8_415b_92df_9651566354e9.slice/crio-005fffd2cc3ec647653892d929e53aa5201241a1c13d07be61815b17135635ef WatchSource:0}: Error finding container 005fffd2cc3ec647653892d929e53aa5201241a1c13d07be61815b17135635ef: Status 404 returned error can't find the container with id 005fffd2cc3ec647653892d929e53aa5201241a1c13d07be61815b17135635ef
Sep 06 19:28:22.210608 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:22.210511    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-r9x9b\" (UID: \"51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-r9x9b"
Sep 06 19:28:22.210608 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:22.210551    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-tls\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:22.210814 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:22.210656    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 19:28:22.210814 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:22.210658    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 19:28:22.210814 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:22.210667    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76594964b-r2b8l: secret "image-registry-tls" not found
Sep 06 19:28:22.210814 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:22.210721    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-tls podName:2c31deca-9cbc-4806-9a33-d7dffdb06af2 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:23.210707761 +0000 UTC m=+66.615666808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-tls") pod "image-registry-76594964b-r2b8l" (UID: "2c31deca-9cbc-4806-9a33-d7dffdb06af2") : secret "image-registry-tls" not found
Sep 06 19:28:22.210814 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:22.210734    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-cluster-monitoring-operator-tls podName:51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:23.210728127 +0000 UTC m=+66.615687174 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-r9x9b" (UID: "51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808") : secret "cluster-monitoring-operator-tls" not found
Sep 06 19:28:22.353124 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:22.353077    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-277g4" event={"ID":"5865d485-e5a8-415b-92df-9651566354e9","Type":"ContainerStarted","Data":"005fffd2cc3ec647653892d929e53aa5201241a1c13d07be61815b17135635ef"}
Sep 06 19:28:22.354261 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:22.354238    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-zzvsc" event={"ID":"8028b46f-2528-461f-9953-160fd19dbbae","Type":"ContainerStarted","Data":"3ec44d0310b2aa7418b4b2a9e466a279f3de20808c3ed83720e07623afbd8ecb"}
Sep 06 19:28:22.816432 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:22.816389    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs\") pod \"network-metrics-daemon-cb2dz\" (UID: \"0ace7f43-c761-489f-b523-b01650e632df\") " pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:28:22.816432 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:22.816440    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret\") pod \"global-pull-secret-syncer-x5xzv\" (UID: \"54e739ed-02ca-4f6a-82d8-bf2966672a28\") " pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:28:22.819031 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:22.818999    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 06 19:28:22.819182 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:22.819064    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 06 19:28:22.827330 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:22.827302    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 06 19:28:22.827483 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:22.827392    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs podName:0ace7f43-c761-489f-b523-b01650e632df nodeName:}" failed. No retries permitted until 2026-09-06 19:29:26.827369401 +0000 UTC m=+130.232328466 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs") pod "network-metrics-daemon-cb2dz" (UID: "0ace7f43-c761-489f-b523-b01650e632df") : secret "metrics-daemon-secret" not found
Sep 06 19:28:22.830264 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:22.830229    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54e739ed-02ca-4f6a-82d8-bf2966672a28-original-pull-secret\") pod \"global-pull-secret-syncer-x5xzv\" (UID: \"54e739ed-02ca-4f6a-82d8-bf2966672a28\") " pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:28:22.917893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:22.917861    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7gq7\" (UniqueName: \"kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7\") pod \"network-check-target-m2kz7\" (UID: \"9704ea38-52ce-4441-abd1-644d157c0285\") " pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:28:22.920520 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:22.920490    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 06 19:28:22.930623 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:22.930593    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 06 19:28:22.947074 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:22.947046    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7gq7\" (UniqueName: \"kubernetes.io/projected/9704ea38-52ce-4441-abd1-644d157c0285-kube-api-access-j7gq7\") pod \"network-check-target-m2kz7\" (UID: \"9704ea38-52ce-4441-abd1-644d157c0285\") " pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:28:23.126060 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:23.126022    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x5xzv"
Sep 06 19:28:23.142095 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:23.142067    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-26tb5\""
Sep 06 19:28:23.150167 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:23.150110    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:28:23.221183 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:23.221096    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-r9x9b\" (UID: \"51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-r9x9b"
Sep 06 19:28:23.221183 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:23.221140    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-tls\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:23.221341 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:23.221312    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 19:28:23.221341 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:23.221324    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76594964b-r2b8l: secret "image-registry-tls" not found
Sep 06 19:28:23.221403 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:23.221367    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-tls podName:2c31deca-9cbc-4806-9a33-d7dffdb06af2 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:25.221355127 +0000 UTC m=+68.626314187 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-tls") pod "image-registry-76594964b-r2b8l" (UID: "2c31deca-9cbc-4806-9a33-d7dffdb06af2") : secret "image-registry-tls" not found
Sep 06 19:28:23.221616 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:23.221536    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 19:28:23.221616 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:23.221587    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-cluster-monitoring-operator-tls podName:51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:25.221574778 +0000 UTC m=+68.626533829 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-r9x9b" (UID: "51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808") : secret "cluster-monitoring-operator-tls" not found
Sep 06 19:28:23.321797 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:23.321741    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls\") pod \"dns-default-56494\" (UID: \"28ba1dda-1c3b-4df4-b791-d138a97959a4\") " pod="openshift-dns/dns-default-56494"
Sep 06 19:28:23.322173 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:23.321919    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 19:28:23.322173 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:23.321998    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls podName:28ba1dda-1c3b-4df4-b791-d138a97959a4 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:55.32197894 +0000 UTC m=+98.726938014 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls") pod "dns-default-56494" (UID: "28ba1dda-1c3b-4df4-b791-d138a97959a4") : secret "dns-default-metrics-tls" not found
Sep 06 19:28:23.359665 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:23.359623    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-zzvsc" event={"ID":"8028b46f-2528-461f-9953-160fd19dbbae","Type":"ContainerStarted","Data":"c1c4408e205fa557bc4b782ef2856e9839699095a61464047e3dbbd21f19eac5"}
Sep 06 19:28:23.373062 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:23.373008    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-zzvsc" podStartSLOduration=1.14208143 podStartE2EDuration="2.372990095s" totalImagesPullingTime="1.230908665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:28:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:28:23.372705012 +0000 UTC m=+66.777664081" watchObservedRunningTime="2026-09-06 19:28:23.372990095 +0000 UTC m=+66.777949210"
Sep 06 19:28:23.418036 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:23.417966    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x5xzv"]
Sep 06 19:28:23.421633 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:28:23.421603    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e739ed_02ca_4f6a_82d8_bf2966672a28.slice/crio-aeadb178b3c63e1c385285c1b81b722118a35cf651d84c16952b1b96dc6b3d0f WatchSource:0}: Error finding container aeadb178b3c63e1c385285c1b81b722118a35cf651d84c16952b1b96dc6b3d0f: Status 404 returned error can't find the container with id aeadb178b3c63e1c385285c1b81b722118a35cf651d84c16952b1b96dc6b3d0f
Sep 06 19:28:23.444348 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:23.444315    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m2kz7"]
Sep 06 19:28:23.445444 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:23.445418    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:23.448458 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:28:23.448430    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9704ea38_52ce_4441_abd1_644d157c0285.slice/crio-bfa8b456d3b7e44fc967f84a1f221316818cb37d2653806507d85990f88aa9ae WatchSource:0}: Error finding container bfa8b456d3b7e44fc967f84a1f221316818cb37d2653806507d85990f88aa9ae: Status 404 returned error can't find the container with id bfa8b456d3b7e44fc967f84a1f221316818cb37d2653806507d85990f88aa9ae
Sep 06 19:28:23.547582 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:23.547497    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:24.364214 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:24.364176    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m2kz7" event={"ID":"9704ea38-52ce-4441-abd1-644d157c0285","Type":"ContainerStarted","Data":"bfa8b456d3b7e44fc967f84a1f221316818cb37d2653806507d85990f88aa9ae"}
Sep 06 19:28:24.366309 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:24.366279    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x5xzv" event={"ID":"54e739ed-02ca-4f6a-82d8-bf2966672a28","Type":"ContainerStarted","Data":"aeadb178b3c63e1c385285c1b81b722118a35cf651d84c16952b1b96dc6b3d0f"}
Sep 06 19:28:25.238120 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:25.237946    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-r9x9b\" (UID: \"51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-r9x9b"
Sep 06 19:28:25.238120 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:25.238005    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-tls\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:25.238120 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:25.238112    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 19:28:25.238421 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:25.238164    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 19:28:25.238421 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:25.238181    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76594964b-r2b8l: secret "image-registry-tls" not found
Sep 06 19:28:25.238421 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:25.238210    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-cluster-monitoring-operator-tls podName:51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:29.238190402 +0000 UTC m=+72.643149466 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-r9x9b" (UID: "51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808") : secret "cluster-monitoring-operator-tls" not found
Sep 06 19:28:25.238421 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:25.238228    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-tls podName:2c31deca-9cbc-4806-9a33-d7dffdb06af2 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:29.238218822 +0000 UTC m=+72.643177869 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-tls") pod "image-registry-76594964b-r2b8l" (UID: "2c31deca-9cbc-4806-9a33-d7dffdb06af2") : secret "image-registry-tls" not found
Sep 06 19:28:25.372801 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:25.372081    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-277g4" event={"ID":"5865d485-e5a8-415b-92df-9651566354e9","Type":"ContainerStarted","Data":"dc57fced1a509b8408988c793257ac361a56bfc058ac56020c12329c3122acf7"}
Sep 06 19:28:25.387883 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:25.387821    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-277g4" podStartSLOduration=2.100649006 podStartE2EDuration="4.387805322s" totalImagesPullingTime="2.287156316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:28:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:28:25.386661733 +0000 UTC m=+68.791620803" watchObservedRunningTime="2026-09-06 19:28:25.387805322 +0000 UTC m=+68.792764390"
Sep 06 19:28:26.270493 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:26.270439    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:26.324394 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:26.324350    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:26.515397 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:26.515347    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:26.614061 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:26.613959    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:26.981888 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:26.981830    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:27.086588 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.086551    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:27.316500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.316418    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6cz9v"]
Sep 06 19:28:27.319691 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.319668    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:27.322483 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.322294    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 06 19:28:27.323457 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.323438    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 06 19:28:27.323457 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.323444    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 06 19:28:27.323457 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.323465    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 06 19:28:27.323654 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.323501    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8jvvj\""
Sep 06 19:28:27.331359 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.331313    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6cz9v"]
Sep 06 19:28:27.331908 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.331870    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:27.356894 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.356856    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-data-volume\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:27.356894 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.356899    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-crio-socket\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:27.357167 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.356938    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:27.357167 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.356955    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:27.357167 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.357079    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wrxr\" (UniqueName: \"kubernetes.io/projected/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-kube-api-access-9wrxr\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:27.458018 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.457978    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-data-volume\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:27.458018 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.458026    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-crio-socket\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:27.458270 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.458064    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:27.458270 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.458090    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:27.458270 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.458165    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wrxr\" (UniqueName: \"kubernetes.io/projected/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-kube-api-access-9wrxr\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:27.458270 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.458184    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-crio-socket\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:27.458270 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:27.458223    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 19:28:27.458532 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:27.458283    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 19:28:27.458532 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:27.458310    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-kube-rbac-proxy-cm podName:e040aebf-fab1-43a7-b979-e59c8f9ec6a6 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:27.958289333 +0000 UTC m=+71.363248397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6cz9v" (UID: "e040aebf-fab1-43a7-b979-e59c8f9ec6a6") : configmap "kube-rbac-proxy" not found
Sep 06 19:28:27.458532 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:27.458339    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-insights-runtime-extractor-tls podName:e040aebf-fab1-43a7-b979-e59c8f9ec6a6 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:27.958324275 +0000 UTC m=+71.363283337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6cz9v" (UID: "e040aebf-fab1-43a7-b979-e59c8f9ec6a6") : secret "insights-runtime-extractor-tls" not found
Sep 06 19:28:27.458532 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.458373    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-data-volume\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:27.466570 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.466541    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wrxr\" (UniqueName: \"kubernetes.io/projected/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-kube-api-access-9wrxr\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:27.719225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.719186    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:27.747994 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.747960    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5nnhh"]
Sep 06 19:28:27.751345 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.751322    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5nnhh"
Sep 06 19:28:27.754002 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.753977    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6lpsc\""
Sep 06 19:28:27.754132 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.754071    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 06 19:28:27.754132 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.754110    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 06 19:28:27.761220 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.761190    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5nnhh"]
Sep 06 19:28:27.791262 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.791199    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:27.843839 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.843807    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:27.862251 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.862183    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kr2t\" (UniqueName: \"kubernetes.io/projected/76572444-9723-40e9-b1fc-19f1f2687538-kube-api-access-5kr2t\") pod \"migrator-fdbb8fdff-5nnhh\" (UID: \"76572444-9723-40e9-b1fc-19f1f2687538\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5nnhh"
Sep 06 19:28:27.962878 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.962840    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:27.963071 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.962892    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:27.963071 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.962961    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kr2t\" (UniqueName: \"kubernetes.io/projected/76572444-9723-40e9-b1fc-19f1f2687538-kube-api-access-5kr2t\") pod \"migrator-fdbb8fdff-5nnhh\" (UID: \"76572444-9723-40e9-b1fc-19f1f2687538\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5nnhh"
Sep 06 19:28:27.963071 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:27.962975    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 19:28:27.963071 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:27.963052    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-kube-rbac-proxy-cm podName:e040aebf-fab1-43a7-b979-e59c8f9ec6a6 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:28.963032081 +0000 UTC m=+72.367991155 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6cz9v" (UID: "e040aebf-fab1-43a7-b979-e59c8f9ec6a6") : configmap "kube-rbac-proxy" not found
Sep 06 19:28:27.963293 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:27.963077    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 19:28:27.963293 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:27.963128    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-insights-runtime-extractor-tls podName:e040aebf-fab1-43a7-b979-e59c8f9ec6a6 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:28.963117361 +0000 UTC m=+72.368076420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6cz9v" (UID: "e040aebf-fab1-43a7-b979-e59c8f9ec6a6") : secret "insights-runtime-extractor-tls" not found
Sep 06 19:28:27.971310 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:27.971238    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kr2t\" (UniqueName: \"kubernetes.io/projected/76572444-9723-40e9-b1fc-19f1f2687538-kube-api-access-5kr2t\") pod \"migrator-fdbb8fdff-5nnhh\" (UID: \"76572444-9723-40e9-b1fc-19f1f2687538\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5nnhh"
Sep 06 19:28:28.063193 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:28.063148    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5nnhh"
Sep 06 19:28:28.680065 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:28.679964    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:28.706284 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:28.706253    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5nnhh"]
Sep 06 19:28:28.780614 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:28.780569    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:28.973527 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:28.973418    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:28.973527 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:28.973470    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:28.973723 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:28.973550    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 19:28:28.973723 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:28.973612    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-kube-rbac-proxy-cm podName:e040aebf-fab1-43a7-b979-e59c8f9ec6a6 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:30.973597839 +0000 UTC m=+74.378556889 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6cz9v" (UID: "e040aebf-fab1-43a7-b979-e59c8f9ec6a6") : configmap "kube-rbac-proxy" not found
Sep 06 19:28:28.973723 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:28.973703    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 19:28:28.973874 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:28.973760    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-insights-runtime-extractor-tls podName:e040aebf-fab1-43a7-b979-e59c8f9ec6a6 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:30.973746037 +0000 UTC m=+74.378705083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6cz9v" (UID: "e040aebf-fab1-43a7-b979-e59c8f9ec6a6") : secret "insights-runtime-extractor-tls" not found
Sep 06 19:28:29.276991 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:29.276894    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-r9x9b\" (UID: \"51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-r9x9b"
Sep 06 19:28:29.276991 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:29.276947    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-tls\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:29.277222 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:29.277076    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 19:28:29.277222 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:29.277092    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 19:28:29.277222 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:29.277182    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-cluster-monitoring-operator-tls podName:51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:37.277160914 +0000 UTC m=+80.682119966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-r9x9b" (UID: "51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808") : secret "cluster-monitoring-operator-tls" not found
Sep 06 19:28:29.277222 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:29.277190    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76594964b-r2b8l: secret "image-registry-tls" not found
Sep 06 19:28:29.277405 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:29.277244    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-tls podName:2c31deca-9cbc-4806-9a33-d7dffdb06af2 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:37.277227737 +0000 UTC m=+80.682186785 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-tls") pod "image-registry-76594964b-r2b8l" (UID: "2c31deca-9cbc-4806-9a33-d7dffdb06af2") : secret "image-registry-tls" not found
Sep 06 19:28:29.384541 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:29.384499    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m2kz7" event={"ID":"9704ea38-52ce-4441-abd1-644d157c0285","Type":"ContainerStarted","Data":"83acbb5f9e5d1117a936a5e75689da5d8d67af83f2df3435c687b9e873cb0c19"}
Sep 06 19:28:29.384703 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:29.384628    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:28:29.386263 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:29.386221    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5nnhh" event={"ID":"76572444-9723-40e9-b1fc-19f1f2687538","Type":"ContainerStarted","Data":"b9f93a7494b0ade2fc8cbefa3d34fcd026edc2137bca8297515f76197b8b53f9"}
Sep 06 19:28:29.387914 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:29.387887    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x5xzv" event={"ID":"54e739ed-02ca-4f6a-82d8-bf2966672a28","Type":"ContainerStarted","Data":"c59d3e832e63ab9cab26262ea31afa201861e0dc68d80bd85e8c80e66bcda944"}
Sep 06 19:28:29.398451 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:29.398391    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m2kz7" podStartSLOduration=67.428159557 podStartE2EDuration="1m12.398371362s" totalImagesPullingTime="4.970211805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:27:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:28:29.398280032 +0000 UTC m=+72.803239099" watchObservedRunningTime="2026-09-06 19:28:29.398371362 +0000 UTC m=+72.803330431"
Sep 06 19:28:29.414516 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:29.414302    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x5xzv" podStartSLOduration=67.406457141 podStartE2EDuration="1m12.41428195s" totalImagesPullingTime="5.007824809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:27:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:28:29.414000531 +0000 UTC m=+72.818959600" watchObservedRunningTime="2026-09-06 19:28:29.41428195 +0000 UTC m=+72.819241018"
Sep 06 19:28:29.449574 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:29.449536    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:29.489335 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:29.489303    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z2s8x_becacc1b-0eeb-4404-908e-585e7edaa25b/dns-node-resolver/0.log"
Sep 06 19:28:30.088860 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:30.088767    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4mk76_36bfe5b6-eb77-43e5-952f-f69db221e46a/node-ca/0.log"
Sep 06 19:28:30.393160 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:30.393128    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5nnhh" event={"ID":"76572444-9723-40e9-b1fc-19f1f2687538","Type":"ContainerStarted","Data":"3712bb162b8763d26d70685fad0384dfadc434f5ebe62b7e6e29c7dff3945c9e"}
Sep 06 19:28:30.393330 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:30.393203    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5nnhh" event={"ID":"76572444-9723-40e9-b1fc-19f1f2687538","Type":"ContainerStarted","Data":"968333ed1b0dc5b12ff75fbebb1f447fcbb60667417f7efff4d3d6b7e2c2a567"}
Sep 06 19:28:30.408419 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:30.408365    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5nnhh" podStartSLOduration=2.306296236 podStartE2EDuration="3.40834984s" totalImagesPullingTime="1.102053604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:28:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:28:30.407349731 +0000 UTC m=+73.812308801" watchObservedRunningTime="2026-09-06 19:28:30.40834984 +0000 UTC m=+73.813308937"
Sep 06 19:28:30.889340 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:30.889297    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j88s9_74bff902-740b-408e-9a44-55fbc457e249/serve-healthcheck-canary/0.log"
Sep 06 19:28:30.993118 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:30.993072    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:30.993118 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:30.993122    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:30.993303 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:30.993205    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 19:28:30.993303 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:30.993270    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 19:28:30.993303 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:30.993280    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-kube-rbac-proxy-cm podName:e040aebf-fab1-43a7-b979-e59c8f9ec6a6 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:34.99326331 +0000 UTC m=+78.398222357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6cz9v" (UID: "e040aebf-fab1-43a7-b979-e59c8f9ec6a6") : configmap "kube-rbac-proxy" not found
Sep 06 19:28:30.993402 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:30.993310    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-insights-runtime-extractor-tls podName:e040aebf-fab1-43a7-b979-e59c8f9ec6a6 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:34.993300068 +0000 UTC m=+78.398259115 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6cz9v" (UID: "e040aebf-fab1-43a7-b979-e59c8f9ec6a6") : secret "insights-runtime-extractor-tls" not found
Sep 06 19:28:31.954391 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:31.954348    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:32.463817 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:32.463763    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:32.662261 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:32.662227    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:32.760364 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:32.760266    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:32.861043 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:32.861008    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:32.969418 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:32.969378    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:33.357629 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:33.357588    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:33.757450 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:33.757070    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:34.557929 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:34.557881    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:34.761680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:34.761646    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:34.957373 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:34.957339    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:35.021212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:35.021174    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:35.021212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:35.021214    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:35.021439 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:35.021319    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 19:28:35.021439 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:35.021330    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 19:28:35.021439 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:35.021399    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-insights-runtime-extractor-tls podName:e040aebf-fab1-43a7-b979-e59c8f9ec6a6 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:43.021384609 +0000 UTC m=+86.426343656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6cz9v" (UID: "e040aebf-fab1-43a7-b979-e59c8f9ec6a6") : secret "insights-runtime-extractor-tls" not found
Sep 06 19:28:35.021439 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:35.021413    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-kube-rbac-proxy-cm podName:e040aebf-fab1-43a7-b979-e59c8f9ec6a6 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:43.021406003 +0000 UTC m=+86.426365050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6cz9v" (UID: "e040aebf-fab1-43a7-b979-e59c8f9ec6a6") : configmap "kube-rbac-proxy" not found
Sep 06 19:28:35.356983 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:35.356870    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:35.932206 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:35.932165    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:36.155939 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:36.155904    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:36.206849 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:36.206739    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:36.269310 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:36.269275    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:36.562832 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:36.562717    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:36.762874 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:36.762839    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:36.814663 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:36.814585    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:36.959996 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:36.959964    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:37.160081 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:37.160038    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:37.341893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:37.341859    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-r9x9b\" (UID: \"51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-r9x9b"
Sep 06 19:28:37.341893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:37.341894    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-tls\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:37.342188 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:37.342015    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 19:28:37.342188 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:28:37.342086    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-cluster-monitoring-operator-tls podName:51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808 nodeName:}" failed. No retries permitted until 2026-09-06 19:28:53.342066928 +0000 UTC m=+96.747025992 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-r9x9b" (UID: "51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808") : secret "cluster-monitoring-operator-tls" not found
Sep 06 19:28:37.344560 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:37.344535    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-tls\") pod \"image-registry-76594964b-r2b8l\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") " pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:37.454232 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:37.454141    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:37.729271 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:37.729110    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76594964b-r2b8l"]
Sep 06 19:28:37.732233 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:28:37.732201    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c31deca_9cbc_4806_9a33_d7dffdb06af2.slice/crio-b6f8f8d55831c0c3404b0001b7cf672a0b919264b08305eda2bf5bfb87b10886 WatchSource:0}: Error finding container b6f8f8d55831c0c3404b0001b7cf672a0b919264b08305eda2bf5bfb87b10886: Status 404 returned error can't find the container with id b6f8f8d55831c0c3404b0001b7cf672a0b919264b08305eda2bf5bfb87b10886
Sep 06 19:28:38.158462 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:38.158426    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:38.420434 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:38.420336    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76594964b-r2b8l" event={"ID":"2c31deca-9cbc-4806-9a33-d7dffdb06af2","Type":"ContainerStarted","Data":"eab57fe0e4c28c52eba311292c8b1de00886c15acc1e9a39dd1fc58b44a3582b"}
Sep 06 19:28:38.420434 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:38.420389    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76594964b-r2b8l" event={"ID":"2c31deca-9cbc-4806-9a33-d7dffdb06af2","Type":"ContainerStarted","Data":"b6f8f8d55831c0c3404b0001b7cf672a0b919264b08305eda2bf5bfb87b10886"}
Sep 06 19:28:38.420661 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:38.420465    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:28:38.439198 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:38.439143    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76594964b-r2b8l" podStartSLOduration=17.439128028 podStartE2EDuration="17.439128028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:28:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:28:38.438055199 +0000 UTC m=+81.843014269" watchObservedRunningTime="2026-09-06 19:28:38.439128028 +0000 UTC m=+81.844087096"
Sep 06 19:28:38.557233 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:38.557195    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:38.732460 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:38.732364    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:38.833508 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:38.833474    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:38.960302 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:38.960265    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:39.355013 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:39.354976    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:39.741220 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:39.741167    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:40.161874 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:40.161824    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:40.357146 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:40.357100    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:40.764526 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:40.764484    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:40.957216 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:40.957181    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:41.357013 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:41.356977    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:41.961155 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:41.961102    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:42.359631 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:42.359539    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:42.762490 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:42.762445    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:42.956080 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:42.956045    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:43.089340 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:43.089263    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:43.089340 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:43.089299    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:43.089807 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:43.089763    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:43.091723 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:43.091708    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e040aebf-fab1-43a7-b979-e59c8f9ec6a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6cz9v\" (UID: \"e040aebf-fab1-43a7-b979-e59c8f9ec6a6\") " pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:43.165523 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:43.165480    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:43.230565 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:43.230533    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6cz9v"
Sep 06 19:28:43.516239 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:43.516204    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6cz9v"]
Sep 06 19:28:43.519645 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:28:43.519615    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode040aebf_fab1_43a7_b979_e59c8f9ec6a6.slice/crio-9fa0ba9a0b20df2c2f895f6998c2082ec2aca05e0414787a2b25da8b78472ec5 WatchSource:0}: Error finding container 9fa0ba9a0b20df2c2f895f6998c2082ec2aca05e0414787a2b25da8b78472ec5: Status 404 returned error can't find the container with id 9fa0ba9a0b20df2c2f895f6998c2082ec2aca05e0414787a2b25da8b78472ec5
Sep 06 19:28:44.441753 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:44.441658    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6cz9v" event={"ID":"e040aebf-fab1-43a7-b979-e59c8f9ec6a6","Type":"ContainerStarted","Data":"2ddf4d66929d86f8652df2d34e38428c072307ff3c31c85aff0b969d38004564"}
Sep 06 19:28:44.441753 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:44.441725    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6cz9v" event={"ID":"e040aebf-fab1-43a7-b979-e59c8f9ec6a6","Type":"ContainerStarted","Data":"4200c57f7a9eaaf4038a4ba980c78bacf6703063607f6c13c4d7aa2ee283683e"}
Sep 06 19:28:44.441753 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:44.441751    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6cz9v" event={"ID":"e040aebf-fab1-43a7-b979-e59c8f9ec6a6","Type":"ContainerStarted","Data":"9fa0ba9a0b20df2c2f895f6998c2082ec2aca05e0414787a2b25da8b78472ec5"}
Sep 06 19:28:46.451705 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:46.451662    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6cz9v" event={"ID":"e040aebf-fab1-43a7-b979-e59c8f9ec6a6","Type":"ContainerStarted","Data":"69d043ff3dce9e3d1d2ac428d9bb3e550b2305f49b1328460c639ba0d1a68bc9"}
Sep 06 19:28:46.468212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:46.468153    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6cz9v" podStartSLOduration=17.570419069 podStartE2EDuration="19.468133506s" totalImagesPullingTime="1.897714437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 19:28:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:28:46.466880095 +0000 UTC m=+89.871839158" watchObservedRunningTime="2026-09-06 19:28:46.468133506 +0000 UTC m=+89.873092573"
Sep 06 19:28:48.130353 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.130317    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4"]
Sep 06 19:28:48.133495 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.133472    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4"
Sep 06 19:28:48.136030 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.136009    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 06 19:28:48.137002 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.136981    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 06 19:28:48.137129 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.137011    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 06 19:28:48.137129 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.137061    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 06 19:28:48.137129 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.137114    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 06 19:28:48.137281 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.137132    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 06 19:28:48.137281 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.137277    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 06 19:28:48.146359 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.146338    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4"]
Sep 06 19:28:48.156094 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.156065    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76594964b-r2b8l"]
Sep 06 19:28:48.212675 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.212640    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:48.230224 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.230191    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ecd639c-3aae-4a4b-848e-a6be68c5833e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-58fd5b8794-96zn4\" (UID: \"0ecd639c-3aae-4a4b-848e-a6be68c5833e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4"
Sep 06 19:28:48.230224 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.230227    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0ecd639c-3aae-4a4b-848e-a6be68c5833e-ca\") pod \"cluster-proxy-proxy-agent-58fd5b8794-96zn4\" (UID: \"0ecd639c-3aae-4a4b-848e-a6be68c5833e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4"
Sep 06 19:28:48.230465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.230275    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swhc2\" (UniqueName: \"kubernetes.io/projected/0ecd639c-3aae-4a4b-848e-a6be68c5833e-kube-api-access-swhc2\") pod \"cluster-proxy-proxy-agent-58fd5b8794-96zn4\" (UID: \"0ecd639c-3aae-4a4b-848e-a6be68c5833e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4"
Sep 06 19:28:48.230465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.230389    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0ecd639c-3aae-4a4b-848e-a6be68c5833e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-58fd5b8794-96zn4\" (UID: \"0ecd639c-3aae-4a4b-848e-a6be68c5833e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4"
Sep 06 19:28:48.230465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.230426    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ecd639c-3aae-4a4b-848e-a6be68c5833e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-58fd5b8794-96zn4\" (UID: \"0ecd639c-3aae-4a4b-848e-a6be68c5833e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4"
Sep 06 19:28:48.230590 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.230482    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0ecd639c-3aae-4a4b-848e-a6be68c5833e-hub\") pod \"cluster-proxy-proxy-agent-58fd5b8794-96zn4\" (UID: \"0ecd639c-3aae-4a4b-848e-a6be68c5833e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4"
Sep 06 19:28:48.309932 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.309883    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:48.331523 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.331491    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0ecd639c-3aae-4a4b-848e-a6be68c5833e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-58fd5b8794-96zn4\" (UID: \"0ecd639c-3aae-4a4b-848e-a6be68c5833e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4"
Sep 06 19:28:48.331523 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.331524    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ecd639c-3aae-4a4b-848e-a6be68c5833e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-58fd5b8794-96zn4\" (UID: \"0ecd639c-3aae-4a4b-848e-a6be68c5833e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4"
Sep 06 19:28:48.331740 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.331552    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0ecd639c-3aae-4a4b-848e-a6be68c5833e-hub\") pod \"cluster-proxy-proxy-agent-58fd5b8794-96zn4\" (UID: \"0ecd639c-3aae-4a4b-848e-a6be68c5833e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4"
Sep 06 19:28:48.331740 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.331698    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ecd639c-3aae-4a4b-848e-a6be68c5833e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-58fd5b8794-96zn4\" (UID: \"0ecd639c-3aae-4a4b-848e-a6be68c5833e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4"
Sep 06 19:28:48.331740 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.331729    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0ecd639c-3aae-4a4b-848e-a6be68c5833e-ca\") pod \"cluster-proxy-proxy-agent-58fd5b8794-96zn4\" (UID: \"0ecd639c-3aae-4a4b-848e-a6be68c5833e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4"
Sep 06 19:28:48.331924 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.331798    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swhc2\" (UniqueName: \"kubernetes.io/projected/0ecd639c-3aae-4a4b-848e-a6be68c5833e-kube-api-access-swhc2\") pod \"cluster-proxy-proxy-agent-58fd5b8794-96zn4\" (UID: \"0ecd639c-3aae-4a4b-848e-a6be68c5833e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4"
Sep 06 19:28:48.332447 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.332347    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ecd639c-3aae-4a4b-848e-a6be68c5833e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-58fd5b8794-96zn4\" (UID: \"0ecd639c-3aae-4a4b-848e-a6be68c5833e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4"
Sep 06 19:28:48.334478 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.334457    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0ecd639c-3aae-4a4b-848e-a6be68c5833e-hub\") pod \"cluster-proxy-proxy-agent-58fd5b8794-96zn4\" (UID: \"0ecd639c-3aae-4a4b-848e-a6be68c5833e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4"
Sep 06 19:28:48.334613 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.334464    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0ecd639c-3aae-4a4b-848e-a6be68c5833e-ca\") pod \"cluster-proxy-proxy-agent-58fd5b8794-96zn4\" (UID: \"0ecd639c-3aae-4a4b-848e-a6be68c5833e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4"
Sep 06 19:28:48.334613 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.334551    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0ecd639c-3aae-4a4b-848e-a6be68c5833e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-58fd5b8794-96zn4\" (UID: \"0ecd639c-3aae-4a4b-848e-a6be68c5833e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4"
Sep 06 19:28:48.334613 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.334604    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ecd639c-3aae-4a4b-848e-a6be68c5833e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-58fd5b8794-96zn4\" (UID: \"0ecd639c-3aae-4a4b-848e-a6be68c5833e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4"
Sep 06 19:28:48.340672 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.340652    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swhc2\" (UniqueName: \"kubernetes.io/projected/0ecd639c-3aae-4a4b-848e-a6be68c5833e-kube-api-access-swhc2\") pod \"cluster-proxy-proxy-agent-58fd5b8794-96zn4\" (UID: \"0ecd639c-3aae-4a4b-848e-a6be68c5833e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4"
Sep 06 19:28:48.408430 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.408340    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:48.450379 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.450355    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4"
Sep 06 19:28:48.720361 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.720281    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4"]
Sep 06 19:28:48.724652 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:28:48.724625    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ecd639c_3aae_4a4b_848e_a6be68c5833e.slice/crio-7830be46f58c6a2fbc9d0b6fc88b19703b798bbeec3d58e8094b066427b6b0ae WatchSource:0}: Error finding container 7830be46f58c6a2fbc9d0b6fc88b19703b798bbeec3d58e8094b066427b6b0ae: Status 404 returned error can't find the container with id 7830be46f58c6a2fbc9d0b6fc88b19703b798bbeec3d58e8094b066427b6b0ae
Sep 06 19:28:48.779022 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.778986    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:48.879827 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:48.879793    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:49.005827 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:49.005722    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:49.105969 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:49.105931    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:49.291082 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:49.291004    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:49.391479 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:49.391446    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:49.463662 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:49.463632    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4" event={"ID":"0ecd639c-3aae-4a4b-848e-a6be68c5833e","Type":"ContainerStarted","Data":"7830be46f58c6a2fbc9d0b6fc88b19703b798bbeec3d58e8094b066427b6b0ae"}
Sep 06 19:28:51.225081 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:51.225050    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:51.321273 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:51.321236    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:51.421717 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:51.421678    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:51.540051 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:51.539955    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:51.883593 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:51.883548    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:51.934503 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:51.934451    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:52.298634 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:52.298544    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:52.703672 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:52.703640    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:52.803696 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:52.803654    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:52.903937 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:52.903904    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:53.114326 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:53.114233    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:53.203105 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:53.203067    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:53.254586 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:53.254546    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:53.374236 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:53.374200    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-r9x9b\" (UID: \"51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-r9x9b"
Sep 06 19:28:53.376639 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:53.376620    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-r9x9b\" (UID: \"51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-r9x9b"
Sep 06 19:28:53.631573 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:53.631470    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-r9x9b"
Sep 06 19:28:53.899382 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:53.899297    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-r9x9b"]
Sep 06 19:28:53.902383 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:28:53.902359    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51e9c3ec_c5d6_46e0_b9df_65b9ad1c3808.slice/crio-05f7c9ff7758f12bd1901949de8be52e24df13e3d6fb543a4ae748767a30399d WatchSource:0}: Error finding container 05f7c9ff7758f12bd1901949de8be52e24df13e3d6fb543a4ae748767a30399d: Status 404 returned error can't find the container with id 05f7c9ff7758f12bd1901949de8be52e24df13e3d6fb543a4ae748767a30399d
Sep 06 19:28:54.482513 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:54.482472    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-r9x9b" event={"ID":"51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808","Type":"ContainerStarted","Data":"05f7c9ff7758f12bd1901949de8be52e24df13e3d6fb543a4ae748767a30399d"}
Sep 06 19:28:55.121693 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:55.121650    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:55.167322 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:55.167272    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:55.323679 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:55.323645    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:55.389733 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:55.389698    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls\") pod \"dns-default-56494\" (UID: \"28ba1dda-1c3b-4df4-b791-d138a97959a4\") " pod="openshift-dns/dns-default-56494"
Sep 06 19:28:55.392066 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:55.392048    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28ba1dda-1c3b-4df4-b791-d138a97959a4-metrics-tls\") pod \"dns-default-56494\" (UID: \"28ba1dda-1c3b-4df4-b791-d138a97959a4\") " pod="openshift-dns/dns-default-56494"
Sep 06 19:28:55.419210 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:55.419178    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kglk6\""
Sep 06 19:28:55.424165 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:55.424134    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-56494"
Sep 06 19:28:55.424322 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:55.424262    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:55.714620 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:55.714529    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-56494"]
Sep 06 19:28:55.718413 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:28:55.718383    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28ba1dda_1c3b_4df4_b791_d138a97959a4.slice/crio-c4ad537b090a3fdc6c257577f86a44e86ba51abbcce31f4d8181b6a6bdded0c2 WatchSource:0}: Error finding container c4ad537b090a3fdc6c257577f86a44e86ba51abbcce31f4d8181b6a6bdded0c2: Status 404 returned error can't find the container with id c4ad537b090a3fdc6c257577f86a44e86ba51abbcce31f4d8181b6a6bdded0c2
Sep 06 19:28:55.793740 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:55.793710    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:55.895620 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:55.895585    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:55.962253 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:55.962215    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:56.207140 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:56.207107    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:28:56.492879 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:56.492770    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-r9x9b" event={"ID":"51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808","Type":"ContainerStarted","Data":"4576da1a9ac1300c26073c5703b97f1e53a54c141b2b7fe57e57018aa30fc0b5"}
Sep 06 19:28:56.494558 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:56.494528    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-56494" event={"ID":"28ba1dda-1c3b-4df4-b791-d138a97959a4","Type":"ContainerStarted","Data":"c4ad537b090a3fdc6c257577f86a44e86ba51abbcce31f4d8181b6a6bdded0c2"}
Sep 06 19:28:56.508388 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:56.508321    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-r9x9b" podStartSLOduration=33.970275946 podStartE2EDuration="35.50829964s" totalImagesPullingTime="1.538023694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:28:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:28:56.506366065 +0000 UTC m=+99.911325135" watchObservedRunningTime="2026-09-06 19:28:56.50829964 +0000 UTC m=+99.913258701"
Sep 06 19:28:57.500144 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:57.500106    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-56494" event={"ID":"28ba1dda-1c3b-4df4-b791-d138a97959a4","Type":"ContainerStarted","Data":"35abf9fe6f2a925f9264ebf0d0fe94c2b0744d4170833ee06979b8ee01b8259b"}
Sep 06 19:28:57.500498 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:57.500169    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-56494" event={"ID":"28ba1dda-1c3b-4df4-b791-d138a97959a4","Type":"ContainerStarted","Data":"bb2c1dc4a5973f0476eaef3fd01a8b9209baea6ce618a8299d8ab1e5373d629e"}
Sep 06 19:28:57.515354 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:57.515308    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-56494" podStartSLOduration=64.963861408 podStartE2EDuration="1m6.5152932s" totalImagesPullingTime="1.551431792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:28:57.514196693 +0000 UTC m=+100.919155763" watchObservedRunningTime="2026-09-06 19:28:57.5152932 +0000 UTC m=+100.920252267"
Sep 06 19:28:58.163342 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:58.163302    2568 patch_prober.go:28] interesting pod/image-registry-76594964b-r2b8l container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 06 19:28:58.163534 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:58.163370    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76594964b-r2b8l" podUID="2c31deca-9cbc-4806-9a33-d7dffdb06af2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 19:28:58.505881 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:58.505798    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-56494"
Sep 06 19:28:59.963061 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:28:59.963020    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:00.028562 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:00.028505    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:00.396634 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:00.396600    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m2kz7"
Sep 06 19:29:00.435282 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:00.435249    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:02.525848 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:02.525800    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4" event={"ID":"0ecd639c-3aae-4a4b-848e-a6be68c5833e","Type":"ContainerStarted","Data":"f17a84a5556261b8dc0fe9ed2c667294258cda4b998e19957ee459cce0bab4c0"}
Sep 06 19:29:02.525848 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:02.525854    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4" event={"ID":"0ecd639c-3aae-4a4b-848e-a6be68c5833e","Type":"ContainerStarted","Data":"433c7d80671700eeb9a9ee36016cc32a4e389cb5a9f1280b1a439a7e8f8f2dd9"}
Sep 06 19:29:02.526260 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:02.525874    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4" event={"ID":"0ecd639c-3aae-4a4b-848e-a6be68c5833e","Type":"ContainerStarted","Data":"8dd3c648542b90a312af83b149635ead954bd4f5cb89fd882335a99ca1443080"}
Sep 06 19:29:02.543614 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:02.543564    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fd5b8794-96zn4" podStartSLOduration=1.852956109 podStartE2EDuration="14.543549054s" totalImagesPullingTime="12.690592945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:28:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:29:02.541806265 +0000 UTC m=+105.946765333" watchObservedRunningTime="2026-09-06 19:29:02.543549054 +0000 UTC m=+105.948508122"
Sep 06 19:29:02.854154 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:02.854073    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:02.954190 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:02.954157    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:04.003031 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:04.002991    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:04.050439 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:04.050408    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:07.326753 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:07.326710    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:08.160842 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:08.160809    2568 patch_prober.go:28] interesting pod/image-registry-76594964b-r2b8l container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 06 19:29:08.160995 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:08.160866    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76594964b-r2b8l" podUID="2c31deca-9cbc-4806-9a33-d7dffdb06af2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 19:29:08.296607 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:08.296572    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:08.397006 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:08.396976    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:08.514607 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:08.514524    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-56494"
Sep 06 19:29:09.605799 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:09.605745    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:10.299593 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:10.299564    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:10.400489 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:10.400455    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:10.449624 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:10.449591    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:10.723904 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:10.723862    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:10.840404 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:10.840366    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:11.091171 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.091078    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:11.341856 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.341744    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:11.379952 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.379919    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bwd9k"]
Sep 06 19:29:11.382114 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.382098    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.384658 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.384623    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 06 19:29:11.384658 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.384655    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 06 19:29:11.384861 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.384675    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8lnxb\""
Sep 06 19:29:11.384861 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.384627    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 06 19:29:11.385695 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.385676    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 06 19:29:11.433110 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.433081    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:11.500173 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.500134    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:11.521620 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.521581    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/675027e6-fdf5-4649-b98f-b0b246c1c1ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.521620 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.521621    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/675027e6-fdf5-4649-b98f-b0b246c1c1ca-root\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.521865 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.521650    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/675027e6-fdf5-4649-b98f-b0b246c1c1ca-sys\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.521865 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.521698    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/675027e6-fdf5-4649-b98f-b0b246c1c1ca-metrics-client-ca\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.521865 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.521723    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/675027e6-fdf5-4649-b98f-b0b246c1c1ca-node-exporter-wtmp\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.521865 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.521747    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/675027e6-fdf5-4649-b98f-b0b246c1c1ca-node-exporter-textfile\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.521865 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.521764    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tgnt\" (UniqueName: \"kubernetes.io/projected/675027e6-fdf5-4649-b98f-b0b246c1c1ca-kube-api-access-4tgnt\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.521865 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.521833    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/675027e6-fdf5-4649-b98f-b0b246c1c1ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.522051 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.521874    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/675027e6-fdf5-4649-b98f-b0b246c1c1ca-node-exporter-tls\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.599753 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.599648    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:11.622697 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.622656    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/675027e6-fdf5-4649-b98f-b0b246c1c1ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.622697 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.622699    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/675027e6-fdf5-4649-b98f-b0b246c1c1ca-root\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.622902 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.622718    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/675027e6-fdf5-4649-b98f-b0b246c1c1ca-sys\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.622902 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.622741    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/675027e6-fdf5-4649-b98f-b0b246c1c1ca-metrics-client-ca\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.622902 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.622766    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/675027e6-fdf5-4649-b98f-b0b246c1c1ca-node-exporter-wtmp\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.622902 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.622822    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/675027e6-fdf5-4649-b98f-b0b246c1c1ca-node-exporter-textfile\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.622902 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.622835    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/675027e6-fdf5-4649-b98f-b0b246c1c1ca-sys\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.622902 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.622849    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tgnt\" (UniqueName: \"kubernetes.io/projected/675027e6-fdf5-4649-b98f-b0b246c1c1ca-kube-api-access-4tgnt\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.622902 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.622819    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/675027e6-fdf5-4649-b98f-b0b246c1c1ca-root\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.622902 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.622875    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/675027e6-fdf5-4649-b98f-b0b246c1c1ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.622902 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.622904    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/675027e6-fdf5-4649-b98f-b0b246c1c1ca-node-exporter-tls\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.623273 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.622922    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/675027e6-fdf5-4649-b98f-b0b246c1c1ca-node-exporter-wtmp\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.623273 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:29:11.623010    2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 06 19:29:11.623273 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:29:11.623071    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/675027e6-fdf5-4649-b98f-b0b246c1c1ca-node-exporter-tls podName:675027e6-fdf5-4649-b98f-b0b246c1c1ca nodeName:}" failed. No retries permitted until 2026-09-06 19:29:12.123052177 +0000 UTC m=+115.528011223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/675027e6-fdf5-4649-b98f-b0b246c1c1ca-node-exporter-tls") pod "node-exporter-bwd9k" (UID: "675027e6-fdf5-4649-b98f-b0b246c1c1ca") : secret "node-exporter-tls" not found
Sep 06 19:29:11.623273 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.623221    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/675027e6-fdf5-4649-b98f-b0b246c1c1ca-node-exporter-textfile\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.623469 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.623322    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/675027e6-fdf5-4649-b98f-b0b246c1c1ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.623854 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.623830    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/675027e6-fdf5-4649-b98f-b0b246c1c1ca-metrics-client-ca\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.628040 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.627880    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/675027e6-fdf5-4649-b98f-b0b246c1c1ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.631151 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.631130    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tgnt\" (UniqueName: \"kubernetes.io/projected/675027e6-fdf5-4649-b98f-b0b246c1c1ca-kube-api-access-4tgnt\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:11.700342 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.700266    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:11.800054 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.800016    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:11.900097 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:11.900062    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:12.005459 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:12.005424    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:12.107188 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:12.107154    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:12.126997 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:12.126968    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/675027e6-fdf5-4649-b98f-b0b246c1c1ca-node-exporter-tls\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:12.129569 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:12.129546    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/675027e6-fdf5-4649-b98f-b0b246c1c1ca-node-exporter-tls\") pod \"node-exporter-bwd9k\" (UID: \"675027e6-fdf5-4649-b98f-b0b246c1c1ca\") " pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:12.290794 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:12.290693    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bwd9k"
Sep 06 19:29:12.300180 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:29:12.300154    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod675027e6_fdf5_4649_b98f_b0b246c1c1ca.slice/crio-c677724212eb0b49b036252b99269fca8e40535fc52e59eed33b518972cc058d WatchSource:0}: Error finding container c677724212eb0b49b036252b99269fca8e40535fc52e59eed33b518972cc058d: Status 404 returned error can't find the container with id c677724212eb0b49b036252b99269fca8e40535fc52e59eed33b518972cc058d
Sep 06 19:29:12.327723 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:12.327689    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:12.396904 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:12.396868    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:12.537019 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:12.536989    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:12.561268 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:12.561159    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bwd9k" event={"ID":"675027e6-fdf5-4649-b98f-b0b246c1c1ca","Type":"ContainerStarted","Data":"c677724212eb0b49b036252b99269fca8e40535fc52e59eed33b518972cc058d"}
Sep 06 19:29:12.737924 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:12.737884    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:12.797083 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:12.797050    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:13.175874 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.175832    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-76594964b-r2b8l" podUID="2c31deca-9cbc-4806-9a33-d7dffdb06af2" containerName="registry" containerID="cri-o://eab57fe0e4c28c52eba311292c8b1de00886c15acc1e9a39dd1fc58b44a3582b" gracePeriod=30
Sep 06 19:29:13.418854 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.418822    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:29:13.540260 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.540222    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-certificates\") pod \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") "
Sep 06 19:29:13.540433 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.540296    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-tls\") pod \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") "
Sep 06 19:29:13.540433 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.540322    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-bound-sa-token\") pod \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") "
Sep 06 19:29:13.540433 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.540347    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c31deca-9cbc-4806-9a33-d7dffdb06af2-ca-trust-extracted\") pod \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") "
Sep 06 19:29:13.540433 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.540372    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6whd7\" (UniqueName: \"kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-kube-api-access-6whd7\") pod \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") "
Sep 06 19:29:13.540433 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.540394    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c31deca-9cbc-4806-9a33-d7dffdb06af2-trusted-ca\") pod \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") "
Sep 06 19:29:13.540433 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.540423    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c31deca-9cbc-4806-9a33-d7dffdb06af2-installation-pull-secrets\") pod \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") "
Sep 06 19:29:13.540802 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.540453    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c31deca-9cbc-4806-9a33-d7dffdb06af2-image-registry-private-configuration\") pod \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\" (UID: \"2c31deca-9cbc-4806-9a33-d7dffdb06af2\") "
Sep 06 19:29:13.540802 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.540668    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2c31deca-9cbc-4806-9a33-d7dffdb06af2" (UID: "2c31deca-9cbc-4806-9a33-d7dffdb06af2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:29:13.542798 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.542732    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c31deca-9cbc-4806-9a33-d7dffdb06af2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2c31deca-9cbc-4806-9a33-d7dffdb06af2" (UID: "2c31deca-9cbc-4806-9a33-d7dffdb06af2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:29:13.543503 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.543458    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c31deca-9cbc-4806-9a33-d7dffdb06af2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2c31deca-9cbc-4806-9a33-d7dffdb06af2" (UID: "2c31deca-9cbc-4806-9a33-d7dffdb06af2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:29:13.543503 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.543467    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-kube-api-access-6whd7" (OuterVolumeSpecName: "kube-api-access-6whd7") pod "2c31deca-9cbc-4806-9a33-d7dffdb06af2" (UID: "2c31deca-9cbc-4806-9a33-d7dffdb06af2"). InnerVolumeSpecName "kube-api-access-6whd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:29:13.543708 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.543519    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2c31deca-9cbc-4806-9a33-d7dffdb06af2" (UID: "2c31deca-9cbc-4806-9a33-d7dffdb06af2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:29:13.543708 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.543548    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2c31deca-9cbc-4806-9a33-d7dffdb06af2" (UID: "2c31deca-9cbc-4806-9a33-d7dffdb06af2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:29:13.543708 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.543537    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c31deca-9cbc-4806-9a33-d7dffdb06af2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2c31deca-9cbc-4806-9a33-d7dffdb06af2" (UID: "2c31deca-9cbc-4806-9a33-d7dffdb06af2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:29:13.549556 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.549526    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c31deca-9cbc-4806-9a33-d7dffdb06af2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2c31deca-9cbc-4806-9a33-d7dffdb06af2" (UID: "2c31deca-9cbc-4806-9a33-d7dffdb06af2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 19:29:13.566100 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.566068    2568 generic.go:356] "Generic (PLEG): container finished" podID="675027e6-fdf5-4649-b98f-b0b246c1c1ca" containerID="7bc44d12c61935523387b742be6925b927c752de73a9ea8d2f9501973c54328c" exitCode=0
Sep 06 19:29:13.566240 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.566158    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bwd9k" event={"ID":"675027e6-fdf5-4649-b98f-b0b246c1c1ca","Type":"ContainerDied","Data":"7bc44d12c61935523387b742be6925b927c752de73a9ea8d2f9501973c54328c"}
Sep 06 19:29:13.567478 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.567455    2568 generic.go:356] "Generic (PLEG): container finished" podID="2c31deca-9cbc-4806-9a33-d7dffdb06af2" containerID="eab57fe0e4c28c52eba311292c8b1de00886c15acc1e9a39dd1fc58b44a3582b" exitCode=0
Sep 06 19:29:13.567582 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.567488    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76594964b-r2b8l" event={"ID":"2c31deca-9cbc-4806-9a33-d7dffdb06af2","Type":"ContainerDied","Data":"eab57fe0e4c28c52eba311292c8b1de00886c15acc1e9a39dd1fc58b44a3582b"}
Sep 06 19:29:13.567582 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.567497    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76594964b-r2b8l"
Sep 06 19:29:13.567582 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.567516    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76594964b-r2b8l" event={"ID":"2c31deca-9cbc-4806-9a33-d7dffdb06af2","Type":"ContainerDied","Data":"b6f8f8d55831c0c3404b0001b7cf672a0b919264b08305eda2bf5bfb87b10886"}
Sep 06 19:29:13.567582 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.567553    2568 scope.go:117] "RemoveContainer" containerID="eab57fe0e4c28c52eba311292c8b1de00886c15acc1e9a39dd1fc58b44a3582b"
Sep 06 19:29:13.577024 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.577007    2568 scope.go:117] "RemoveContainer" containerID="eab57fe0e4c28c52eba311292c8b1de00886c15acc1e9a39dd1fc58b44a3582b"
Sep 06 19:29:13.577343 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:29:13.577320    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eab57fe0e4c28c52eba311292c8b1de00886c15acc1e9a39dd1fc58b44a3582b\": container with ID starting with eab57fe0e4c28c52eba311292c8b1de00886c15acc1e9a39dd1fc58b44a3582b not found: ID does not exist" containerID="eab57fe0e4c28c52eba311292c8b1de00886c15acc1e9a39dd1fc58b44a3582b"
Sep 06 19:29:13.577402 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.577352    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eab57fe0e4c28c52eba311292c8b1de00886c15acc1e9a39dd1fc58b44a3582b"} err="failed to get container status \"eab57fe0e4c28c52eba311292c8b1de00886c15acc1e9a39dd1fc58b44a3582b\": rpc error: code = NotFound desc = could not find container \"eab57fe0e4c28c52eba311292c8b1de00886c15acc1e9a39dd1fc58b44a3582b\": container with ID starting with eab57fe0e4c28c52eba311292c8b1de00886c15acc1e9a39dd1fc58b44a3582b not found: ID does not exist"
Sep 06 19:29:13.592488 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.592461    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76594964b-r2b8l"]
Sep 06 19:29:13.598407 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.598381    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-76594964b-r2b8l"]
Sep 06 19:29:13.641283 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.641254    2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-certificates\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:29:13.641283 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.641280    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-registry-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:29:13.641487 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.641291    2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-bound-sa-token\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:29:13.641487 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.641299    2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c31deca-9cbc-4806-9a33-d7dffdb06af2-ca-trust-extracted\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:29:13.641487 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.641308    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6whd7\" (UniqueName: \"kubernetes.io/projected/2c31deca-9cbc-4806-9a33-d7dffdb06af2-kube-api-access-6whd7\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:29:13.641487 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.641316    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c31deca-9cbc-4806-9a33-d7dffdb06af2-trusted-ca\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:29:13.641487 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.641324    2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c31deca-9cbc-4806-9a33-d7dffdb06af2-installation-pull-secrets\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:29:13.641487 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:13.641332    2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c31deca-9cbc-4806-9a33-d7dffdb06af2-image-registry-private-configuration\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:29:14.132532 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.132493    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:14.230373 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.230335    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:14.300491 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.300462    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:14.309478 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.309451    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-c4f978df8-c467n"]
Sep 06 19:29:14.309757 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.309741    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c31deca-9cbc-4806-9a33-d7dffdb06af2" containerName="registry"
Sep 06 19:29:14.309864 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.309761    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c31deca-9cbc-4806-9a33-d7dffdb06af2" containerName="registry"
Sep 06 19:29:14.309864 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.309859    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c31deca-9cbc-4806-9a33-d7dffdb06af2" containerName="registry"
Sep 06 19:29:14.312193 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.312172    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.314596 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.314574    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 06 19:29:14.314691 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.314655    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 06 19:29:14.314743 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.314689    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 06 19:29:14.314855 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.314832    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 06 19:29:14.314914 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.314868    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 06 19:29:14.315000 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.314986    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cmn1d2bvf9346\""
Sep 06 19:29:14.315381 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.315365    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wb566\""
Sep 06 19:29:14.323952 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.323932    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c4f978df8-c467n"]
Sep 06 19:29:14.447273 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.447171    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ae66aef-9b78-40f1-a71a-855e56e3db80-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.447273 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.447213    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ae66aef-9b78-40f1-a71a-855e56e3db80-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.447273 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.447232    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ae66aef-9b78-40f1-a71a-855e56e3db80-secret-grpc-tls\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.447509 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.447325    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1ae66aef-9b78-40f1-a71a-855e56e3db80-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.447509 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.447368    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1ae66aef-9b78-40f1-a71a-855e56e3db80-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.447509 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.447396    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74p8j\" (UniqueName: \"kubernetes.io/projected/1ae66aef-9b78-40f1-a71a-855e56e3db80-kube-api-access-74p8j\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.447509 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.447429    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1ae66aef-9b78-40f1-a71a-855e56e3db80-secret-thanos-querier-tls\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.447509 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.447473    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ae66aef-9b78-40f1-a71a-855e56e3db80-metrics-client-ca\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.548409 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.548369    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ae66aef-9b78-40f1-a71a-855e56e3db80-metrics-client-ca\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.548409 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.548416    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ae66aef-9b78-40f1-a71a-855e56e3db80-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.548600 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.548434    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ae66aef-9b78-40f1-a71a-855e56e3db80-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.548600 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.548564    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ae66aef-9b78-40f1-a71a-855e56e3db80-secret-grpc-tls\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.548674 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.548624    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1ae66aef-9b78-40f1-a71a-855e56e3db80-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.548674 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.548649    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1ae66aef-9b78-40f1-a71a-855e56e3db80-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.548769 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.548678    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74p8j\" (UniqueName: \"kubernetes.io/projected/1ae66aef-9b78-40f1-a71a-855e56e3db80-kube-api-access-74p8j\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.548769 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.548722    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1ae66aef-9b78-40f1-a71a-855e56e3db80-secret-thanos-querier-tls\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.549322 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.549285    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ae66aef-9b78-40f1-a71a-855e56e3db80-metrics-client-ca\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.551445 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.551414    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1ae66aef-9b78-40f1-a71a-855e56e3db80-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.551551 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.551472    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ae66aef-9b78-40f1-a71a-855e56e3db80-secret-grpc-tls\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.551613 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.551601    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ae66aef-9b78-40f1-a71a-855e56e3db80-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.551818 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.551799    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1ae66aef-9b78-40f1-a71a-855e56e3db80-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.551894 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.551852    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1ae66aef-9b78-40f1-a71a-855e56e3db80-secret-thanos-querier-tls\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.552016 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.551997    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ae66aef-9b78-40f1-a71a-855e56e3db80-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.561125 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.561101    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74p8j\" (UniqueName: \"kubernetes.io/projected/1ae66aef-9b78-40f1-a71a-855e56e3db80-kube-api-access-74p8j\") pod \"thanos-querier-c4f978df8-c467n\" (UID: \"1ae66aef-9b78-40f1-a71a-855e56e3db80\") " pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.577939 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.577903    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bwd9k" event={"ID":"675027e6-fdf5-4649-b98f-b0b246c1c1ca","Type":"ContainerStarted","Data":"9b0713449a6ab69ab68002a7fc01c57db252a66a724394e42f88d7a9da8ce7eb"}
Sep 06 19:29:14.578102 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.577998    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bwd9k" event={"ID":"675027e6-fdf5-4649-b98f-b0b246c1c1ca","Type":"ContainerStarted","Data":"b7b1e6fcd583daf571c58d5f892f9bf587abb371509cc00f4bda9d260d68d524"}
Sep 06 19:29:14.596485 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.596436    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bwd9k" podStartSLOduration=2.51823453 podStartE2EDuration="3.596422565s" totalImagesPullingTime="1.006271658s" totalInitContainerRuntime="71.916377ms" isStatefulPod=true podCreationTimestamp="2026-09-06 19:29:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:29:14.595481752 +0000 UTC m=+118.000440821" watchObservedRunningTime="2026-09-06 19:29:14.596422565 +0000 UTC m=+118.001381632"
Sep 06 19:29:14.612510 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.612483    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:14.621394 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.621358    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:14.894191 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.894144    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c4f978df8-c467n"]
Sep 06 19:29:14.897464 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:29:14.897437    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ae66aef_9b78_40f1_a71a_855e56e3db80.slice/crio-e55116b7545c8946ed374e52a2c5f02e62eb6e56c3be7edb28add971eae0c507 WatchSource:0}: Error finding container e55116b7545c8946ed374e52a2c5f02e62eb6e56c3be7edb28add971eae0c507: Status 404 returned error can't find the container with id e55116b7545c8946ed374e52a2c5f02e62eb6e56c3be7edb28add971eae0c507
Sep 06 19:29:14.949577 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:14.949536    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:15.114054 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:15.114023    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c31deca-9cbc-4806-9a33-d7dffdb06af2" path="/var/lib/kubelet/pods/2c31deca-9cbc-4806-9a33-d7dffdb06af2/volumes"
Sep 06 19:29:15.325714 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:15.325616    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:15.377166 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:15.377134    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:15.585853 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:15.585710    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c4f978df8-c467n" event={"ID":"1ae66aef-9b78-40f1-a71a-855e56e3db80","Type":"ContainerStarted","Data":"e55116b7545c8946ed374e52a2c5f02e62eb6e56c3be7edb28add971eae0c507"}
Sep 06 19:29:16.113832 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:16.113793    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:16.183137 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:16.183101    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:16.742392 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:16.742358    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:17.303988 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:17.303901    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:17.381195 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:17.381114    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:17.507124 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:17.507080    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:17.593572 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:17.593546    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c4f978df8-c467n" event={"ID":"1ae66aef-9b78-40f1-a71a-855e56e3db80","Type":"ContainerStarted","Data":"7517acf776bbfa14b68c0124e78e41c59c3bf2db3583cfe3ff15037b09b3a70a"}
Sep 06 19:29:17.593665 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:17.593641    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c4f978df8-c467n" event={"ID":"1ae66aef-9b78-40f1-a71a-855e56e3db80","Type":"ContainerStarted","Data":"9c8d6f804d7e4273761d272026e9cb01e085f2a5cf7c98e858c49da1224597ea"}
Sep 06 19:29:17.593719 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:17.593669    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c4f978df8-c467n" event={"ID":"1ae66aef-9b78-40f1-a71a-855e56e3db80","Type":"ContainerStarted","Data":"314174907b501a767071272d47a8d239a0905bbf8548c52f68c2d4907c718a4e"}
Sep 06 19:29:18.600480 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:18.600446    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c4f978df8-c467n" event={"ID":"1ae66aef-9b78-40f1-a71a-855e56e3db80","Type":"ContainerStarted","Data":"c070c79fb3d3fac3aba9331906c69a50edf01db244b219871bbdbf46e40c6b15"}
Sep 06 19:29:18.600892 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:18.600515    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c4f978df8-c467n" event={"ID":"1ae66aef-9b78-40f1-a71a-855e56e3db80","Type":"ContainerStarted","Data":"9a623a3a96d54e9466db27ef4274f04f8bd29aac03abc0e18c639c58818e5514"}
Sep 06 19:29:18.600892 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:18.600551    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c4f978df8-c467n" event={"ID":"1ae66aef-9b78-40f1-a71a-855e56e3db80","Type":"ContainerStarted","Data":"c63169deada713f007284b16de664ca5b32a617d666b69e4c279da1738884760"}
Sep 06 19:29:18.600892 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:18.600589    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:18.623383 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:18.623327    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-c4f978df8-c467n" podStartSLOduration=2.119916513 podStartE2EDuration="4.623310346s" totalImagesPullingTime="2.503393833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:29:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:29:18.621166536 +0000 UTC m=+122.026125604" watchObservedRunningTime="2026-09-06 19:29:18.623310346 +0000 UTC m=+122.028269413"
Sep 06 19:29:24.610211 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:24.610181    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-c4f978df8-c467n"
Sep 06 19:29:25.109113 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:25.109079    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:25.160890 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:25.160856    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:26.841393 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:26.841357    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs\") pod \"network-metrics-daemon-cb2dz\" (UID: \"0ace7f43-c761-489f-b523-b01650e632df\") " pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:29:26.843770 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:26.843752    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ace7f43-c761-489f-b523-b01650e632df-metrics-certs\") pod \"network-metrics-daemon-cb2dz\" (UID: \"0ace7f43-c761-489f-b523-b01650e632df\") " pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:29:27.034842 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:27.034803    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9bdz9\""
Sep 06 19:29:27.042721 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:27.042698    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cb2dz"
Sep 06 19:29:27.310963 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:27.310933    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cb2dz"]
Sep 06 19:29:27.313985 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:29:27.313959    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ace7f43_c761_489f_b523_b01650e632df.slice/crio-a8b0dfaa6f24c6f58651d98bb316626202691dca77e13aee68837a13f8a13847 WatchSource:0}: Error finding container a8b0dfaa6f24c6f58651d98bb316626202691dca77e13aee68837a13f8a13847: Status 404 returned error can't find the container with id a8b0dfaa6f24c6f58651d98bb316626202691dca77e13aee68837a13f8a13847
Sep 06 19:29:27.497946 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:27.497901    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:27.599223 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:27.599188    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:27.630930 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:27.630897    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cb2dz" event={"ID":"0ace7f43-c761-489f-b523-b01650e632df","Type":"ContainerStarted","Data":"a8b0dfaa6f24c6f58651d98bb316626202691dca77e13aee68837a13f8a13847"}
Sep 06 19:29:27.699601 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:27.699565    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:28.636505 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:28.636472    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cb2dz" event={"ID":"0ace7f43-c761-489f-b523-b01650e632df","Type":"ContainerStarted","Data":"2d0a34943edc56e9cb871fc259458b6e9173619deb2da897013db3ab7b017543"}
Sep 06 19:29:28.636900 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:28.636521    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cb2dz" event={"ID":"0ace7f43-c761-489f-b523-b01650e632df","Type":"ContainerStarted","Data":"17be88408aacb0835d8c6eec0df522be9b62ad052c3aec1de626596649aa3c87"}
Sep 06 19:29:28.652436 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:28.652390    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cb2dz" podStartSLOduration=130.640870098 podStartE2EDuration="2m11.652376424s" totalImagesPullingTime="1.011506326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:27:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:29:28.651393547 +0000 UTC m=+132.056352614" watchObservedRunningTime="2026-09-06 19:29:28.652376424 +0000 UTC m=+132.057335532"
Sep 06 19:29:28.736301 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:28.736264    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:28.837444 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:28.837402    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:29.635367 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:29.635330    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:29.736223 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:29.736186    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:34.004794 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:34.004738    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:34.053909 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:34.053876    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:40.682669 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:40.682635    2568 generic.go:356] "Generic (PLEG): container finished" podID="5865d485-e5a8-415b-92df-9651566354e9" containerID="dc57fced1a509b8408988c793257ac361a56bfc058ac56020c12329c3122acf7" exitCode=0
Sep 06 19:29:40.683079 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:40.682697    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-277g4" event={"ID":"5865d485-e5a8-415b-92df-9651566354e9","Type":"ContainerDied","Data":"dc57fced1a509b8408988c793257ac361a56bfc058ac56020c12329c3122acf7"}
Sep 06 19:29:40.683079 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:40.683010    2568 scope.go:117] "RemoveContainer" containerID="dc57fced1a509b8408988c793257ac361a56bfc058ac56020c12329c3122acf7"
Sep 06 19:29:41.230914 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:41.230877    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:41.331494 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:41.331457    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:41.381594 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:41.381569    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:41.688685 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:41.688646    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-277g4" event={"ID":"5865d485-e5a8-415b-92df-9651566354e9","Type":"ContainerStarted","Data":"5e0fd1ba9da8774350af5cdb8c5e513f2bef28041f7d3add1cff5fcff619470a"}
Sep 06 19:29:49.001733 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:49.001693    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:29:49.049546 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:29:49.049507    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:30:30.479607 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:30:30.479566    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:30:30.681708 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:30:30.681651    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:30:38.982909 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:30:38.982865    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:30:39.082503 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:30:39.082466    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:30:39.183276 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:30:39.183243    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:30:39.235352 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:30:39.235266    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:30:39.810146 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:30:39.810112    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:30:39.910225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:30:39.910194    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:30:40.706516 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:30:40.706481    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:30:45.737410 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:30:45.737361    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:30:49.805200 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:30:49.805164    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:30:49.855633 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:30:49.855592    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:30:49.903652 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:30:49.903616    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:31:13.363590 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:31:13.363541    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:31:13.411221 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:31:13.411190    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:31:45.670037 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:31:45.669874    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:31:45.772865 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:31:45.772827    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:31:51.314291 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:31:51.314247    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:31:51.618999 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:31:51.618901    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:31:51.668206 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:31:51.668168    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:31:52.420962 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:31:52.420923    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:31:52.475536 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:31:52.475505    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:31:57.672265 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:31:57.672226    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:31:57.772513 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:31:57.772477    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:32:01.014588 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:32:01.014552    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:32:02.094098 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:32:02.094064    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:32:02.140803 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:32:02.140745    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:32:02.194406 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:32:02.194374    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:32:02.239230 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:32:02.239189    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:32:04.012478 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:32:04.012441    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:32:04.112273 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:32:04.112239    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:32:17.040980 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:32:17.040951    2568 kubelet.go:1648] "Image garbage collection succeeded"
Sep 06 19:32:38.878877 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:32:38.878831    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:32:38.974244 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:32:38.974207    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:00.402601 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:00.402565    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:01.599500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:01.599469    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:04.008795 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:04.008750    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:04.058386 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:04.058354    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:05.504093 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:05.504058    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:05.605793 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:05.605737    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:07.852742 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:07.852667    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:08.261297 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:08.261265    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:10.812599 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:10.812554    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:10.912273 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:10.912244    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:15.270128 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:15.270093    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:15.768769 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:15.768735    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-59mxr"]
Sep 06 19:33:15.771786 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:15.771759    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-59mxr"
Sep 06 19:33:15.774184 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:15.774158    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-lsl6b\""
Sep 06 19:33:15.774339 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:15.774194    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 06 19:33:15.774339 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:15.774256    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 06 19:33:15.781509 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:15.781482    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-59mxr"]
Sep 06 19:33:15.812511 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:15.812474    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m4np\" (UniqueName: \"kubernetes.io/projected/0b00516c-04a3-45f8-a35c-f911d11baf60-kube-api-access-4m4np\") pod \"cert-manager-55b4d954d5-59mxr\" (UID: \"0b00516c-04a3-45f8-a35c-f911d11baf60\") " pod="cert-manager/cert-manager-55b4d954d5-59mxr"
Sep 06 19:33:15.812700 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:15.812533    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b00516c-04a3-45f8-a35c-f911d11baf60-bound-sa-token\") pod \"cert-manager-55b4d954d5-59mxr\" (UID: \"0b00516c-04a3-45f8-a35c-f911d11baf60\") " pod="cert-manager/cert-manager-55b4d954d5-59mxr"
Sep 06 19:33:15.913430 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:15.913398    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m4np\" (UniqueName: \"kubernetes.io/projected/0b00516c-04a3-45f8-a35c-f911d11baf60-kube-api-access-4m4np\") pod \"cert-manager-55b4d954d5-59mxr\" (UID: \"0b00516c-04a3-45f8-a35c-f911d11baf60\") " pod="cert-manager/cert-manager-55b4d954d5-59mxr"
Sep 06 19:33:15.913544 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:15.913446    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b00516c-04a3-45f8-a35c-f911d11baf60-bound-sa-token\") pod \"cert-manager-55b4d954d5-59mxr\" (UID: \"0b00516c-04a3-45f8-a35c-f911d11baf60\") " pod="cert-manager/cert-manager-55b4d954d5-59mxr"
Sep 06 19:33:15.921287 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:15.921250    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b00516c-04a3-45f8-a35c-f911d11baf60-bound-sa-token\") pod \"cert-manager-55b4d954d5-59mxr\" (UID: \"0b00516c-04a3-45f8-a35c-f911d11baf60\") " pod="cert-manager/cert-manager-55b4d954d5-59mxr"
Sep 06 19:33:15.921470 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:15.921450    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m4np\" (UniqueName: \"kubernetes.io/projected/0b00516c-04a3-45f8-a35c-f911d11baf60-kube-api-access-4m4np\") pod \"cert-manager-55b4d954d5-59mxr\" (UID: \"0b00516c-04a3-45f8-a35c-f911d11baf60\") " pod="cert-manager/cert-manager-55b4d954d5-59mxr"
Sep 06 19:33:16.080954 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:16.080858    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-59mxr"
Sep 06 19:33:16.349496 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:16.349410    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-59mxr"]
Sep 06 19:33:16.352226 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:33:16.352196    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b00516c_04a3_45f8_a35c_f911d11baf60.slice/crio-05520b90731931e185be7f74db4b2c99e1ef0423c4fc5cbed7be0ab28cbccb17 WatchSource:0}: Error finding container 05520b90731931e185be7f74db4b2c99e1ef0423c4fc5cbed7be0ab28cbccb17: Status 404 returned error can't find the container with id 05520b90731931e185be7f74db4b2c99e1ef0423c4fc5cbed7be0ab28cbccb17
Sep 06 19:33:16.354310 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:16.354293    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 19:33:16.444757 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:16.444720    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-59mxr" event={"ID":"0b00516c-04a3-45f8-a35c-f911d11baf60","Type":"ContainerStarted","Data":"05520b90731931e185be7f74db4b2c99e1ef0423c4fc5cbed7be0ab28cbccb17"}
Sep 06 19:33:16.862318 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:16.862220    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:16.962424 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:16.962349    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:17.358212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:17.358127    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:17.457840 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:17.457801    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:19.051936 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:19.051894    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4456c"]
Sep 06 19:33:19.055479 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:19.055457    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4456c"
Sep 06 19:33:19.057828 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:19.057766    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zdvm5\""
Sep 06 19:33:19.058823 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:19.058803    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 06 19:33:19.058931 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:19.058803    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 06 19:33:19.063565 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:19.063545    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4456c"]
Sep 06 19:33:19.136957 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:19.136930    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56797bc7-f544-422d-a2f4-8b5323949f7a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4456c\" (UID: \"56797bc7-f544-422d-a2f4-8b5323949f7a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4456c"
Sep 06 19:33:19.137139 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:19.136981    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4l6n\" (UniqueName: \"kubernetes.io/projected/56797bc7-f544-422d-a2f4-8b5323949f7a-kube-api-access-t4l6n\") pod \"openshift-lws-operator-fd8ccff4c-4456c\" (UID: \"56797bc7-f544-422d-a2f4-8b5323949f7a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4456c"
Sep 06 19:33:19.238383 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:19.238343    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56797bc7-f544-422d-a2f4-8b5323949f7a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4456c\" (UID: \"56797bc7-f544-422d-a2f4-8b5323949f7a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4456c"
Sep 06 19:33:19.238383 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:19.238385    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4l6n\" (UniqueName: \"kubernetes.io/projected/56797bc7-f544-422d-a2f4-8b5323949f7a-kube-api-access-t4l6n\") pod \"openshift-lws-operator-fd8ccff4c-4456c\" (UID: \"56797bc7-f544-422d-a2f4-8b5323949f7a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4456c"
Sep 06 19:33:19.238710 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:19.238689    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56797bc7-f544-422d-a2f4-8b5323949f7a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4456c\" (UID: \"56797bc7-f544-422d-a2f4-8b5323949f7a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4456c"
Sep 06 19:33:19.246521 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:19.246500    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4l6n\" (UniqueName: \"kubernetes.io/projected/56797bc7-f544-422d-a2f4-8b5323949f7a-kube-api-access-t4l6n\") pod \"openshift-lws-operator-fd8ccff4c-4456c\" (UID: \"56797bc7-f544-422d-a2f4-8b5323949f7a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4456c"
Sep 06 19:33:19.367487 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:19.367396    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4456c"
Sep 06 19:33:19.458739 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:19.458697    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-59mxr" event={"ID":"0b00516c-04a3-45f8-a35c-f911d11baf60","Type":"ContainerStarted","Data":"e8fedc3b1a430452c42cfd8a05e804840dc1f283c62a45ddf0c9b30aa2d80046"}
Sep 06 19:33:19.474125 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:19.474075    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-59mxr" podStartSLOduration=1.584944069 podStartE2EDuration="4.474053669s" totalImagesPullingTime="2.8891096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:33:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:33:19.472762271 +0000 UTC m=+362.877721339" watchObservedRunningTime="2026-09-06 19:33:19.474053669 +0000 UTC m=+362.879012739"
Sep 06 19:33:19.638011 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:19.637966    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4456c"]
Sep 06 19:33:19.641030 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:33:19.641002    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56797bc7_f544_422d_a2f4_8b5323949f7a.slice/crio-4d43ef90d7036ca3aaca5be68d263d34bd5f1bb22d32c7a49d51cd7cab0f8501 WatchSource:0}: Error finding container 4d43ef90d7036ca3aaca5be68d263d34bd5f1bb22d32c7a49d51cd7cab0f8501: Status 404 returned error can't find the container with id 4d43ef90d7036ca3aaca5be68d263d34bd5f1bb22d32c7a49d51cd7cab0f8501
Sep 06 19:33:20.466874 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:20.466822    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4456c" event={"ID":"56797bc7-f544-422d-a2f4-8b5323949f7a","Type":"ContainerStarted","Data":"4d43ef90d7036ca3aaca5be68d263d34bd5f1bb22d32c7a49d51cd7cab0f8501"}
Sep 06 19:33:22.476466 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:22.476421    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4456c" event={"ID":"56797bc7-f544-422d-a2f4-8b5323949f7a","Type":"ContainerStarted","Data":"44804df2248f868924af70d24c1b18551dffe5b60a6fb722750dccad1274c0e0"}
Sep 06 19:33:22.493301 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:22.493244    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4456c" podStartSLOduration=1.267692567 podStartE2EDuration="3.493204854s" totalImagesPullingTime="2.225512287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:33:22.490763167 +0000 UTC m=+365.895722235" watchObservedRunningTime="2026-09-06 19:33:22.493204854 +0000 UTC m=+365.898163925"
Sep 06 19:33:23.136579 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:23.136545    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:23.234850 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:23.234813    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:24.836512 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:24.836473    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:37.524330 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:37.524289    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:37.624594 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:37.624560    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:38.135625 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.135590    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:38.397608 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.397515    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:38.501221 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.501189    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:38.544862 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.544830    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5"]
Sep 06 19:33:38.548024 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.548009    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5"
Sep 06 19:33:38.550586 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.550564    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 06 19:33:38.550757 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.550659    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pp5zq\""
Sep 06 19:33:38.550757 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.550674    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 06 19:33:38.550757 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.550672    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 06 19:33:38.550954 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.550941    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 06 19:33:38.562237 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.562216    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5"]
Sep 06 19:33:38.637103 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.637070    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:38.686291 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.686203    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6f3128d-2981-42bb-8c91-a145c95603c9-tmp\") pod \"opendatahub-operator-controller-manager-7f964dcc99-gj8j5\" (UID: \"d6f3128d-2981-42bb-8c91-a145c95603c9\") " pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5"
Sep 06 19:33:38.686291 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.686252    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d6f3128d-2981-42bb-8c91-a145c95603c9-manifests\") pod \"opendatahub-operator-controller-manager-7f964dcc99-gj8j5\" (UID: \"d6f3128d-2981-42bb-8c91-a145c95603c9\") " pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5"
Sep 06 19:33:38.686291 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.686283    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnx54\" (UniqueName: \"kubernetes.io/projected/d6f3128d-2981-42bb-8c91-a145c95603c9-kube-api-access-xnx54\") pod \"opendatahub-operator-controller-manager-7f964dcc99-gj8j5\" (UID: \"d6f3128d-2981-42bb-8c91-a145c95603c9\") " pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5"
Sep 06 19:33:38.686497 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.686330    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6f3128d-2981-42bb-8c91-a145c95603c9-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f964dcc99-gj8j5\" (UID: \"d6f3128d-2981-42bb-8c91-a145c95603c9\") " pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5"
Sep 06 19:33:38.686497 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.686400    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d6f3128d-2981-42bb-8c91-a145c95603c9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f964dcc99-gj8j5\" (UID: \"d6f3128d-2981-42bb-8c91-a145c95603c9\") " pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5"
Sep 06 19:33:38.753943 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.753907    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:38.787689 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.787650    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d6f3128d-2981-42bb-8c91-a145c95603c9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f964dcc99-gj8j5\" (UID: \"d6f3128d-2981-42bb-8c91-a145c95603c9\") " pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5"
Sep 06 19:33:38.787876 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.787714    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6f3128d-2981-42bb-8c91-a145c95603c9-tmp\") pod \"opendatahub-operator-controller-manager-7f964dcc99-gj8j5\" (UID: \"d6f3128d-2981-42bb-8c91-a145c95603c9\") " pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5"
Sep 06 19:33:38.787876 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.787736    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d6f3128d-2981-42bb-8c91-a145c95603c9-manifests\") pod \"opendatahub-operator-controller-manager-7f964dcc99-gj8j5\" (UID: \"d6f3128d-2981-42bb-8c91-a145c95603c9\") " pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5"
Sep 06 19:33:38.787876 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.787755    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnx54\" (UniqueName: \"kubernetes.io/projected/d6f3128d-2981-42bb-8c91-a145c95603c9-kube-api-access-xnx54\") pod \"opendatahub-operator-controller-manager-7f964dcc99-gj8j5\" (UID: \"d6f3128d-2981-42bb-8c91-a145c95603c9\") " pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5"
Sep 06 19:33:38.787876 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.787792    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6f3128d-2981-42bb-8c91-a145c95603c9-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f964dcc99-gj8j5\" (UID: \"d6f3128d-2981-42bb-8c91-a145c95603c9\") " pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5"
Sep 06 19:33:38.788277 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.788250    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d6f3128d-2981-42bb-8c91-a145c95603c9-manifests\") pod \"opendatahub-operator-controller-manager-7f964dcc99-gj8j5\" (UID: \"d6f3128d-2981-42bb-8c91-a145c95603c9\") " pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5"
Sep 06 19:33:38.790122 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.790101    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6f3128d-2981-42bb-8c91-a145c95603c9-tmp\") pod \"opendatahub-operator-controller-manager-7f964dcc99-gj8j5\" (UID: \"d6f3128d-2981-42bb-8c91-a145c95603c9\") " pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5"
Sep 06 19:33:38.790342 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.790324    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d6f3128d-2981-42bb-8c91-a145c95603c9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f964dcc99-gj8j5\" (UID: \"d6f3128d-2981-42bb-8c91-a145c95603c9\") " pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5"
Sep 06 19:33:38.790403 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.790385    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6f3128d-2981-42bb-8c91-a145c95603c9-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f964dcc99-gj8j5\" (UID: \"d6f3128d-2981-42bb-8c91-a145c95603c9\") " pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5"
Sep 06 19:33:38.802715 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.802687    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnx54\" (UniqueName: \"kubernetes.io/projected/d6f3128d-2981-42bb-8c91-a145c95603c9-kube-api-access-xnx54\") pod \"opendatahub-operator-controller-manager-7f964dcc99-gj8j5\" (UID: \"d6f3128d-2981-42bb-8c91-a145c95603c9\") " pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5"
Sep 06 19:33:38.851750 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.851713    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:38.857525 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.857502    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5"
Sep 06 19:33:38.951662 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:38.951575    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:39.054546 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:39.054496    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:39.137995 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:39.137938    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:39.139900 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:39.139879    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5"]
Sep 06 19:33:39.142208 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:33:39.142174    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6f3128d_2981_42bb_8c91_a145c95603c9.slice/crio-7669b5d89c79fed5e1491d4fa226ee63b4123cde827509b0be3c854cc7f6d1b7 WatchSource:0}: Error finding container 7669b5d89c79fed5e1491d4fa226ee63b4123cde827509b0be3c854cc7f6d1b7: Status 404 returned error can't find the container with id 7669b5d89c79fed5e1491d4fa226ee63b4123cde827509b0be3c854cc7f6d1b7
Sep 06 19:33:39.540791 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:39.540747    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5" event={"ID":"d6f3128d-2981-42bb-8c91-a145c95603c9","Type":"ContainerStarted","Data":"7669b5d89c79fed5e1491d4fa226ee63b4123cde827509b0be3c854cc7f6d1b7"}
Sep 06 19:33:42.553947 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:42.553903    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5" event={"ID":"d6f3128d-2981-42bb-8c91-a145c95603c9","Type":"ContainerStarted","Data":"e3872b72a583dab8135644dd4422e01e34f931335e5fe74c12f84939b2d531e0"}
Sep 06 19:33:43.559038 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:43.558999    2568 generic.go:356] "Generic (PLEG): container finished" podID="d6f3128d-2981-42bb-8c91-a145c95603c9" containerID="e3872b72a583dab8135644dd4422e01e34f931335e5fe74c12f84939b2d531e0" exitCode=0
Sep 06 19:33:43.559038 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:43.559043    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5" event={"ID":"d6f3128d-2981-42bb-8c91-a145c95603c9","Type":"ContainerDied","Data":"e3872b72a583dab8135644dd4422e01e34f931335e5fe74c12f84939b2d531e0"}
Sep 06 19:33:44.564386 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:44.564347    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5" event={"ID":"d6f3128d-2981-42bb-8c91-a145c95603c9","Type":"ContainerStarted","Data":"bcb8c16150485cc1b4876e4e2771db6532d076820424edb33f6c87e6f376ed11"}
Sep 06 19:33:44.564763 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:44.564503    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5"
Sep 06 19:33:44.584884 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:44.584832    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5" podStartSLOduration=2.367170432 podStartE2EDuration="6.584814895s" totalImagesPullingTime="3.135009479s" totalInitContainerRuntime="1.082634984s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:33:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:33:44.583173274 +0000 UTC m=+387.988132343" watchObservedRunningTime="2026-09-06 19:33:44.584814895 +0000 UTC m=+387.989773958"
Sep 06 19:33:49.024650 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:49.024607    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:49.122571 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:49.122533    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:55.571586 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:55.571550    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f964dcc99-gj8j5"
Sep 06 19:33:58.082981 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:58.082947    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:33:58.233800 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:33:58.233735    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:03.608857 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:03.608817    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:03.645481 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:03.645443    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d55646b9-nc5jm"]
Sep 06 19:34:03.653662 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:03.653635    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d55646b9-nc5jm"
Sep 06 19:34:03.655006 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:03.654979    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d55646b9-nc5jm"]
Sep 06 19:34:03.656365 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:03.656334    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 06 19:34:03.657502 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:03.657395    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 06 19:34:03.657502 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:03.657409    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 06 19:34:03.657502 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:03.657464    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 06 19:34:03.657502 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:03.657475    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9wnfx\""
Sep 06 19:34:03.675013 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:03.674985    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b60b24a-c1db-4efd-8491-824719bb3c92-tmp\") pod \"kube-auth-proxy-7d55646b9-nc5jm\" (UID: \"2b60b24a-c1db-4efd-8491-824719bb3c92\") " pod="openshift-ingress/kube-auth-proxy-7d55646b9-nc5jm"
Sep 06 19:34:03.675215 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:03.675054    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b60b24a-c1db-4efd-8491-824719bb3c92-tls-certs\") pod \"kube-auth-proxy-7d55646b9-nc5jm\" (UID: \"2b60b24a-c1db-4efd-8491-824719bb3c92\") " pod="openshift-ingress/kube-auth-proxy-7d55646b9-nc5jm"
Sep 06 19:34:03.675215 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:03.675127    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6wnc\" (UniqueName: \"kubernetes.io/projected/2b60b24a-c1db-4efd-8491-824719bb3c92-kube-api-access-m6wnc\") pod \"kube-auth-proxy-7d55646b9-nc5jm\" (UID: \"2b60b24a-c1db-4efd-8491-824719bb3c92\") " pod="openshift-ingress/kube-auth-proxy-7d55646b9-nc5jm"
Sep 06 19:34:03.776127 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:03.776070    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6wnc\" (UniqueName: \"kubernetes.io/projected/2b60b24a-c1db-4efd-8491-824719bb3c92-kube-api-access-m6wnc\") pod \"kube-auth-proxy-7d55646b9-nc5jm\" (UID: \"2b60b24a-c1db-4efd-8491-824719bb3c92\") " pod="openshift-ingress/kube-auth-proxy-7d55646b9-nc5jm"
Sep 06 19:34:03.776127 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:03.776118    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b60b24a-c1db-4efd-8491-824719bb3c92-tmp\") pod \"kube-auth-proxy-7d55646b9-nc5jm\" (UID: \"2b60b24a-c1db-4efd-8491-824719bb3c92\") " pod="openshift-ingress/kube-auth-proxy-7d55646b9-nc5jm"
Sep 06 19:34:03.776396 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:03.776179    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b60b24a-c1db-4efd-8491-824719bb3c92-tls-certs\") pod \"kube-auth-proxy-7d55646b9-nc5jm\" (UID: \"2b60b24a-c1db-4efd-8491-824719bb3c92\") " pod="openshift-ingress/kube-auth-proxy-7d55646b9-nc5jm"
Sep 06 19:34:03.776396 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:34:03.776286    2568 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 06 19:34:03.776396 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:34:03.776363    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b60b24a-c1db-4efd-8491-824719bb3c92-tls-certs podName:2b60b24a-c1db-4efd-8491-824719bb3c92 nodeName:}" failed. No retries permitted until 2026-09-06 19:34:04.276343832 +0000 UTC m=+407.681302878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2b60b24a-c1db-4efd-8491-824719bb3c92-tls-certs") pod "kube-auth-proxy-7d55646b9-nc5jm" (UID: "2b60b24a-c1db-4efd-8491-824719bb3c92") : secret "kube-auth-proxy-tls" not found
Sep 06 19:34:03.778714 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:03.778681    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b60b24a-c1db-4efd-8491-824719bb3c92-tmp\") pod \"kube-auth-proxy-7d55646b9-nc5jm\" (UID: \"2b60b24a-c1db-4efd-8491-824719bb3c92\") " pod="openshift-ingress/kube-auth-proxy-7d55646b9-nc5jm"
Sep 06 19:34:03.784485 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:03.784461    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6wnc\" (UniqueName: \"kubernetes.io/projected/2b60b24a-c1db-4efd-8491-824719bb3c92-kube-api-access-m6wnc\") pod \"kube-auth-proxy-7d55646b9-nc5jm\" (UID: \"2b60b24a-c1db-4efd-8491-824719bb3c92\") " pod="openshift-ingress/kube-auth-proxy-7d55646b9-nc5jm"
Sep 06 19:34:04.012670 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.012636    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:04.280199 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.280116    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b60b24a-c1db-4efd-8491-824719bb3c92-tls-certs\") pod \"kube-auth-proxy-7d55646b9-nc5jm\" (UID: \"2b60b24a-c1db-4efd-8491-824719bb3c92\") " pod="openshift-ingress/kube-auth-proxy-7d55646b9-nc5jm"
Sep 06 19:34:04.282879 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.282854    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b60b24a-c1db-4efd-8491-824719bb3c92-tls-certs\") pod \"kube-auth-proxy-7d55646b9-nc5jm\" (UID: \"2b60b24a-c1db-4efd-8491-824719bb3c92\") " pod="openshift-ingress/kube-auth-proxy-7d55646b9-nc5jm"
Sep 06 19:34:04.564580 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.564492    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d55646b9-nc5jm"
Sep 06 19:34:04.779238 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.779186    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:04.780093 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.780072    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"]
Sep 06 19:34:04.782224 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.782204    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:04.784807 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.784771    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 06 19:34:04.784807 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.784773    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 06 19:34:04.784966 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.784831    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-t2j56\""
Sep 06 19:34:04.784966 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.784771    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 06 19:34:04.785045 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.785015    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 06 19:34:04.796342 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.796317    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"]
Sep 06 19:34:04.839243 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.839161    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d55646b9-nc5jm"]
Sep 06 19:34:04.841939 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:34:04.841909    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b60b24a_c1db_4efd_8491_824719bb3c92.slice/crio-c60b68e44e5c42195dd965ca3e6c0acf78366a873b3e5423ce10d6d88ff17c3e WatchSource:0}: Error finding container c60b68e44e5c42195dd965ca3e6c0acf78366a873b3e5423ce10d6d88ff17c3e: Status 404 returned error can't find the container with id c60b68e44e5c42195dd965ca3e6c0acf78366a873b3e5423ce10d6d88ff17c3e
Sep 06 19:34:04.850043 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.850015    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:04.885888 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.885851    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/990282d3-7107-44b2-beb6-8294f8dac48c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-lpxkc\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:04.886064 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.885902    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/990282d3-7107-44b2-beb6-8294f8dac48c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-lpxkc\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:04.886064 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.885921    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/990282d3-7107-44b2-beb6-8294f8dac48c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-lpxkc\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:04.886161 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.886071    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/990282d3-7107-44b2-beb6-8294f8dac48c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-lpxkc\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:04.886215 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.886173    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/990282d3-7107-44b2-beb6-8294f8dac48c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-lpxkc\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:04.886262 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.886215    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2kh8\" (UniqueName: \"kubernetes.io/projected/990282d3-7107-44b2-beb6-8294f8dac48c-kube-api-access-h2kh8\") pod \"istiod-openshift-gateway-7b7995d5cd-lpxkc\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:04.886262 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.886247    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/990282d3-7107-44b2-beb6-8294f8dac48c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-lpxkc\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:04.986599 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.986564    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/990282d3-7107-44b2-beb6-8294f8dac48c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-lpxkc\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:04.986741 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.986607    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/990282d3-7107-44b2-beb6-8294f8dac48c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-lpxkc\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:04.986741 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.986623    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/990282d3-7107-44b2-beb6-8294f8dac48c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-lpxkc\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:04.986902 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.986747    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/990282d3-7107-44b2-beb6-8294f8dac48c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-lpxkc\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:04.986902 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.986807    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/990282d3-7107-44b2-beb6-8294f8dac48c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-lpxkc\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:04.986902 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.986840    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2kh8\" (UniqueName: \"kubernetes.io/projected/990282d3-7107-44b2-beb6-8294f8dac48c-kube-api-access-h2kh8\") pod \"istiod-openshift-gateway-7b7995d5cd-lpxkc\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:04.986902 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.986878    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/990282d3-7107-44b2-beb6-8294f8dac48c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-lpxkc\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:04.987450 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.987425    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/990282d3-7107-44b2-beb6-8294f8dac48c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-lpxkc\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:04.989253 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.989223    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/990282d3-7107-44b2-beb6-8294f8dac48c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-lpxkc\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:04.989353 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.989337    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/990282d3-7107-44b2-beb6-8294f8dac48c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-lpxkc\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:04.989567 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.989547    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/990282d3-7107-44b2-beb6-8294f8dac48c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-lpxkc\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:04.989657 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.989594    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/990282d3-7107-44b2-beb6-8294f8dac48c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-lpxkc\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:04.994465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.994439    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2kh8\" (UniqueName: \"kubernetes.io/projected/990282d3-7107-44b2-beb6-8294f8dac48c-kube-api-access-h2kh8\") pod \"istiod-openshift-gateway-7b7995d5cd-lpxkc\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:04.994558 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:04.994540    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/990282d3-7107-44b2-beb6-8294f8dac48c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-lpxkc\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:05.091539 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:05.091431    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:05.363886 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:05.363811    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"]
Sep 06 19:34:05.366614 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:34:05.366587    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod990282d3_7107_44b2_beb6_8294f8dac48c.slice/crio-85011ef899039f6bc6e0b0e5ed4d480fe2f2b41511e927c2bd929624fe06471e WatchSource:0}: Error finding container 85011ef899039f6bc6e0b0e5ed4d480fe2f2b41511e927c2bd929624fe06471e: Status 404 returned error can't find the container with id 85011ef899039f6bc6e0b0e5ed4d480fe2f2b41511e927c2bd929624fe06471e
Sep 06 19:34:05.542870 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:05.542740    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:05.641336 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:05.641277    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:05.651192 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:05.649876    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc" event={"ID":"990282d3-7107-44b2-beb6-8294f8dac48c","Type":"ContainerStarted","Data":"85011ef899039f6bc6e0b0e5ed4d480fe2f2b41511e927c2bd929624fe06471e"}
Sep 06 19:34:05.651845 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:05.651818    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d55646b9-nc5jm" event={"ID":"2b60b24a-c1db-4efd-8491-824719bb3c92","Type":"ContainerStarted","Data":"c60b68e44e5c42195dd965ca3e6c0acf78366a873b3e5423ce10d6d88ff17c3e"}
Sep 06 19:34:05.743865 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:05.743828    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:05.842894 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:05.842857    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:06.236936 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:06.236889    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:06.290256 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:06.290218    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:07.664890 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:07.664843    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d55646b9-nc5jm" event={"ID":"2b60b24a-c1db-4efd-8491-824719bb3c92","Type":"ContainerStarted","Data":"8b840630d8bd1ede1067312215995a16c6d841f3af1fc414ae22bcde6f557c8c"}
Sep 06 19:34:07.681845 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:07.680971    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d55646b9-nc5jm" podStartSLOduration=2.056862328 podStartE2EDuration="4.680949965s" totalImagesPullingTime="2.624087637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:34:07.680044924 +0000 UTC m=+411.085003993" watchObservedRunningTime="2026-09-06 19:34:07.680949965 +0000 UTC m=+411.085909035"
Sep 06 19:34:09.269016 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:09.268981    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:09.326026 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:09.325971    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:09.335686 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:09.335651    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 19:34:09.335835 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:09.335732    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 19:34:09.425841 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:09.425799    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:09.526079 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:09.525977    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:09.676079 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:09.676034    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc" event={"ID":"990282d3-7107-44b2-beb6-8294f8dac48c","Type":"ContainerStarted","Data":"2e27a662336108a439965e1714813e8794826c3975d921b4f6fa51e838877590"}
Sep 06 19:34:09.676241 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:09.676139    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:09.691077 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:09.691047    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:09.696977 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:09.696930    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc" podStartSLOduration=1.730144678 podStartE2EDuration="5.696912661s" totalImagesPullingTime="3.966767983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:34:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:34:09.694426679 +0000 UTC m=+413.099385749" watchObservedRunningTime="2026-09-06 19:34:09.696912661 +0000 UTC m=+413.101871729"
Sep 06 19:34:09.999491 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:09.999438    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:10.294326 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:10.294209    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:10.402012 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:10.401977    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:10.682218 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:10.682186    2568 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-lpxkc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 06 19:34:10.682394 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:10.682239    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc" podUID="990282d3-7107-44b2-beb6-8294f8dac48c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 19:34:10.876096 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:10.876066    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:11.134838 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:11.134803    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:11.399186 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:11.399072    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:13.681878 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:13.681846    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:16.755591 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:16.755553    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:17.001756 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:17.001715    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:17.102650 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:17.102564    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:18.354691 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.354654    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:18.407832 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.407799    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v79g2"]
Sep 06 19:34:18.414736 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.414713    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v79g2"
Sep 06 19:34:18.417601 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.417579    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 06 19:34:18.418595 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.418572    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-v78lh\""
Sep 06 19:34:18.420012 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.419993    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jxv8g"]
Sep 06 19:34:18.421932 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.421903    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxv8g"
Sep 06 19:34:18.424037 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.424016    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v79g2"]
Sep 06 19:34:18.424374 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.424356    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 06 19:34:18.424456 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.424417    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-8n8zz\""
Sep 06 19:34:18.440256 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.440223    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jxv8g"]
Sep 06 19:34:18.444378 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.444352    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:18.497118 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.497083    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4kt8\" (UniqueName: \"kubernetes.io/projected/686c55be-e970-4a2c-9af8-366c2a9ae6f1-kube-api-access-n4kt8\") pod \"kserve-controller-manager-d6f4b65b8-v79g2\" (UID: \"686c55be-e970-4a2c-9af8-366c2a9ae6f1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v79g2"
Sep 06 19:34:18.497118 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.497123    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/686c55be-e970-4a2c-9af8-366c2a9ae6f1-cert\") pod \"kserve-controller-manager-d6f4b65b8-v79g2\" (UID: \"686c55be-e970-4a2c-9af8-366c2a9ae6f1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v79g2"
Sep 06 19:34:18.497347 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.497156    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9p59\" (UniqueName: \"kubernetes.io/projected/1a3ebeb4-7f09-4e1e-97e1-707583cbd97c-kube-api-access-v9p59\") pod \"llmisvc-controller-manager-777c6bd7d5-jxv8g\" (UID: \"1a3ebeb4-7f09-4e1e-97e1-707583cbd97c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxv8g"
Sep 06 19:34:18.497347 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.497287    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a3ebeb4-7f09-4e1e-97e1-707583cbd97c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jxv8g\" (UID: \"1a3ebeb4-7f09-4e1e-97e1-707583cbd97c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxv8g"
Sep 06 19:34:18.545877 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.545821    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:18.598053 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.598012    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a3ebeb4-7f09-4e1e-97e1-707583cbd97c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jxv8g\" (UID: \"1a3ebeb4-7f09-4e1e-97e1-707583cbd97c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxv8g"
Sep 06 19:34:18.598247 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.598065    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4kt8\" (UniqueName: \"kubernetes.io/projected/686c55be-e970-4a2c-9af8-366c2a9ae6f1-kube-api-access-n4kt8\") pod \"kserve-controller-manager-d6f4b65b8-v79g2\" (UID: \"686c55be-e970-4a2c-9af8-366c2a9ae6f1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v79g2"
Sep 06 19:34:18.598247 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.598093    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/686c55be-e970-4a2c-9af8-366c2a9ae6f1-cert\") pod \"kserve-controller-manager-d6f4b65b8-v79g2\" (UID: \"686c55be-e970-4a2c-9af8-366c2a9ae6f1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v79g2"
Sep 06 19:34:18.598247 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.598119    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9p59\" (UniqueName: \"kubernetes.io/projected/1a3ebeb4-7f09-4e1e-97e1-707583cbd97c-kube-api-access-v9p59\") pod \"llmisvc-controller-manager-777c6bd7d5-jxv8g\" (UID: \"1a3ebeb4-7f09-4e1e-97e1-707583cbd97c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxv8g"
Sep 06 19:34:18.598247 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:34:18.598243    2568 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 06 19:34:18.598423 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:34:18.598326    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/686c55be-e970-4a2c-9af8-366c2a9ae6f1-cert podName:686c55be-e970-4a2c-9af8-366c2a9ae6f1 nodeName:}" failed. No retries permitted until 2026-09-06 19:34:19.098294933 +0000 UTC m=+422.503253988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/686c55be-e970-4a2c-9af8-366c2a9ae6f1-cert") pod "kserve-controller-manager-d6f4b65b8-v79g2" (UID: "686c55be-e970-4a2c-9af8-366c2a9ae6f1") : secret "kserve-webhook-server-cert" not found
Sep 06 19:34:18.600605 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.600585    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a3ebeb4-7f09-4e1e-97e1-707583cbd97c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jxv8g\" (UID: \"1a3ebeb4-7f09-4e1e-97e1-707583cbd97c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxv8g"
Sep 06 19:34:18.615527 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.615470    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9p59\" (UniqueName: \"kubernetes.io/projected/1a3ebeb4-7f09-4e1e-97e1-707583cbd97c-kube-api-access-v9p59\") pod \"llmisvc-controller-manager-777c6bd7d5-jxv8g\" (UID: \"1a3ebeb4-7f09-4e1e-97e1-707583cbd97c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxv8g"
Sep 06 19:34:18.616018 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.616002    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4kt8\" (UniqueName: \"kubernetes.io/projected/686c55be-e970-4a2c-9af8-366c2a9ae6f1-kube-api-access-n4kt8\") pod \"kserve-controller-manager-d6f4b65b8-v79g2\" (UID: \"686c55be-e970-4a2c-9af8-366c2a9ae6f1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v79g2"
Sep 06 19:34:18.733584 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.733541    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxv8g"
Sep 06 19:34:18.879533 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:18.879494    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:19.004544 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:19.004510    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jxv8g"]
Sep 06 19:34:19.007170 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:34:19.007144    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1a3ebeb4_7f09_4e1e_97e1_707583cbd97c.slice/crio-341569b02ddaddf7c7f6fa3df7ad0d968826a53e34375970b6a42ce1536e9b1a WatchSource:0}: Error finding container 341569b02ddaddf7c7f6fa3df7ad0d968826a53e34375970b6a42ce1536e9b1a: Status 404 returned error can't find the container with id 341569b02ddaddf7c7f6fa3df7ad0d968826a53e34375970b6a42ce1536e9b1a
Sep 06 19:34:19.102629 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:19.102595    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/686c55be-e970-4a2c-9af8-366c2a9ae6f1-cert\") pod \"kserve-controller-manager-d6f4b65b8-v79g2\" (UID: \"686c55be-e970-4a2c-9af8-366c2a9ae6f1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v79g2"
Sep 06 19:34:19.105181 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:19.105145    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/686c55be-e970-4a2c-9af8-366c2a9ae6f1-cert\") pod \"kserve-controller-manager-d6f4b65b8-v79g2\" (UID: \"686c55be-e970-4a2c-9af8-366c2a9ae6f1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v79g2"
Sep 06 19:34:19.326543 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:19.326445    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v79g2"
Sep 06 19:34:19.621060 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:19.621036    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v79g2"]
Sep 06 19:34:19.622614 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:34:19.622590    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod686c55be_e970_4a2c_9af8_366c2a9ae6f1.slice/crio-8a3e21a4a7bde5463194111c61f0bc6e452fa15dc56a74314afcdc750ce8a6c0 WatchSource:0}: Error finding container 8a3e21a4a7bde5463194111c61f0bc6e452fa15dc56a74314afcdc750ce8a6c0: Status 404 returned error can't find the container with id 8a3e21a4a7bde5463194111c61f0bc6e452fa15dc56a74314afcdc750ce8a6c0
Sep 06 19:34:19.719925 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:19.719888    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxv8g" event={"ID":"1a3ebeb4-7f09-4e1e-97e1-707583cbd97c","Type":"ContainerStarted","Data":"341569b02ddaddf7c7f6fa3df7ad0d968826a53e34375970b6a42ce1536e9b1a"}
Sep 06 19:34:19.721086 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:19.721059    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v79g2" event={"ID":"686c55be-e970-4a2c-9af8-366c2a9ae6f1","Type":"ContainerStarted","Data":"8a3e21a4a7bde5463194111c61f0bc6e452fa15dc56a74314afcdc750ce8a6c0"}
Sep 06 19:34:20.109176 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:20.109134    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:20.205757 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:20.205720    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:20.321221 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:20.321160    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:20.678247 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:20.678215    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"]
Sep 06 19:34:20.678717 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:20.678468    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc" podUID="990282d3-7107-44b2-beb6-8294f8dac48c" containerName="discovery" containerID="cri-o://2e27a662336108a439965e1714813e8794826c3975d921b4f6fa51e838877590" gracePeriod=30
Sep 06 19:34:20.944296 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:20.944273    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:21.019879 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.019846    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/990282d3-7107-44b2-beb6-8294f8dac48c-istio-kubeconfig\") pod \"990282d3-7107-44b2-beb6-8294f8dac48c\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") "
Sep 06 19:34:21.020073 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.019918    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/990282d3-7107-44b2-beb6-8294f8dac48c-istio-csr-dns-cert\") pod \"990282d3-7107-44b2-beb6-8294f8dac48c\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") "
Sep 06 19:34:21.020073 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.019949    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2kh8\" (UniqueName: \"kubernetes.io/projected/990282d3-7107-44b2-beb6-8294f8dac48c-kube-api-access-h2kh8\") pod \"990282d3-7107-44b2-beb6-8294f8dac48c\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") "
Sep 06 19:34:21.020073 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.019997    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/990282d3-7107-44b2-beb6-8294f8dac48c-istio-csr-ca-configmap\") pod \"990282d3-7107-44b2-beb6-8294f8dac48c\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") "
Sep 06 19:34:21.020073 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.020024    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/990282d3-7107-44b2-beb6-8294f8dac48c-cacerts\") pod \"990282d3-7107-44b2-beb6-8294f8dac48c\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") "
Sep 06 19:34:21.020073 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.020056    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/990282d3-7107-44b2-beb6-8294f8dac48c-istio-token\") pod \"990282d3-7107-44b2-beb6-8294f8dac48c\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") "
Sep 06 19:34:21.020317 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.020099    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/990282d3-7107-44b2-beb6-8294f8dac48c-local-certs\") pod \"990282d3-7107-44b2-beb6-8294f8dac48c\" (UID: \"990282d3-7107-44b2-beb6-8294f8dac48c\") "
Sep 06 19:34:21.021354 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.021326    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/990282d3-7107-44b2-beb6-8294f8dac48c-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "990282d3-7107-44b2-beb6-8294f8dac48c" (UID: "990282d3-7107-44b2-beb6-8294f8dac48c"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:34:21.024156 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.024120    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/990282d3-7107-44b2-beb6-8294f8dac48c-kube-api-access-h2kh8" (OuterVolumeSpecName: "kube-api-access-h2kh8") pod "990282d3-7107-44b2-beb6-8294f8dac48c" (UID: "990282d3-7107-44b2-beb6-8294f8dac48c"). InnerVolumeSpecName "kube-api-access-h2kh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:34:21.024247 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.024159    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/990282d3-7107-44b2-beb6-8294f8dac48c-local-certs" (OuterVolumeSpecName: "local-certs") pod "990282d3-7107-44b2-beb6-8294f8dac48c" (UID: "990282d3-7107-44b2-beb6-8294f8dac48c"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 19:34:21.024409 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.024367    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/990282d3-7107-44b2-beb6-8294f8dac48c-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "990282d3-7107-44b2-beb6-8294f8dac48c" (UID: "990282d3-7107-44b2-beb6-8294f8dac48c"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:34:21.025129 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.025103    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/990282d3-7107-44b2-beb6-8294f8dac48c-cacerts" (OuterVolumeSpecName: "cacerts") pod "990282d3-7107-44b2-beb6-8294f8dac48c" (UID: "990282d3-7107-44b2-beb6-8294f8dac48c"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:34:21.025276 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.025250    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/990282d3-7107-44b2-beb6-8294f8dac48c-istio-token" (OuterVolumeSpecName: "istio-token") pod "990282d3-7107-44b2-beb6-8294f8dac48c" (UID: "990282d3-7107-44b2-beb6-8294f8dac48c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:34:21.025654 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.025632    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/990282d3-7107-44b2-beb6-8294f8dac48c-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "990282d3-7107-44b2-beb6-8294f8dac48c" (UID: "990282d3-7107-44b2-beb6-8294f8dac48c"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:34:21.120953 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.120922    2568 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/990282d3-7107-44b2-beb6-8294f8dac48c-istio-kubeconfig\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:34:21.120953 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.120952    2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/990282d3-7107-44b2-beb6-8294f8dac48c-istio-csr-dns-cert\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:34:21.121196 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.120967    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2kh8\" (UniqueName: \"kubernetes.io/projected/990282d3-7107-44b2-beb6-8294f8dac48c-kube-api-access-h2kh8\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:34:21.121196 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.120978    2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/990282d3-7107-44b2-beb6-8294f8dac48c-istio-csr-ca-configmap\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:34:21.121196 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.120986    2568 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/990282d3-7107-44b2-beb6-8294f8dac48c-cacerts\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:34:21.121196 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.120995    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/990282d3-7107-44b2-beb6-8294f8dac48c-istio-token\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:34:21.121196 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.121008    2568 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/990282d3-7107-44b2-beb6-8294f8dac48c-local-certs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:34:21.732129 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.732088    2568 generic.go:356] "Generic (PLEG): container finished" podID="990282d3-7107-44b2-beb6-8294f8dac48c" containerID="2e27a662336108a439965e1714813e8794826c3975d921b4f6fa51e838877590" exitCode=0
Sep 06 19:34:21.732620 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.732149    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"
Sep 06 19:34:21.732620 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.732195    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc" event={"ID":"990282d3-7107-44b2-beb6-8294f8dac48c","Type":"ContainerDied","Data":"2e27a662336108a439965e1714813e8794826c3975d921b4f6fa51e838877590"}
Sep 06 19:34:21.732620 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.732276    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc" event={"ID":"990282d3-7107-44b2-beb6-8294f8dac48c","Type":"ContainerDied","Data":"85011ef899039f6bc6e0b0e5ed4d480fe2f2b41511e927c2bd929624fe06471e"}
Sep 06 19:34:21.732620 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.732306    2568 scope.go:117] "RemoveContainer" containerID="2e27a662336108a439965e1714813e8794826c3975d921b4f6fa51e838877590"
Sep 06 19:34:21.750916 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.750880    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"]
Sep 06 19:34:21.754159 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:21.754134    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lpxkc"]
Sep 06 19:34:22.178815 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:22.178772    2568 scope.go:117] "RemoveContainer" containerID="2e27a662336108a439965e1714813e8794826c3975d921b4f6fa51e838877590"
Sep 06 19:34:22.179178 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:34:22.179154    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e27a662336108a439965e1714813e8794826c3975d921b4f6fa51e838877590\": container with ID starting with 2e27a662336108a439965e1714813e8794826c3975d921b4f6fa51e838877590 not found: ID does not exist" containerID="2e27a662336108a439965e1714813e8794826c3975d921b4f6fa51e838877590"
Sep 06 19:34:22.179263 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:22.179190    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e27a662336108a439965e1714813e8794826c3975d921b4f6fa51e838877590"} err="failed to get container status \"2e27a662336108a439965e1714813e8794826c3975d921b4f6fa51e838877590\": rpc error: code = NotFound desc = could not find container \"2e27a662336108a439965e1714813e8794826c3975d921b4f6fa51e838877590\": container with ID starting with 2e27a662336108a439965e1714813e8794826c3975d921b4f6fa51e838877590 not found: ID does not exist"
Sep 06 19:34:22.739748 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:22.739707    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v79g2" event={"ID":"686c55be-e970-4a2c-9af8-366c2a9ae6f1","Type":"ContainerStarted","Data":"e3f364e0b0f29a20285b3942c01f6ae91c046cab64e86c4c00f5258aa7d5652b"}
Sep 06 19:34:22.740233 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:22.739827    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v79g2"
Sep 06 19:34:22.741197 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:22.741158    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxv8g" event={"ID":"1a3ebeb4-7f09-4e1e-97e1-707583cbd97c","Type":"ContainerStarted","Data":"ffbf1c950aaf8265aa850797ddcdd5a25d36a4fe6209a3f3ffc98d69bb3548da"}
Sep 06 19:34:22.741357 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:22.741323    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxv8g"
Sep 06 19:34:22.754558 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:22.754506    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v79g2" podStartSLOduration=2.188088032 podStartE2EDuration="4.754487615s" totalImagesPullingTime="2.566399583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:34:22.753427004 +0000 UTC m=+426.158386073" watchObservedRunningTime="2026-09-06 19:34:22.754487615 +0000 UTC m=+426.159446684"
Sep 06 19:34:22.768104 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:22.768053    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxv8g" podStartSLOduration=1.588292915 podStartE2EDuration="4.768037273s" totalImagesPullingTime="3.179744358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:34:22.767079837 +0000 UTC m=+426.172038906" watchObservedRunningTime="2026-09-06 19:34:22.768037273 +0000 UTC m=+426.172996340"
Sep 06 19:34:23.114522 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:23.114446    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="990282d3-7107-44b2-beb6-8294f8dac48c" path="/var/lib/kubelet/pods/990282d3-7107-44b2-beb6-8294f8dac48c/volumes"
Sep 06 19:34:53.746854 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:53.746752    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxv8g"
Sep 06 19:34:53.749718 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:53.749696    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v79g2"
Sep 06 19:34:58.840148 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:58.840112    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:34:58.940955 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:34:58.940911    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:10.163079 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:10.162994    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:10.275280 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:10.275239    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:22.371689 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:22.371653    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:24.405658 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:24.405620    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78"]
Sep 06 19:35:24.406097 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:24.405933    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="990282d3-7107-44b2-beb6-8294f8dac48c" containerName="discovery"
Sep 06 19:35:24.406097 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:24.405945    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="990282d3-7107-44b2-beb6-8294f8dac48c" containerName="discovery"
Sep 06 19:35:24.406097 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:24.406005    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="990282d3-7107-44b2-beb6-8294f8dac48c" containerName="discovery"
Sep 06 19:35:24.408524 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:24.408507    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78"
Sep 06 19:35:24.411194 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:24.411164    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 06 19:35:24.411331 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:24.411301    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-98slt\""
Sep 06 19:35:24.412216 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:24.412198    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 06 19:35:24.418000 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:24.417975    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78"]
Sep 06 19:35:24.501259 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:24.501221    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svb74\" (UniqueName: \"kubernetes.io/projected/3c54a55a-dbaa-431f-b94e-c2b547dff6c0-kube-api-access-svb74\") pod \"limitador-operator-controller-manager-6c549b6d85-qtp78\" (UID: \"3c54a55a-dbaa-431f-b94e-c2b547dff6c0\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78"
Sep 06 19:35:24.602459 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:24.602421    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svb74\" (UniqueName: \"kubernetes.io/projected/3c54a55a-dbaa-431f-b94e-c2b547dff6c0-kube-api-access-svb74\") pod \"limitador-operator-controller-manager-6c549b6d85-qtp78\" (UID: \"3c54a55a-dbaa-431f-b94e-c2b547dff6c0\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78"
Sep 06 19:35:24.622192 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:24.622154    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svb74\" (UniqueName: \"kubernetes.io/projected/3c54a55a-dbaa-431f-b94e-c2b547dff6c0-kube-api-access-svb74\") pod \"limitador-operator-controller-manager-6c549b6d85-qtp78\" (UID: \"3c54a55a-dbaa-431f-b94e-c2b547dff6c0\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78"
Sep 06 19:35:24.719186 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:24.719097    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78"
Sep 06 19:35:24.957795 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:24.957747    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:24.998799 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:24.998698    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78"]
Sep 06 19:35:25.004143 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:35:25.004111    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c54a55a_dbaa_431f_b94e_c2b547dff6c0.slice/crio-41d5d8a21e8c9126ede5d1b96b3c4f92864a0108eb882f89915c37630e5b1619 WatchSource:0}: Error finding container 41d5d8a21e8c9126ede5d1b96b3c4f92864a0108eb882f89915c37630e5b1619: Status 404 returned error can't find the container with id 41d5d8a21e8c9126ede5d1b96b3c4f92864a0108eb882f89915c37630e5b1619
Sep 06 19:35:25.363175 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:25.363087    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:25.771141 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:25.771111    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:26.009827 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:26.009771    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78" event={"ID":"3c54a55a-dbaa-431f-b94e-c2b547dff6c0","Type":"ContainerStarted","Data":"41d5d8a21e8c9126ede5d1b96b3c4f92864a0108eb882f89915c37630e5b1619"}
Sep 06 19:35:28.607588 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:28.607529    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:28.645542 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:28.645505    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"]
Sep 06 19:35:28.655454 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:28.655419    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"
Sep 06 19:35:28.658541 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:28.658283    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-986z8\""
Sep 06 19:35:28.658679 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:28.658631    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"]
Sep 06 19:35:28.734416 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:28.734375    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05f16bef-2561-4159-ba9c-4af16d7f5fdb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-mfj9r\" (UID: \"05f16bef-2561-4159-ba9c-4af16d7f5fdb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"
Sep 06 19:35:28.734596 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:28.734425    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmbg4\" (UniqueName: \"kubernetes.io/projected/05f16bef-2561-4159-ba9c-4af16d7f5fdb-kube-api-access-gmbg4\") pod \"kuadrant-operator-controller-manager-58fc56757c-mfj9r\" (UID: \"05f16bef-2561-4159-ba9c-4af16d7f5fdb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"
Sep 06 19:35:28.767667 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:28.767586    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:28.835856 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:28.835821    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05f16bef-2561-4159-ba9c-4af16d7f5fdb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-mfj9r\" (UID: \"05f16bef-2561-4159-ba9c-4af16d7f5fdb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"
Sep 06 19:35:28.836038 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:28.835867    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmbg4\" (UniqueName: \"kubernetes.io/projected/05f16bef-2561-4159-ba9c-4af16d7f5fdb-kube-api-access-gmbg4\") pod \"kuadrant-operator-controller-manager-58fc56757c-mfj9r\" (UID: \"05f16bef-2561-4159-ba9c-4af16d7f5fdb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"
Sep 06 19:35:28.836234 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:28.836213    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05f16bef-2561-4159-ba9c-4af16d7f5fdb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-mfj9r\" (UID: \"05f16bef-2561-4159-ba9c-4af16d7f5fdb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"
Sep 06 19:35:28.846320 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:28.846276    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmbg4\" (UniqueName: \"kubernetes.io/projected/05f16bef-2561-4159-ba9c-4af16d7f5fdb-kube-api-access-gmbg4\") pod \"kuadrant-operator-controller-manager-58fc56757c-mfj9r\" (UID: \"05f16bef-2561-4159-ba9c-4af16d7f5fdb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"
Sep 06 19:35:28.971185 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:28.971148    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"
Sep 06 19:35:29.387452 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:29.387407    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:29.634468 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:29.634441    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:29.737385 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:29.737288    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:29.783598 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:29.783572    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"]
Sep 06 19:35:29.786651 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:35:29.786622    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05f16bef_2561_4159_ba9c_4af16d7f5fdb.slice/crio-5b0a70ae5b033d50acb0411f5cf968f387d24df26125e5c6e0dd783be9307bee WatchSource:0}: Error finding container 5b0a70ae5b033d50acb0411f5cf968f387d24df26125e5c6e0dd783be9307bee: Status 404 returned error can't find the container with id 5b0a70ae5b033d50acb0411f5cf968f387d24df26125e5c6e0dd783be9307bee
Sep 06 19:35:30.029986 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:30.029888    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r" event={"ID":"05f16bef-2561-4159-ba9c-4af16d7f5fdb","Type":"ContainerStarted","Data":"5b0a70ae5b033d50acb0411f5cf968f387d24df26125e5c6e0dd783be9307bee"}
Sep 06 19:35:30.031561 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:30.031535    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78" event={"ID":"3c54a55a-dbaa-431f-b94e-c2b547dff6c0","Type":"ContainerStarted","Data":"e9cf94fb1ea5b2c164e7b45926954d29bd69cee09b24c4b84897fa054dc0788a"}
Sep 06 19:35:30.031703 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:30.031652    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78"
Sep 06 19:35:30.064126 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:30.064070    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78" podStartSLOduration=1.497098771 podStartE2EDuration="6.064052672s" totalImagesPullingTime="4.566953901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:35:30.061655306 +0000 UTC m=+493.466614375" watchObservedRunningTime="2026-09-06 19:35:30.064052672 +0000 UTC m=+493.469011739"
Sep 06 19:35:31.230408 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:31.230370    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:31.283315 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:31.283278    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-btg8p"]
Sep 06 19:35:31.287757 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:31.287733    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-btg8p"
Sep 06 19:35:31.290520 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:31.290500    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-59qmb\""
Sep 06 19:35:31.297546 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:31.297520    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-btg8p"]
Sep 06 19:35:31.335320 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:31.335275    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:31.356508 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:31.356471    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzq7z\" (UniqueName: \"kubernetes.io/projected/56b17505-b75d-4401-9dfe-fd36a7059322-kube-api-access-tzq7z\") pod \"authorino-operator-68d88948d8-btg8p\" (UID: \"56b17505-b75d-4401-9dfe-fd36a7059322\") " pod="kuadrant-system/authorino-operator-68d88948d8-btg8p"
Sep 06 19:35:31.457766 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:31.457725    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzq7z\" (UniqueName: \"kubernetes.io/projected/56b17505-b75d-4401-9dfe-fd36a7059322-kube-api-access-tzq7z\") pod \"authorino-operator-68d88948d8-btg8p\" (UID: \"56b17505-b75d-4401-9dfe-fd36a7059322\") " pod="kuadrant-system/authorino-operator-68d88948d8-btg8p"
Sep 06 19:35:31.469683 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:31.469648    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzq7z\" (UniqueName: \"kubernetes.io/projected/56b17505-b75d-4401-9dfe-fd36a7059322-kube-api-access-tzq7z\") pod \"authorino-operator-68d88948d8-btg8p\" (UID: \"56b17505-b75d-4401-9dfe-fd36a7059322\") " pod="kuadrant-system/authorino-operator-68d88948d8-btg8p"
Sep 06 19:35:31.601528 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:31.601443    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-btg8p"
Sep 06 19:35:31.901512 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:31.901484    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-btg8p"]
Sep 06 19:35:31.903911 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:35:31.903883    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56b17505_b75d_4401_9dfe_fd36a7059322.slice/crio-edc76c3a82efaef86b2b7f23b0f3b0d3a5c52a0f40112e909f34db719b50c318 WatchSource:0}: Error finding container edc76c3a82efaef86b2b7f23b0f3b0d3a5c52a0f40112e909f34db719b50c318: Status 404 returned error can't find the container with id edc76c3a82efaef86b2b7f23b0f3b0d3a5c52a0f40112e909f34db719b50c318
Sep 06 19:35:31.982120 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:31.982081    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:32.043054 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:32.043020    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-btg8p" event={"ID":"56b17505-b75d-4401-9dfe-fd36a7059322","Type":"ContainerStarted","Data":"edc76c3a82efaef86b2b7f23b0f3b0d3a5c52a0f40112e909f34db719b50c318"}
Sep 06 19:35:32.603460 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:32.603426    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:33.614401 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:33.614362    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-srcks"]
Sep 06 19:35:33.617752 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:33.617732    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-srcks"
Sep 06 19:35:33.620738 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:33.620716    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 06 19:35:33.620840 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:33.620750    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-mrczs\""
Sep 06 19:35:33.627943 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:33.627921    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-srcks"]
Sep 06 19:35:33.676447 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:33.676412    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tmck\" (UniqueName: \"kubernetes.io/projected/7400440a-0bc8-48f0-a04c-48bd2f84d325-kube-api-access-6tmck\") pod \"dns-operator-controller-manager-5985564776-srcks\" (UID: \"7400440a-0bc8-48f0-a04c-48bd2f84d325\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-srcks"
Sep 06 19:35:33.777096 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:33.777061    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tmck\" (UniqueName: \"kubernetes.io/projected/7400440a-0bc8-48f0-a04c-48bd2f84d325-kube-api-access-6tmck\") pod \"dns-operator-controller-manager-5985564776-srcks\" (UID: \"7400440a-0bc8-48f0-a04c-48bd2f84d325\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-srcks"
Sep 06 19:35:33.791756 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:33.791722    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tmck\" (UniqueName: \"kubernetes.io/projected/7400440a-0bc8-48f0-a04c-48bd2f84d325-kube-api-access-6tmck\") pod \"dns-operator-controller-manager-5985564776-srcks\" (UID: \"7400440a-0bc8-48f0-a04c-48bd2f84d325\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-srcks"
Sep 06 19:35:33.928503 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:33.928462    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-srcks"
Sep 06 19:35:34.055362 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:34.055317    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r" event={"ID":"05f16bef-2561-4159-ba9c-4af16d7f5fdb","Type":"ContainerStarted","Data":"0b06e83c0709200c0ffe77cebb47e6700573d63d41257bb8e8a4ea20e68dee4e"}
Sep 06 19:35:34.055541 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:34.055428    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"
Sep 06 19:35:34.079962 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:34.079897    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r" podStartSLOduration=2.253567921 podStartE2EDuration="6.079876002s" totalImagesPullingTime="3.826308081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:35:34.077913146 +0000 UTC m=+497.482872215" watchObservedRunningTime="2026-09-06 19:35:34.079876002 +0000 UTC m=+497.484835070"
Sep 06 19:35:34.210722 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:34.210674    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-srcks"]
Sep 06 19:35:34.258703 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:35:34.258674    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7400440a_0bc8_48f0_a04c_48bd2f84d325.slice/crio-d0302ff5a1d33151a227b96ca6db900b63c9d46d21dc4d8ab4b525b33b6384b0 WatchSource:0}: Error finding container d0302ff5a1d33151a227b96ca6db900b63c9d46d21dc4d8ab4b525b33b6384b0: Status 404 returned error can't find the container with id d0302ff5a1d33151a227b96ca6db900b63c9d46d21dc4d8ab4b525b33b6384b0
Sep 06 19:35:34.969983 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:34.969948    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:35.063171 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:35.063039    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-btg8p" event={"ID":"56b17505-b75d-4401-9dfe-fd36a7059322","Type":"ContainerStarted","Data":"0767259ebac333a7bfb39020623eef3c055624b67bd54feb13cfd1ebaddedaa4"}
Sep 06 19:35:35.063372 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:35.063200    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-btg8p"
Sep 06 19:35:35.064599 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:35.064571    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-srcks" event={"ID":"7400440a-0bc8-48f0-a04c-48bd2f84d325","Type":"ContainerStarted","Data":"d0302ff5a1d33151a227b96ca6db900b63c9d46d21dc4d8ab4b525b33b6384b0"}
Sep 06 19:35:35.070058 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:35.070026    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:35.079487 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:35.079434    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-btg8p" podStartSLOduration=1.669560964 podStartE2EDuration="4.079414837s" totalImagesPullingTime="2.409853873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:35:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:35:35.078803287 +0000 UTC m=+498.483762351" watchObservedRunningTime="2026-09-06 19:35:35.079414837 +0000 UTC m=+498.484373908"
Sep 06 19:35:36.070977 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:36.070893    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-srcks" event={"ID":"7400440a-0bc8-48f0-a04c-48bd2f84d325","Type":"ContainerStarted","Data":"0cf99f87249b39dfcd6dda52d095743ad6eabda2a6c6bde4cbc3007de093feb8"}
Sep 06 19:35:36.071327 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:36.070974    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-srcks"
Sep 06 19:35:36.088743 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:36.088691    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-srcks" podStartSLOduration=1.5723427779999999 podStartE2EDuration="3.088673855s" totalImagesPullingTime="1.516331077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:35:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:35:36.087204816 +0000 UTC m=+499.492163953" watchObservedRunningTime="2026-09-06 19:35:36.088673855 +0000 UTC m=+499.493632920"
Sep 06 19:35:36.539338 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:36.539302    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-pf5lm"]
Sep 06 19:35:36.539511 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:36.539371    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:36.542796 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:36.542760    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pf5lm"
Sep 06 19:35:36.545498 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:36.545469    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 06 19:35:36.545498 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:36.545480    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 06 19:35:36.545636 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:36.545500    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zq5kt\""
Sep 06 19:35:36.549556 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:36.549536    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-pf5lm"]
Sep 06 19:35:36.603645 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:36.603607    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/109589e5-010f-4a08-acc8-b68695feebd3-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-pf5lm\" (UID: \"109589e5-010f-4a08-acc8-b68695feebd3\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pf5lm"
Sep 06 19:35:36.603873 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:36.603654    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v78r5\" (UniqueName: \"kubernetes.io/projected/109589e5-010f-4a08-acc8-b68695feebd3-kube-api-access-v78r5\") pod \"kuadrant-console-plugin-598f86468b-pf5lm\" (UID: \"109589e5-010f-4a08-acc8-b68695feebd3\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pf5lm"
Sep 06 19:35:36.603873 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:36.603757    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/109589e5-010f-4a08-acc8-b68695feebd3-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-pf5lm\" (UID: \"109589e5-010f-4a08-acc8-b68695feebd3\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pf5lm"
Sep 06 19:35:36.705080 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:36.705039    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/109589e5-010f-4a08-acc8-b68695feebd3-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-pf5lm\" (UID: \"109589e5-010f-4a08-acc8-b68695feebd3\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pf5lm"
Sep 06 19:35:36.705285 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:36.705095    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/109589e5-010f-4a08-acc8-b68695feebd3-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-pf5lm\" (UID: \"109589e5-010f-4a08-acc8-b68695feebd3\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pf5lm"
Sep 06 19:35:36.705285 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:36.705116    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v78r5\" (UniqueName: \"kubernetes.io/projected/109589e5-010f-4a08-acc8-b68695feebd3-kube-api-access-v78r5\") pod \"kuadrant-console-plugin-598f86468b-pf5lm\" (UID: \"109589e5-010f-4a08-acc8-b68695feebd3\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pf5lm"
Sep 06 19:35:36.705285 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:36.705231    2568 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 06 19:35:36.705387 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:36.705304    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/109589e5-010f-4a08-acc8-b68695feebd3-plugin-serving-cert podName:109589e5-010f-4a08-acc8-b68695feebd3 nodeName:}" failed. No retries permitted until 2026-09-06 19:35:37.205282656 +0000 UTC m=+500.610241702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/109589e5-010f-4a08-acc8-b68695feebd3-plugin-serving-cert") pod "kuadrant-console-plugin-598f86468b-pf5lm" (UID: "109589e5-010f-4a08-acc8-b68695feebd3") : secret "plugin-serving-cert" not found
Sep 06 19:35:36.705755 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:36.705737    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/109589e5-010f-4a08-acc8-b68695feebd3-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-pf5lm\" (UID: \"109589e5-010f-4a08-acc8-b68695feebd3\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pf5lm"
Sep 06 19:35:36.716004 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:36.715983    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v78r5\" (UniqueName: \"kubernetes.io/projected/109589e5-010f-4a08-acc8-b68695feebd3-kube-api-access-v78r5\") pod \"kuadrant-console-plugin-598f86468b-pf5lm\" (UID: \"109589e5-010f-4a08-acc8-b68695feebd3\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pf5lm"
Sep 06 19:35:36.784024 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:36.783991    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:37.209493 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:37.209456    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/109589e5-010f-4a08-acc8-b68695feebd3-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-pf5lm\" (UID: \"109589e5-010f-4a08-acc8-b68695feebd3\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pf5lm"
Sep 06 19:35:37.212419 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:37.212377    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/109589e5-010f-4a08-acc8-b68695feebd3-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-pf5lm\" (UID: \"109589e5-010f-4a08-acc8-b68695feebd3\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pf5lm"
Sep 06 19:35:37.452835 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:37.452770    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pf5lm"
Sep 06 19:35:37.719685 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:37.719644    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-pf5lm"]
Sep 06 19:35:37.722264 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:35:37.722240    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod109589e5_010f_4a08_acc8_b68695feebd3.slice/crio-66ee020a40fe014c9e5b021803cd3d8bd63ec28214248b3000a13577047da109 WatchSource:0}: Error finding container 66ee020a40fe014c9e5b021803cd3d8bd63ec28214248b3000a13577047da109: Status 404 returned error can't find the container with id 66ee020a40fe014c9e5b021803cd3d8bd63ec28214248b3000a13577047da109
Sep 06 19:35:38.080809 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:38.080703    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pf5lm" event={"ID":"109589e5-010f-4a08-acc8-b68695feebd3","Type":"ContainerStarted","Data":"66ee020a40fe014c9e5b021803cd3d8bd63ec28214248b3000a13577047da109"}
Sep 06 19:35:38.765534 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:38.765470    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:38.818528 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:38.818414    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:39.165658 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:39.165602    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:39.219524 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:39.219385    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:39.576396 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:39.576308    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:39.671977 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:39.671945    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:41.039007 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:41.038977    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78"
Sep 06 19:35:43.114284 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:43.114248    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pf5lm" event={"ID":"109589e5-010f-4a08-acc8-b68695feebd3","Type":"ContainerStarted","Data":"ddb06831ea773e861ebed49d1572bbb6e2ce9c3229cec2f9e23921ed7cf00bab"}
Sep 06 19:35:45.067425 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:45.067389    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"
Sep 06 19:35:45.087171 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:45.087104    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pf5lm" podStartSLOduration=3.942710893 podStartE2EDuration="9.087087883s" totalImagesPullingTime="5.14437699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:35:43.124743662 +0000 UTC m=+506.529702730" watchObservedRunningTime="2026-09-06 19:35:45.087087883 +0000 UTC m=+508.492046950"
Sep 06 19:35:46.073685 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:46.073655    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-btg8p"
Sep 06 19:35:46.280405 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:46.280371    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ccbnb"]
Sep 06 19:35:46.283947 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:46.283931    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ccbnb"
Sep 06 19:35:46.294997 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:46.294977    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ccbnb"]
Sep 06 19:35:46.390989 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:46.390961    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00f5c4da-3edd-4bc7-957b-b78a9106ff36-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-ccbnb\" (UID: \"00f5c4da-3edd-4bc7-957b-b78a9106ff36\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ccbnb"
Sep 06 19:35:46.391163 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:46.391008    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqrnn\" (UniqueName: \"kubernetes.io/projected/00f5c4da-3edd-4bc7-957b-b78a9106ff36-kube-api-access-xqrnn\") pod \"kuadrant-operator-controller-manager-96db98c47-ccbnb\" (UID: \"00f5c4da-3edd-4bc7-957b-b78a9106ff36\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ccbnb"
Sep 06 19:35:46.488339 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:46.488305    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ccbnb"]
Sep 06 19:35:46.488571 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:46.488552    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-xqrnn], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ccbnb" podUID="00f5c4da-3edd-4bc7-957b-b78a9106ff36"
Sep 06 19:35:46.491867 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:46.491843    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00f5c4da-3edd-4bc7-957b-b78a9106ff36-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-ccbnb\" (UID: \"00f5c4da-3edd-4bc7-957b-b78a9106ff36\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ccbnb"
Sep 06 19:35:46.491921 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:46.491889    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqrnn\" (UniqueName: \"kubernetes.io/projected/00f5c4da-3edd-4bc7-957b-b78a9106ff36-kube-api-access-xqrnn\") pod \"kuadrant-operator-controller-manager-96db98c47-ccbnb\" (UID: \"00f5c4da-3edd-4bc7-957b-b78a9106ff36\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ccbnb"
Sep 06 19:35:46.492248 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:46.492230    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00f5c4da-3edd-4bc7-957b-b78a9106ff36-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-ccbnb\" (UID: \"00f5c4da-3edd-4bc7-957b-b78a9106ff36\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ccbnb"
Sep 06 19:35:46.506719 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:46.506695    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqrnn\" (UniqueName: \"kubernetes.io/projected/00f5c4da-3edd-4bc7-957b-b78a9106ff36-kube-api-access-xqrnn\") pod \"kuadrant-operator-controller-manager-96db98c47-ccbnb\" (UID: \"00f5c4da-3edd-4bc7-957b-b78a9106ff36\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ccbnb"
Sep 06 19:35:47.077346 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.077307    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-srcks"
Sep 06 19:35:47.116341 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.116303    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"]
Sep 06 19:35:47.116586 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.116523    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r" podUID="05f16bef-2561-4159-ba9c-4af16d7f5fdb" containerName="manager" containerID="cri-o://0b06e83c0709200c0ffe77cebb47e6700573d63d41257bb8e8a4ea20e68dee4e" gracePeriod=2
Sep 06 19:35:47.126964 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.126937    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"]
Sep 06 19:35:47.128826 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.128642    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ccbnb"
Sep 06 19:35:47.129976 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:47.129946    2568 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"05f16bef-2561-4159-ba9c-4af16d7f5fdb\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-58fc56757c-mfj9r\": pods \"kuadrant-operator-controller-manager-58fc56757c-mfj9r\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"
Sep 06 19:35:47.132264 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:47.132237    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-mfj9r\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="05f16bef-2561-4159-ba9c-4af16d7f5fdb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"
Sep 06 19:35:47.140752 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.140729    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln"]
Sep 06 19:35:47.141145 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.141123    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05f16bef-2561-4159-ba9c-4af16d7f5fdb" containerName="manager"
Sep 06 19:35:47.141145 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.141144    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="05f16bef-2561-4159-ba9c-4af16d7f5fdb" containerName="manager"
Sep 06 19:35:47.141302 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.141267    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="05f16bef-2561-4159-ba9c-4af16d7f5fdb" containerName="manager"
Sep 06 19:35:47.144536 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.144514    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln"
Sep 06 19:35:47.157486 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.157458    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln"]
Sep 06 19:35:47.160327 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:47.160284    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-mfj9r\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="05f16bef-2561-4159-ba9c-4af16d7f5fdb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"
Sep 06 19:35:47.171295 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.171258    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ccbnb"]
Sep 06 19:35:47.189449 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.189395    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ccbnb"]
Sep 06 19:35:47.189610 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.189589    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ccbnb"
Sep 06 19:35:47.192012 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:47.191980    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-mfj9r\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="05f16bef-2561-4159-ba9c-4af16d7f5fdb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"
Sep 06 19:35:47.193993 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:47.193965    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-ccbnb\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="00f5c4da-3edd-4bc7-957b-b78a9106ff36" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ccbnb"
Sep 06 19:35:47.196913 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.196885    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-2n4ln\" (UID: \"e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln"
Sep 06 19:35:47.197013 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.196951    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kswk8\" (UniqueName: \"kubernetes.io/projected/e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a-kube-api-access-kswk8\") pod \"kuadrant-operator-controller-manager-58fc56757c-2n4ln\" (UID: \"e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln"
Sep 06 19:35:47.198087 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.198067    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78"]
Sep 06 19:35:47.198249 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.198231    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78" podUID="3c54a55a-dbaa-431f-b94e-c2b547dff6c0" containerName="manager" containerID="cri-o://e9cf94fb1ea5b2c164e7b45926954d29bd69cee09b24c4b84897fa054dc0788a" gracePeriod=2
Sep 06 19:35:47.211146 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:47.210988    2568 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3c54a55a-dbaa-431f-b94e-c2b547dff6c0\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-6c549b6d85-qtp78\": pods \"limitador-operator-controller-manager-6c549b6d85-qtp78\" not found" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78"
Sep 06 19:35:47.211829 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.211808    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78"]
Sep 06 19:35:47.213116 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:47.213089    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-mfj9r\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="05f16bef-2561-4159-ba9c-4af16d7f5fdb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"
Sep 06 19:35:47.215834 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:47.215654    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-ccbnb\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="00f5c4da-3edd-4bc7-957b-b78a9106ff36" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ccbnb"
Sep 06 19:35:47.223763 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.223743    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xbc9k"]
Sep 06 19:35:47.224136 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.224119    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c54a55a-dbaa-431f-b94e-c2b547dff6c0" containerName="manager"
Sep 06 19:35:47.224136 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.224138    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c54a55a-dbaa-431f-b94e-c2b547dff6c0" containerName="manager"
Sep 06 19:35:47.224260 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.224199    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c54a55a-dbaa-431f-b94e-c2b547dff6c0" containerName="manager"
Sep 06 19:35:47.230604 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.228254    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xbc9k"
Sep 06 19:35:47.232258 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:47.232032    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-qtp78\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="3c54a55a-dbaa-431f-b94e-c2b547dff6c0" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78"
Sep 06 19:35:47.234101 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:47.234069    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-mfj9r\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="05f16bef-2561-4159-ba9c-4af16d7f5fdb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"
Sep 06 19:35:47.237361 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.237336    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xbc9k"]
Sep 06 19:35:47.255899 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:47.255870    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-ccbnb\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="00f5c4da-3edd-4bc7-957b-b78a9106ff36" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ccbnb"
Sep 06 19:35:47.297356 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.297327    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00f5c4da-3edd-4bc7-957b-b78a9106ff36-extensions-socket-volume\") pod \"00f5c4da-3edd-4bc7-957b-b78a9106ff36\" (UID: \"00f5c4da-3edd-4bc7-957b-b78a9106ff36\") "
Sep 06 19:35:47.297356 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.297361    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqrnn\" (UniqueName: \"kubernetes.io/projected/00f5c4da-3edd-4bc7-957b-b78a9106ff36-kube-api-access-xqrnn\") pod \"00f5c4da-3edd-4bc7-957b-b78a9106ff36\" (UID: \"00f5c4da-3edd-4bc7-957b-b78a9106ff36\") "
Sep 06 19:35:47.297519 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.297508    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-2n4ln\" (UID: \"e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln"
Sep 06 19:35:47.297567 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.297535    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrfwc\" (UniqueName: \"kubernetes.io/projected/8997338c-99ab-46bc-8867-b0c60d24166d-kube-api-access-jrfwc\") pod \"limitador-operator-controller-manager-6c549b6d85-xbc9k\" (UID: \"8997338c-99ab-46bc-8867-b0c60d24166d\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xbc9k"
Sep 06 19:35:47.297567 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.297562    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kswk8\" (UniqueName: \"kubernetes.io/projected/e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a-kube-api-access-kswk8\") pod \"kuadrant-operator-controller-manager-58fc56757c-2n4ln\" (UID: \"e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln"
Sep 06 19:35:47.297654 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.297585    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00f5c4da-3edd-4bc7-957b-b78a9106ff36-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "00f5c4da-3edd-4bc7-957b-b78a9106ff36" (UID: "00f5c4da-3edd-4bc7-957b-b78a9106ff36"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 19:35:47.297890 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.297867    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-2n4ln\" (UID: \"e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln"
Sep 06 19:35:47.299540 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.299516    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00f5c4da-3edd-4bc7-957b-b78a9106ff36-kube-api-access-xqrnn" (OuterVolumeSpecName: "kube-api-access-xqrnn") pod "00f5c4da-3edd-4bc7-957b-b78a9106ff36" (UID: "00f5c4da-3edd-4bc7-957b-b78a9106ff36"). InnerVolumeSpecName "kube-api-access-xqrnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:35:47.312615 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.312586    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kswk8\" (UniqueName: \"kubernetes.io/projected/e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a-kube-api-access-kswk8\") pod \"kuadrant-operator-controller-manager-58fc56757c-2n4ln\" (UID: \"e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln"
Sep 06 19:35:47.398680 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.398642    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrfwc\" (UniqueName: \"kubernetes.io/projected/8997338c-99ab-46bc-8867-b0c60d24166d-kube-api-access-jrfwc\") pod \"limitador-operator-controller-manager-6c549b6d85-xbc9k\" (UID: \"8997338c-99ab-46bc-8867-b0c60d24166d\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xbc9k"
Sep 06 19:35:47.398875 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.398701    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00f5c4da-3edd-4bc7-957b-b78a9106ff36-extensions-socket-volume\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:35:47.398875 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.398715    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqrnn\" (UniqueName: \"kubernetes.io/projected/00f5c4da-3edd-4bc7-957b-b78a9106ff36-kube-api-access-xqrnn\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:35:47.413609 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.413580    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrfwc\" (UniqueName: \"kubernetes.io/projected/8997338c-99ab-46bc-8867-b0c60d24166d-kube-api-access-jrfwc\") pod \"limitador-operator-controller-manager-6c549b6d85-xbc9k\" (UID: \"8997338c-99ab-46bc-8867-b0c60d24166d\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xbc9k"
Sep 06 19:35:47.423397 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.423378    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"
Sep 06 19:35:47.429700 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.429677    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78"
Sep 06 19:35:47.438916 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:47.438886    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-qtp78\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="3c54a55a-dbaa-431f-b94e-c2b547dff6c0" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78"
Sep 06 19:35:47.441244 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:47.441224    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-mfj9r\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="05f16bef-2561-4159-ba9c-4af16d7f5fdb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"
Sep 06 19:35:47.444594 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:47.444572    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-ccbnb\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="00f5c4da-3edd-4bc7-957b-b78a9106ff36" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ccbnb"
Sep 06 19:35:47.447011 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:47.446988    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-qtp78\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="3c54a55a-dbaa-431f-b94e-c2b547dff6c0" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78"
Sep 06 19:35:47.449105 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:47.449086    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-mfj9r\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="05f16bef-2561-4159-ba9c-4af16d7f5fdb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"
Sep 06 19:35:47.451252 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:47.451235    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-ccbnb\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="00f5c4da-3edd-4bc7-957b-b78a9106ff36" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ccbnb"
Sep 06 19:35:47.489466 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.489429    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:47.499578 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.499546    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln"
Sep 06 19:35:47.499737 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.499601    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05f16bef-2561-4159-ba9c-4af16d7f5fdb-extensions-socket-volume\") pod \"05f16bef-2561-4159-ba9c-4af16d7f5fdb\" (UID: \"05f16bef-2561-4159-ba9c-4af16d7f5fdb\") "
Sep 06 19:35:47.499737 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.499697    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmbg4\" (UniqueName: \"kubernetes.io/projected/05f16bef-2561-4159-ba9c-4af16d7f5fdb-kube-api-access-gmbg4\") pod \"05f16bef-2561-4159-ba9c-4af16d7f5fdb\" (UID: \"05f16bef-2561-4159-ba9c-4af16d7f5fdb\") "
Sep 06 19:35:47.499737 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.499721    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svb74\" (UniqueName: \"kubernetes.io/projected/3c54a55a-dbaa-431f-b94e-c2b547dff6c0-kube-api-access-svb74\") pod \"3c54a55a-dbaa-431f-b94e-c2b547dff6c0\" (UID: \"3c54a55a-dbaa-431f-b94e-c2b547dff6c0\") "
Sep 06 19:35:47.500077 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.500055    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05f16bef-2561-4159-ba9c-4af16d7f5fdb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "05f16bef-2561-4159-ba9c-4af16d7f5fdb" (UID: "05f16bef-2561-4159-ba9c-4af16d7f5fdb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 19:35:47.502006 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.501987    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c54a55a-dbaa-431f-b94e-c2b547dff6c0-kube-api-access-svb74" (OuterVolumeSpecName: "kube-api-access-svb74") pod "3c54a55a-dbaa-431f-b94e-c2b547dff6c0" (UID: "3c54a55a-dbaa-431f-b94e-c2b547dff6c0"). InnerVolumeSpecName "kube-api-access-svb74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:35:47.502102 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.502048    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05f16bef-2561-4159-ba9c-4af16d7f5fdb-kube-api-access-gmbg4" (OuterVolumeSpecName: "kube-api-access-gmbg4") pod "05f16bef-2561-4159-ba9c-4af16d7f5fdb" (UID: "05f16bef-2561-4159-ba9c-4af16d7f5fdb"). InnerVolumeSpecName "kube-api-access-gmbg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:35:47.574454 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.574422    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xbc9k"
Sep 06 19:35:47.591257 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.591219    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:47.601128 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.601096    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmbg4\" (UniqueName: \"kubernetes.io/projected/05f16bef-2561-4159-ba9c-4af16d7f5fdb-kube-api-access-gmbg4\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:35:47.601128 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.601122    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svb74\" (UniqueName: \"kubernetes.io/projected/3c54a55a-dbaa-431f-b94e-c2b547dff6c0-kube-api-access-svb74\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:35:47.601128 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.601134    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05f16bef-2561-4159-ba9c-4af16d7f5fdb-extensions-socket-volume\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:35:47.780998 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.780928    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln"]
Sep 06 19:35:47.784581 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:35:47.784544    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode292b2fe_daaa_4e71_8e9e_b7dcbfa0ec0a.slice/crio-89c10790c87088e9aaf86bb4bd8a018eb59bb32a32bbc7111698ddec3fe5f082 WatchSource:0}: Error finding container 89c10790c87088e9aaf86bb4bd8a018eb59bb32a32bbc7111698ddec3fe5f082: Status 404 returned error can't find the container with id 89c10790c87088e9aaf86bb4bd8a018eb59bb32a32bbc7111698ddec3fe5f082
Sep 06 19:35:47.856258 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:47.856231    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xbc9k"]
Sep 06 19:35:47.858992 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:35:47.858971    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8997338c_99ab_46bc_8867_b0c60d24166d.slice/crio-86d0949d21c01fa530a65821dd79f954e2c18c43d4fbea86ecebbd26c71178cf WatchSource:0}: Error finding container 86d0949d21c01fa530a65821dd79f954e2c18c43d4fbea86ecebbd26c71178cf: Status 404 returned error can't find the container with id 86d0949d21c01fa530a65821dd79f954e2c18c43d4fbea86ecebbd26c71178cf
Sep 06 19:35:48.136027 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:48.135990    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln" event={"ID":"e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a","Type":"ContainerStarted","Data":"a8d5234b96923082c6c208ebe4c55ed8aeb8971fe994c0ca354749e642bc0d06"}
Sep 06 19:35:48.136434 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:48.136160    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln"
Sep 06 19:35:48.136434 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:48.136201    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln" event={"ID":"e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a","Type":"ContainerStarted","Data":"89c10790c87088e9aaf86bb4bd8a018eb59bb32a32bbc7111698ddec3fe5f082"}
Sep 06 19:35:48.137830 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:48.137806    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xbc9k" event={"ID":"8997338c-99ab-46bc-8867-b0c60d24166d","Type":"ContainerStarted","Data":"44aef521124dd1ec04615507c6db73c93d4d730a49ee26e3d2f4b00a9c93fc95"}
Sep 06 19:35:48.137971 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:48.137842    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xbc9k" event={"ID":"8997338c-99ab-46bc-8867-b0c60d24166d","Type":"ContainerStarted","Data":"86d0949d21c01fa530a65821dd79f954e2c18c43d4fbea86ecebbd26c71178cf"}
Sep 06 19:35:48.137971 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:48.137861    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xbc9k"
Sep 06 19:35:48.138336 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:48.138313    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-ccbnb\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="00f5c4da-3edd-4bc7-957b-b78a9106ff36" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ccbnb"
Sep 06 19:35:48.139283 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:48.139260    2568 generic.go:356] "Generic (PLEG): container finished" podID="05f16bef-2561-4159-ba9c-4af16d7f5fdb" containerID="0b06e83c0709200c0ffe77cebb47e6700573d63d41257bb8e8a4ea20e68dee4e" exitCode=0
Sep 06 19:35:48.139379 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:48.139303    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"
Sep 06 19:35:48.139379 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:48.139340    2568 scope.go:117] "RemoveContainer" containerID="0b06e83c0709200c0ffe77cebb47e6700573d63d41257bb8e8a4ea20e68dee4e"
Sep 06 19:35:48.140238 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:48.140211    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-qtp78\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="3c54a55a-dbaa-431f-b94e-c2b547dff6c0" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78"
Sep 06 19:35:48.140809 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:48.140764    2568 generic.go:356] "Generic (PLEG): container finished" podID="3c54a55a-dbaa-431f-b94e-c2b547dff6c0" containerID="e9cf94fb1ea5b2c164e7b45926954d29bd69cee09b24c4b84897fa054dc0788a" exitCode=0
Sep 06 19:35:48.140879 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:48.140822    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78"
Sep 06 19:35:48.141011 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:48.140995    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ccbnb"
Sep 06 19:35:48.142026 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:48.141998    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-mfj9r\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="05f16bef-2561-4159-ba9c-4af16d7f5fdb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"
Sep 06 19:35:48.149540 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:48.149522    2568 scope.go:117] "RemoveContainer" containerID="0b06e83c0709200c0ffe77cebb47e6700573d63d41257bb8e8a4ea20e68dee4e"
Sep 06 19:35:48.149928 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:48.149903    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b06e83c0709200c0ffe77cebb47e6700573d63d41257bb8e8a4ea20e68dee4e\": container with ID starting with 0b06e83c0709200c0ffe77cebb47e6700573d63d41257bb8e8a4ea20e68dee4e not found: ID does not exist" containerID="0b06e83c0709200c0ffe77cebb47e6700573d63d41257bb8e8a4ea20e68dee4e"
Sep 06 19:35:48.150017 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:48.149945    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b06e83c0709200c0ffe77cebb47e6700573d63d41257bb8e8a4ea20e68dee4e"} err="failed to get container status \"0b06e83c0709200c0ffe77cebb47e6700573d63d41257bb8e8a4ea20e68dee4e\": rpc error: code = NotFound desc = could not find container \"0b06e83c0709200c0ffe77cebb47e6700573d63d41257bb8e8a4ea20e68dee4e\": container with ID starting with 0b06e83c0709200c0ffe77cebb47e6700573d63d41257bb8e8a4ea20e68dee4e not found: ID does not exist"
Sep 06 19:35:48.150017 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:48.149970    2568 scope.go:117] "RemoveContainer" containerID="e9cf94fb1ea5b2c164e7b45926954d29bd69cee09b24c4b84897fa054dc0788a"
Sep 06 19:35:48.158382 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:48.158362    2568 scope.go:117] "RemoveContainer" containerID="e9cf94fb1ea5b2c164e7b45926954d29bd69cee09b24c4b84897fa054dc0788a"
Sep 06 19:35:48.158695 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:48.158678    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9cf94fb1ea5b2c164e7b45926954d29bd69cee09b24c4b84897fa054dc0788a\": container with ID starting with e9cf94fb1ea5b2c164e7b45926954d29bd69cee09b24c4b84897fa054dc0788a not found: ID does not exist" containerID="e9cf94fb1ea5b2c164e7b45926954d29bd69cee09b24c4b84897fa054dc0788a"
Sep 06 19:35:48.158736 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:48.158704    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9cf94fb1ea5b2c164e7b45926954d29bd69cee09b24c4b84897fa054dc0788a"} err="failed to get container status \"e9cf94fb1ea5b2c164e7b45926954d29bd69cee09b24c4b84897fa054dc0788a\": rpc error: code = NotFound desc = could not find container \"e9cf94fb1ea5b2c164e7b45926954d29bd69cee09b24c4b84897fa054dc0788a\": container with ID starting with e9cf94fb1ea5b2c164e7b45926954d29bd69cee09b24c4b84897fa054dc0788a not found: ID does not exist"
Sep 06 19:35:48.166212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:48.166170    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln" podStartSLOduration=1.166156667 podStartE2EDuration="1.166156667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:35:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:35:48.16541659 +0000 UTC m=+511.570375659" watchObservedRunningTime="2026-09-06 19:35:48.166156667 +0000 UTC m=+511.571115736"
Sep 06 19:35:48.167532 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:48.167507    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-ccbnb\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="00f5c4da-3edd-4bc7-957b-b78a9106ff36" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ccbnb"
Sep 06 19:35:48.169308 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:48.169288    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-qtp78\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="3c54a55a-dbaa-431f-b94e-c2b547dff6c0" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qtp78"
Sep 06 19:35:48.170984 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:35:48.170966    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-mfj9r\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="05f16bef-2561-4159-ba9c-4af16d7f5fdb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mfj9r"
Sep 06 19:35:48.191560 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:48.191496    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xbc9k" podStartSLOduration=1.191473802 podStartE2EDuration="1.191473802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:35:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:35:48.191087469 +0000 UTC m=+511.596046539" watchObservedRunningTime="2026-09-06 19:35:48.191473802 +0000 UTC m=+511.596432872"
Sep 06 19:35:49.116179 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:49.116142    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00f5c4da-3edd-4bc7-957b-b78a9106ff36" path="/var/lib/kubelet/pods/00f5c4da-3edd-4bc7-957b-b78a9106ff36/volumes"
Sep 06 19:35:49.116379 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:49.116367    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05f16bef-2561-4159-ba9c-4af16d7f5fdb" path="/var/lib/kubelet/pods/05f16bef-2561-4159-ba9c-4af16d7f5fdb/volumes"
Sep 06 19:35:49.116632 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:49.116622    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c54a55a-dbaa-431f-b94e-c2b547dff6c0" path="/var/lib/kubelet/pods/3c54a55a-dbaa-431f-b94e-c2b547dff6c0/volumes"
Sep 06 19:35:49.829649 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:49.829616    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:49.936925 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:49.936889    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:51.226798 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:51.226751    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:54.179463 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:54.179429    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:54.279708 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:54.279671    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:57.998255 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:57.998212    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:58.093025 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:58.092991    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:58.193090 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:58.193051    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:58.244313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:58.244281    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:59.150444 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:59.150409    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xbc9k"
Sep 06 19:35:59.150936 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:59.150586    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln"
Sep 06 19:35:59.186539 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:59.186507    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:35:59.285201 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:35:59.285140    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:36:03.276541 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:03.276506    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln"]
Sep 06 19:36:03.276965 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:03.276720    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln" podUID="e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a" containerName="manager" containerID="cri-o://a8d5234b96923082c6c208ebe4c55ed8aeb8971fe994c0ca354749e642bc0d06" gracePeriod=10
Sep 06 19:36:03.529237 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:03.529159    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln"
Sep 06 19:36:03.543525 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:03.543487    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw"]
Sep 06 19:36:03.543861 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:03.543846    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a" containerName="manager"
Sep 06 19:36:03.543861 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:03.543861    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a" containerName="manager"
Sep 06 19:36:03.543996 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:03.543917    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a" containerName="manager"
Sep 06 19:36:03.546743 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:03.546725    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw"
Sep 06 19:36:03.563365 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:03.563335    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw"]
Sep 06 19:36:03.643810 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:03.643742    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a-extensions-socket-volume\") pod \"e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a\" (UID: \"e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a\") "
Sep 06 19:36:03.643981 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:03.643845    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kswk8\" (UniqueName: \"kubernetes.io/projected/e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a-kube-api-access-kswk8\") pod \"e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a\" (UID: \"e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a\") "
Sep 06 19:36:03.644023 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:03.643987    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/544bdb4e-a2c9-4be3-ad11-69ccf819a939-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-8pgjw\" (UID: \"544bdb4e-a2c9-4be3-ad11-69ccf819a939\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw"
Sep 06 19:36:03.644061 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:03.644027    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rvqk\" (UniqueName: \"kubernetes.io/projected/544bdb4e-a2c9-4be3-ad11-69ccf819a939-kube-api-access-5rvqk\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-8pgjw\" (UID: \"544bdb4e-a2c9-4be3-ad11-69ccf819a939\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw"
Sep 06 19:36:03.644134 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:03.644111    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a" (UID: "e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 19:36:03.646113 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:03.646090    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a-kube-api-access-kswk8" (OuterVolumeSpecName: "kube-api-access-kswk8") pod "e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a" (UID: "e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a"). InnerVolumeSpecName "kube-api-access-kswk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:36:03.744671 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:03.744637    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rvqk\" (UniqueName: \"kubernetes.io/projected/544bdb4e-a2c9-4be3-ad11-69ccf819a939-kube-api-access-5rvqk\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-8pgjw\" (UID: \"544bdb4e-a2c9-4be3-ad11-69ccf819a939\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw"
Sep 06 19:36:03.744855 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:03.744707    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/544bdb4e-a2c9-4be3-ad11-69ccf819a939-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-8pgjw\" (UID: \"544bdb4e-a2c9-4be3-ad11-69ccf819a939\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw"
Sep 06 19:36:03.744855 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:03.744736    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a-extensions-socket-volume\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:36:03.744855 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:03.744745    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kswk8\" (UniqueName: \"kubernetes.io/projected/e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a-kube-api-access-kswk8\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:36:03.745071 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:03.745055    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/544bdb4e-a2c9-4be3-ad11-69ccf819a939-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-8pgjw\" (UID: \"544bdb4e-a2c9-4be3-ad11-69ccf819a939\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw"
Sep 06 19:36:03.752493 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:03.752454    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rvqk\" (UniqueName: \"kubernetes.io/projected/544bdb4e-a2c9-4be3-ad11-69ccf819a939-kube-api-access-5rvqk\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-8pgjw\" (UID: \"544bdb4e-a2c9-4be3-ad11-69ccf819a939\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw"
Sep 06 19:36:03.856735 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:03.856657    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw"
Sep 06 19:36:04.164245 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:04.164222    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw"]
Sep 06 19:36:04.166468 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:36:04.166427    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod544bdb4e_a2c9_4be3_ad11_69ccf819a939.slice/crio-18d68553a63265d151a7e0e6c672ea3db1f0a18e84f19e7f05b523e41025bd07 WatchSource:0}: Error finding container 18d68553a63265d151a7e0e6c672ea3db1f0a18e84f19e7f05b523e41025bd07: Status 404 returned error can't find the container with id 18d68553a63265d151a7e0e6c672ea3db1f0a18e84f19e7f05b523e41025bd07
Sep 06 19:36:04.219022 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:04.218996    2568 generic.go:356] "Generic (PLEG): container finished" podID="e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a" containerID="a8d5234b96923082c6c208ebe4c55ed8aeb8971fe994c0ca354749e642bc0d06" exitCode=0
Sep 06 19:36:04.219149 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:04.219042    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln"
Sep 06 19:36:04.219149 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:04.219093    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln" event={"ID":"e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a","Type":"ContainerDied","Data":"a8d5234b96923082c6c208ebe4c55ed8aeb8971fe994c0ca354749e642bc0d06"}
Sep 06 19:36:04.219249 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:04.219159    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln" event={"ID":"e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a","Type":"ContainerDied","Data":"89c10790c87088e9aaf86bb4bd8a018eb59bb32a32bbc7111698ddec3fe5f082"}
Sep 06 19:36:04.219249 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:04.219191    2568 scope.go:117] "RemoveContainer" containerID="a8d5234b96923082c6c208ebe4c55ed8aeb8971fe994c0ca354749e642bc0d06"
Sep 06 19:36:04.220769 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:04.220721    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw" event={"ID":"544bdb4e-a2c9-4be3-ad11-69ccf819a939","Type":"ContainerStarted","Data":"18d68553a63265d151a7e0e6c672ea3db1f0a18e84f19e7f05b523e41025bd07"}
Sep 06 19:36:04.228469 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:04.228440    2568 scope.go:117] "RemoveContainer" containerID="a8d5234b96923082c6c208ebe4c55ed8aeb8971fe994c0ca354749e642bc0d06"
Sep 06 19:36:04.228866 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:36:04.228841    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8d5234b96923082c6c208ebe4c55ed8aeb8971fe994c0ca354749e642bc0d06\": container with ID starting with a8d5234b96923082c6c208ebe4c55ed8aeb8971fe994c0ca354749e642bc0d06 not found: ID does not exist" containerID="a8d5234b96923082c6c208ebe4c55ed8aeb8971fe994c0ca354749e642bc0d06"
Sep 06 19:36:04.228963 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:04.228873    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8d5234b96923082c6c208ebe4c55ed8aeb8971fe994c0ca354749e642bc0d06"} err="failed to get container status \"a8d5234b96923082c6c208ebe4c55ed8aeb8971fe994c0ca354749e642bc0d06\": rpc error: code = NotFound desc = could not find container \"a8d5234b96923082c6c208ebe4c55ed8aeb8971fe994c0ca354749e642bc0d06\": container with ID starting with a8d5234b96923082c6c208ebe4c55ed8aeb8971fe994c0ca354749e642bc0d06 not found: ID does not exist"
Sep 06 19:36:04.243372 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:04.243335    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln"]
Sep 06 19:36:04.246788 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:04.246747    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2n4ln"]
Sep 06 19:36:05.115236 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:05.115200    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a" path="/var/lib/kubelet/pods/e292b2fe-daaa-4e71-8e9e-b7dcbfa0ec0a/volumes"
Sep 06 19:36:05.227884 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:05.227849    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw" event={"ID":"544bdb4e-a2c9-4be3-ad11-69ccf819a939","Type":"ContainerStarted","Data":"5ed304c68b2dc18e45b8bd926b379c092ade0a73854766d0adb74d1aeaf07b70"}
Sep 06 19:36:05.228114 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:05.227963    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw"
Sep 06 19:36:05.254342 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:05.254266    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw" podStartSLOduration=2.254244587 podStartE2EDuration="2.254244587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:36:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:36:05.253132484 +0000 UTC m=+528.658091575" watchObservedRunningTime="2026-09-06 19:36:05.254244587 +0000 UTC m=+528.659203657"
Sep 06 19:36:08.391647 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:08.391525    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:36:08.489028 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:08.488988    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:36:11.987309 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:11.987273    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:36:12.042798 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:12.042740    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:36:16.234993 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:16.234963    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw"
Sep 06 19:36:19.560275 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:19.560241    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:36:19.661629 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:19.661596    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:36:34.030242 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.030205    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-4w7kc"]
Sep 06 19:36:34.034833 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.034814    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-4w7kc"
Sep 06 19:36:34.037253 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.037230    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 06 19:36:34.040926 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.040891    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:36:34.047876 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.047850    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-4w7kc"]
Sep 06 19:36:34.086867 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.086829    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll7sz\" (UniqueName: \"kubernetes.io/projected/593a7b1c-3b65-426f-8ced-a33ee68f30ad-kube-api-access-ll7sz\") pod \"limitador-limitador-859c4d96d6-4w7kc\" (UID: \"593a7b1c-3b65-426f-8ced-a33ee68f30ad\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-4w7kc"
Sep 06 19:36:34.087036 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.086882    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/593a7b1c-3b65-426f-8ced-a33ee68f30ad-config-file\") pod \"limitador-limitador-859c4d96d6-4w7kc\" (UID: \"593a7b1c-3b65-426f-8ced-a33ee68f30ad\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-4w7kc"
Sep 06 19:36:34.129127 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.129094    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-4w7kc"]
Sep 06 19:36:34.131100 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.131059    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:36:34.187865 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.187828    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll7sz\" (UniqueName: \"kubernetes.io/projected/593a7b1c-3b65-426f-8ced-a33ee68f30ad-kube-api-access-ll7sz\") pod \"limitador-limitador-859c4d96d6-4w7kc\" (UID: \"593a7b1c-3b65-426f-8ced-a33ee68f30ad\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-4w7kc"
Sep 06 19:36:34.187865 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.187867    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/593a7b1c-3b65-426f-8ced-a33ee68f30ad-config-file\") pod \"limitador-limitador-859c4d96d6-4w7kc\" (UID: \"593a7b1c-3b65-426f-8ced-a33ee68f30ad\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-4w7kc"
Sep 06 19:36:34.188439 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.188421    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/593a7b1c-3b65-426f-8ced-a33ee68f30ad-config-file\") pod \"limitador-limitador-859c4d96d6-4w7kc\" (UID: \"593a7b1c-3b65-426f-8ced-a33ee68f30ad\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-4w7kc"
Sep 06 19:36:34.195294 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.195265    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll7sz\" (UniqueName: \"kubernetes.io/projected/593a7b1c-3b65-426f-8ced-a33ee68f30ad-kube-api-access-ll7sz\") pod \"limitador-limitador-859c4d96d6-4w7kc\" (UID: \"593a7b1c-3b65-426f-8ced-a33ee68f30ad\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-4w7kc"
Sep 06 19:36:34.231384 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.231346    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:36:34.352511 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.352428    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-4w7kc"
Sep 06 19:36:34.622224 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.622142    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-4w7kc"]
Sep 06 19:36:34.624447 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:36:34.624420    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod593a7b1c_3b65_426f_8ced_a33ee68f30ad.slice/crio-34adbbdaf658f38b766d7b2659129029181f54068a1fccf00f2167fc15dae0de WatchSource:0}: Error finding container 34adbbdaf658f38b766d7b2659129029181f54068a1fccf00f2167fc15dae0de: Status 404 returned error can't find the container with id 34adbbdaf658f38b766d7b2659129029181f54068a1fccf00f2167fc15dae0de
Sep 06 19:36:34.802515 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.802477    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-9xkgm"]
Sep 06 19:36:34.807039 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.807017    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-9xkgm"
Sep 06 19:36:34.809467 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.809448    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kmgmx\""
Sep 06 19:36:34.809876 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.809851    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-9xkgm"]
Sep 06 19:36:34.839275 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.839243    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:36:34.894460 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.894427    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsfnm\" (UniqueName: \"kubernetes.io/projected/38244500-359c-4c16-b224-4d9a06275a24-kube-api-access-zsfnm\") pod \"authorino-b54df94b4-9xkgm\" (UID: \"38244500-359c-4c16-b224-4d9a06275a24\") " pod="kuadrant-system/authorino-b54df94b4-9xkgm"
Sep 06 19:36:34.899050 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.899017    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:36:34.995519 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:34.995481    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsfnm\" (UniqueName: \"kubernetes.io/projected/38244500-359c-4c16-b224-4d9a06275a24-kube-api-access-zsfnm\") pod \"authorino-b54df94b4-9xkgm\" (UID: \"38244500-359c-4c16-b224-4d9a06275a24\") " pod="kuadrant-system/authorino-b54df94b4-9xkgm"
Sep 06 19:36:35.004130 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:35.004089    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsfnm\" (UniqueName: \"kubernetes.io/projected/38244500-359c-4c16-b224-4d9a06275a24-kube-api-access-zsfnm\") pod \"authorino-b54df94b4-9xkgm\" (UID: \"38244500-359c-4c16-b224-4d9a06275a24\") " pod="kuadrant-system/authorino-b54df94b4-9xkgm"
Sep 06 19:36:35.118245 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:35.118211    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-9xkgm"
Sep 06 19:36:35.363635 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:35.363600    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-4w7kc" event={"ID":"593a7b1c-3b65-426f-8ced-a33ee68f30ad","Type":"ContainerStarted","Data":"34adbbdaf658f38b766d7b2659129029181f54068a1fccf00f2167fc15dae0de"}
Sep 06 19:36:35.387597 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:35.387573    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-9xkgm"]
Sep 06 19:36:35.390081 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:36:35.390046    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38244500_359c_4c16_b224_4d9a06275a24.slice/crio-f30e71e3fc04c9b1285f249a9c71b55a60a3e37b3ab3fd225e40be83cefb6af4 WatchSource:0}: Error finding container f30e71e3fc04c9b1285f249a9c71b55a60a3e37b3ab3fd225e40be83cefb6af4: Status 404 returned error can't find the container with id f30e71e3fc04c9b1285f249a9c71b55a60a3e37b3ab3fd225e40be83cefb6af4
Sep 06 19:36:36.372069 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:36.371968    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-4w7kc" event={"ID":"593a7b1c-3b65-426f-8ced-a33ee68f30ad","Type":"ContainerStarted","Data":"54078022d0ea3a48be12e731726231b3f4bdb324709e74ece8765ed718f157e0"}
Sep 06 19:36:36.372510 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:36.372181    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-4w7kc"
Sep 06 19:36:36.373663 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:36.373630    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-9xkgm" event={"ID":"38244500-359c-4c16-b224-4d9a06275a24","Type":"ContainerStarted","Data":"f30e71e3fc04c9b1285f249a9c71b55a60a3e37b3ab3fd225e40be83cefb6af4"}
Sep 06 19:36:36.389067 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:36.388996    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-4w7kc" podStartSLOduration=0.976917291 podStartE2EDuration="2.388976957s" totalImagesPullingTime="1.412059666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:36:36.387927485 +0000 UTC m=+559.792886556" watchObservedRunningTime="2026-09-06 19:36:36.388976957 +0000 UTC m=+559.793936066"
Sep 06 19:36:37.382147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:37.382104    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-9xkgm" event={"ID":"38244500-359c-4c16-b224-4d9a06275a24","Type":"ContainerStarted","Data":"6b78da8e848e7ff7018895d2650b9c4a844ebebeb585297524f18c30ef302f4a"}
Sep 06 19:36:37.397150 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:37.397080    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-9xkgm" podStartSLOduration=1.5178549019999998 podStartE2EDuration="3.397062472s" totalImagesPullingTime="1.87920757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:36:37.39569333 +0000 UTC m=+560.800652401" watchObservedRunningTime="2026-09-06 19:36:37.397062472 +0000 UTC m=+560.802021540"
Sep 06 19:36:37.496150 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:37.496117    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-9xkgm"]
Sep 06 19:36:39.390834 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:39.390789    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-9xkgm" podUID="38244500-359c-4c16-b224-4d9a06275a24" containerName="authorino" containerID="cri-o://6b78da8e848e7ff7018895d2650b9c4a844ebebeb585297524f18c30ef302f4a" gracePeriod=30
Sep 06 19:36:39.643640 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:39.643569    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-9xkgm"
Sep 06 19:36:39.736824 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:39.736764    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsfnm\" (UniqueName: \"kubernetes.io/projected/38244500-359c-4c16-b224-4d9a06275a24-kube-api-access-zsfnm\") pod \"38244500-359c-4c16-b224-4d9a06275a24\" (UID: \"38244500-359c-4c16-b224-4d9a06275a24\") "
Sep 06 19:36:39.739018 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:39.738991    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38244500-359c-4c16-b224-4d9a06275a24-kube-api-access-zsfnm" (OuterVolumeSpecName: "kube-api-access-zsfnm") pod "38244500-359c-4c16-b224-4d9a06275a24" (UID: "38244500-359c-4c16-b224-4d9a06275a24"). InnerVolumeSpecName "kube-api-access-zsfnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:36:39.837569 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:39.837529    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsfnm\" (UniqueName: \"kubernetes.io/projected/38244500-359c-4c16-b224-4d9a06275a24-kube-api-access-zsfnm\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:36:40.397665 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:40.397632    2568 generic.go:356] "Generic (PLEG): container finished" podID="38244500-359c-4c16-b224-4d9a06275a24" containerID="6b78da8e848e7ff7018895d2650b9c4a844ebebeb585297524f18c30ef302f4a" exitCode=0
Sep 06 19:36:40.398095 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:40.397669    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-9xkgm"
Sep 06 19:36:40.398095 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:40.397676    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-9xkgm" event={"ID":"38244500-359c-4c16-b224-4d9a06275a24","Type":"ContainerDied","Data":"6b78da8e848e7ff7018895d2650b9c4a844ebebeb585297524f18c30ef302f4a"}
Sep 06 19:36:40.398095 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:40.397712    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-9xkgm" event={"ID":"38244500-359c-4c16-b224-4d9a06275a24","Type":"ContainerDied","Data":"f30e71e3fc04c9b1285f249a9c71b55a60a3e37b3ab3fd225e40be83cefb6af4"}
Sep 06 19:36:40.398095 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:40.397732    2568 scope.go:117] "RemoveContainer" containerID="6b78da8e848e7ff7018895d2650b9c4a844ebebeb585297524f18c30ef302f4a"
Sep 06 19:36:40.406757 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:40.406736    2568 scope.go:117] "RemoveContainer" containerID="6b78da8e848e7ff7018895d2650b9c4a844ebebeb585297524f18c30ef302f4a"
Sep 06 19:36:40.407066 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:36:40.407048    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b78da8e848e7ff7018895d2650b9c4a844ebebeb585297524f18c30ef302f4a\": container with ID starting with 6b78da8e848e7ff7018895d2650b9c4a844ebebeb585297524f18c30ef302f4a not found: ID does not exist" containerID="6b78da8e848e7ff7018895d2650b9c4a844ebebeb585297524f18c30ef302f4a"
Sep 06 19:36:40.407122 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:40.407074    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b78da8e848e7ff7018895d2650b9c4a844ebebeb585297524f18c30ef302f4a"} err="failed to get container status \"6b78da8e848e7ff7018895d2650b9c4a844ebebeb585297524f18c30ef302f4a\": rpc error: code = NotFound desc = could not find container \"6b78da8e848e7ff7018895d2650b9c4a844ebebeb585297524f18c30ef302f4a\": container with ID starting with 6b78da8e848e7ff7018895d2650b9c4a844ebebeb585297524f18c30ef302f4a not found: ID does not exist"
Sep 06 19:36:40.416761 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:40.416737    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-9xkgm"]
Sep 06 19:36:40.420553 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:40.420532    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-9xkgm"]
Sep 06 19:36:41.117904 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:41.117873    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38244500-359c-4c16-b224-4d9a06275a24" path="/var/lib/kubelet/pods/38244500-359c-4c16-b224-4d9a06275a24/volumes"
Sep 06 19:36:47.383204 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:47.383169    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-4w7kc"
Sep 06 19:36:47.500074 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:47.500037    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-4w7kc"]
Sep 06 19:36:47.500273 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:47.500249    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-4w7kc" podUID="593a7b1c-3b65-426f-8ced-a33ee68f30ad" containerName="limitador" containerID="cri-o://54078022d0ea3a48be12e731726231b3f4bdb324709e74ece8765ed718f157e0" gracePeriod=30
Sep 06 19:36:48.437904 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:48.437874    2568 generic.go:356] "Generic (PLEG): container finished" podID="593a7b1c-3b65-426f-8ced-a33ee68f30ad" containerID="54078022d0ea3a48be12e731726231b3f4bdb324709e74ece8765ed718f157e0" exitCode=0
Sep 06 19:36:48.438251 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:48.437943    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-4w7kc" event={"ID":"593a7b1c-3b65-426f-8ced-a33ee68f30ad","Type":"ContainerDied","Data":"54078022d0ea3a48be12e731726231b3f4bdb324709e74ece8765ed718f157e0"}
Sep 06 19:36:48.438251 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:48.437979    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-4w7kc" event={"ID":"593a7b1c-3b65-426f-8ced-a33ee68f30ad","Type":"ContainerDied","Data":"34adbbdaf658f38b766d7b2659129029181f54068a1fccf00f2167fc15dae0de"}
Sep 06 19:36:48.438251 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:48.437999    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34adbbdaf658f38b766d7b2659129029181f54068a1fccf00f2167fc15dae0de"
Sep 06 19:36:48.447836 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:48.447809    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-4w7kc"
Sep 06 19:36:48.610807 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:48.610700    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/593a7b1c-3b65-426f-8ced-a33ee68f30ad-config-file\") pod \"593a7b1c-3b65-426f-8ced-a33ee68f30ad\" (UID: \"593a7b1c-3b65-426f-8ced-a33ee68f30ad\") "
Sep 06 19:36:48.610807 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:48.610745    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ll7sz\" (UniqueName: \"kubernetes.io/projected/593a7b1c-3b65-426f-8ced-a33ee68f30ad-kube-api-access-ll7sz\") pod \"593a7b1c-3b65-426f-8ced-a33ee68f30ad\" (UID: \"593a7b1c-3b65-426f-8ced-a33ee68f30ad\") "
Sep 06 19:36:48.611071 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:48.611049    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/593a7b1c-3b65-426f-8ced-a33ee68f30ad-config-file" (OuterVolumeSpecName: "config-file") pod "593a7b1c-3b65-426f-8ced-a33ee68f30ad" (UID: "593a7b1c-3b65-426f-8ced-a33ee68f30ad"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:36:48.613061 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:48.613039    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/593a7b1c-3b65-426f-8ced-a33ee68f30ad-kube-api-access-ll7sz" (OuterVolumeSpecName: "kube-api-access-ll7sz") pod "593a7b1c-3b65-426f-8ced-a33ee68f30ad" (UID: "593a7b1c-3b65-426f-8ced-a33ee68f30ad"). InnerVolumeSpecName "kube-api-access-ll7sz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:36:48.711764 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:48.711732    2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/593a7b1c-3b65-426f-8ced-a33ee68f30ad-config-file\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:36:48.711764 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:48.711758    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ll7sz\" (UniqueName: \"kubernetes.io/projected/593a7b1c-3b65-426f-8ced-a33ee68f30ad-kube-api-access-ll7sz\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:36:49.442475 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:49.442389    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-4w7kc"
Sep 06 19:36:49.457493 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:49.457458    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-4w7kc"]
Sep 06 19:36:49.460933 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:49.460902    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-4w7kc"]
Sep 06 19:36:51.114594 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:51.114558    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="593a7b1c-3b65-426f-8ced-a33ee68f30ad" path="/var/lib/kubelet/pods/593a7b1c-3b65-426f-8ced-a33ee68f30ad/volumes"
Sep 06 19:36:51.624488 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:51.624440    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:36:51.717197 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:51.717133    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:36:52.059858 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:52.059750    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ls7kj"]
Sep 06 19:36:52.060140 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:52.060127    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38244500-359c-4c16-b224-4d9a06275a24" containerName="authorino"
Sep 06 19:36:52.060192 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:52.060142    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="38244500-359c-4c16-b224-4d9a06275a24" containerName="authorino"
Sep 06 19:36:52.060192 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:52.060156    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="593a7b1c-3b65-426f-8ced-a33ee68f30ad" containerName="limitador"
Sep 06 19:36:52.060192 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:52.060162    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="593a7b1c-3b65-426f-8ced-a33ee68f30ad" containerName="limitador"
Sep 06 19:36:52.060319 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:52.060217    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="593a7b1c-3b65-426f-8ced-a33ee68f30ad" containerName="limitador"
Sep 06 19:36:52.060319 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:52.060224    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="38244500-359c-4c16-b224-4d9a06275a24" containerName="authorino"
Sep 06 19:36:52.063297 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:52.063280    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ls7kj"
Sep 06 19:36:52.066273 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:52.066251    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 06 19:36:52.066582 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:52.066548    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 06 19:36:52.066695 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:52.066666    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-6nzfb\""
Sep 06 19:36:52.067622 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:52.067594    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 19:36:52.081456 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:52.081433    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ls7kj"]
Sep 06 19:36:52.137064 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:52.137033    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:36:52.140975 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:52.140952    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/695ab482-5ee8-47bb-9a5b-8db1ffdebfd2-data\") pod \"postgres-69fb4594cf-ls7kj\" (UID: \"695ab482-5ee8-47bb-9a5b-8db1ffdebfd2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ls7kj"
Sep 06 19:36:52.141088 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:52.140998    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd729\" (UniqueName: \"kubernetes.io/projected/695ab482-5ee8-47bb-9a5b-8db1ffdebfd2-kube-api-access-rd729\") pod \"postgres-69fb4594cf-ls7kj\" (UID: \"695ab482-5ee8-47bb-9a5b-8db1ffdebfd2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ls7kj"
Sep 06 19:36:52.242077 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:52.242030    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/695ab482-5ee8-47bb-9a5b-8db1ffdebfd2-data\") pod \"postgres-69fb4594cf-ls7kj\" (UID: \"695ab482-5ee8-47bb-9a5b-8db1ffdebfd2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ls7kj"
Sep 06 19:36:52.242256 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:52.242098    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd729\" (UniqueName: \"kubernetes.io/projected/695ab482-5ee8-47bb-9a5b-8db1ffdebfd2-kube-api-access-rd729\") pod \"postgres-69fb4594cf-ls7kj\" (UID: \"695ab482-5ee8-47bb-9a5b-8db1ffdebfd2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ls7kj"
Sep 06 19:36:52.242470 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:52.242450    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/695ab482-5ee8-47bb-9a5b-8db1ffdebfd2-data\") pod \"postgres-69fb4594cf-ls7kj\" (UID: \"695ab482-5ee8-47bb-9a5b-8db1ffdebfd2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ls7kj"
Sep 06 19:36:52.250199 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:52.250174    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd729\" (UniqueName: \"kubernetes.io/projected/695ab482-5ee8-47bb-9a5b-8db1ffdebfd2-kube-api-access-rd729\") pod \"postgres-69fb4594cf-ls7kj\" (UID: \"695ab482-5ee8-47bb-9a5b-8db1ffdebfd2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ls7kj"
Sep 06 19:36:52.373941 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:52.373914    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ls7kj"
Sep 06 19:36:52.643425 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:52.643399    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ls7kj"]
Sep 06 19:36:52.646198 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:36:52.646169    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod695ab482_5ee8_47bb_9a5b_8db1ffdebfd2.slice/crio-0ddb20182cbb7309444bcdb1a749876ea657d036bf9baec416b608cc4d42cdc6 WatchSource:0}: Error finding container 0ddb20182cbb7309444bcdb1a749876ea657d036bf9baec416b608cc4d42cdc6: Status 404 returned error can't find the container with id 0ddb20182cbb7309444bcdb1a749876ea657d036bf9baec416b608cc4d42cdc6
Sep 06 19:36:53.465413 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:53.465336    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ls7kj" event={"ID":"695ab482-5ee8-47bb-9a5b-8db1ffdebfd2","Type":"ContainerStarted","Data":"0ddb20182cbb7309444bcdb1a749876ea657d036bf9baec416b608cc4d42cdc6"}
Sep 06 19:36:57.489214 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:57.489176    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ls7kj" event={"ID":"695ab482-5ee8-47bb-9a5b-8db1ffdebfd2","Type":"ContainerStarted","Data":"c0c04f6868fccc672787df5dfa22227ec061d384722f7e25683a2ea62f565439"}
Sep 06 19:36:57.489606 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:57.489386    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ls7kj"
Sep 06 19:36:57.503468 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:36:57.503421    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ls7kj" podStartSLOduration=0.759338947 podStartE2EDuration="5.503406012s" totalImagesPullingTime="4.744067065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:36:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:36:57.502797317 +0000 UTC m=+580.907756381" watchObservedRunningTime="2026-09-06 19:36:57.503406012 +0000 UTC m=+580.908365079"
Sep 06 19:37:03.525128 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:03.525099    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ls7kj"
Sep 06 19:37:03.832369 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:03.832232    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:37:03.972587 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:03.972558    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:37:04.045415 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.045372    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-ngwxh"]
Sep 06 19:37:04.058580 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.058541    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-ngwxh"]
Sep 06 19:37:04.058726 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.058634    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-ngwxh"
Sep 06 19:37:04.060973 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.060947    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kmgmx\""
Sep 06 19:37:04.182939 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.182897    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-ngwxh"]
Sep 06 19:37:04.183209 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:37:04.183185    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qrb5m], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-ngwxh" podUID="2e9db8a6-9adf-443a-806d-27a1147ebce9"
Sep 06 19:37:04.209863 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.209825    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687bd45585-mlgwh"]
Sep 06 19:37:04.213146 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.213115    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-mlgwh"
Sep 06 19:37:04.215505 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.215487    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 06 19:37:04.219467 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.219442    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687bd45585-mlgwh"]
Sep 06 19:37:04.244128 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.244096    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrb5m\" (UniqueName: \"kubernetes.io/projected/2e9db8a6-9adf-443a-806d-27a1147ebce9-kube-api-access-qrb5m\") pod \"authorino-5dc7ccb5f-ngwxh\" (UID: \"2e9db8a6-9adf-443a-806d-27a1147ebce9\") " pod="kuadrant-system/authorino-5dc7ccb5f-ngwxh"
Sep 06 19:37:04.276905 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.276872    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-mlgwh"]
Sep 06 19:37:04.277123 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:37:04.277104    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-4l78z tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-687bd45585-mlgwh" podUID="43c00f39-f11c-41e0-922b-114706b130a1"
Sep 06 19:37:04.345432 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.345394    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l78z\" (UniqueName: \"kubernetes.io/projected/43c00f39-f11c-41e0-922b-114706b130a1-kube-api-access-4l78z\") pod \"authorino-687bd45585-mlgwh\" (UID: \"43c00f39-f11c-41e0-922b-114706b130a1\") " pod="kuadrant-system/authorino-687bd45585-mlgwh"
Sep 06 19:37:04.345606 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.345443    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrb5m\" (UniqueName: \"kubernetes.io/projected/2e9db8a6-9adf-443a-806d-27a1147ebce9-kube-api-access-qrb5m\") pod \"authorino-5dc7ccb5f-ngwxh\" (UID: \"2e9db8a6-9adf-443a-806d-27a1147ebce9\") " pod="kuadrant-system/authorino-5dc7ccb5f-ngwxh"
Sep 06 19:37:04.345606 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.345511    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/43c00f39-f11c-41e0-922b-114706b130a1-tls-cert\") pod \"authorino-687bd45585-mlgwh\" (UID: \"43c00f39-f11c-41e0-922b-114706b130a1\") " pod="kuadrant-system/authorino-687bd45585-mlgwh"
Sep 06 19:37:04.353015 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.352990    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrb5m\" (UniqueName: \"kubernetes.io/projected/2e9db8a6-9adf-443a-806d-27a1147ebce9-kube-api-access-qrb5m\") pod \"authorino-5dc7ccb5f-ngwxh\" (UID: \"2e9db8a6-9adf-443a-806d-27a1147ebce9\") " pod="kuadrant-system/authorino-5dc7ccb5f-ngwxh"
Sep 06 19:37:04.446158 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.446064    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/43c00f39-f11c-41e0-922b-114706b130a1-tls-cert\") pod \"authorino-687bd45585-mlgwh\" (UID: \"43c00f39-f11c-41e0-922b-114706b130a1\") " pod="kuadrant-system/authorino-687bd45585-mlgwh"
Sep 06 19:37:04.446158 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.446132    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l78z\" (UniqueName: \"kubernetes.io/projected/43c00f39-f11c-41e0-922b-114706b130a1-kube-api-access-4l78z\") pod \"authorino-687bd45585-mlgwh\" (UID: \"43c00f39-f11c-41e0-922b-114706b130a1\") " pod="kuadrant-system/authorino-687bd45585-mlgwh"
Sep 06 19:37:04.448748 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.448717    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/43c00f39-f11c-41e0-922b-114706b130a1-tls-cert\") pod \"authorino-687bd45585-mlgwh\" (UID: \"43c00f39-f11c-41e0-922b-114706b130a1\") " pod="kuadrant-system/authorino-687bd45585-mlgwh"
Sep 06 19:37:04.453536 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.453510    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l78z\" (UniqueName: \"kubernetes.io/projected/43c00f39-f11c-41e0-922b-114706b130a1-kube-api-access-4l78z\") pod \"authorino-687bd45585-mlgwh\" (UID: \"43c00f39-f11c-41e0-922b-114706b130a1\") " pod="kuadrant-system/authorino-687bd45585-mlgwh"
Sep 06 19:37:04.524017 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.523986    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-mlgwh"
Sep 06 19:37:04.524017 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.523991    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-ngwxh"
Sep 06 19:37:04.531225 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.531200    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-mlgwh"
Sep 06 19:37:04.533821 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.533802    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-ngwxh"
Sep 06 19:37:04.647593 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.647565    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4l78z\" (UniqueName: \"kubernetes.io/projected/43c00f39-f11c-41e0-922b-114706b130a1-kube-api-access-4l78z\") pod \"43c00f39-f11c-41e0-922b-114706b130a1\" (UID: \"43c00f39-f11c-41e0-922b-114706b130a1\") "
Sep 06 19:37:04.647808 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.647629    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/43c00f39-f11c-41e0-922b-114706b130a1-tls-cert\") pod \"43c00f39-f11c-41e0-922b-114706b130a1\" (UID: \"43c00f39-f11c-41e0-922b-114706b130a1\") "
Sep 06 19:37:04.647808 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.647718    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrb5m\" (UniqueName: \"kubernetes.io/projected/2e9db8a6-9adf-443a-806d-27a1147ebce9-kube-api-access-qrb5m\") pod \"2e9db8a6-9adf-443a-806d-27a1147ebce9\" (UID: \"2e9db8a6-9adf-443a-806d-27a1147ebce9\") "
Sep 06 19:37:04.649985 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.649950    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43c00f39-f11c-41e0-922b-114706b130a1-kube-api-access-4l78z" (OuterVolumeSpecName: "kube-api-access-4l78z") pod "43c00f39-f11c-41e0-922b-114706b130a1" (UID: "43c00f39-f11c-41e0-922b-114706b130a1"). InnerVolumeSpecName "kube-api-access-4l78z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:37:04.649985 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.649964    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43c00f39-f11c-41e0-922b-114706b130a1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "43c00f39-f11c-41e0-922b-114706b130a1" (UID: "43c00f39-f11c-41e0-922b-114706b130a1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:37:04.649985 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.649973    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e9db8a6-9adf-443a-806d-27a1147ebce9-kube-api-access-qrb5m" (OuterVolumeSpecName: "kube-api-access-qrb5m") pod "2e9db8a6-9adf-443a-806d-27a1147ebce9" (UID: "2e9db8a6-9adf-443a-806d-27a1147ebce9"). InnerVolumeSpecName "kube-api-access-qrb5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:37:04.748702 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.748609    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4l78z\" (UniqueName: \"kubernetes.io/projected/43c00f39-f11c-41e0-922b-114706b130a1-kube-api-access-4l78z\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:37:04.748702 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.748641    2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/43c00f39-f11c-41e0-922b-114706b130a1-tls-cert\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:37:04.748702 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:04.748655    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrb5m\" (UniqueName: \"kubernetes.io/projected/2e9db8a6-9adf-443a-806d-27a1147ebce9-kube-api-access-qrb5m\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:37:05.529265 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:05.529235    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-ngwxh"
Sep 06 19:37:05.529441 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:05.529237    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-mlgwh"
Sep 06 19:37:05.556175 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:05.556136    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-mlgwh"]
Sep 06 19:37:05.559159 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:05.559128    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687bd45585-mlgwh"]
Sep 06 19:37:05.579207 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:05.579173    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-ngwxh"]
Sep 06 19:37:05.581579 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:05.581553    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-ngwxh"]
Sep 06 19:37:07.115370 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:07.115333    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e9db8a6-9adf-443a-806d-27a1147ebce9" path="/var/lib/kubelet/pods/2e9db8a6-9adf-443a-806d-27a1147ebce9/volumes"
Sep 06 19:37:07.115740 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:07.115572    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43c00f39-f11c-41e0-922b-114706b130a1" path="/var/lib/kubelet/pods/43c00f39-f11c-41e0-922b-114706b130a1/volumes"
Sep 06 19:37:10.175530 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.175499    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:37:10.208070 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.208032    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69f557767c-9m928"]
Sep 06 19:37:10.211093 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.211077    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69f557767c-9m928"
Sep 06 19:37:10.213586 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.213552    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 06 19:37:10.213730 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.213598    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-clffn\""
Sep 06 19:37:10.214635 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.214614    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 06 19:37:10.214753 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.214656    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 06 19:37:10.220498 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.220474    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69f557767c-9m928"]
Sep 06 19:37:10.247958 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.247923    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:37:10.304500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.304467    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:37:10.358530 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.358491    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-785588cb-8rcpm"]
Sep 06 19:37:10.361756 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.361734    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-785588cb-8rcpm"
Sep 06 19:37:10.370998 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.370974    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-785588cb-8rcpm"]
Sep 06 19:37:10.398273 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.398237    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a412005b-b66b-40bc-a57f-7bd56458532f-webhook-cert\") pod \"maas-controller-69f557767c-9m928\" (UID: \"a412005b-b66b-40bc-a57f-7bd56458532f\") " pod="opendatahub/maas-controller-69f557767c-9m928"
Sep 06 19:37:10.398436 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.398299    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a412005b-b66b-40bc-a57f-7bd56458532f-metrics-certs\") pod \"maas-controller-69f557767c-9m928\" (UID: \"a412005b-b66b-40bc-a57f-7bd56458532f\") " pod="opendatahub/maas-controller-69f557767c-9m928"
Sep 06 19:37:10.398436 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.398370    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wzc8\" (UniqueName: \"kubernetes.io/projected/a412005b-b66b-40bc-a57f-7bd56458532f-kube-api-access-5wzc8\") pod \"maas-controller-69f557767c-9m928\" (UID: \"a412005b-b66b-40bc-a57f-7bd56458532f\") " pod="opendatahub/maas-controller-69f557767c-9m928"
Sep 06 19:37:10.499144 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.499062    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a412005b-b66b-40bc-a57f-7bd56458532f-webhook-cert\") pod \"maas-controller-69f557767c-9m928\" (UID: \"a412005b-b66b-40bc-a57f-7bd56458532f\") " pod="opendatahub/maas-controller-69f557767c-9m928"
Sep 06 19:37:10.499144 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.499105    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a412005b-b66b-40bc-a57f-7bd56458532f-metrics-certs\") pod \"maas-controller-69f557767c-9m928\" (UID: \"a412005b-b66b-40bc-a57f-7bd56458532f\") " pod="opendatahub/maas-controller-69f557767c-9m928"
Sep 06 19:37:10.499338 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.499146    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wzc8\" (UniqueName: \"kubernetes.io/projected/a412005b-b66b-40bc-a57f-7bd56458532f-kube-api-access-5wzc8\") pod \"maas-controller-69f557767c-9m928\" (UID: \"a412005b-b66b-40bc-a57f-7bd56458532f\") " pod="opendatahub/maas-controller-69f557767c-9m928"
Sep 06 19:37:10.499338 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.499186    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22502a87-c696-4516-9f31-338877e8d756-webhook-cert\") pod \"maas-controller-785588cb-8rcpm\" (UID: \"22502a87-c696-4516-9f31-338877e8d756\") " pod="opendatahub/maas-controller-785588cb-8rcpm"
Sep 06 19:37:10.499338 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.499208    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22502a87-c696-4516-9f31-338877e8d756-metrics-certs\") pod \"maas-controller-785588cb-8rcpm\" (UID: \"22502a87-c696-4516-9f31-338877e8d756\") " pod="opendatahub/maas-controller-785588cb-8rcpm"
Sep 06 19:37:10.499338 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:37:10.499207    2568 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 06 19:37:10.499338 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.499230    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb9xr\" (UniqueName: \"kubernetes.io/projected/22502a87-c696-4516-9f31-338877e8d756-kube-api-access-rb9xr\") pod \"maas-controller-785588cb-8rcpm\" (UID: \"22502a87-c696-4516-9f31-338877e8d756\") " pod="opendatahub/maas-controller-785588cb-8rcpm"
Sep 06 19:37:10.499338 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:37:10.499280    2568 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 06 19:37:10.499338 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:37:10.499310    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a412005b-b66b-40bc-a57f-7bd56458532f-webhook-cert podName:a412005b-b66b-40bc-a57f-7bd56458532f nodeName:}" failed. No retries permitted until 2026-09-06 19:37:10.99929052 +0000 UTC m=+594.404249570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/a412005b-b66b-40bc-a57f-7bd56458532f-webhook-cert") pod "maas-controller-69f557767c-9m928" (UID: "a412005b-b66b-40bc-a57f-7bd56458532f") : secret "maas-controller-webhook-cert" not found
Sep 06 19:37:10.499608 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:37:10.499348    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a412005b-b66b-40bc-a57f-7bd56458532f-metrics-certs podName:a412005b-b66b-40bc-a57f-7bd56458532f nodeName:}" failed. No retries permitted until 2026-09-06 19:37:10.999333342 +0000 UTC m=+594.404292388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a412005b-b66b-40bc-a57f-7bd56458532f-metrics-certs") pod "maas-controller-69f557767c-9m928" (UID: "a412005b-b66b-40bc-a57f-7bd56458532f") : secret "maas-controller-metrics-tls" not found
Sep 06 19:37:10.509217 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.509195    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wzc8\" (UniqueName: \"kubernetes.io/projected/a412005b-b66b-40bc-a57f-7bd56458532f-kube-api-access-5wzc8\") pod \"maas-controller-69f557767c-9m928\" (UID: \"a412005b-b66b-40bc-a57f-7bd56458532f\") " pod="opendatahub/maas-controller-69f557767c-9m928"
Sep 06 19:37:10.600639 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.600605    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22502a87-c696-4516-9f31-338877e8d756-webhook-cert\") pod \"maas-controller-785588cb-8rcpm\" (UID: \"22502a87-c696-4516-9f31-338877e8d756\") " pod="opendatahub/maas-controller-785588cb-8rcpm"
Sep 06 19:37:10.600639 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.600637    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22502a87-c696-4516-9f31-338877e8d756-metrics-certs\") pod \"maas-controller-785588cb-8rcpm\" (UID: \"22502a87-c696-4516-9f31-338877e8d756\") " pod="opendatahub/maas-controller-785588cb-8rcpm"
Sep 06 19:37:10.600879 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.600662    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb9xr\" (UniqueName: \"kubernetes.io/projected/22502a87-c696-4516-9f31-338877e8d756-kube-api-access-rb9xr\") pod \"maas-controller-785588cb-8rcpm\" (UID: \"22502a87-c696-4516-9f31-338877e8d756\") " pod="opendatahub/maas-controller-785588cb-8rcpm"
Sep 06 19:37:10.600879 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:37:10.600750    2568 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 06 19:37:10.600879 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:37:10.600833    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22502a87-c696-4516-9f31-338877e8d756-webhook-cert podName:22502a87-c696-4516-9f31-338877e8d756 nodeName:}" failed. No retries permitted until 2026-09-06 19:37:11.100817945 +0000 UTC m=+594.505777004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/22502a87-c696-4516-9f31-338877e8d756-webhook-cert") pod "maas-controller-785588cb-8rcpm" (UID: "22502a87-c696-4516-9f31-338877e8d756") : secret "maas-controller-webhook-cert" not found
Sep 06 19:37:10.603355 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.603329    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22502a87-c696-4516-9f31-338877e8d756-metrics-certs\") pod \"maas-controller-785588cb-8rcpm\" (UID: \"22502a87-c696-4516-9f31-338877e8d756\") " pod="opendatahub/maas-controller-785588cb-8rcpm"
Sep 06 19:37:10.608391 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.608366    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb9xr\" (UniqueName: \"kubernetes.io/projected/22502a87-c696-4516-9f31-338877e8d756-kube-api-access-rb9xr\") pod \"maas-controller-785588cb-8rcpm\" (UID: \"22502a87-c696-4516-9f31-338877e8d756\") " pod="opendatahub/maas-controller-785588cb-8rcpm"
Sep 06 19:37:10.627153 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.627117    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:37:10.729255 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:10.729221    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:37:11.003748 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:11.003711    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a412005b-b66b-40bc-a57f-7bd56458532f-webhook-cert\") pod \"maas-controller-69f557767c-9m928\" (UID: \"a412005b-b66b-40bc-a57f-7bd56458532f\") " pod="opendatahub/maas-controller-69f557767c-9m928"
Sep 06 19:37:11.003748 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:11.003753    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a412005b-b66b-40bc-a57f-7bd56458532f-metrics-certs\") pod \"maas-controller-69f557767c-9m928\" (UID: \"a412005b-b66b-40bc-a57f-7bd56458532f\") " pod="opendatahub/maas-controller-69f557767c-9m928"
Sep 06 19:37:11.006353 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:11.006322    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a412005b-b66b-40bc-a57f-7bd56458532f-webhook-cert\") pod \"maas-controller-69f557767c-9m928\" (UID: \"a412005b-b66b-40bc-a57f-7bd56458532f\") " pod="opendatahub/maas-controller-69f557767c-9m928"
Sep 06 19:37:11.006486 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:11.006353    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a412005b-b66b-40bc-a57f-7bd56458532f-metrics-certs\") pod \"maas-controller-69f557767c-9m928\" (UID: \"a412005b-b66b-40bc-a57f-7bd56458532f\") " pod="opendatahub/maas-controller-69f557767c-9m928"
Sep 06 19:37:11.104408 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:11.104370    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22502a87-c696-4516-9f31-338877e8d756-webhook-cert\") pod \"maas-controller-785588cb-8rcpm\" (UID: \"22502a87-c696-4516-9f31-338877e8d756\") " pod="opendatahub/maas-controller-785588cb-8rcpm"
Sep 06 19:37:11.106855 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:11.106834    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22502a87-c696-4516-9f31-338877e8d756-webhook-cert\") pod \"maas-controller-785588cb-8rcpm\" (UID: \"22502a87-c696-4516-9f31-338877e8d756\") " pod="opendatahub/maas-controller-785588cb-8rcpm"
Sep 06 19:37:11.121761 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:11.121729    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69f557767c-9m928"
Sep 06 19:37:11.273373 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:11.273266    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-785588cb-8rcpm"
Sep 06 19:37:11.389291 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:11.389150    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69f557767c-9m928"]
Sep 06 19:37:11.391404 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:37:11.391372    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda412005b_b66b_40bc_a57f_7bd56458532f.slice/crio-ca63a69df098e294e2f2c220f78885522ed7145a341ec46e734a7895cb6de12d WatchSource:0}: Error finding container ca63a69df098e294e2f2c220f78885522ed7145a341ec46e734a7895cb6de12d: Status 404 returned error can't find the container with id ca63a69df098e294e2f2c220f78885522ed7145a341ec46e734a7895cb6de12d
Sep 06 19:37:11.544975 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:11.544941    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-785588cb-8rcpm"]
Sep 06 19:37:11.547467 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:37:11.547439    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22502a87_c696_4516_9f31_338877e8d756.slice/crio-87bb40e6f65c948d6c36b136ac5445d084fedc5c592d2b4c19716bf5aca83c99 WatchSource:0}: Error finding container 87bb40e6f65c948d6c36b136ac5445d084fedc5c592d2b4c19716bf5aca83c99: Status 404 returned error can't find the container with id 87bb40e6f65c948d6c36b136ac5445d084fedc5c592d2b4c19716bf5aca83c99
Sep 06 19:37:11.556908 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:11.556871    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69f557767c-9m928" event={"ID":"a412005b-b66b-40bc-a57f-7bd56458532f","Type":"ContainerStarted","Data":"ca63a69df098e294e2f2c220f78885522ed7145a341ec46e734a7895cb6de12d"}
Sep 06 19:37:11.558112 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:11.558089    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-785588cb-8rcpm" event={"ID":"22502a87-c696-4516-9f31-338877e8d756","Type":"ContainerStarted","Data":"87bb40e6f65c948d6c36b136ac5445d084fedc5c592d2b4c19716bf5aca83c99"}
Sep 06 19:37:14.160508 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:14.160455    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:37:14.266096 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:14.265999    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:37:14.581651 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:14.581569    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69f557767c-9m928" event={"ID":"a412005b-b66b-40bc-a57f-7bd56458532f","Type":"ContainerStarted","Data":"21f04275a00530d6f639519fa5336e2e7edcca87a9276c67ecbda876d32833bf"}
Sep 06 19:37:14.581825 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:14.581660    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69f557767c-9m928"
Sep 06 19:37:14.583098 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:14.583071    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-785588cb-8rcpm" event={"ID":"22502a87-c696-4516-9f31-338877e8d756","Type":"ContainerStarted","Data":"7cd0e43bef3b821e232866337af1a2f8f9e72b346338490f548e06850f508f8c"}
Sep 06 19:37:14.583228 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:14.583217    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-785588cb-8rcpm"
Sep 06 19:37:14.613951 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:14.613901    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-785588cb-8rcpm" podStartSLOduration=2.204489209 podStartE2EDuration="4.613886321s" totalImagesPullingTime="2.409397112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:37:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:37:14.612549329 +0000 UTC m=+598.017508422" watchObservedRunningTime="2026-09-06 19:37:14.613886321 +0000 UTC m=+598.018845653"
Sep 06 19:37:14.614239 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:14.614217    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-69f557767c-9m928" podStartSLOduration=2.055930338 podStartE2EDuration="4.614209871s" totalImagesPullingTime="2.558279533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:37:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:37:14.597897508 +0000 UTC m=+598.002856576" watchObservedRunningTime="2026-09-06 19:37:14.614209871 +0000 UTC m=+598.019168939"
Sep 06 19:37:25.590630 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:25.590598    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-785588cb-8rcpm"
Sep 06 19:37:25.591108 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:25.590687    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69f557767c-9m928"
Sep 06 19:37:25.665506 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:25.665469    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69f557767c-9m928"]
Sep 06 19:37:25.665699 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:25.665668    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-69f557767c-9m928" podUID="a412005b-b66b-40bc-a57f-7bd56458532f" containerName="manager" containerID="cri-o://21f04275a00530d6f639519fa5336e2e7edcca87a9276c67ecbda876d32833bf" gracePeriod=30
Sep 06 19:37:25.912477 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:25.912448    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69f557767c-9m928"
Sep 06 19:37:26.022830 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:26.022763    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wzc8\" (UniqueName: \"kubernetes.io/projected/a412005b-b66b-40bc-a57f-7bd56458532f-kube-api-access-5wzc8\") pod \"a412005b-b66b-40bc-a57f-7bd56458532f\" (UID: \"a412005b-b66b-40bc-a57f-7bd56458532f\") "
Sep 06 19:37:26.023009 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:26.022843    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a412005b-b66b-40bc-a57f-7bd56458532f-metrics-certs\") pod \"a412005b-b66b-40bc-a57f-7bd56458532f\" (UID: \"a412005b-b66b-40bc-a57f-7bd56458532f\") "
Sep 06 19:37:26.023009 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:26.022899    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a412005b-b66b-40bc-a57f-7bd56458532f-webhook-cert\") pod \"a412005b-b66b-40bc-a57f-7bd56458532f\" (UID: \"a412005b-b66b-40bc-a57f-7bd56458532f\") "
Sep 06 19:37:26.025147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:26.025106    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a412005b-b66b-40bc-a57f-7bd56458532f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a412005b-b66b-40bc-a57f-7bd56458532f" (UID: "a412005b-b66b-40bc-a57f-7bd56458532f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:37:26.025294 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:26.025152    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a412005b-b66b-40bc-a57f-7bd56458532f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a412005b-b66b-40bc-a57f-7bd56458532f" (UID: "a412005b-b66b-40bc-a57f-7bd56458532f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:37:26.025294 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:26.025200    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a412005b-b66b-40bc-a57f-7bd56458532f-kube-api-access-5wzc8" (OuterVolumeSpecName: "kube-api-access-5wzc8") pod "a412005b-b66b-40bc-a57f-7bd56458532f" (UID: "a412005b-b66b-40bc-a57f-7bd56458532f"). InnerVolumeSpecName "kube-api-access-5wzc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:37:26.124348 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:26.124311    2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a412005b-b66b-40bc-a57f-7bd56458532f-webhook-cert\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:37:26.124348 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:26.124342    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wzc8\" (UniqueName: \"kubernetes.io/projected/a412005b-b66b-40bc-a57f-7bd56458532f-kube-api-access-5wzc8\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:37:26.124348 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:26.124352    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a412005b-b66b-40bc-a57f-7bd56458532f-metrics-certs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:37:26.642219 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:26.642181    2568 generic.go:356] "Generic (PLEG): container finished" podID="a412005b-b66b-40bc-a57f-7bd56458532f" containerID="21f04275a00530d6f639519fa5336e2e7edcca87a9276c67ecbda876d32833bf" exitCode=0
Sep 06 19:37:26.642667 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:26.642231    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69f557767c-9m928"
Sep 06 19:37:26.642667 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:26.642230    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69f557767c-9m928" event={"ID":"a412005b-b66b-40bc-a57f-7bd56458532f","Type":"ContainerDied","Data":"21f04275a00530d6f639519fa5336e2e7edcca87a9276c67ecbda876d32833bf"}
Sep 06 19:37:26.642667 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:26.642385    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69f557767c-9m928" event={"ID":"a412005b-b66b-40bc-a57f-7bd56458532f","Type":"ContainerDied","Data":"ca63a69df098e294e2f2c220f78885522ed7145a341ec46e734a7895cb6de12d"}
Sep 06 19:37:26.642667 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:26.642426    2568 scope.go:117] "RemoveContainer" containerID="21f04275a00530d6f639519fa5336e2e7edcca87a9276c67ecbda876d32833bf"
Sep 06 19:37:26.651314 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:26.651295    2568 scope.go:117] "RemoveContainer" containerID="21f04275a00530d6f639519fa5336e2e7edcca87a9276c67ecbda876d32833bf"
Sep 06 19:37:26.651603 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:37:26.651584    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21f04275a00530d6f639519fa5336e2e7edcca87a9276c67ecbda876d32833bf\": container with ID starting with 21f04275a00530d6f639519fa5336e2e7edcca87a9276c67ecbda876d32833bf not found: ID does not exist" containerID="21f04275a00530d6f639519fa5336e2e7edcca87a9276c67ecbda876d32833bf"
Sep 06 19:37:26.651668 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:26.651611    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21f04275a00530d6f639519fa5336e2e7edcca87a9276c67ecbda876d32833bf"} err="failed to get container status \"21f04275a00530d6f639519fa5336e2e7edcca87a9276c67ecbda876d32833bf\": rpc error: code = NotFound desc = could not find container \"21f04275a00530d6f639519fa5336e2e7edcca87a9276c67ecbda876d32833bf\": container with ID starting with 21f04275a00530d6f639519fa5336e2e7edcca87a9276c67ecbda876d32833bf not found: ID does not exist"
Sep 06 19:37:26.661959 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:26.661937    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69f557767c-9m928"]
Sep 06 19:37:26.665766 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:26.665744    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-69f557767c-9m928"]
Sep 06 19:37:27.115299 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:27.115220    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a412005b-b66b-40bc-a57f-7bd56458532f" path="/var/lib/kubelet/pods/a412005b-b66b-40bc-a57f-7bd56458532f/volumes"
Sep 06 19:37:46.773134 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:46.773096    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:37:46.871960 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:46.871917    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:37:48.179886 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.179845    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:37:48.282703 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.282666    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:37:48.323514 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.323477    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"]
Sep 06 19:37:48.323866 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.323851    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a412005b-b66b-40bc-a57f-7bd56458532f" containerName="manager"
Sep 06 19:37:48.323914 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.323868    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a412005b-b66b-40bc-a57f-7bd56458532f" containerName="manager"
Sep 06 19:37:48.323959 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.323950    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a412005b-b66b-40bc-a57f-7bd56458532f" containerName="manager"
Sep 06 19:37:48.326741 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.326721    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"
Sep 06 19:37:48.329342 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.329320    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 06 19:37:48.329488 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.329396    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 06 19:37:48.329590 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.329573    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bfdfp\""
Sep 06 19:37:48.334512 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.334486    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"]
Sep 06 19:37:48.415352 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.415316    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/634cc9c8-a072-49d3-9b01-4af02ecc62f4-maas-api-tls\") pod \"maas-api-764cc5b8c6-2czq4\" (UID: \"634cc9c8-a072-49d3-9b01-4af02ecc62f4\") " pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"
Sep 06 19:37:48.415352 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.415353    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/634cc9c8-a072-49d3-9b01-4af02ecc62f4-openshift-service-ca\") pod \"maas-api-764cc5b8c6-2czq4\" (UID: \"634cc9c8-a072-49d3-9b01-4af02ecc62f4\") " pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"
Sep 06 19:37:48.415564 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.415427    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hppbf\" (UniqueName: \"kubernetes.io/projected/634cc9c8-a072-49d3-9b01-4af02ecc62f4-kube-api-access-hppbf\") pod \"maas-api-764cc5b8c6-2czq4\" (UID: \"634cc9c8-a072-49d3-9b01-4af02ecc62f4\") " pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"
Sep 06 19:37:48.415564 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.415505    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/634cc9c8-a072-49d3-9b01-4af02ecc62f4-metrics-certs\") pod \"maas-api-764cc5b8c6-2czq4\" (UID: \"634cc9c8-a072-49d3-9b01-4af02ecc62f4\") " pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"
Sep 06 19:37:48.516672 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.516600    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/634cc9c8-a072-49d3-9b01-4af02ecc62f4-maas-api-tls\") pod \"maas-api-764cc5b8c6-2czq4\" (UID: \"634cc9c8-a072-49d3-9b01-4af02ecc62f4\") " pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"
Sep 06 19:37:48.516672 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.516631    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/634cc9c8-a072-49d3-9b01-4af02ecc62f4-openshift-service-ca\") pod \"maas-api-764cc5b8c6-2czq4\" (UID: \"634cc9c8-a072-49d3-9b01-4af02ecc62f4\") " pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"
Sep 06 19:37:48.516890 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.516767    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hppbf\" (UniqueName: \"kubernetes.io/projected/634cc9c8-a072-49d3-9b01-4af02ecc62f4-kube-api-access-hppbf\") pod \"maas-api-764cc5b8c6-2czq4\" (UID: \"634cc9c8-a072-49d3-9b01-4af02ecc62f4\") " pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"
Sep 06 19:37:48.516890 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:37:48.516803    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Sep 06 19:37:48.516890 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.516850    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/634cc9c8-a072-49d3-9b01-4af02ecc62f4-metrics-certs\") pod \"maas-api-764cc5b8c6-2czq4\" (UID: \"634cc9c8-a072-49d3-9b01-4af02ecc62f4\") " pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"
Sep 06 19:37:48.516890 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:37:48.516879    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/634cc9c8-a072-49d3-9b01-4af02ecc62f4-maas-api-tls podName:634cc9c8-a072-49d3-9b01-4af02ecc62f4 nodeName:}" failed. No retries permitted until 2026-09-06 19:37:49.01685575 +0000 UTC m=+632.421814809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/634cc9c8-a072-49d3-9b01-4af02ecc62f4-maas-api-tls") pod "maas-api-764cc5b8c6-2czq4" (UID: "634cc9c8-a072-49d3-9b01-4af02ecc62f4") : secret "maas-api-serving-cert" not found
Sep 06 19:37:48.517107 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:37:48.516933    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 06 19:37:48.517107 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:37:48.517009    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/634cc9c8-a072-49d3-9b01-4af02ecc62f4-metrics-certs podName:634cc9c8-a072-49d3-9b01-4af02ecc62f4 nodeName:}" failed. No retries permitted until 2026-09-06 19:37:49.016993187 +0000 UTC m=+632.421952247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/634cc9c8-a072-49d3-9b01-4af02ecc62f4-metrics-certs") pod "maas-api-764cc5b8c6-2czq4" (UID: "634cc9c8-a072-49d3-9b01-4af02ecc62f4") : secret "maas-api-metrics-tls" not found
Sep 06 19:37:48.517351 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.517333    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/634cc9c8-a072-49d3-9b01-4af02ecc62f4-openshift-service-ca\") pod \"maas-api-764cc5b8c6-2czq4\" (UID: \"634cc9c8-a072-49d3-9b01-4af02ecc62f4\") " pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"
Sep 06 19:37:48.525221 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.525177    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hppbf\" (UniqueName: \"kubernetes.io/projected/634cc9c8-a072-49d3-9b01-4af02ecc62f4-kube-api-access-hppbf\") pod \"maas-api-764cc5b8c6-2czq4\" (UID: \"634cc9c8-a072-49d3-9b01-4af02ecc62f4\") " pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"
Sep 06 19:37:48.585879 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.585844    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:37:48.686944 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.686908    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:37:48.765686 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.765650    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:37:48.766617 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.766596    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-2s44b"]
Sep 06 19:37:48.770282 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.770226    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2s44b"
Sep 06 19:37:48.772939 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.772919    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fldd8\""
Sep 06 19:37:48.773040 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.772981    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 06 19:37:48.780551 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.780529    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-2s44b"]
Sep 06 19:37:48.920709 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.920670    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2f5k\" (UniqueName: \"kubernetes.io/projected/564501d8-6ec9-471a-9bba-085afc155bc5-kube-api-access-p2f5k\") pod \"payload-pre-processing-59fbc47bf8-2s44b\" (UID: \"564501d8-6ec9-471a-9bba-085afc155bc5\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2s44b"
Sep 06 19:37:48.920920 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:48.920823    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/564501d8-6ec9-471a-9bba-085afc155bc5-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-2s44b\" (UID: \"564501d8-6ec9-471a-9bba-085afc155bc5\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2s44b"
Sep 06 19:37:49.021826 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:49.021714    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/564501d8-6ec9-471a-9bba-085afc155bc5-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-2s44b\" (UID: \"564501d8-6ec9-471a-9bba-085afc155bc5\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2s44b"
Sep 06 19:37:49.021826 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:49.021768    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/634cc9c8-a072-49d3-9b01-4af02ecc62f4-metrics-certs\") pod \"maas-api-764cc5b8c6-2czq4\" (UID: \"634cc9c8-a072-49d3-9b01-4af02ecc62f4\") " pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"
Sep 06 19:37:49.022023 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:49.021844    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2f5k\" (UniqueName: \"kubernetes.io/projected/564501d8-6ec9-471a-9bba-085afc155bc5-kube-api-access-p2f5k\") pod \"payload-pre-processing-59fbc47bf8-2s44b\" (UID: \"564501d8-6ec9-471a-9bba-085afc155bc5\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2s44b"
Sep 06 19:37:49.022023 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:49.021863    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/634cc9c8-a072-49d3-9b01-4af02ecc62f4-maas-api-tls\") pod \"maas-api-764cc5b8c6-2czq4\" (UID: \"634cc9c8-a072-49d3-9b01-4af02ecc62f4\") " pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"
Sep 06 19:37:49.022485 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:49.022457    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/564501d8-6ec9-471a-9bba-085afc155bc5-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-2s44b\" (UID: \"564501d8-6ec9-471a-9bba-085afc155bc5\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2s44b"
Sep 06 19:37:49.024536 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:49.024512    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/634cc9c8-a072-49d3-9b01-4af02ecc62f4-maas-api-tls\") pod \"maas-api-764cc5b8c6-2czq4\" (UID: \"634cc9c8-a072-49d3-9b01-4af02ecc62f4\") " pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"
Sep 06 19:37:49.024635 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:49.024539    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/634cc9c8-a072-49d3-9b01-4af02ecc62f4-metrics-certs\") pod \"maas-api-764cc5b8c6-2czq4\" (UID: \"634cc9c8-a072-49d3-9b01-4af02ecc62f4\") " pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"
Sep 06 19:37:49.029314 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:49.029292    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2f5k\" (UniqueName: \"kubernetes.io/projected/564501d8-6ec9-471a-9bba-085afc155bc5-kube-api-access-p2f5k\") pod \"payload-pre-processing-59fbc47bf8-2s44b\" (UID: \"564501d8-6ec9-471a-9bba-085afc155bc5\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2s44b"
Sep 06 19:37:49.082053 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:49.082020    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2s44b"
Sep 06 19:37:49.238477 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:49.238448    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"
Sep 06 19:37:49.355110 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:49.355080    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-2s44b"]
Sep 06 19:37:49.358044 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:37:49.358016    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod564501d8_6ec9_471a_9bba_085afc155bc5.slice/crio-81fc7b14d0efd031e84b4bb201db49a10f6c1f7bcdfc01029d77196cfb860940 WatchSource:0}: Error finding container 81fc7b14d0efd031e84b4bb201db49a10f6c1f7bcdfc01029d77196cfb860940: Status 404 returned error can't find the container with id 81fc7b14d0efd031e84b4bb201db49a10f6c1f7bcdfc01029d77196cfb860940
Sep 06 19:37:49.508172 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:49.508130    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"]
Sep 06 19:37:49.511242 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:37:49.511210    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod634cc9c8_a072_49d3_9b01_4af02ecc62f4.slice/crio-c673e23d4bac4ea09a1df654dfcd71a577b67587752d0080aae784e1b118f2d1 WatchSource:0}: Error finding container c673e23d4bac4ea09a1df654dfcd71a577b67587752d0080aae784e1b118f2d1: Status 404 returned error can't find the container with id c673e23d4bac4ea09a1df654dfcd71a577b67587752d0080aae784e1b118f2d1
Sep 06 19:37:49.751414 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:49.751371    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4" event={"ID":"634cc9c8-a072-49d3-9b01-4af02ecc62f4","Type":"ContainerStarted","Data":"c673e23d4bac4ea09a1df654dfcd71a577b67587752d0080aae784e1b118f2d1"}
Sep 06 19:37:49.752662 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:49.752640    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2s44b" event={"ID":"564501d8-6ec9-471a-9bba-085afc155bc5","Type":"ContainerStarted","Data":"81fc7b14d0efd031e84b4bb201db49a10f6c1f7bcdfc01029d77196cfb860940"}
Sep 06 19:37:51.764981 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:51.764895    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4" event={"ID":"634cc9c8-a072-49d3-9b01-4af02ecc62f4","Type":"ContainerStarted","Data":"078aad114d6ce7b36611d364f2209998cb72b71ce2ecde4bfea104b059369bfd"}
Sep 06 19:37:51.765398 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:51.765073    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"
Sep 06 19:37:51.766485 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:51.766460    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2s44b" event={"ID":"564501d8-6ec9-471a-9bba-085afc155bc5","Type":"ContainerStarted","Data":"1a739efe339bc961a72df651e82d4642e6664b549569ec57c89f90a5ac8388f9"}
Sep 06 19:37:51.766597 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:51.766527    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2s44b"
Sep 06 19:37:51.784087 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:51.784038    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4" podStartSLOduration=1.902137288 podStartE2EDuration="3.784021864s" totalImagesPullingTime="1.881884576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:37:51.783492982 +0000 UTC m=+635.188452052" watchObservedRunningTime="2026-09-06 19:37:51.784021864 +0000 UTC m=+635.188980931"
Sep 06 19:37:51.799731 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:51.799683    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2s44b" podStartSLOduration=1.758958146 podStartE2EDuration="3.799663626s" totalImagesPullingTime="2.04070548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:37:51.797585638 +0000 UTC m=+635.202544697" watchObservedRunningTime="2026-09-06 19:37:51.799663626 +0000 UTC m=+635.204622698"
Sep 06 19:37:57.777798 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:57.777755    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"
Sep 06 19:37:58.717436 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:58.717397    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:37:58.816789 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:37:58.816739    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:38:02.774293 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:02.774264    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2s44b"
Sep 06 19:38:07.155246 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.155212    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"]
Sep 06 19:38:07.158990 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.158969    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:07.161511 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.161487    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ldj7j\""
Sep 06 19:38:07.162629 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.162606    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 06 19:38:07.162731 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.162652    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 06 19:38:07.162800 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.162755    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 06 19:38:07.167021 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.166996    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"]
Sep 06 19:38:07.176013 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.175984    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:38:07.184627 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.184597    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d7d1eee-7ece-44cf-9e30-def2f2f05cf6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz\" (UID: \"8d7d1eee-7ece-44cf-9e30-def2f2f05cf6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:07.184790 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.184640    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d7d1eee-7ece-44cf-9e30-def2f2f05cf6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz\" (UID: \"8d7d1eee-7ece-44cf-9e30-def2f2f05cf6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:07.184790 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.184663    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d7d1eee-7ece-44cf-9e30-def2f2f05cf6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz\" (UID: \"8d7d1eee-7ece-44cf-9e30-def2f2f05cf6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:07.184790 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.184726    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d7d1eee-7ece-44cf-9e30-def2f2f05cf6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz\" (UID: \"8d7d1eee-7ece-44cf-9e30-def2f2f05cf6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:07.184924 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.184904    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d7d1eee-7ece-44cf-9e30-def2f2f05cf6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz\" (UID: \"8d7d1eee-7ece-44cf-9e30-def2f2f05cf6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:07.185031 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.185015    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx6d8\" (UniqueName: \"kubernetes.io/projected/8d7d1eee-7ece-44cf-9e30-def2f2f05cf6-kube-api-access-hx6d8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz\" (UID: \"8d7d1eee-7ece-44cf-9e30-def2f2f05cf6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:07.285993 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.285959    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d7d1eee-7ece-44cf-9e30-def2f2f05cf6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz\" (UID: \"8d7d1eee-7ece-44cf-9e30-def2f2f05cf6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:07.286222 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.286014    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx6d8\" (UniqueName: \"kubernetes.io/projected/8d7d1eee-7ece-44cf-9e30-def2f2f05cf6-kube-api-access-hx6d8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz\" (UID: \"8d7d1eee-7ece-44cf-9e30-def2f2f05cf6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:07.286222 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.286052    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d7d1eee-7ece-44cf-9e30-def2f2f05cf6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz\" (UID: \"8d7d1eee-7ece-44cf-9e30-def2f2f05cf6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:07.286222 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.286080    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d7d1eee-7ece-44cf-9e30-def2f2f05cf6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz\" (UID: \"8d7d1eee-7ece-44cf-9e30-def2f2f05cf6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:07.286222 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.286101    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d7d1eee-7ece-44cf-9e30-def2f2f05cf6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz\" (UID: \"8d7d1eee-7ece-44cf-9e30-def2f2f05cf6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:07.286222 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.286132    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d7d1eee-7ece-44cf-9e30-def2f2f05cf6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz\" (UID: \"8d7d1eee-7ece-44cf-9e30-def2f2f05cf6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:07.286492 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.286472    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d7d1eee-7ece-44cf-9e30-def2f2f05cf6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz\" (UID: \"8d7d1eee-7ece-44cf-9e30-def2f2f05cf6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:07.286566 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.286522    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d7d1eee-7ece-44cf-9e30-def2f2f05cf6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz\" (UID: \"8d7d1eee-7ece-44cf-9e30-def2f2f05cf6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:07.286566 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.286533    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d7d1eee-7ece-44cf-9e30-def2f2f05cf6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz\" (UID: \"8d7d1eee-7ece-44cf-9e30-def2f2f05cf6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:07.288679 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.288656    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d7d1eee-7ece-44cf-9e30-def2f2f05cf6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz\" (UID: \"8d7d1eee-7ece-44cf-9e30-def2f2f05cf6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:07.289072 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.289052    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d7d1eee-7ece-44cf-9e30-def2f2f05cf6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz\" (UID: \"8d7d1eee-7ece-44cf-9e30-def2f2f05cf6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:07.293356 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.293339    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx6d8\" (UniqueName: \"kubernetes.io/projected/8d7d1eee-7ece-44cf-9e30-def2f2f05cf6-kube-api-access-hx6d8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz\" (UID: \"8d7d1eee-7ece-44cf-9e30-def2f2f05cf6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:07.472629 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.472528    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:07.748988 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.748964    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"]
Sep 06 19:38:07.750911 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:38:07.750879    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d7d1eee_7ece_44cf_9e30_def2f2f05cf6.slice/crio-e37f41a4f86c93d2ec016e745ed00beac123c001946f2e8e6040cf355c9e4537 WatchSource:0}: Error finding container e37f41a4f86c93d2ec016e745ed00beac123c001946f2e8e6040cf355c9e4537: Status 404 returned error can't find the container with id e37f41a4f86c93d2ec016e745ed00beac123c001946f2e8e6040cf355c9e4537
Sep 06 19:38:07.847516 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:07.847476    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz" event={"ID":"8d7d1eee-7ece-44cf-9e30-def2f2f05cf6","Type":"ContainerStarted","Data":"e37f41a4f86c93d2ec016e745ed00beac123c001946f2e8e6040cf355c9e4537"}
Sep 06 19:38:09.859086 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:09.859049    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz" event={"ID":"8d7d1eee-7ece-44cf-9e30-def2f2f05cf6","Type":"ContainerStarted","Data":"47cdfd5bf4d1d61757140cb0aa90f54991606462c0098f39fe92521522f640d8"}
Sep 06 19:38:09.876925 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:09.876867    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz" podStartSLOduration=1.746712612 podStartE2EDuration="2.876849052s" totalImagesPullingTime="1.13013644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:38:09.874446602 +0000 UTC m=+653.279405674" watchObservedRunningTime="2026-09-06 19:38:09.876849052 +0000 UTC m=+653.281808120"
Sep 06 19:38:13.670260 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:13.670226    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:38:17.473315 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:17.473274    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:17.473708 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:17.473362    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:17.486321 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:17.486294    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:17.910512 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:17.910486    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz"
Sep 06 19:38:33.640664 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.640622    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"]
Sep 06 19:38:33.654747 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.654707    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"]
Sep 06 19:38:33.654933 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.654853    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:33.657442 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.657415    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 06 19:38:33.676154 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.676118    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:38:33.728870 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.728834    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74856547-1dbe-4517-be6c-becf90ff86ba-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9\" (UID: \"74856547-1dbe-4517-be6c-becf90ff86ba\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:33.729057 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.728882    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74856547-1dbe-4517-be6c-becf90ff86ba-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9\" (UID: \"74856547-1dbe-4517-be6c-becf90ff86ba\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:33.729057 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.728901    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74856547-1dbe-4517-be6c-becf90ff86ba-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9\" (UID: \"74856547-1dbe-4517-be6c-becf90ff86ba\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:33.729057 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.728986    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74856547-1dbe-4517-be6c-becf90ff86ba-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9\" (UID: \"74856547-1dbe-4517-be6c-becf90ff86ba\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:33.729057 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.729025    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74856547-1dbe-4517-be6c-becf90ff86ba-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9\" (UID: \"74856547-1dbe-4517-be6c-becf90ff86ba\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:33.729207 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.729061    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-445p7\" (UniqueName: \"kubernetes.io/projected/74856547-1dbe-4517-be6c-becf90ff86ba-kube-api-access-445p7\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9\" (UID: \"74856547-1dbe-4517-be6c-becf90ff86ba\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:33.829724 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.829679    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74856547-1dbe-4517-be6c-becf90ff86ba-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9\" (UID: \"74856547-1dbe-4517-be6c-becf90ff86ba\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:33.829724 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.829728    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74856547-1dbe-4517-be6c-becf90ff86ba-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9\" (UID: \"74856547-1dbe-4517-be6c-becf90ff86ba\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:33.830022 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.829746    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74856547-1dbe-4517-be6c-becf90ff86ba-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9\" (UID: \"74856547-1dbe-4517-be6c-becf90ff86ba\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:33.830022 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.829816    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74856547-1dbe-4517-be6c-becf90ff86ba-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9\" (UID: \"74856547-1dbe-4517-be6c-becf90ff86ba\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:33.830022 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.829849    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74856547-1dbe-4517-be6c-becf90ff86ba-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9\" (UID: \"74856547-1dbe-4517-be6c-becf90ff86ba\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:33.830022 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.829886    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-445p7\" (UniqueName: \"kubernetes.io/projected/74856547-1dbe-4517-be6c-becf90ff86ba-kube-api-access-445p7\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9\" (UID: \"74856547-1dbe-4517-be6c-becf90ff86ba\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:33.830231 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.830199    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74856547-1dbe-4517-be6c-becf90ff86ba-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9\" (UID: \"74856547-1dbe-4517-be6c-becf90ff86ba\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:33.830284 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.830227    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74856547-1dbe-4517-be6c-becf90ff86ba-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9\" (UID: \"74856547-1dbe-4517-be6c-becf90ff86ba\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:33.830326 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.830289    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74856547-1dbe-4517-be6c-becf90ff86ba-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9\" (UID: \"74856547-1dbe-4517-be6c-becf90ff86ba\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:33.832394 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.832370    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74856547-1dbe-4517-be6c-becf90ff86ba-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9\" (UID: \"74856547-1dbe-4517-be6c-becf90ff86ba\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:33.832516 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.832491    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74856547-1dbe-4517-be6c-becf90ff86ba-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9\" (UID: \"74856547-1dbe-4517-be6c-becf90ff86ba\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:33.837375 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.837352    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-445p7\" (UniqueName: \"kubernetes.io/projected/74856547-1dbe-4517-be6c-becf90ff86ba-kube-api-access-445p7\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9\" (UID: \"74856547-1dbe-4517-be6c-becf90ff86ba\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:33.966337 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:33.966245    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:34.241623 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:34.241518    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"]
Sep 06 19:38:34.244562 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:38:34.244532    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74856547_1dbe_4517_be6c_becf90ff86ba.slice/crio-e9bea6a34b8b1a696bfe6e1ac8fa2a459e39ce59150af4f5a2830d1c7f41b1f1 WatchSource:0}: Error finding container e9bea6a34b8b1a696bfe6e1ac8fa2a459e39ce59150af4f5a2830d1c7f41b1f1: Status 404 returned error can't find the container with id e9bea6a34b8b1a696bfe6e1ac8fa2a459e39ce59150af4f5a2830d1c7f41b1f1
Sep 06 19:38:34.245913 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:34.245897    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 19:38:34.982030 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:34.981994    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9" event={"ID":"74856547-1dbe-4517-be6c-becf90ff86ba","Type":"ContainerStarted","Data":"1747145f4af27e40966e839c5e2b5128464862d0a84a250aa3797945532b7716"}
Sep 06 19:38:34.982618 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:34.982045    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9" event={"ID":"74856547-1dbe-4517-be6c-becf90ff86ba","Type":"ContainerStarted","Data":"e9bea6a34b8b1a696bfe6e1ac8fa2a459e39ce59150af4f5a2830d1c7f41b1f1"}
Sep 06 19:38:34.999660 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:34.999600    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9" podStartSLOduration=1.822110117 podStartE2EDuration="1.999582908s" totalImagesPullingTime="177.472791ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:38:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:38:34.997973574 +0000 UTC m=+678.402932643" watchObservedRunningTime="2026-09-06 19:38:34.999582908 +0000 UTC m=+678.404541975"
Sep 06 19:38:38.151309 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:38.151265    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:38:39.405644 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:39.405606    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:38:39.451936 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:39.451903    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:38:43.966677 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:43.966634    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:43.967105 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:43.966701    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:43.979065 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:43.979034    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:44.042546 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:44.042519    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9"
Sep 06 19:38:52.137418 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.137385    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"]
Sep 06 19:38:52.141395 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.141369    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:38:52.143873 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.143847    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 06 19:38:52.149687 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.149664    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"]
Sep 06 19:38:52.164923 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.164894    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:38:52.298711 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.298675    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d854e460-158a-416f-a891-719a161297bf-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86cc4\" (UID: \"d854e460-158a-416f-a891-719a161297bf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:38:52.298937 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.298742    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d854e460-158a-416f-a891-719a161297bf-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86cc4\" (UID: \"d854e460-158a-416f-a891-719a161297bf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:38:52.298937 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.298789    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d854e460-158a-416f-a891-719a161297bf-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86cc4\" (UID: \"d854e460-158a-416f-a891-719a161297bf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:38:52.298937 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.298834    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d854e460-158a-416f-a891-719a161297bf-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86cc4\" (UID: \"d854e460-158a-416f-a891-719a161297bf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:38:52.298937 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.298857    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fx9s\" (UniqueName: \"kubernetes.io/projected/d854e460-158a-416f-a891-719a161297bf-kube-api-access-2fx9s\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86cc4\" (UID: \"d854e460-158a-416f-a891-719a161297bf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:38:52.299131 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.298942    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d854e460-158a-416f-a891-719a161297bf-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86cc4\" (UID: \"d854e460-158a-416f-a891-719a161297bf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:38:52.400063 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.399974    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d854e460-158a-416f-a891-719a161297bf-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86cc4\" (UID: \"d854e460-158a-416f-a891-719a161297bf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:38:52.400063 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.400034    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d854e460-158a-416f-a891-719a161297bf-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86cc4\" (UID: \"d854e460-158a-416f-a891-719a161297bf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:38:52.400293 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.400082    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d854e460-158a-416f-a891-719a161297bf-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86cc4\" (UID: \"d854e460-158a-416f-a891-719a161297bf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:38:52.400293 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.400107    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d854e460-158a-416f-a891-719a161297bf-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86cc4\" (UID: \"d854e460-158a-416f-a891-719a161297bf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:38:52.400293 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.400260    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d854e460-158a-416f-a891-719a161297bf-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86cc4\" (UID: \"d854e460-158a-416f-a891-719a161297bf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:38:52.400460 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.400310    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fx9s\" (UniqueName: \"kubernetes.io/projected/d854e460-158a-416f-a891-719a161297bf-kube-api-access-2fx9s\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86cc4\" (UID: \"d854e460-158a-416f-a891-719a161297bf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:38:52.400460 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.400419    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d854e460-158a-416f-a891-719a161297bf-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86cc4\" (UID: \"d854e460-158a-416f-a891-719a161297bf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:38:52.400572 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.400472    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d854e460-158a-416f-a891-719a161297bf-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86cc4\" (UID: \"d854e460-158a-416f-a891-719a161297bf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:38:52.400657 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.400629    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d854e460-158a-416f-a891-719a161297bf-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86cc4\" (UID: \"d854e460-158a-416f-a891-719a161297bf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:38:52.402722 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.402694    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d854e460-158a-416f-a891-719a161297bf-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86cc4\" (UID: \"d854e460-158a-416f-a891-719a161297bf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:38:52.403018 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.402998    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d854e460-158a-416f-a891-719a161297bf-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86cc4\" (UID: \"d854e460-158a-416f-a891-719a161297bf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:38:52.408384 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.408359    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fx9s\" (UniqueName: \"kubernetes.io/projected/d854e460-158a-416f-a891-719a161297bf-kube-api-access-2fx9s\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86cc4\" (UID: \"d854e460-158a-416f-a891-719a161297bf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:38:52.454085 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.454052    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:38:52.727325 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:52.727301    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"]
Sep 06 19:38:52.729922 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:38:52.729897    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd854e460_158a_416f_a891_719a161297bf.slice/crio-3797d1ace70e44f92f3d10130a9b773dc76e669117c07cd953b10f0c9b68c74c WatchSource:0}: Error finding container 3797d1ace70e44f92f3d10130a9b773dc76e669117c07cd953b10f0c9b68c74c: Status 404 returned error can't find the container with id 3797d1ace70e44f92f3d10130a9b773dc76e669117c07cd953b10f0c9b68c74c
Sep 06 19:38:53.077716 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:53.077632    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4" event={"ID":"d854e460-158a-416f-a891-719a161297bf","Type":"ContainerStarted","Data":"8dee5e0158c991e1e975b74282c7c73bf01312b3f776d09da1d0724f0b71ee9f"}
Sep 06 19:38:53.077716 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:53.077684    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4" event={"ID":"d854e460-158a-416f-a891-719a161297bf","Type":"ContainerStarted","Data":"3797d1ace70e44f92f3d10130a9b773dc76e669117c07cd953b10f0c9b68c74c"}
Sep 06 19:38:53.094004 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:38:53.093950    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4" podStartSLOduration=0.91180718 podStartE2EDuration="1.093931969s" totalImagesPullingTime="182.124789ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:38:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:38:53.092843654 +0000 UTC m=+696.497802725" watchObservedRunningTime="2026-09-06 19:38:53.093931969 +0000 UTC m=+696.498891037"
Sep 06 19:39:02.455189 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:39:02.455144    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:39:02.455669 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:39:02.455215    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:39:02.467942 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:39:02.467914    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:39:03.140081 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:39:03.140046    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86cc4"
Sep 06 19:39:08.357322 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:39:08.357230    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:39:15.825402 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:39:15.825367    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:39:17.572874 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:39:17.572839    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:39:44.144588 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:39:44.144548    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:39:44.671634 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:39:44.671587    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:39:54.837132 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:39:54.837089    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:40:39.614676 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:40:39.614461    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:40:39.663361 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:40:39.663326    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:04.260494 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:04.260454    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:04.360668 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:04.360627    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:05.331918 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:05.331868    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:05.427501 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:05.427467    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:20.328272 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:20.328231    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:20.448347 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:20.448306    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:20.640988 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:20.640934    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:20.998059 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:20.997963    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:21.636997 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:21.636962    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:21.736713 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:21.736658    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:22.076212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:22.076110    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:22.158033 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:22.157996    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7648-140110653565744"]
Sep 06 19:41:22.161424 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:22.161407    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7648-140110653565744"
Sep 06 19:41:22.164394 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:22.164372    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kn2d6\""
Sep 06 19:41:22.164804 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:22.164761    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7648-140110653565744"]
Sep 06 19:41:22.302063 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:22.302015    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b47nn\" (UniqueName: \"kubernetes.io/projected/6f557a63-0c57-4526-849e-229fb1b54403-kube-api-access-b47nn\") pod \"test-curl-7648-140110653565744\" (UID: \"6f557a63-0c57-4526-849e-229fb1b54403\") " pod="opendatahub/test-curl-7648-140110653565744"
Sep 06 19:41:22.403522 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:22.403478    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b47nn\" (UniqueName: \"kubernetes.io/projected/6f557a63-0c57-4526-849e-229fb1b54403-kube-api-access-b47nn\") pod \"test-curl-7648-140110653565744\" (UID: \"6f557a63-0c57-4526-849e-229fb1b54403\") " pod="opendatahub/test-curl-7648-140110653565744"
Sep 06 19:41:22.412689 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:22.412661    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b47nn\" (UniqueName: \"kubernetes.io/projected/6f557a63-0c57-4526-849e-229fb1b54403-kube-api-access-b47nn\") pod \"test-curl-7648-140110653565744\" (UID: \"6f557a63-0c57-4526-849e-229fb1b54403\") " pod="opendatahub/test-curl-7648-140110653565744"
Sep 06 19:41:22.471090 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:22.471048    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7648-140110653565744"
Sep 06 19:41:22.744275 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:22.744199    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7648-140110653565744"]
Sep 06 19:41:22.747705 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:41:22.747677    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f557a63_0c57_4526_849e_229fb1b54403.slice/crio-e651b67499b0c5aa6a68d152569e3d3887733d9ca53222260e4d08a296a4e55e WatchSource:0}: Error finding container e651b67499b0c5aa6a68d152569e3d3887733d9ca53222260e4d08a296a4e55e: Status 404 returned error can't find the container with id e651b67499b0c5aa6a68d152569e3d3887733d9ca53222260e4d08a296a4e55e
Sep 06 19:41:22.833961 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:22.833922    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7648-140110653565744" event={"ID":"6f557a63-0c57-4526-849e-229fb1b54403","Type":"ContainerStarted","Data":"e651b67499b0c5aa6a68d152569e3d3887733d9ca53222260e4d08a296a4e55e"}
Sep 06 19:41:23.820156 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:23.820062    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:23.840852 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:23.840822    2568 generic.go:356] "Generic (PLEG): container finished" podID="6f557a63-0c57-4526-849e-229fb1b54403" containerID="00b88e71ad8ffe9b61be9acd55d250b647919a026a58e68d8b963c0b3295e990" exitCode=0
Sep 06 19:41:23.841033 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:23.840896    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7648-140110653565744" event={"ID":"6f557a63-0c57-4526-849e-229fb1b54403","Type":"ContainerDied","Data":"00b88e71ad8ffe9b61be9acd55d250b647919a026a58e68d8b963c0b3295e990"}
Sep 06 19:41:23.883504 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:23.883465    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:24.982668 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:24.982634    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7648-140110653565744"
Sep 06 19:41:25.002863 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.002833    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7648-140110653565744_6f557a63-0c57-4526-849e-229fb1b54403/test-curl-7648-140110653565744/0.log"
Sep 06 19:41:25.022885 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.022845    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7648-140110653565744"]
Sep 06 19:41:25.024554 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.024527    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7648-140110653565744"]
Sep 06 19:41:25.128450 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.128424    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b47nn\" (UniqueName: \"kubernetes.io/projected/6f557a63-0c57-4526-849e-229fb1b54403-kube-api-access-b47nn\") pod \"6f557a63-0c57-4526-849e-229fb1b54403\" (UID: \"6f557a63-0c57-4526-849e-229fb1b54403\") "
Sep 06 19:41:25.130706 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.130675    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f557a63-0c57-4526-849e-229fb1b54403-kube-api-access-b47nn" (OuterVolumeSpecName: "kube-api-access-b47nn") pod "6f557a63-0c57-4526-849e-229fb1b54403" (UID: "6f557a63-0c57-4526-849e-229fb1b54403"). InnerVolumeSpecName "kube-api-access-b47nn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:41:25.153478 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.153447    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7648-140110653565744"]
Sep 06 19:41:25.153859 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.153845    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f557a63-0c57-4526-849e-229fb1b54403" containerName="test-curl-7648-140110653565744"
Sep 06 19:41:25.153911 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.153861    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f557a63-0c57-4526-849e-229fb1b54403" containerName="test-curl-7648-140110653565744"
Sep 06 19:41:25.153951 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.153916    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f557a63-0c57-4526-849e-229fb1b54403" containerName="test-curl-7648-140110653565744"
Sep 06 19:41:25.156801 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.156769    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7648-140110653565744"
Sep 06 19:41:25.172091 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.172066    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7648-140110653565744"]
Sep 06 19:41:25.203949 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.203916    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"]
Sep 06 19:41:25.207303 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.207280    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"
Sep 06 19:41:25.210070 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.210051    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-6433a6-serving-cert\""
Sep 06 19:41:25.229523 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.229498    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b47nn\" (UniqueName: \"kubernetes.io/projected/6f557a63-0c57-4526-849e-229fb1b54403-kube-api-access-b47nn\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:41:25.232011 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.231982    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"]
Sep 06 19:41:25.238102 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.238077    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:25.303198 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.303127    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:25.330195 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.330147    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-maas-api-tls\") pod \"maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww\" (UID: \"771ddfb7-7f35-4c2e-a994-58eb4d7262ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"
Sep 06 19:41:25.330195 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.330196    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n7wc\" (UniqueName: \"kubernetes.io/projected/2a9cc9c2-eb97-4b2a-b274-ec6c30083093-kube-api-access-8n7wc\") pod \"test-curl-7648-140110653565744\" (UID: \"2a9cc9c2-eb97-4b2a-b274-ec6c30083093\") " pod="opendatahub/test-curl-7648-140110653565744"
Sep 06 19:41:25.330430 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.330286    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww\" (UID: \"771ddfb7-7f35-4c2e-a994-58eb4d7262ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"
Sep 06 19:41:25.330430 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.330365    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7rhq\" (UniqueName: \"kubernetes.io/projected/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-kube-api-access-b7rhq\") pod \"maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww\" (UID: \"771ddfb7-7f35-4c2e-a994-58eb4d7262ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"
Sep 06 19:41:25.330430 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.330393    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-metrics-certs\") pod \"maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww\" (UID: \"771ddfb7-7f35-4c2e-a994-58eb4d7262ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"
Sep 06 19:41:25.403394 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.403308    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:25.430875 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.430836    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww\" (UID: \"771ddfb7-7f35-4c2e-a994-58eb4d7262ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"
Sep 06 19:41:25.431078 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.430895    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7rhq\" (UniqueName: \"kubernetes.io/projected/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-kube-api-access-b7rhq\") pod \"maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww\" (UID: \"771ddfb7-7f35-4c2e-a994-58eb4d7262ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"
Sep 06 19:41:25.431078 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.430917    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-metrics-certs\") pod \"maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww\" (UID: \"771ddfb7-7f35-4c2e-a994-58eb4d7262ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"
Sep 06 19:41:25.431078 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.430960    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-maas-api-tls\") pod \"maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww\" (UID: \"771ddfb7-7f35-4c2e-a994-58eb4d7262ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"
Sep 06 19:41:25.431078 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.430979    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n7wc\" (UniqueName: \"kubernetes.io/projected/2a9cc9c2-eb97-4b2a-b274-ec6c30083093-kube-api-access-8n7wc\") pod \"test-curl-7648-140110653565744\" (UID: \"2a9cc9c2-eb97-4b2a-b274-ec6c30083093\") " pod="opendatahub/test-curl-7648-140110653565744"
Sep 06 19:41:25.431559 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.431536    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww\" (UID: \"771ddfb7-7f35-4c2e-a994-58eb4d7262ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"
Sep 06 19:41:25.433829 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.433805    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-metrics-certs\") pod \"maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww\" (UID: \"771ddfb7-7f35-4c2e-a994-58eb4d7262ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"
Sep 06 19:41:25.433955 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.433879    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-maas-api-tls\") pod \"maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww\" (UID: \"771ddfb7-7f35-4c2e-a994-58eb4d7262ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"
Sep 06 19:41:25.440487 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.440463    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7rhq\" (UniqueName: \"kubernetes.io/projected/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-kube-api-access-b7rhq\") pod \"maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww\" (UID: \"771ddfb7-7f35-4c2e-a994-58eb4d7262ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"
Sep 06 19:41:25.440604 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.440536    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n7wc\" (UniqueName: \"kubernetes.io/projected/2a9cc9c2-eb97-4b2a-b274-ec6c30083093-kube-api-access-8n7wc\") pod \"test-curl-7648-140110653565744\" (UID: \"2a9cc9c2-eb97-4b2a-b274-ec6c30083093\") " pod="opendatahub/test-curl-7648-140110653565744"
Sep 06 19:41:25.465548 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.465515    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7648-140110653565744"
Sep 06 19:41:25.518233 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.518178    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"
Sep 06 19:41:25.687601 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.687506    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:25.738729 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.738587    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7648-140110653565744"]
Sep 06 19:41:25.740856 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:41:25.740823    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a9cc9c2_eb97_4b2a_b274_ec6c30083093.slice/crio-eee80da64253b83300dee57576242a6dc3debcb59397541938653fb0c5675fee WatchSource:0}: Error finding container eee80da64253b83300dee57576242a6dc3debcb59397541938653fb0c5675fee: Status 404 returned error can't find the container with id eee80da64253b83300dee57576242a6dc3debcb59397541938653fb0c5675fee
Sep 06 19:41:25.775165 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.775131    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:25.813259 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.812969    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"]
Sep 06 19:41:25.815303 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:41:25.815276    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod771ddfb7_7f35_4c2e_a994_58eb4d7262ca.slice/crio-f6d18e1c9e52327f2a7272f71c49a10df81e52a2e5b221ca8046f816bc23fdfa WatchSource:0}: Error finding container f6d18e1c9e52327f2a7272f71c49a10df81e52a2e5b221ca8046f816bc23fdfa: Status 404 returned error can't find the container with id f6d18e1c9e52327f2a7272f71c49a10df81e52a2e5b221ca8046f816bc23fdfa
Sep 06 19:41:25.819845 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.819822    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8"]
Sep 06 19:41:25.824751 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.824733    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8"
Sep 06 19:41:25.827478 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.827460    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-6433a6-dockercfg-cmpvz\""
Sep 06 19:41:25.827591 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.827516    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-6433a6\""
Sep 06 19:41:25.832974 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.832950    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8"]
Sep 06 19:41:25.854841 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.854807    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7648-140110653565744" event={"ID":"2a9cc9c2-eb97-4b2a-b274-ec6c30083093","Type":"ContainerStarted","Data":"eee80da64253b83300dee57576242a6dc3debcb59397541938653fb0c5675fee"}
Sep 06 19:41:25.856032 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.856000    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww" event={"ID":"771ddfb7-7f35-4c2e-a994-58eb4d7262ca","Type":"ContainerStarted","Data":"f6d18e1c9e52327f2a7272f71c49a10df81e52a2e5b221ca8046f816bc23fdfa"}
Sep 06 19:41:25.857286 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.857265    2568 scope.go:117] "RemoveContainer" containerID="00b88e71ad8ffe9b61be9acd55d250b647919a026a58e68d8b963c0b3295e990"
Sep 06 19:41:25.857404 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.857307    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7648-140110653565744"
Sep 06 19:41:25.936210 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.936161    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmpzr\" (UniqueName: \"kubernetes.io/projected/90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd-kube-api-access-hmpzr\") pod \"payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8\" (UID: \"90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8"
Sep 06 19:41:25.936210 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:25.936206    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8\" (UID: \"90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8"
Sep 06 19:41:26.036798 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:26.036697    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmpzr\" (UniqueName: \"kubernetes.io/projected/90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd-kube-api-access-hmpzr\") pod \"payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8\" (UID: \"90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8"
Sep 06 19:41:26.036798 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:26.036740    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8\" (UID: \"90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8"
Sep 06 19:41:26.037450 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:26.037429    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8\" (UID: \"90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8"
Sep 06 19:41:26.044007 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:26.043971    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmpzr\" (UniqueName: \"kubernetes.io/projected/90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd-kube-api-access-hmpzr\") pod \"payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8\" (UID: \"90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8"
Sep 06 19:41:26.138038 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:26.137999    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8"
Sep 06 19:41:26.415678 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:26.415653    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8"]
Sep 06 19:41:26.418110 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:41:26.418081    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b4fd34_ebb0_41f6_ad4b_3960ff62c7cd.slice/crio-9be1e94223474b9273c9f26c46a03aa30f3998d8e191942d7ecf960227765d94 WatchSource:0}: Error finding container 9be1e94223474b9273c9f26c46a03aa30f3998d8e191942d7ecf960227765d94: Status 404 returned error can't find the container with id 9be1e94223474b9273c9f26c46a03aa30f3998d8e191942d7ecf960227765d94
Sep 06 19:41:26.864082 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:26.864043    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww" event={"ID":"771ddfb7-7f35-4c2e-a994-58eb4d7262ca","Type":"ContainerStarted","Data":"551ea58a9d01c0369867ea46093a1c1fcffac7aec27f58c7742effc27dcf5711"}
Sep 06 19:41:26.864295 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:26.864121    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"
Sep 06 19:41:26.865708 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:26.865677    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8" event={"ID":"90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd","Type":"ContainerStarted","Data":"8673d915e0eb3039fa7af17a8f85bc4d516fc633dee4e6b7fda136427db4bcbc"}
Sep 06 19:41:26.865867 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:26.865722    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8" event={"ID":"90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd","Type":"ContainerStarted","Data":"9be1e94223474b9273c9f26c46a03aa30f3998d8e191942d7ecf960227765d94"}
Sep 06 19:41:26.865867 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:26.865755    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8"
Sep 06 19:41:26.868219 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:26.868194    2568 generic.go:356] "Generic (PLEG): container finished" podID="2a9cc9c2-eb97-4b2a-b274-ec6c30083093" containerID="833b6f2822a259145e6478d0a6d4a4033959af5623e33134232da1cb543c404c" exitCode=0
Sep 06 19:41:26.868329 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:26.868225    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7648-140110653565744" event={"ID":"2a9cc9c2-eb97-4b2a-b274-ec6c30083093","Type":"ContainerDied","Data":"833b6f2822a259145e6478d0a6d4a4033959af5623e33134232da1cb543c404c"}
Sep 06 19:41:26.882575 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:26.882523    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww" podStartSLOduration=1.4697966980000001 podStartE2EDuration="1.882508338s" totalImagesPullingTime="412.71164ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:41:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:41:26.880594588 +0000 UTC m=+850.285553658" watchObservedRunningTime="2026-09-06 19:41:26.882508338 +0000 UTC m=+850.287467407"
Sep 06 19:41:26.897874 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:26.897799    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8" podStartSLOduration=1.897758353 podStartE2EDuration="1.897758353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:41:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:41:26.895583605 +0000 UTC m=+850.300542676" watchObservedRunningTime="2026-09-06 19:41:26.897758353 +0000 UTC m=+850.302717421"
Sep 06 19:41:27.115584 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:27.115501    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f557a63-0c57-4526-849e-229fb1b54403" path="/var/lib/kubelet/pods/6f557a63-0c57-4526-849e-229fb1b54403/volumes"
Sep 06 19:41:27.938561 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:27.938508    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:28.014799 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:28.014758    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7648-140110653565744"
Sep 06 19:41:28.033352 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:28.033325    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7648-140110653565744_2a9cc9c2-eb97-4b2a-b274-ec6c30083093/test-curl-7648-140110653565744/0.log"
Sep 06 19:41:28.033554 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:28.033481    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:28.053465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:28.053423    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7648-140110653565744"]
Sep 06 19:41:28.056897 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:28.056873    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7648-140110653565744"]
Sep 06 19:41:28.146354 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:28.146239    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:28.157245 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:28.157206    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8n7wc\" (UniqueName: \"kubernetes.io/projected/2a9cc9c2-eb97-4b2a-b274-ec6c30083093-kube-api-access-8n7wc\") pod \"2a9cc9c2-eb97-4b2a-b274-ec6c30083093\" (UID: \"2a9cc9c2-eb97-4b2a-b274-ec6c30083093\") "
Sep 06 19:41:28.159429 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:28.159405    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a9cc9c2-eb97-4b2a-b274-ec6c30083093-kube-api-access-8n7wc" (OuterVolumeSpecName: "kube-api-access-8n7wc") pod "2a9cc9c2-eb97-4b2a-b274-ec6c30083093" (UID: "2a9cc9c2-eb97-4b2a-b274-ec6c30083093"). InnerVolumeSpecName "kube-api-access-8n7wc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:41:28.258075 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:28.258035    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8n7wc\" (UniqueName: \"kubernetes.io/projected/2a9cc9c2-eb97-4b2a-b274-ec6c30083093-kube-api-access-8n7wc\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:41:28.637074 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:28.637039    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:28.686143 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:28.686108    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:28.833941 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:28.833906    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:28.880405 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:28.880376    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eee80da64253b83300dee57576242a6dc3debcb59397541938653fb0c5675fee"
Sep 06 19:41:28.880405 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:28.880406    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7648-140110653565744"
Sep 06 19:41:28.890172 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:41:28.890139    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7648-140110653565744\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="2a9cc9c2-eb97-4b2a-b274-ec6c30083093" pod="opendatahub/test-curl-7648-140110653565744"
Sep 06 19:41:28.961599 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:28.961562    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:29.116211 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:29.116179    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a9cc9c2-eb97-4b2a-b274-ec6c30083093" path="/var/lib/kubelet/pods/2a9cc9c2-eb97-4b2a-b274-ec6c30083093/volumes"
Sep 06 19:41:29.254089 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:29.253995    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:31.218529 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:31.218465    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:31.318022 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:31.317990    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:31.748666 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:31.748622    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:31.835248 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:31.835199    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:32.344833 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.344797    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"]
Sep 06 19:41:32.345501 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.345478    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a9cc9c2-eb97-4b2a-b274-ec6c30083093" containerName="test-curl-7648-140110653565744"
Sep 06 19:41:32.345582 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.345505    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a9cc9c2-eb97-4b2a-b274-ec6c30083093" containerName="test-curl-7648-140110653565744"
Sep 06 19:41:32.345641 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.345612    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a9cc9c2-eb97-4b2a-b274-ec6c30083093" containerName="test-curl-7648-140110653565744"
Sep 06 19:41:32.349583 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.349558    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"
Sep 06 19:41:32.352211 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.352181    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-4e3f8e3b-serving-cert\""
Sep 06 19:41:32.357521 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.357488    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"]
Sep 06 19:41:32.379313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.379261    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:32.479978 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.479934    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:32.492810 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.492736    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n7qz\" (UniqueName: \"kubernetes.io/projected/efefd02e-631b-4ba3-96d1-b83ce14912ba-kube-api-access-2n7qz\") pod \"maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n\" (UID: \"efefd02e-631b-4ba3-96d1-b83ce14912ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"
Sep 06 19:41:32.492970 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.492901    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efefd02e-631b-4ba3-96d1-b83ce14912ba-openshift-service-ca\") pod \"maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n\" (UID: \"efefd02e-631b-4ba3-96d1-b83ce14912ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"
Sep 06 19:41:32.492970 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.492931    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efefd02e-631b-4ba3-96d1-b83ce14912ba-metrics-certs\") pod \"maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n\" (UID: \"efefd02e-631b-4ba3-96d1-b83ce14912ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"
Sep 06 19:41:32.493095 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.493079    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efefd02e-631b-4ba3-96d1-b83ce14912ba-maas-api-tls\") pod \"maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n\" (UID: \"efefd02e-631b-4ba3-96d1-b83ce14912ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"
Sep 06 19:41:32.593628 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.593590    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n7qz\" (UniqueName: \"kubernetes.io/projected/efefd02e-631b-4ba3-96d1-b83ce14912ba-kube-api-access-2n7qz\") pod \"maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n\" (UID: \"efefd02e-631b-4ba3-96d1-b83ce14912ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"
Sep 06 19:41:32.593875 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.593686    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efefd02e-631b-4ba3-96d1-b83ce14912ba-openshift-service-ca\") pod \"maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n\" (UID: \"efefd02e-631b-4ba3-96d1-b83ce14912ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"
Sep 06 19:41:32.593875 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.593712    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efefd02e-631b-4ba3-96d1-b83ce14912ba-metrics-certs\") pod \"maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n\" (UID: \"efefd02e-631b-4ba3-96d1-b83ce14912ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"
Sep 06 19:41:32.593875 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.593815    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efefd02e-631b-4ba3-96d1-b83ce14912ba-maas-api-tls\") pod \"maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n\" (UID: \"efefd02e-631b-4ba3-96d1-b83ce14912ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"
Sep 06 19:41:32.594270 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.594244    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:32.594600 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.594576    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efefd02e-631b-4ba3-96d1-b83ce14912ba-openshift-service-ca\") pod \"maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n\" (UID: \"efefd02e-631b-4ba3-96d1-b83ce14912ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"
Sep 06 19:41:32.596670 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.596605    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efefd02e-631b-4ba3-96d1-b83ce14912ba-maas-api-tls\") pod \"maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n\" (UID: \"efefd02e-631b-4ba3-96d1-b83ce14912ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"
Sep 06 19:41:32.596670 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.596608    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efefd02e-631b-4ba3-96d1-b83ce14912ba-metrics-certs\") pod \"maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n\" (UID: \"efefd02e-631b-4ba3-96d1-b83ce14912ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"
Sep 06 19:41:32.607337 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.607314    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n7qz\" (UniqueName: \"kubernetes.io/projected/efefd02e-631b-4ba3-96d1-b83ce14912ba-kube-api-access-2n7qz\") pod \"maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n\" (UID: \"efefd02e-631b-4ba3-96d1-b83ce14912ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"
Sep 06 19:41:32.662955 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.662923    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"
Sep 06 19:41:32.878651 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.878626    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"
Sep 06 19:41:32.888685 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.888651    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:32.942388 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.942364    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"]
Sep 06 19:41:32.945248 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:41:32.945210    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefefd02e_631b_4ba3_96d1_b83ce14912ba.slice/crio-e0745b7a4124a50144fd2a0339f6826b3c3c7f5ca769da232afe2e6f56ff00a3 WatchSource:0}: Error finding container e0745b7a4124a50144fd2a0339f6826b3c3c7f5ca769da232afe2e6f56ff00a3: Status 404 returned error can't find the container with id e0745b7a4124a50144fd2a0339f6826b3c3c7f5ca769da232afe2e6f56ff00a3
Sep 06 19:41:32.950883 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:32.950845    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:33.250168 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.250070    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"]
Sep 06 19:41:33.254548 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.254527    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"
Sep 06 19:41:33.256940 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.256918    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-0ebbc9-serving-cert\""
Sep 06 19:41:33.261824 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.261765    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"]
Sep 06 19:41:33.299587 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.299544    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db15347c-5ccb-48c7-8daf-2275d6a740c5-openshift-service-ca\") pod \"maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv\" (UID: \"db15347c-5ccb-48c7-8daf-2275d6a740c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"
Sep 06 19:41:33.299587 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.299600    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfznq\" (UniqueName: \"kubernetes.io/projected/db15347c-5ccb-48c7-8daf-2275d6a740c5-kube-api-access-vfznq\") pod \"maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv\" (UID: \"db15347c-5ccb-48c7-8daf-2275d6a740c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"
Sep 06 19:41:33.299889 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.299632    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db15347c-5ccb-48c7-8daf-2275d6a740c5-maas-api-tls\") pod \"maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv\" (UID: \"db15347c-5ccb-48c7-8daf-2275d6a740c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"
Sep 06 19:41:33.299889 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.299716    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db15347c-5ccb-48c7-8daf-2275d6a740c5-metrics-certs\") pod \"maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv\" (UID: \"db15347c-5ccb-48c7-8daf-2275d6a740c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"
Sep 06 19:41:33.356340 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.356290    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:33.400694 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.400623    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db15347c-5ccb-48c7-8daf-2275d6a740c5-openshift-service-ca\") pod \"maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv\" (UID: \"db15347c-5ccb-48c7-8daf-2275d6a740c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"
Sep 06 19:41:33.400694 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.400668    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfznq\" (UniqueName: \"kubernetes.io/projected/db15347c-5ccb-48c7-8daf-2275d6a740c5-kube-api-access-vfznq\") pod \"maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv\" (UID: \"db15347c-5ccb-48c7-8daf-2275d6a740c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"
Sep 06 19:41:33.400973 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.400824    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db15347c-5ccb-48c7-8daf-2275d6a740c5-maas-api-tls\") pod \"maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv\" (UID: \"db15347c-5ccb-48c7-8daf-2275d6a740c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"
Sep 06 19:41:33.400973 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.400889    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db15347c-5ccb-48c7-8daf-2275d6a740c5-metrics-certs\") pod \"maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv\" (UID: \"db15347c-5ccb-48c7-8daf-2275d6a740c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"
Sep 06 19:41:33.401435 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.401410    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db15347c-5ccb-48c7-8daf-2275d6a740c5-openshift-service-ca\") pod \"maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv\" (UID: \"db15347c-5ccb-48c7-8daf-2275d6a740c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"
Sep 06 19:41:33.403447 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.403428    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db15347c-5ccb-48c7-8daf-2275d6a740c5-metrics-certs\") pod \"maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv\" (UID: \"db15347c-5ccb-48c7-8daf-2275d6a740c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"
Sep 06 19:41:33.403718 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.403703    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db15347c-5ccb-48c7-8daf-2275d6a740c5-maas-api-tls\") pod \"maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv\" (UID: \"db15347c-5ccb-48c7-8daf-2275d6a740c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"
Sep 06 19:41:33.408012 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.407992    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfznq\" (UniqueName: \"kubernetes.io/projected/db15347c-5ccb-48c7-8daf-2275d6a740c5-kube-api-access-vfznq\") pod \"maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv\" (UID: \"db15347c-5ccb-48c7-8daf-2275d6a740c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"
Sep 06 19:41:33.456246 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.456216    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:33.556739 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.556620    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:33.573065 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.573034    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"
Sep 06 19:41:33.808347 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.808214    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:33.854287 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.854261    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"]
Sep 06 19:41:33.856350 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:41:33.856321    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb15347c_5ccb_48c7_8daf_2275d6a740c5.slice/crio-503c47886c9256ff763c175cb2b7c31fa730782ec44672b63d360b578855ec92 WatchSource:0}: Error finding container 503c47886c9256ff763c175cb2b7c31fa730782ec44672b63d360b578855ec92: Status 404 returned error can't find the container with id 503c47886c9256ff763c175cb2b7c31fa730782ec44672b63d360b578855ec92
Sep 06 19:41:33.899831 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.899757    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:33.911437 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.911406    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n" event={"ID":"efefd02e-631b-4ba3-96d1-b83ce14912ba","Type":"ContainerStarted","Data":"0458ca64dc5bf67e07a013ba9d2d23a6525a827aa261ca1480ea3bf946620a6a"}
Sep 06 19:41:33.911639 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.911459    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n" event={"ID":"efefd02e-631b-4ba3-96d1-b83ce14912ba","Type":"ContainerStarted","Data":"e0745b7a4124a50144fd2a0339f6826b3c3c7f5ca769da232afe2e6f56ff00a3"}
Sep 06 19:41:33.911639 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.911517    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"
Sep 06 19:41:33.912728 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.912704    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv" event={"ID":"db15347c-5ccb-48c7-8daf-2275d6a740c5","Type":"ContainerStarted","Data":"503c47886c9256ff763c175cb2b7c31fa730782ec44672b63d360b578855ec92"}
Sep 06 19:41:33.934486 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.934434    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n" podStartSLOduration=1.455121512 podStartE2EDuration="1.93441875s" totalImagesPullingTime="479.297238ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:41:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:41:33.932806695 +0000 UTC m=+857.337765764" watchObservedRunningTime="2026-09-06 19:41:33.93441875 +0000 UTC m=+857.339377819"
Sep 06 19:41:33.941593 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.941566    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m"]
Sep 06 19:41:33.946549 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.946528    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m"
Sep 06 19:41:33.948997 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.948966    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-0ebbc9-dockercfg-2bhzc\""
Sep 06 19:41:33.949119 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.948970    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-0ebbc9\""
Sep 06 19:41:33.953986 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:33.953964    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m"]
Sep 06 19:41:34.005528 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:34.005489    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc8kc\" (UniqueName: \"kubernetes.io/projected/7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a-kube-api-access-cc8kc\") pod \"payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m\" (UID: \"7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a\") " pod="openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m"
Sep 06 19:41:34.005748 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:34.005706    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a-plugins-config-volume\") pod \"payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m\" (UID: \"7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a\") " pod="openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m"
Sep 06 19:41:34.106762 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:34.106667    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a-plugins-config-volume\") pod \"payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m\" (UID: \"7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a\") " pod="openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m"
Sep 06 19:41:34.106762 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:34.106742    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc8kc\" (UniqueName: \"kubernetes.io/projected/7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a-kube-api-access-cc8kc\") pod \"payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m\" (UID: \"7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a\") " pod="openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m"
Sep 06 19:41:34.107384 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:34.107365    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a-plugins-config-volume\") pod \"payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m\" (UID: \"7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a\") " pod="openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m"
Sep 06 19:41:34.114669 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:34.114643    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc8kc\" (UniqueName: \"kubernetes.io/projected/7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a-kube-api-access-cc8kc\") pod \"payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m\" (UID: \"7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a\") " pod="openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m"
Sep 06 19:41:34.186433 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:34.186398    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:34.259025 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:34.258996    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m"
Sep 06 19:41:34.536870 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:34.536843    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m"]
Sep 06 19:41:34.539404 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:41:34.539372    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bbd2ae3_9bbf_4ab2_aec0_8d354cfe511a.slice/crio-a595082479003ade1a1a2c56244e77e20c7eb9c91c9c13e636618f42eecb34bc WatchSource:0}: Error finding container a595082479003ade1a1a2c56244e77e20c7eb9c91c9c13e636618f42eecb34bc: Status 404 returned error can't find the container with id a595082479003ade1a1a2c56244e77e20c7eb9c91c9c13e636618f42eecb34bc
Sep 06 19:41:34.920586 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:34.920551    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m" event={"ID":"7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a","Type":"ContainerStarted","Data":"4a5758cfb32d19d27bbcb0f315942fb0d1ba0c057134267a8599b7f5414615b5"}
Sep 06 19:41:34.920811 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:34.920617    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m"
Sep 06 19:41:34.920811 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:34.920639    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m" event={"ID":"7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a","Type":"ContainerStarted","Data":"a595082479003ade1a1a2c56244e77e20c7eb9c91c9c13e636618f42eecb34bc"}
Sep 06 19:41:34.922443 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:34.922412    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv" event={"ID":"db15347c-5ccb-48c7-8daf-2275d6a740c5","Type":"ContainerStarted","Data":"2e70886b2cea8e5a1e7047491977172c1fa4a0cb5c959e89977b8b020f42a6ca"}
Sep 06 19:41:34.922637 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:34.922620    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"
Sep 06 19:41:34.936217 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:34.936168    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m" podStartSLOduration=1.9361550840000001 podStartE2EDuration="1.936155084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:41:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:41:34.934575044 +0000 UTC m=+858.339534112" watchObservedRunningTime="2026-09-06 19:41:34.936155084 +0000 UTC m=+858.341114152"
Sep 06 19:41:34.951327 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:34.951270    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv" podStartSLOduration=1.6395446900000001 podStartE2EDuration="1.951248759s" totalImagesPullingTime="311.704069ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:41:34.948563423 +0000 UTC m=+858.353522496" watchObservedRunningTime="2026-09-06 19:41:34.951248759 +0000 UTC m=+858.356207831"
Sep 06 19:41:35.066247 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:35.066212    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:37.875530 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:37.875493    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8"
Sep 06 19:41:38.758009 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:38.757968    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:38.907408 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:38.907370    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:39.002365 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:39.002318    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:39.101915 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:39.101804    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:39.927707 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:39.927681    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"
Sep 06 19:41:40.933140 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:40.933113    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"
Sep 06 19:41:41.752847 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:41.752796    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:43.300451 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:43.300413    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:43.401990 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:43.401960    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:43.504395 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:43.504357    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:45.733420 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:45.733326    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:45.929987 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:45.929957    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m"
Sep 06 19:41:46.964356 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:46.964317    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:48.607488 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:48.607456    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:48.916738 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:48.916700    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:49.205641 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:49.205535    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:49.349255 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:49.349210    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:49.449594 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:49.449560    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:49.549914 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:49.549820    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:49.667557 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:49.667513    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:50.612979 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:50.612947    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:51.884579 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:51.884517    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:52.007016 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:52.006982    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:52.983648 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:52.983606    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"]
Sep 06 19:41:52.987718 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:52.987690    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"
Sep 06 19:41:52.990219 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:52.990195    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-d5bb2d-serving-cert\""
Sep 06 19:41:52.998286 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:52.998262    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"]
Sep 06 19:41:53.012560 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:53.012531    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:53.067076 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:53.067029    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:53.087959 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:53.087920    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fd5a435-07da-44d3-9f78-6a6e1a827a98-metrics-certs\") pod \"maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4\" (UID: \"2fd5a435-07da-44d3-9f78-6a6e1a827a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"
Sep 06 19:41:53.088143 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:53.087976    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fd5a435-07da-44d3-9f78-6a6e1a827a98-maas-api-tls\") pod \"maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4\" (UID: \"2fd5a435-07da-44d3-9f78-6a6e1a827a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"
Sep 06 19:41:53.088143 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:53.088058    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd5a435-07da-44d3-9f78-6a6e1a827a98-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4\" (UID: \"2fd5a435-07da-44d3-9f78-6a6e1a827a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"
Sep 06 19:41:53.088143 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:53.088095    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcv5g\" (UniqueName: \"kubernetes.io/projected/2fd5a435-07da-44d3-9f78-6a6e1a827a98-kube-api-access-gcv5g\") pod \"maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4\" (UID: \"2fd5a435-07da-44d3-9f78-6a6e1a827a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"
Sep 06 19:41:53.189444 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:53.189408    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fd5a435-07da-44d3-9f78-6a6e1a827a98-metrics-certs\") pod \"maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4\" (UID: \"2fd5a435-07da-44d3-9f78-6a6e1a827a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"
Sep 06 19:41:53.189444 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:53.189449    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fd5a435-07da-44d3-9f78-6a6e1a827a98-maas-api-tls\") pod \"maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4\" (UID: \"2fd5a435-07da-44d3-9f78-6a6e1a827a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"
Sep 06 19:41:53.189679 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:41:53.189620    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-serving-cert: secret "maas-api-e2e-inf-b-d5bb2d-serving-cert" not found
Sep 06 19:41:53.189720 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:41:53.189691    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd5a435-07da-44d3-9f78-6a6e1a827a98-maas-api-tls podName:2fd5a435-07da-44d3-9f78-6a6e1a827a98 nodeName:}" failed. No retries permitted until 2026-09-06 19:41:53.689670384 +0000 UTC m=+877.094629445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2fd5a435-07da-44d3-9f78-6a6e1a827a98-maas-api-tls") pod "maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4" (UID: "2fd5a435-07da-44d3-9f78-6a6e1a827a98") : secret "maas-api-e2e-inf-b-d5bb2d-serving-cert" not found
Sep 06 19:41:53.189720 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:53.189707    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd5a435-07da-44d3-9f78-6a6e1a827a98-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4\" (UID: \"2fd5a435-07da-44d3-9f78-6a6e1a827a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"
Sep 06 19:41:53.189869 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:53.189738    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcv5g\" (UniqueName: \"kubernetes.io/projected/2fd5a435-07da-44d3-9f78-6a6e1a827a98-kube-api-access-gcv5g\") pod \"maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4\" (UID: \"2fd5a435-07da-44d3-9f78-6a6e1a827a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"
Sep 06 19:41:53.190463 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:53.190435    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd5a435-07da-44d3-9f78-6a6e1a827a98-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4\" (UID: \"2fd5a435-07da-44d3-9f78-6a6e1a827a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"
Sep 06 19:41:53.192866 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:53.192842    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fd5a435-07da-44d3-9f78-6a6e1a827a98-metrics-certs\") pod \"maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4\" (UID: \"2fd5a435-07da-44d3-9f78-6a6e1a827a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"
Sep 06 19:41:53.198266 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:53.198236    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcv5g\" (UniqueName: \"kubernetes.io/projected/2fd5a435-07da-44d3-9f78-6a6e1a827a98-kube-api-access-gcv5g\") pod \"maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4\" (UID: \"2fd5a435-07da-44d3-9f78-6a6e1a827a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"
Sep 06 19:41:53.459282 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:53.459236    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:53.559320 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:53.559284    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:53.628234 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:53.628200    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:53.695543 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:53.695509    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fd5a435-07da-44d3-9f78-6a6e1a827a98-maas-api-tls\") pod \"maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4\" (UID: \"2fd5a435-07da-44d3-9f78-6a6e1a827a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"
Sep 06 19:41:53.698500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:53.698469    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fd5a435-07da-44d3-9f78-6a6e1a827a98-maas-api-tls\") pod \"maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4\" (UID: \"2fd5a435-07da-44d3-9f78-6a6e1a827a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"
Sep 06 19:41:53.901950 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:53.901909    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"
Sep 06 19:41:53.959156 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:53.959100    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:54.177190 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:54.177165    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"]
Sep 06 19:41:54.179282 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:41:54.179257    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd5a435_07da_44d3_9f78_6a6e1a827a98.slice/crio-ae7709d46c97219d31deafeaed5763a498b6ebcfc87b5cb495097515630631c7 WatchSource:0}: Error finding container ae7709d46c97219d31deafeaed5763a498b6ebcfc87b5cb495097515630631c7: Status 404 returned error can't find the container with id ae7709d46c97219d31deafeaed5763a498b6ebcfc87b5cb495097515630631c7
Sep 06 19:41:54.753344 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:54.753241    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:55.041312 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:55.041195    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4" event={"ID":"2fd5a435-07da-44d3-9f78-6a6e1a827a98","Type":"ContainerStarted","Data":"d9c3e44650177885451a93b4abc24c35e4b39152d8b68c1014512ae4f8c21f4d"}
Sep 06 19:41:55.041312 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:55.041262    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4" event={"ID":"2fd5a435-07da-44d3-9f78-6a6e1a827a98","Type":"ContainerStarted","Data":"ae7709d46c97219d31deafeaed5763a498b6ebcfc87b5cb495097515630631c7"}
Sep 06 19:41:55.041536 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:55.041320    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"
Sep 06 19:41:55.060963 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:55.060908    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4" podStartSLOduration=2.800868372 podStartE2EDuration="3.060889729s" totalImagesPullingTime="260.021357ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:41:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:41:55.058563969 +0000 UTC m=+878.463523049" watchObservedRunningTime="2026-09-06 19:41:55.060889729 +0000 UTC m=+878.465848801"
Sep 06 19:41:55.570323 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:55.570288    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:55.917609 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:55.917571    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:56.017766 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:56.017732    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:56.380389 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:56.380349    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:57.082209 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:57.082168    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:41:57.778762 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:41:57.778730    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:01.052688 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:01.052659    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"
Sep 06 19:42:01.745066 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:01.745022    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:02.896501 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:02.896447    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"]
Sep 06 19:42:02.897010 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:02.896691    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n" podUID="efefd02e-631b-4ba3-96d1-b83ce14912ba" containerName="maas-api" containerID="cri-o://0458ca64dc5bf67e07a013ba9d2d23a6525a827aa261ca1480ea3bf946620a6a" gracePeriod=30
Sep 06 19:42:02.923722 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:02.923688    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:03.003020 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:03.002984    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:03.064488 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:03.064392    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:03.091092 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:03.089022    2568 generic.go:356] "Generic (PLEG): container finished" podID="efefd02e-631b-4ba3-96d1-b83ce14912ba" containerID="0458ca64dc5bf67e07a013ba9d2d23a6525a827aa261ca1480ea3bf946620a6a" exitCode=0
Sep 06 19:42:03.091092 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:03.089190    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n" event={"ID":"efefd02e-631b-4ba3-96d1-b83ce14912ba","Type":"ContainerDied","Data":"0458ca64dc5bf67e07a013ba9d2d23a6525a827aa261ca1480ea3bf946620a6a"}
Sep 06 19:42:03.132480 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:03.132442    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:03.167075 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:03.167048    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"
Sep 06 19:42:03.196350 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:03.196315    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:03.287945 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:03.287817    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efefd02e-631b-4ba3-96d1-b83ce14912ba-metrics-certs\") pod \"efefd02e-631b-4ba3-96d1-b83ce14912ba\" (UID: \"efefd02e-631b-4ba3-96d1-b83ce14912ba\") "
Sep 06 19:42:03.287945 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:03.287914    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efefd02e-631b-4ba3-96d1-b83ce14912ba-maas-api-tls\") pod \"efefd02e-631b-4ba3-96d1-b83ce14912ba\" (UID: \"efefd02e-631b-4ba3-96d1-b83ce14912ba\") "
Sep 06 19:42:03.288248 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:03.287955    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n7qz\" (UniqueName: \"kubernetes.io/projected/efefd02e-631b-4ba3-96d1-b83ce14912ba-kube-api-access-2n7qz\") pod \"efefd02e-631b-4ba3-96d1-b83ce14912ba\" (UID: \"efefd02e-631b-4ba3-96d1-b83ce14912ba\") "
Sep 06 19:42:03.288248 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:03.288010    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efefd02e-631b-4ba3-96d1-b83ce14912ba-openshift-service-ca\") pod \"efefd02e-631b-4ba3-96d1-b83ce14912ba\" (UID: \"efefd02e-631b-4ba3-96d1-b83ce14912ba\") "
Sep 06 19:42:03.288825 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:03.288758    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efefd02e-631b-4ba3-96d1-b83ce14912ba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "efefd02e-631b-4ba3-96d1-b83ce14912ba" (UID: "efefd02e-631b-4ba3-96d1-b83ce14912ba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:42:03.293113 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:03.293079    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efefd02e-631b-4ba3-96d1-b83ce14912ba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "efefd02e-631b-4ba3-96d1-b83ce14912ba" (UID: "efefd02e-631b-4ba3-96d1-b83ce14912ba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:42:03.293113 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:03.293081    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efefd02e-631b-4ba3-96d1-b83ce14912ba-kube-api-access-2n7qz" (OuterVolumeSpecName: "kube-api-access-2n7qz") pod "efefd02e-631b-4ba3-96d1-b83ce14912ba" (UID: "efefd02e-631b-4ba3-96d1-b83ce14912ba"). InnerVolumeSpecName "kube-api-access-2n7qz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:42:03.293430 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:03.293144    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efefd02e-631b-4ba3-96d1-b83ce14912ba-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "efefd02e-631b-4ba3-96d1-b83ce14912ba" (UID: "efefd02e-631b-4ba3-96d1-b83ce14912ba"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:42:03.294763 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:03.294698    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:03.388889 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:03.388848    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n7qz\" (UniqueName: \"kubernetes.io/projected/efefd02e-631b-4ba3-96d1-b83ce14912ba-kube-api-access-2n7qz\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:42:03.388889 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:03.388881    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efefd02e-631b-4ba3-96d1-b83ce14912ba-openshift-service-ca\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:42:03.388889 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:03.388898    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efefd02e-631b-4ba3-96d1-b83ce14912ba-metrics-certs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:42:03.389191 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:03.388910    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efefd02e-631b-4ba3-96d1-b83ce14912ba-maas-api-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:42:03.729540 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:03.729498    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:03.829284 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:03.829247    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:03.928578 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:03.928547    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:04.099704 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:04.099615    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"
Sep 06 19:42:04.099704 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:04.099622    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n" event={"ID":"efefd02e-631b-4ba3-96d1-b83ce14912ba","Type":"ContainerDied","Data":"e0745b7a4124a50144fd2a0339f6826b3c3c7f5ca769da232afe2e6f56ff00a3"}
Sep 06 19:42:04.099927 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:04.099718    2568 scope.go:117] "RemoveContainer" containerID="0458ca64dc5bf67e07a013ba9d2d23a6525a827aa261ca1480ea3bf946620a6a"
Sep 06 19:42:04.135117 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:04.135084    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"]
Sep 06 19:42:04.141206 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:04.141178    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4e3f8e3b-55594f6f89-9qr9n"]
Sep 06 19:42:04.234479 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:04.234441    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:04.430091 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:04.430047    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:05.115168 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:05.115133    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efefd02e-631b-4ba3-96d1-b83ce14912ba" path="/var/lib/kubelet/pods/efefd02e-631b-4ba3-96d1-b83ce14912ba/volumes"
Sep 06 19:42:06.539873 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:06.539834    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:06.640549 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:06.640515    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:06.645645 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:06.645610    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"]
Sep 06 19:42:06.646503 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:06.646478    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efefd02e-631b-4ba3-96d1-b83ce14912ba" containerName="maas-api"
Sep 06 19:42:06.646503 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:06.646505    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="efefd02e-631b-4ba3-96d1-b83ce14912ba" containerName="maas-api"
Sep 06 19:42:06.646645 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:06.646599    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="efefd02e-631b-4ba3-96d1-b83ce14912ba" containerName="maas-api"
Sep 06 19:42:06.651636 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:06.651616    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"
Sep 06 19:42:06.654211 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:06.654193    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-b4020e88-serving-cert\""
Sep 06 19:42:06.661058 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:06.661035    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"]
Sep 06 19:42:06.698651 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:06.698607    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:06.823057 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:06.822966    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad946a3d-bd1e-42a9-a213-785e281b9e84-openshift-service-ca\") pod \"maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf\" (UID: \"ad946a3d-bd1e-42a9-a213-785e281b9e84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"
Sep 06 19:42:06.823057 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:06.823011    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbpn7\" (UniqueName: \"kubernetes.io/projected/ad946a3d-bd1e-42a9-a213-785e281b9e84-kube-api-access-dbpn7\") pod \"maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf\" (UID: \"ad946a3d-bd1e-42a9-a213-785e281b9e84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"
Sep 06 19:42:06.823247 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:06.823064    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad946a3d-bd1e-42a9-a213-785e281b9e84-maas-api-tls\") pod \"maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf\" (UID: \"ad946a3d-bd1e-42a9-a213-785e281b9e84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"
Sep 06 19:42:06.823247 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:06.823138    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad946a3d-bd1e-42a9-a213-785e281b9e84-metrics-certs\") pod \"maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf\" (UID: \"ad946a3d-bd1e-42a9-a213-785e281b9e84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"
Sep 06 19:42:06.924301 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:06.924259    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad946a3d-bd1e-42a9-a213-785e281b9e84-maas-api-tls\") pod \"maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf\" (UID: \"ad946a3d-bd1e-42a9-a213-785e281b9e84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"
Sep 06 19:42:06.924478 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:06.924313    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad946a3d-bd1e-42a9-a213-785e281b9e84-metrics-certs\") pod \"maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf\" (UID: \"ad946a3d-bd1e-42a9-a213-785e281b9e84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"
Sep 06 19:42:06.924478 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:06.924385    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad946a3d-bd1e-42a9-a213-785e281b9e84-openshift-service-ca\") pod \"maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf\" (UID: \"ad946a3d-bd1e-42a9-a213-785e281b9e84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"
Sep 06 19:42:06.924478 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:42:06.924411    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-serving-cert: secret "maas-api-e2e-migrate-b4020e88-serving-cert" not found
Sep 06 19:42:06.924647 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:06.924417    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbpn7\" (UniqueName: \"kubernetes.io/projected/ad946a3d-bd1e-42a9-a213-785e281b9e84-kube-api-access-dbpn7\") pod \"maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf\" (UID: \"ad946a3d-bd1e-42a9-a213-785e281b9e84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"
Sep 06 19:42:06.924647 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:42:06.924500    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad946a3d-bd1e-42a9-a213-785e281b9e84-maas-api-tls podName:ad946a3d-bd1e-42a9-a213-785e281b9e84 nodeName:}" failed. No retries permitted until 2026-09-06 19:42:07.424482858 +0000 UTC m=+890.829441909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ad946a3d-bd1e-42a9-a213-785e281b9e84-maas-api-tls") pod "maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf" (UID: "ad946a3d-bd1e-42a9-a213-785e281b9e84") : secret "maas-api-e2e-migrate-b4020e88-serving-cert" not found
Sep 06 19:42:06.925232 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:06.925198    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad946a3d-bd1e-42a9-a213-785e281b9e84-openshift-service-ca\") pod \"maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf\" (UID: \"ad946a3d-bd1e-42a9-a213-785e281b9e84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"
Sep 06 19:42:06.927107 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:06.927087    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad946a3d-bd1e-42a9-a213-785e281b9e84-metrics-certs\") pod \"maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf\" (UID: \"ad946a3d-bd1e-42a9-a213-785e281b9e84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"
Sep 06 19:42:06.932597 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:06.932574    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbpn7\" (UniqueName: \"kubernetes.io/projected/ad946a3d-bd1e-42a9-a213-785e281b9e84-kube-api-access-dbpn7\") pod \"maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf\" (UID: \"ad946a3d-bd1e-42a9-a213-785e281b9e84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"
Sep 06 19:42:07.052477 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:07.052419    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:07.244253 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:07.244212    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:07.342668 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:07.342627    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:07.429722 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:07.429673    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad946a3d-bd1e-42a9-a213-785e281b9e84-maas-api-tls\") pod \"maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf\" (UID: \"ad946a3d-bd1e-42a9-a213-785e281b9e84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"
Sep 06 19:42:07.432536 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:07.432496    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad946a3d-bd1e-42a9-a213-785e281b9e84-maas-api-tls\") pod \"maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf\" (UID: \"ad946a3d-bd1e-42a9-a213-785e281b9e84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"
Sep 06 19:42:07.564173 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:07.564076    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"
Sep 06 19:42:07.839957 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:07.839926    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"]
Sep 06 19:42:07.841620 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:42:07.841584    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad946a3d_bd1e_42a9_a213_785e281b9e84.slice/crio-bb6e18d799ac10f1449f42f093fdfbfda148f2d859460689125ff1554c0fbba3 WatchSource:0}: Error finding container bb6e18d799ac10f1449f42f093fdfbfda148f2d859460689125ff1554c0fbba3: Status 404 returned error can't find the container with id bb6e18d799ac10f1449f42f093fdfbfda148f2d859460689125ff1554c0fbba3
Sep 06 19:42:08.125370 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:08.125336    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf" event={"ID":"ad946a3d-bd1e-42a9-a213-785e281b9e84","Type":"ContainerStarted","Data":"bb6e18d799ac10f1449f42f093fdfbfda148f2d859460689125ff1554c0fbba3"}
Sep 06 19:42:09.131739 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:09.131699    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf" event={"ID":"ad946a3d-bd1e-42a9-a213-785e281b9e84","Type":"ContainerStarted","Data":"5a6127837bd72c8a390e44c07ec9fb7491513584b4444ac984b18768a01cf39d"}
Sep 06 19:42:09.132135 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:09.131764    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"
Sep 06 19:42:09.147760 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:09.147710    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf" podStartSLOduration=2.800539338 podStartE2EDuration="3.147695802s" totalImagesPullingTime="347.156464ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:42:09.147333396 +0000 UTC m=+892.552292465" watchObservedRunningTime="2026-09-06 19:42:09.147695802 +0000 UTC m=+892.552654870"
Sep 06 19:42:13.830419 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:13.830382    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:15.142602 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:15.142575    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"
Sep 06 19:42:16.770709 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:16.770673    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:27.766304 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:27.766264    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:37.897627 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:37.897586    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"]
Sep 06 19:42:37.898235 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:37.897928    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf" podUID="ad946a3d-bd1e-42a9-a213-785e281b9e84" containerName="maas-api" containerID="cri-o://5a6127837bd72c8a390e44c07ec9fb7491513584b4444ac984b18768a01cf39d" gracePeriod=30
Sep 06 19:42:37.921461 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:37.921423    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:37.986913 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:37.986848    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:38.042900 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.042764    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:38.099706 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.099652    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:38.149517 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.149434    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:38.152397 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.152379    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"
Sep 06 19:42:38.223119 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.223084    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad946a3d-bd1e-42a9-a213-785e281b9e84-openshift-service-ca\") pod \"ad946a3d-bd1e-42a9-a213-785e281b9e84\" (UID: \"ad946a3d-bd1e-42a9-a213-785e281b9e84\") "
Sep 06 19:42:38.223119 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.223129    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad946a3d-bd1e-42a9-a213-785e281b9e84-metrics-certs\") pod \"ad946a3d-bd1e-42a9-a213-785e281b9e84\" (UID: \"ad946a3d-bd1e-42a9-a213-785e281b9e84\") "
Sep 06 19:42:38.223388 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.223222    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbpn7\" (UniqueName: \"kubernetes.io/projected/ad946a3d-bd1e-42a9-a213-785e281b9e84-kube-api-access-dbpn7\") pod \"ad946a3d-bd1e-42a9-a213-785e281b9e84\" (UID: \"ad946a3d-bd1e-42a9-a213-785e281b9e84\") "
Sep 06 19:42:38.223388 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.223304    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad946a3d-bd1e-42a9-a213-785e281b9e84-maas-api-tls\") pod \"ad946a3d-bd1e-42a9-a213-785e281b9e84\" (UID: \"ad946a3d-bd1e-42a9-a213-785e281b9e84\") "
Sep 06 19:42:38.223963 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.223938    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad946a3d-bd1e-42a9-a213-785e281b9e84-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ad946a3d-bd1e-42a9-a213-785e281b9e84" (UID: "ad946a3d-bd1e-42a9-a213-785e281b9e84"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:42:38.226075 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.226046    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad946a3d-bd1e-42a9-a213-785e281b9e84-kube-api-access-dbpn7" (OuterVolumeSpecName: "kube-api-access-dbpn7") pod "ad946a3d-bd1e-42a9-a213-785e281b9e84" (UID: "ad946a3d-bd1e-42a9-a213-785e281b9e84"). InnerVolumeSpecName "kube-api-access-dbpn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:42:38.227376 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.227338    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad946a3d-bd1e-42a9-a213-785e281b9e84-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ad946a3d-bd1e-42a9-a213-785e281b9e84" (UID: "ad946a3d-bd1e-42a9-a213-785e281b9e84"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:42:38.227376 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.227354    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad946a3d-bd1e-42a9-a213-785e281b9e84-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ad946a3d-bd1e-42a9-a213-785e281b9e84" (UID: "ad946a3d-bd1e-42a9-a213-785e281b9e84"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:42:38.243264 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.243231    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:38.298971 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.298934    2568 generic.go:356] "Generic (PLEG): container finished" podID="ad946a3d-bd1e-42a9-a213-785e281b9e84" containerID="5a6127837bd72c8a390e44c07ec9fb7491513584b4444ac984b18768a01cf39d" exitCode=0
Sep 06 19:42:38.299144 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.299000    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"
Sep 06 19:42:38.299144 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.298997    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf" event={"ID":"ad946a3d-bd1e-42a9-a213-785e281b9e84","Type":"ContainerDied","Data":"5a6127837bd72c8a390e44c07ec9fb7491513584b4444ac984b18768a01cf39d"}
Sep 06 19:42:38.299144 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.299135    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf" event={"ID":"ad946a3d-bd1e-42a9-a213-785e281b9e84","Type":"ContainerDied","Data":"bb6e18d799ac10f1449f42f093fdfbfda148f2d859460689125ff1554c0fbba3"}
Sep 06 19:42:38.299278 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.299159    2568 scope.go:117] "RemoveContainer" containerID="5a6127837bd72c8a390e44c07ec9fb7491513584b4444ac984b18768a01cf39d"
Sep 06 19:42:38.308814 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.308766    2568 scope.go:117] "RemoveContainer" containerID="5a6127837bd72c8a390e44c07ec9fb7491513584b4444ac984b18768a01cf39d"
Sep 06 19:42:38.309181 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:42:38.309154    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a6127837bd72c8a390e44c07ec9fb7491513584b4444ac984b18768a01cf39d\": container with ID starting with 5a6127837bd72c8a390e44c07ec9fb7491513584b4444ac984b18768a01cf39d not found: ID does not exist" containerID="5a6127837bd72c8a390e44c07ec9fb7491513584b4444ac984b18768a01cf39d"
Sep 06 19:42:38.309273 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.309194    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a6127837bd72c8a390e44c07ec9fb7491513584b4444ac984b18768a01cf39d"} err="failed to get container status \"5a6127837bd72c8a390e44c07ec9fb7491513584b4444ac984b18768a01cf39d\": rpc error: code = NotFound desc = could not find container \"5a6127837bd72c8a390e44c07ec9fb7491513584b4444ac984b18768a01cf39d\": container with ID starting with 5a6127837bd72c8a390e44c07ec9fb7491513584b4444ac984b18768a01cf39d not found: ID does not exist"
Sep 06 19:42:38.324296 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.324266    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"]
Sep 06 19:42:38.324636 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.324618    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbpn7\" (UniqueName: \"kubernetes.io/projected/ad946a3d-bd1e-42a9-a213-785e281b9e84-kube-api-access-dbpn7\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:42:38.324687 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.324640    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad946a3d-bd1e-42a9-a213-785e281b9e84-maas-api-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:42:38.324687 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.324650    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad946a3d-bd1e-42a9-a213-785e281b9e84-openshift-service-ca\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:42:38.324687 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.324659    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad946a3d-bd1e-42a9-a213-785e281b9e84-metrics-certs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:42:38.328056 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.328033    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b4020e88-6b47cf4d59-9tdqf"]
Sep 06 19:42:38.654165 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.654130    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:38.939351 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:38.939269    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:39.115459 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:39.115422    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad946a3d-bd1e-42a9-a213-785e281b9e84" path="/var/lib/kubelet/pods/ad946a3d-bd1e-42a9-a213-785e281b9e84/volumes"
Sep 06 19:42:39.169381 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:39.169345    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:41.682194 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:41.682159    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:41.806822 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:41.806764    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:42.342010 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:42.341981    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:42.769006 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:42.768961    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"]
Sep 06 19:42:42.770167 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:42.769670    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad946a3d-bd1e-42a9-a213-785e281b9e84" containerName="maas-api"
Sep 06 19:42:42.770167 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:42.769696    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad946a3d-bd1e-42a9-a213-785e281b9e84" containerName="maas-api"
Sep 06 19:42:42.770167 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:42.769883    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad946a3d-bd1e-42a9-a213-785e281b9e84" containerName="maas-api"
Sep 06 19:42:42.773273 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:42.773254    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"
Sep 06 19:42:42.775614 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:42.775590    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b6954964-serving-cert\""
Sep 06 19:42:42.783730 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:42.783689    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"]
Sep 06 19:42:42.807901 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:42.807859    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:42.869024 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:42.868984    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-openshift-service-ca\") pod \"maas-api-e2e-ait-b6954964-f7b695944-p86fr\" (UID: \"d1fbcf57-76d7-443f-9220-d8c8b2758bd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"
Sep 06 19:42:42.869203 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:42.869043    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-metrics-certs\") pod \"maas-api-e2e-ait-b6954964-f7b695944-p86fr\" (UID: \"d1fbcf57-76d7-443f-9220-d8c8b2758bd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"
Sep 06 19:42:42.869203 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:42.869112    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-maas-api-tls\") pod \"maas-api-e2e-ait-b6954964-f7b695944-p86fr\" (UID: \"d1fbcf57-76d7-443f-9220-d8c8b2758bd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"
Sep 06 19:42:42.869203 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:42.869148    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brzzs\" (UniqueName: \"kubernetes.io/projected/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-kube-api-access-brzzs\") pod \"maas-api-e2e-ait-b6954964-f7b695944-p86fr\" (UID: \"d1fbcf57-76d7-443f-9220-d8c8b2758bd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"
Sep 06 19:42:42.871716 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:42.871691    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:42.969793 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:42.969741    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brzzs\" (UniqueName: \"kubernetes.io/projected/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-kube-api-access-brzzs\") pod \"maas-api-e2e-ait-b6954964-f7b695944-p86fr\" (UID: \"d1fbcf57-76d7-443f-9220-d8c8b2758bd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"
Sep 06 19:42:42.969976 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:42.969854    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-openshift-service-ca\") pod \"maas-api-e2e-ait-b6954964-f7b695944-p86fr\" (UID: \"d1fbcf57-76d7-443f-9220-d8c8b2758bd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"
Sep 06 19:42:42.969976 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:42.969895    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-metrics-certs\") pod \"maas-api-e2e-ait-b6954964-f7b695944-p86fr\" (UID: \"d1fbcf57-76d7-443f-9220-d8c8b2758bd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"
Sep 06 19:42:42.970066 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:42.969974    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-maas-api-tls\") pod \"maas-api-e2e-ait-b6954964-f7b695944-p86fr\" (UID: \"d1fbcf57-76d7-443f-9220-d8c8b2758bd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"
Sep 06 19:42:42.970705 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:42.970630    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-openshift-service-ca\") pod \"maas-api-e2e-ait-b6954964-f7b695944-p86fr\" (UID: \"d1fbcf57-76d7-443f-9220-d8c8b2758bd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"
Sep 06 19:42:42.972560 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:42.972537    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-metrics-certs\") pod \"maas-api-e2e-ait-b6954964-f7b695944-p86fr\" (UID: \"d1fbcf57-76d7-443f-9220-d8c8b2758bd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"
Sep 06 19:42:42.972640 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:42.972626    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-maas-api-tls\") pod \"maas-api-e2e-ait-b6954964-f7b695944-p86fr\" (UID: \"d1fbcf57-76d7-443f-9220-d8c8b2758bd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"
Sep 06 19:42:42.977562 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:42.977538    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brzzs\" (UniqueName: \"kubernetes.io/projected/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-kube-api-access-brzzs\") pod \"maas-api-e2e-ait-b6954964-f7b695944-p86fr\" (UID: \"d1fbcf57-76d7-443f-9220-d8c8b2758bd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"
Sep 06 19:42:43.085986 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:43.085893    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"
Sep 06 19:42:43.283059 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:43.283017    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:43.355753 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:43.355642    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:42:43.368452 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:43.368376    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"]
Sep 06 19:42:43.370993 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:42:43.370964    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1fbcf57_76d7_443f_9220_d8c8b2758bd2.slice/crio-366d9cafd14eee93648edcceb46aa1b92dd662606ba9d380ed5be4617bb1a65e WatchSource:0}: Error finding container 366d9cafd14eee93648edcceb46aa1b92dd662606ba9d380ed5be4617bb1a65e: Status 404 returned error can't find the container with id 366d9cafd14eee93648edcceb46aa1b92dd662606ba9d380ed5be4617bb1a65e
Sep 06 19:42:44.337489 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:44.337453    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr" event={"ID":"d1fbcf57-76d7-443f-9220-d8c8b2758bd2","Type":"ContainerStarted","Data":"1f6916d282e34c701812b19e6a8ca35fe29d01353809a7d74d808849d4fc95b5"}
Sep 06 19:42:44.338149 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:44.337504    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr" event={"ID":"d1fbcf57-76d7-443f-9220-d8c8b2758bd2","Type":"ContainerStarted","Data":"366d9cafd14eee93648edcceb46aa1b92dd662606ba9d380ed5be4617bb1a65e"}
Sep 06 19:42:44.338149 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:44.337577    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"
Sep 06 19:42:44.353363 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:44.353308    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr" podStartSLOduration=1.926565241 podStartE2EDuration="2.353291312s" totalImagesPullingTime="426.726071ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:42:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:42:44.352045656 +0000 UTC m=+927.757004725" watchObservedRunningTime="2026-09-06 19:42:44.353291312 +0000 UTC m=+927.758250400"
Sep 06 19:42:50.348792 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:42:50.348746    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"
Sep 06 19:43:00.764655 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:00.764615    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:10.057832 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:10.057772    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:12.961463 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:12.961400    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:13.576137 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:13.576098    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"]
Sep 06 19:43:13.576428 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:13.576395    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr" podUID="d1fbcf57-76d7-443f-9220-d8c8b2758bd2" containerName="maas-api" containerID="cri-o://1f6916d282e34c701812b19e6a8ca35fe29d01353809a7d74d808849d4fc95b5" gracePeriod=30
Sep 06 19:43:13.600412 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:13.600374    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:13.668398 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:13.668352    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:13.722988 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:13.722660    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:13.784986 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:13.784951    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:13.829703 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:13.829642    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"
Sep 06 19:43:13.841899 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:13.841865    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:13.955474 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:13.955444    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-openshift-service-ca\") pod \"d1fbcf57-76d7-443f-9220-d8c8b2758bd2\" (UID: \"d1fbcf57-76d7-443f-9220-d8c8b2758bd2\") "
Sep 06 19:43:13.955665 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:13.955483    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-maas-api-tls\") pod \"d1fbcf57-76d7-443f-9220-d8c8b2758bd2\" (UID: \"d1fbcf57-76d7-443f-9220-d8c8b2758bd2\") "
Sep 06 19:43:13.955665 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:13.955539    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-metrics-certs\") pod \"d1fbcf57-76d7-443f-9220-d8c8b2758bd2\" (UID: \"d1fbcf57-76d7-443f-9220-d8c8b2758bd2\") "
Sep 06 19:43:13.955665 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:13.955569    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brzzs\" (UniqueName: \"kubernetes.io/projected/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-kube-api-access-brzzs\") pod \"d1fbcf57-76d7-443f-9220-d8c8b2758bd2\" (UID: \"d1fbcf57-76d7-443f-9220-d8c8b2758bd2\") "
Sep 06 19:43:13.955885 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:13.955845    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d1fbcf57-76d7-443f-9220-d8c8b2758bd2" (UID: "d1fbcf57-76d7-443f-9220-d8c8b2758bd2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:43:13.957867 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:13.957835    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d1fbcf57-76d7-443f-9220-d8c8b2758bd2" (UID: "d1fbcf57-76d7-443f-9220-d8c8b2758bd2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:43:13.958020 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:13.957919    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-kube-api-access-brzzs" (OuterVolumeSpecName: "kube-api-access-brzzs") pod "d1fbcf57-76d7-443f-9220-d8c8b2758bd2" (UID: "d1fbcf57-76d7-443f-9220-d8c8b2758bd2"). InnerVolumeSpecName "kube-api-access-brzzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:43:13.958020 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:13.957929    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d1fbcf57-76d7-443f-9220-d8c8b2758bd2" (UID: "d1fbcf57-76d7-443f-9220-d8c8b2758bd2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:43:14.056502 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:14.056466    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-openshift-service-ca\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:43:14.056502 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:14.056498    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-maas-api-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:43:14.056502 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:14.056507    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-metrics-certs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:43:14.057004 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:14.056518    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brzzs\" (UniqueName: \"kubernetes.io/projected/d1fbcf57-76d7-443f-9220-d8c8b2758bd2-kube-api-access-brzzs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:43:14.515963 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:14.515933    2568 generic.go:356] "Generic (PLEG): container finished" podID="d1fbcf57-76d7-443f-9220-d8c8b2758bd2" containerID="1f6916d282e34c701812b19e6a8ca35fe29d01353809a7d74d808849d4fc95b5" exitCode=0
Sep 06 19:43:14.516141 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:14.515988    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"
Sep 06 19:43:14.516141 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:14.516021    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr" event={"ID":"d1fbcf57-76d7-443f-9220-d8c8b2758bd2","Type":"ContainerDied","Data":"1f6916d282e34c701812b19e6a8ca35fe29d01353809a7d74d808849d4fc95b5"}
Sep 06 19:43:14.516141 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:14.516075    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr" event={"ID":"d1fbcf57-76d7-443f-9220-d8c8b2758bd2","Type":"ContainerDied","Data":"366d9cafd14eee93648edcceb46aa1b92dd662606ba9d380ed5be4617bb1a65e"}
Sep 06 19:43:14.516141 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:14.516098    2568 scope.go:117] "RemoveContainer" containerID="1f6916d282e34c701812b19e6a8ca35fe29d01353809a7d74d808849d4fc95b5"
Sep 06 19:43:14.527284 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:14.527260    2568 scope.go:117] "RemoveContainer" containerID="1f6916d282e34c701812b19e6a8ca35fe29d01353809a7d74d808849d4fc95b5"
Sep 06 19:43:14.527632 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:43:14.527611    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f6916d282e34c701812b19e6a8ca35fe29d01353809a7d74d808849d4fc95b5\": container with ID starting with 1f6916d282e34c701812b19e6a8ca35fe29d01353809a7d74d808849d4fc95b5 not found: ID does not exist" containerID="1f6916d282e34c701812b19e6a8ca35fe29d01353809a7d74d808849d4fc95b5"
Sep 06 19:43:14.527742 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:14.527645    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f6916d282e34c701812b19e6a8ca35fe29d01353809a7d74d808849d4fc95b5"} err="failed to get container status \"1f6916d282e34c701812b19e6a8ca35fe29d01353809a7d74d808849d4fc95b5\": rpc error: code = NotFound desc = could not find container \"1f6916d282e34c701812b19e6a8ca35fe29d01353809a7d74d808849d4fc95b5\": container with ID starting with 1f6916d282e34c701812b19e6a8ca35fe29d01353809a7d74d808849d4fc95b5 not found: ID does not exist"
Sep 06 19:43:14.537119 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:14.537094    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"]
Sep 06 19:43:14.543491 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:14.543466    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b6954964-f7b695944-p86fr"]
Sep 06 19:43:14.883699 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:14.883656    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:15.116747 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:15.116711    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1fbcf57-76d7-443f-9220-d8c8b2758bd2" path="/var/lib/kubelet/pods/d1fbcf57-76d7-443f-9220-d8c8b2758bd2/volumes"
Sep 06 19:43:15.297638 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:15.297544    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:15.582744 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:15.582649    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:15.794397 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:15.794355    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:17.157119 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:17.157086    2568 scope.go:117] "RemoveContainer" containerID="54078022d0ea3a48be12e731726231b3f4bdb324709e74ece8765ed718f157e0"
Sep 06 19:43:18.019217 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:18.019169    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:18.117593 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:18.117547    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:19.261555 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:19.261519    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"]
Sep 06 19:43:19.262157 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:19.262137    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1fbcf57-76d7-443f-9220-d8c8b2758bd2" containerName="maas-api"
Sep 06 19:43:19.262289 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:19.262167    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1fbcf57-76d7-443f-9220-d8c8b2758bd2" containerName="maas-api"
Sep 06 19:43:19.262387 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:19.262294    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1fbcf57-76d7-443f-9220-d8c8b2758bd2" containerName="maas-api"
Sep 06 19:43:19.267069 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:19.267046    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"
Sep 06 19:43:19.269463 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:19.269442    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-f439b863-serving-cert\""
Sep 06 19:43:19.279191 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:19.279167    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"]
Sep 06 19:43:19.339948 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:19.339892    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:19.405216 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:19.405170    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/087a5522-f83d-4f2a-ab7b-6ec068f522f3-openshift-service-ca\") pod \"maas-api-e2e-derive-f439b863-565b869d69-2bxgm\" (UID: \"087a5522-f83d-4f2a-ab7b-6ec068f522f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"
Sep 06 19:43:19.405407 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:19.405234    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/087a5522-f83d-4f2a-ab7b-6ec068f522f3-maas-api-tls\") pod \"maas-api-e2e-derive-f439b863-565b869d69-2bxgm\" (UID: \"087a5522-f83d-4f2a-ab7b-6ec068f522f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"
Sep 06 19:43:19.405407 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:19.405292    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/087a5522-f83d-4f2a-ab7b-6ec068f522f3-metrics-certs\") pod \"maas-api-e2e-derive-f439b863-565b869d69-2bxgm\" (UID: \"087a5522-f83d-4f2a-ab7b-6ec068f522f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"
Sep 06 19:43:19.405407 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:19.405341    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znfqb\" (UniqueName: \"kubernetes.io/projected/087a5522-f83d-4f2a-ab7b-6ec068f522f3-kube-api-access-znfqb\") pod \"maas-api-e2e-derive-f439b863-565b869d69-2bxgm\" (UID: \"087a5522-f83d-4f2a-ab7b-6ec068f522f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"
Sep 06 19:43:19.440514 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:19.440475    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:19.506871 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:19.506831    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znfqb\" (UniqueName: \"kubernetes.io/projected/087a5522-f83d-4f2a-ab7b-6ec068f522f3-kube-api-access-znfqb\") pod \"maas-api-e2e-derive-f439b863-565b869d69-2bxgm\" (UID: \"087a5522-f83d-4f2a-ab7b-6ec068f522f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"
Sep 06 19:43:19.507077 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:19.506915    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/087a5522-f83d-4f2a-ab7b-6ec068f522f3-openshift-service-ca\") pod \"maas-api-e2e-derive-f439b863-565b869d69-2bxgm\" (UID: \"087a5522-f83d-4f2a-ab7b-6ec068f522f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"
Sep 06 19:43:19.507077 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:19.506961    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/087a5522-f83d-4f2a-ab7b-6ec068f522f3-maas-api-tls\") pod \"maas-api-e2e-derive-f439b863-565b869d69-2bxgm\" (UID: \"087a5522-f83d-4f2a-ab7b-6ec068f522f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"
Sep 06 19:43:19.507077 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:19.507004    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/087a5522-f83d-4f2a-ab7b-6ec068f522f3-metrics-certs\") pod \"maas-api-e2e-derive-f439b863-565b869d69-2bxgm\" (UID: \"087a5522-f83d-4f2a-ab7b-6ec068f522f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"
Sep 06 19:43:19.507255 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:43:19.507150    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-serving-cert: secret "maas-api-e2e-derive-f439b863-serving-cert" not found
Sep 06 19:43:19.507255 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:43:19.507221    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/087a5522-f83d-4f2a-ab7b-6ec068f522f3-maas-api-tls podName:087a5522-f83d-4f2a-ab7b-6ec068f522f3 nodeName:}" failed. No retries permitted until 2026-09-06 19:43:20.007198471 +0000 UTC m=+963.412157532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/087a5522-f83d-4f2a-ab7b-6ec068f522f3-maas-api-tls") pod "maas-api-e2e-derive-f439b863-565b869d69-2bxgm" (UID: "087a5522-f83d-4f2a-ab7b-6ec068f522f3") : secret "maas-api-e2e-derive-f439b863-serving-cert" not found
Sep 06 19:43:19.507675 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:19.507650    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/087a5522-f83d-4f2a-ab7b-6ec068f522f3-openshift-service-ca\") pod \"maas-api-e2e-derive-f439b863-565b869d69-2bxgm\" (UID: \"087a5522-f83d-4f2a-ab7b-6ec068f522f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"
Sep 06 19:43:19.509557 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:19.509539    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/087a5522-f83d-4f2a-ab7b-6ec068f522f3-metrics-certs\") pod \"maas-api-e2e-derive-f439b863-565b869d69-2bxgm\" (UID: \"087a5522-f83d-4f2a-ab7b-6ec068f522f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"
Sep 06 19:43:19.516202 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:19.516143    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znfqb\" (UniqueName: \"kubernetes.io/projected/087a5522-f83d-4f2a-ab7b-6ec068f522f3-kube-api-access-znfqb\") pod \"maas-api-e2e-derive-f439b863-565b869d69-2bxgm\" (UID: \"087a5522-f83d-4f2a-ab7b-6ec068f522f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"
Sep 06 19:43:19.760413 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:19.760369    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:19.855501 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:19.855406    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:19.924717 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:19.924674    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:20.012698 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:20.012660    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/087a5522-f83d-4f2a-ab7b-6ec068f522f3-maas-api-tls\") pod \"maas-api-e2e-derive-f439b863-565b869d69-2bxgm\" (UID: \"087a5522-f83d-4f2a-ab7b-6ec068f522f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"
Sep 06 19:43:20.015374 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:20.015348    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/087a5522-f83d-4f2a-ab7b-6ec068f522f3-maas-api-tls\") pod \"maas-api-e2e-derive-f439b863-565b869d69-2bxgm\" (UID: \"087a5522-f83d-4f2a-ab7b-6ec068f522f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"
Sep 06 19:43:20.178509 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:20.178462    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"
Sep 06 19:43:20.457747 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:20.457628    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"]
Sep 06 19:43:20.460529 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:43:20.460503    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod087a5522_f83d_4f2a_ab7b_6ec068f522f3.slice/crio-49e84bce8988945c07bfaba4da98d42f6ee87dcc809ebdfd8f9311a372c8d470 WatchSource:0}: Error finding container 49e84bce8988945c07bfaba4da98d42f6ee87dcc809ebdfd8f9311a372c8d470: Status 404 returned error can't find the container with id 49e84bce8988945c07bfaba4da98d42f6ee87dcc809ebdfd8f9311a372c8d470
Sep 06 19:43:20.551453 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:20.551415    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm" event={"ID":"087a5522-f83d-4f2a-ab7b-6ec068f522f3","Type":"ContainerStarted","Data":"49e84bce8988945c07bfaba4da98d42f6ee87dcc809ebdfd8f9311a372c8d470"}
Sep 06 19:43:21.559165 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:21.559120    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm" event={"ID":"087a5522-f83d-4f2a-ab7b-6ec068f522f3","Type":"ContainerStarted","Data":"6b4aa1d8c8b813e0c1362187c7184edd253ddbcf850e0319fcea9f63c5f9a110"}
Sep 06 19:43:21.559565 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:21.559298    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"
Sep 06 19:43:21.574703 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:21.574647    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm" podStartSLOduration=2.19904816 podStartE2EDuration="2.574629948s" totalImagesPullingTime="375.581788ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:43:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:43:21.573559357 +0000 UTC m=+964.978518426" watchObservedRunningTime="2026-09-06 19:43:21.574629948 +0000 UTC m=+964.979589071"
Sep 06 19:43:23.429449 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:23.429415    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:27.239966 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:27.239928    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:27.570405 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:27.570315    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"
Sep 06 19:43:29.252452 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:29.252404    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:32.272434 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:32.272399    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:32.464471 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:32.464438    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:40.275688 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:40.275602    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:42.494981 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:42.494929    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:43.092262 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:43.092224    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:43.591860 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:43.591825    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"]
Sep 06 19:43:43.592393 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:43.592083    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv" podUID="db15347c-5ccb-48c7-8daf-2275d6a740c5" containerName="maas-api" containerID="cri-o://2e70886b2cea8e5a1e7047491977172c1fa4a0cb5c959e89977b8b020f42a6ca" gracePeriod=30
Sep 06 19:43:43.620746 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:43.620696    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:43.649263 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:43.649233    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m"]
Sep 06 19:43:43.649502 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:43.649478    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m" podUID="7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a" containerName="payload-processing" containerID="cri-o://4a5758cfb32d19d27bbcb0f315942fb0d1ba0c057134267a8599b7f5414615b5" gracePeriod=30
Sep 06 19:43:43.681929 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:43.681892    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:43.736504 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:43.736465    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:43.800143 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:43.800108    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:43.851136 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:43.851046    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:43.914740 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:43.914707    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"
Sep 06 19:43:43.945269 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:43.945245    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m"
Sep 06 19:43:44.034693 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.034654    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db15347c-5ccb-48c7-8daf-2275d6a740c5-openshift-service-ca\") pod \"db15347c-5ccb-48c7-8daf-2275d6a740c5\" (UID: \"db15347c-5ccb-48c7-8daf-2275d6a740c5\") "
Sep 06 19:43:44.034918 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.034743    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfznq\" (UniqueName: \"kubernetes.io/projected/db15347c-5ccb-48c7-8daf-2275d6a740c5-kube-api-access-vfznq\") pod \"db15347c-5ccb-48c7-8daf-2275d6a740c5\" (UID: \"db15347c-5ccb-48c7-8daf-2275d6a740c5\") "
Sep 06 19:43:44.034918 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.034818    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a-plugins-config-volume\") pod \"7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a\" (UID: \"7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a\") "
Sep 06 19:43:44.034918 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.034888    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db15347c-5ccb-48c7-8daf-2275d6a740c5-metrics-certs\") pod \"db15347c-5ccb-48c7-8daf-2275d6a740c5\" (UID: \"db15347c-5ccb-48c7-8daf-2275d6a740c5\") "
Sep 06 19:43:44.034918 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.034914    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc8kc\" (UniqueName: \"kubernetes.io/projected/7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a-kube-api-access-cc8kc\") pod \"7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a\" (UID: \"7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a\") "
Sep 06 19:43:44.035167 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.034973    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db15347c-5ccb-48c7-8daf-2275d6a740c5-maas-api-tls\") pod \"db15347c-5ccb-48c7-8daf-2275d6a740c5\" (UID: \"db15347c-5ccb-48c7-8daf-2275d6a740c5\") "
Sep 06 19:43:44.035167 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.035131    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db15347c-5ccb-48c7-8daf-2275d6a740c5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "db15347c-5ccb-48c7-8daf-2275d6a740c5" (UID: "db15347c-5ccb-48c7-8daf-2275d6a740c5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:43:44.035324 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.035272    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db15347c-5ccb-48c7-8daf-2275d6a740c5-openshift-service-ca\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:43:44.035543 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.035513    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a" (UID: "7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:43:44.037432 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.037400    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a-kube-api-access-cc8kc" (OuterVolumeSpecName: "kube-api-access-cc8kc") pod "7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a" (UID: "7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a"). InnerVolumeSpecName "kube-api-access-cc8kc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:43:44.037534 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.037426    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db15347c-5ccb-48c7-8daf-2275d6a740c5-kube-api-access-vfznq" (OuterVolumeSpecName: "kube-api-access-vfznq") pod "db15347c-5ccb-48c7-8daf-2275d6a740c5" (UID: "db15347c-5ccb-48c7-8daf-2275d6a740c5"). InnerVolumeSpecName "kube-api-access-vfznq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:43:44.037534 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.037442    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db15347c-5ccb-48c7-8daf-2275d6a740c5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "db15347c-5ccb-48c7-8daf-2275d6a740c5" (UID: "db15347c-5ccb-48c7-8daf-2275d6a740c5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:43:44.037606 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.037591    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db15347c-5ccb-48c7-8daf-2275d6a740c5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "db15347c-5ccb-48c7-8daf-2275d6a740c5" (UID: "db15347c-5ccb-48c7-8daf-2275d6a740c5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:43:44.129724 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.129682    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:44.136620 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.136596    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db15347c-5ccb-48c7-8daf-2275d6a740c5-maas-api-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:43:44.136620 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.136621    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfznq\" (UniqueName: \"kubernetes.io/projected/db15347c-5ccb-48c7-8daf-2275d6a740c5-kube-api-access-vfznq\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:43:44.136812 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.136631    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a-plugins-config-volume\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:43:44.136812 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.136640    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db15347c-5ccb-48c7-8daf-2275d6a740c5-metrics-certs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:43:44.136812 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.136648    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc8kc\" (UniqueName: \"kubernetes.io/projected/7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a-kube-api-access-cc8kc\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:43:44.690925 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.690886    2568 generic.go:356] "Generic (PLEG): container finished" podID="db15347c-5ccb-48c7-8daf-2275d6a740c5" containerID="2e70886b2cea8e5a1e7047491977172c1fa4a0cb5c959e89977b8b020f42a6ca" exitCode=0
Sep 06 19:43:44.691401 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.690932    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"
Sep 06 19:43:44.691401 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.690983    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv" event={"ID":"db15347c-5ccb-48c7-8daf-2275d6a740c5","Type":"ContainerDied","Data":"2e70886b2cea8e5a1e7047491977172c1fa4a0cb5c959e89977b8b020f42a6ca"}
Sep 06 19:43:44.691401 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.691035    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv" event={"ID":"db15347c-5ccb-48c7-8daf-2275d6a740c5","Type":"ContainerDied","Data":"503c47886c9256ff763c175cb2b7c31fa730782ec44672b63d360b578855ec92"}
Sep 06 19:43:44.691401 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.691062    2568 scope.go:117] "RemoveContainer" containerID="2e70886b2cea8e5a1e7047491977172c1fa4a0cb5c959e89977b8b020f42a6ca"
Sep 06 19:43:44.692991 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.692966    2568 generic.go:356] "Generic (PLEG): container finished" podID="7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a" containerID="4a5758cfb32d19d27bbcb0f315942fb0d1ba0c057134267a8599b7f5414615b5" exitCode=0
Sep 06 19:43:44.693094 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.693012    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m"
Sep 06 19:43:44.693094 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.693014    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m" event={"ID":"7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a","Type":"ContainerDied","Data":"4a5758cfb32d19d27bbcb0f315942fb0d1ba0c057134267a8599b7f5414615b5"}
Sep 06 19:43:44.693175 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.693123    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m" event={"ID":"7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a","Type":"ContainerDied","Data":"a595082479003ade1a1a2c56244e77e20c7eb9c91c9c13e636618f42eecb34bc"}
Sep 06 19:43:44.702928 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.702905    2568 scope.go:117] "RemoveContainer" containerID="2e70886b2cea8e5a1e7047491977172c1fa4a0cb5c959e89977b8b020f42a6ca"
Sep 06 19:43:44.703298 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:43:44.703274    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e70886b2cea8e5a1e7047491977172c1fa4a0cb5c959e89977b8b020f42a6ca\": container with ID starting with 2e70886b2cea8e5a1e7047491977172c1fa4a0cb5c959e89977b8b020f42a6ca not found: ID does not exist" containerID="2e70886b2cea8e5a1e7047491977172c1fa4a0cb5c959e89977b8b020f42a6ca"
Sep 06 19:43:44.703409 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.703308    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e70886b2cea8e5a1e7047491977172c1fa4a0cb5c959e89977b8b020f42a6ca"} err="failed to get container status \"2e70886b2cea8e5a1e7047491977172c1fa4a0cb5c959e89977b8b020f42a6ca\": rpc error: code = NotFound desc = could not find container \"2e70886b2cea8e5a1e7047491977172c1fa4a0cb5c959e89977b8b020f42a6ca\": container with ID starting with 2e70886b2cea8e5a1e7047491977172c1fa4a0cb5c959e89977b8b020f42a6ca not found: ID does not exist"
Sep 06 19:43:44.703409 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.703325    2568 scope.go:117] "RemoveContainer" containerID="4a5758cfb32d19d27bbcb0f315942fb0d1ba0c057134267a8599b7f5414615b5"
Sep 06 19:43:44.711618 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.711592    2568 scope.go:117] "RemoveContainer" containerID="4a5758cfb32d19d27bbcb0f315942fb0d1ba0c057134267a8599b7f5414615b5"
Sep 06 19:43:44.711949 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:43:44.711925    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a5758cfb32d19d27bbcb0f315942fb0d1ba0c057134267a8599b7f5414615b5\": container with ID starting with 4a5758cfb32d19d27bbcb0f315942fb0d1ba0c057134267a8599b7f5414615b5 not found: ID does not exist" containerID="4a5758cfb32d19d27bbcb0f315942fb0d1ba0c057134267a8599b7f5414615b5"
Sep 06 19:43:44.712011 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.711958    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a5758cfb32d19d27bbcb0f315942fb0d1ba0c057134267a8599b7f5414615b5"} err="failed to get container status \"4a5758cfb32d19d27bbcb0f315942fb0d1ba0c057134267a8599b7f5414615b5\": rpc error: code = NotFound desc = could not find container \"4a5758cfb32d19d27bbcb0f315942fb0d1ba0c057134267a8599b7f5414615b5\": container with ID starting with 4a5758cfb32d19d27bbcb0f315942fb0d1ba0c057134267a8599b7f5414615b5 not found: ID does not exist"
Sep 06 19:43:44.716592 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.716568    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m"]
Sep 06 19:43:44.720246 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.720225    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0ebbc9-fd78dd755-dzh5m"]
Sep 06 19:43:44.731925 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.731900    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"]
Sep 06 19:43:44.735576 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:44.735557    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-0ebbc9-d5d57d9c7-l9txv"]
Sep 06 19:43:45.116628 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:45.116596    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a" path="/var/lib/kubelet/pods/7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a/volumes"
Sep 06 19:43:45.117049 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:45.117036    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db15347c-5ccb-48c7-8daf-2275d6a740c5" path="/var/lib/kubelet/pods/db15347c-5ccb-48c7-8daf-2275d6a740c5/volumes"
Sep 06 19:43:49.606880 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:49.606841    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"]
Sep 06 19:43:49.607317 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:49.607096    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm" podUID="087a5522-f83d-4f2a-ab7b-6ec068f522f3" containerName="maas-api" containerID="cri-o://6b4aa1d8c8b813e0c1362187c7184edd253ddbcf850e0319fcea9f63c5f9a110" gracePeriod=30
Sep 06 19:43:49.630073 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:49.630028    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:49.703811 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:49.703743    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:49.724050 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:49.724014    2568 generic.go:356] "Generic (PLEG): container finished" podID="087a5522-f83d-4f2a-ab7b-6ec068f522f3" containerID="6b4aa1d8c8b813e0c1362187c7184edd253ddbcf850e0319fcea9f63c5f9a110" exitCode=0
Sep 06 19:43:49.724175 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:49.724077    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm" event={"ID":"087a5522-f83d-4f2a-ab7b-6ec068f522f3","Type":"ContainerDied","Data":"6b4aa1d8c8b813e0c1362187c7184edd253ddbcf850e0319fcea9f63c5f9a110"}
Sep 06 19:43:49.767434 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:49.767367    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:49.866472 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:49.866400    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"
Sep 06 19:43:49.868176 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:49.868147    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:49.968438 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:49.968402    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:49.993651 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:49.993618    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/087a5522-f83d-4f2a-ab7b-6ec068f522f3-openshift-service-ca\") pod \"087a5522-f83d-4f2a-ab7b-6ec068f522f3\" (UID: \"087a5522-f83d-4f2a-ab7b-6ec068f522f3\") "
Sep 06 19:43:49.993822 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:49.993673    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znfqb\" (UniqueName: \"kubernetes.io/projected/087a5522-f83d-4f2a-ab7b-6ec068f522f3-kube-api-access-znfqb\") pod \"087a5522-f83d-4f2a-ab7b-6ec068f522f3\" (UID: \"087a5522-f83d-4f2a-ab7b-6ec068f522f3\") "
Sep 06 19:43:49.993822 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:49.993737    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/087a5522-f83d-4f2a-ab7b-6ec068f522f3-metrics-certs\") pod \"087a5522-f83d-4f2a-ab7b-6ec068f522f3\" (UID: \"087a5522-f83d-4f2a-ab7b-6ec068f522f3\") "
Sep 06 19:43:49.993822 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:49.993807    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/087a5522-f83d-4f2a-ab7b-6ec068f522f3-maas-api-tls\") pod \"087a5522-f83d-4f2a-ab7b-6ec068f522f3\" (UID: \"087a5522-f83d-4f2a-ab7b-6ec068f522f3\") "
Sep 06 19:43:49.994046 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:49.994016    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/087a5522-f83d-4f2a-ab7b-6ec068f522f3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "087a5522-f83d-4f2a-ab7b-6ec068f522f3" (UID: "087a5522-f83d-4f2a-ab7b-6ec068f522f3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:43:49.996081 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:49.996052    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/087a5522-f83d-4f2a-ab7b-6ec068f522f3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "087a5522-f83d-4f2a-ab7b-6ec068f522f3" (UID: "087a5522-f83d-4f2a-ab7b-6ec068f522f3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:43:49.996194 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:49.996114    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/087a5522-f83d-4f2a-ab7b-6ec068f522f3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "087a5522-f83d-4f2a-ab7b-6ec068f522f3" (UID: "087a5522-f83d-4f2a-ab7b-6ec068f522f3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:43:49.996360 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:49.996341    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/087a5522-f83d-4f2a-ab7b-6ec068f522f3-kube-api-access-znfqb" (OuterVolumeSpecName: "kube-api-access-znfqb") pod "087a5522-f83d-4f2a-ab7b-6ec068f522f3" (UID: "087a5522-f83d-4f2a-ab7b-6ec068f522f3"). InnerVolumeSpecName "kube-api-access-znfqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:43:50.094969 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:50.094933    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/087a5522-f83d-4f2a-ab7b-6ec068f522f3-metrics-certs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:43:50.094969 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:50.094963    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/087a5522-f83d-4f2a-ab7b-6ec068f522f3-maas-api-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:43:50.094969 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:50.094972    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/087a5522-f83d-4f2a-ab7b-6ec068f522f3-openshift-service-ca\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:43:50.095251 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:50.094983    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znfqb\" (UniqueName: \"kubernetes.io/projected/087a5522-f83d-4f2a-ab7b-6ec068f522f3-kube-api-access-znfqb\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:43:50.415451 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:50.415409    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:50.509242 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:50.509181    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:50.610704 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:50.610665    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:50.680625 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:50.680516    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:50.730603 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:50.730565    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm" event={"ID":"087a5522-f83d-4f2a-ab7b-6ec068f522f3","Type":"ContainerDied","Data":"49e84bce8988945c07bfaba4da98d42f6ee87dcc809ebdfd8f9311a372c8d470"}
Sep 06 19:43:50.730603 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:50.730603    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"
Sep 06 19:43:50.730876 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:50.730634    2568 scope.go:117] "RemoveContainer" containerID="6b4aa1d8c8b813e0c1362187c7184edd253ddbcf850e0319fcea9f63c5f9a110"
Sep 06 19:43:50.741046 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:50.741020    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:50.751686 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:50.751665    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"]
Sep 06 19:43:50.756204 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:50.756179    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f439b863-565b869d69-2bxgm"]
Sep 06 19:43:51.065582 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:51.065490    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:51.116087 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:51.116051    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="087a5522-f83d-4f2a-ab7b-6ec068f522f3" path="/var/lib/kubelet/pods/087a5522-f83d-4f2a-ab7b-6ec068f522f3/volumes"
Sep 06 19:43:51.357554 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:51.357463    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:51.630301 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:51.630258    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:52.047766 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:52.047665    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:54.666893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:54.666853    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:54.764810 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:54.764744    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:55.778857 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.778715    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"]
Sep 06 19:43:55.779388 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.779363    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db15347c-5ccb-48c7-8daf-2275d6a740c5" containerName="maas-api"
Sep 06 19:43:55.779388 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.779389    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="db15347c-5ccb-48c7-8daf-2275d6a740c5" containerName="maas-api"
Sep 06 19:43:55.779569 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.779408    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a" containerName="payload-processing"
Sep 06 19:43:55.779569 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.779417    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a" containerName="payload-processing"
Sep 06 19:43:55.779569 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.779445    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087a5522-f83d-4f2a-ab7b-6ec068f522f3" containerName="maas-api"
Sep 06 19:43:55.779569 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.779453    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="087a5522-f83d-4f2a-ab7b-6ec068f522f3" containerName="maas-api"
Sep 06 19:43:55.779738 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.779597    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bbd2ae3-9bbf-4ab2-aec0-8d354cfe511a" containerName="payload-processing"
Sep 06 19:43:55.779738 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.779613    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="db15347c-5ccb-48c7-8daf-2275d6a740c5" containerName="maas-api"
Sep 06 19:43:55.779738 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.779623    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="087a5522-f83d-4f2a-ab7b-6ec068f522f3" containerName="maas-api"
Sep 06 19:43:55.784242 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.784221    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"
Sep 06 19:43:55.787234 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.786970    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-838def-serving-cert\""
Sep 06 19:43:55.797485 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.797432    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"]
Sep 06 19:43:55.823176 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.823136    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:55.856151 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.856114    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c962d24a-8656-44bd-acfe-f6c3bbff9f20-openshift-service-ca\") pod \"maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd\" (UID: \"c962d24a-8656-44bd-acfe-f6c3bbff9f20\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"
Sep 06 19:43:55.856320 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.856168    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c962d24a-8656-44bd-acfe-f6c3bbff9f20-metrics-certs\") pod \"maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd\" (UID: \"c962d24a-8656-44bd-acfe-f6c3bbff9f20\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"
Sep 06 19:43:55.856320 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.856280    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c962d24a-8656-44bd-acfe-f6c3bbff9f20-maas-api-tls\") pod \"maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd\" (UID: \"c962d24a-8656-44bd-acfe-f6c3bbff9f20\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"
Sep 06 19:43:55.856320 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.856313    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdnkv\" (UniqueName: \"kubernetes.io/projected/c962d24a-8656-44bd-acfe-f6c3bbff9f20-kube-api-access-zdnkv\") pod \"maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd\" (UID: \"c962d24a-8656-44bd-acfe-f6c3bbff9f20\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"
Sep 06 19:43:55.920163 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.920122    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:55.957038 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.956998    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c962d24a-8656-44bd-acfe-f6c3bbff9f20-maas-api-tls\") pod \"maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd\" (UID: \"c962d24a-8656-44bd-acfe-f6c3bbff9f20\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"
Sep 06 19:43:55.957038 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.957037    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdnkv\" (UniqueName: \"kubernetes.io/projected/c962d24a-8656-44bd-acfe-f6c3bbff9f20-kube-api-access-zdnkv\") pod \"maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd\" (UID: \"c962d24a-8656-44bd-acfe-f6c3bbff9f20\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"
Sep 06 19:43:55.957294 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.957104    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c962d24a-8656-44bd-acfe-f6c3bbff9f20-openshift-service-ca\") pod \"maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd\" (UID: \"c962d24a-8656-44bd-acfe-f6c3bbff9f20\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"
Sep 06 19:43:55.957294 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.957136    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c962d24a-8656-44bd-acfe-f6c3bbff9f20-metrics-certs\") pod \"maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd\" (UID: \"c962d24a-8656-44bd-acfe-f6c3bbff9f20\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"
Sep 06 19:43:55.957948 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.957862    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c962d24a-8656-44bd-acfe-f6c3bbff9f20-openshift-service-ca\") pod \"maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd\" (UID: \"c962d24a-8656-44bd-acfe-f6c3bbff9f20\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"
Sep 06 19:43:55.959697 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.959675    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c962d24a-8656-44bd-acfe-f6c3bbff9f20-maas-api-tls\") pod \"maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd\" (UID: \"c962d24a-8656-44bd-acfe-f6c3bbff9f20\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"
Sep 06 19:43:55.959899 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.959877    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c962d24a-8656-44bd-acfe-f6c3bbff9f20-metrics-certs\") pod \"maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd\" (UID: \"c962d24a-8656-44bd-acfe-f6c3bbff9f20\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"
Sep 06 19:43:55.965406 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:55.965379    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdnkv\" (UniqueName: \"kubernetes.io/projected/c962d24a-8656-44bd-acfe-f6c3bbff9f20-kube-api-access-zdnkv\") pod \"maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd\" (UID: \"c962d24a-8656-44bd-acfe-f6c3bbff9f20\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"
Sep 06 19:43:56.020234 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:56.020193    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:56.097820 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:56.097694    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"
Sep 06 19:43:56.375929 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:56.375902    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"]
Sep 06 19:43:56.378728 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:43:56.378696    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc962d24a_8656_44bd_acfe_f6c3bbff9f20.slice/crio-547a385029a08444d30f33a2fb5b52881a6f5af2740b94b6a5b5cdc9e9aa7250 WatchSource:0}: Error finding container 547a385029a08444d30f33a2fb5b52881a6f5af2740b94b6a5b5cdc9e9aa7250: Status 404 returned error can't find the container with id 547a385029a08444d30f33a2fb5b52881a6f5af2740b94b6a5b5cdc9e9aa7250
Sep 06 19:43:56.379463 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:56.379433    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:56.380162 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:56.380145    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 19:43:56.467305 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:56.467250    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:56.515273 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:56.515239    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5"]
Sep 06 19:43:56.520044 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:56.520021    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5"
Sep 06 19:43:56.522765 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:56.522736    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-838def-dockercfg-hvvjb\""
Sep 06 19:43:56.522765 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:56.522753    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-838def\""
Sep 06 19:43:56.530164 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:56.530133    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5"]
Sep 06 19:43:56.664301 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:56.664207    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08c95479-6158-4a9c-87e9-355644b0fca3-plugins-config-volume\") pod \"payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5\" (UID: \"08c95479-6158-4a9c-87e9-355644b0fca3\") " pod="openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5"
Sep 06 19:43:56.664301 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:56.664244    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqcd7\" (UniqueName: \"kubernetes.io/projected/08c95479-6158-4a9c-87e9-355644b0fca3-kube-api-access-gqcd7\") pod \"payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5\" (UID: \"08c95479-6158-4a9c-87e9-355644b0fca3\") " pod="openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5"
Sep 06 19:43:56.764539 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:56.764509    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd" event={"ID":"c962d24a-8656-44bd-acfe-f6c3bbff9f20","Type":"ContainerStarted","Data":"547a385029a08444d30f33a2fb5b52881a6f5af2740b94b6a5b5cdc9e9aa7250"}
Sep 06 19:43:56.764936 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:56.764915    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08c95479-6158-4a9c-87e9-355644b0fca3-plugins-config-volume\") pod \"payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5\" (UID: \"08c95479-6158-4a9c-87e9-355644b0fca3\") " pod="openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5"
Sep 06 19:43:56.764991 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:56.764945    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqcd7\" (UniqueName: \"kubernetes.io/projected/08c95479-6158-4a9c-87e9-355644b0fca3-kube-api-access-gqcd7\") pod \"payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5\" (UID: \"08c95479-6158-4a9c-87e9-355644b0fca3\") " pod="openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5"
Sep 06 19:43:56.765612 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:56.765591    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08c95479-6158-4a9c-87e9-355644b0fca3-plugins-config-volume\") pod \"payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5\" (UID: \"08c95479-6158-4a9c-87e9-355644b0fca3\") " pod="openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5"
Sep 06 19:43:56.772274 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:56.772253    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqcd7\" (UniqueName: \"kubernetes.io/projected/08c95479-6158-4a9c-87e9-355644b0fca3-kube-api-access-gqcd7\") pod \"payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5\" (UID: \"08c95479-6158-4a9c-87e9-355644b0fca3\") " pod="openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5"
Sep 06 19:43:56.833093 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:56.833050    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5"
Sep 06 19:43:57.115547 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:43:57.115519    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08c95479_6158_4a9c_87e9_355644b0fca3.slice/crio-39875b968088da69821e6f5b5157b63fc1220fe8c05c56f04a621032439ad6ed WatchSource:0}: Error finding container 39875b968088da69821e6f5b5157b63fc1220fe8c05c56f04a621032439ad6ed: Status 404 returned error can't find the container with id 39875b968088da69821e6f5b5157b63fc1220fe8c05c56f04a621032439ad6ed
Sep 06 19:43:57.116978 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:57.116953    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5"]
Sep 06 19:43:57.774836 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:57.774792    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd" event={"ID":"c962d24a-8656-44bd-acfe-f6c3bbff9f20","Type":"ContainerStarted","Data":"2ba881e8bce5ade2fb53098a7bf5fe217aaf6598cdd08e3d5b6454a93bdb2044"}
Sep 06 19:43:57.775043 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:57.774906    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"
Sep 06 19:43:57.777172 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:57.777130    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5" event={"ID":"08c95479-6158-4a9c-87e9-355644b0fca3","Type":"ContainerStarted","Data":"d08f941f4ebba45f2c62c5c58e4354c12802e280dfc605d0f066223f7c74b70c"}
Sep 06 19:43:57.777398 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:57.777371    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5" event={"ID":"08c95479-6158-4a9c-87e9-355644b0fca3","Type":"ContainerStarted","Data":"39875b968088da69821e6f5b5157b63fc1220fe8c05c56f04a621032439ad6ed"}
Sep 06 19:43:57.777497 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:57.777415    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5"
Sep 06 19:43:57.792093 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:57.792014    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd" podStartSLOduration=2.431025833 podStartE2EDuration="2.791993872s" totalImagesPullingTime="360.968039ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:43:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:43:57.790425762 +0000 UTC m=+1001.195384832" watchObservedRunningTime="2026-09-06 19:43:57.791993872 +0000 UTC m=+1001.196952941"
Sep 06 19:43:57.807395 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:57.807335    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5" podStartSLOduration=1.8073182 podStartE2EDuration="1.8073182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:43:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:43:57.805950697 +0000 UTC m=+1001.210909769" watchObservedRunningTime="2026-09-06 19:43:57.8073182 +0000 UTC m=+1001.212277268"
Sep 06 19:43:58.094881 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:58.094768    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:58.144266 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:58.144232    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:58.226860 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:58.226822    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:58.326133 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:58.326097    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:58.426117 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:58.426084    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:43:58.739386 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:43:58.739284    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:44:03.790295 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:44:03.790262    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"
Sep 06 19:44:04.626281 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:44:04.626245    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:44:08.787302 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:44:08.787270    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5"
Sep 06 19:44:19.571332 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:44:19.571274    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:44:24.628825 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:44:24.628758    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:44:30.175720 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:44:30.175683    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:44:30.231588 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:44:30.231556    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:44:30.317727 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:44:30.317693    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:44:30.415903 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:44:30.415865    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:44:46.147967 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:44:46.147930    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:44:50.843241 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:44:50.843212    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:44:51.866008 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:44:51.865972    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:44:51.920757 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:44:51.920714    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:44:52.004191 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:44:52.004152    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:44:52.103478 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:44:52.103445    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:02.518346 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:02.518315    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:03.041701 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:03.041669    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:03.269478 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:03.269438    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:09.193409 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:09.193319    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:09.248764 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:09.248725    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:09.333072 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:09.333030    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:09.434149 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:09.434111    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:09.534384 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:09.534291    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:10.078029 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:10.077983    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:10.178210 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:10.178168    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:10.278314 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:10.278282    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:11.671953 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:11.671912    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:13.641350 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:13.641316    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"]
Sep 06 19:45:13.642212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:13.642175    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd" podUID="c962d24a-8656-44bd-acfe-f6c3bbff9f20" containerName="maas-api" containerID="cri-o://2ba881e8bce5ade2fb53098a7bf5fe217aaf6598cdd08e3d5b6454a93bdb2044" gracePeriod=30
Sep 06 19:45:13.677973 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:13.677938    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:13.723599 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:13.723567    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5"]
Sep 06 19:45:13.723838 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:13.723813    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5" podUID="08c95479-6158-4a9c-87e9-355644b0fca3" containerName="payload-processing" containerID="cri-o://d08f941f4ebba45f2c62c5c58e4354c12802e280dfc605d0f066223f7c74b70c" gracePeriod=30
Sep 06 19:45:13.785907 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:13.785872    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd" podUID="c962d24a-8656-44bd-acfe-f6c3bbff9f20" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.55:8443/health\": dial tcp 10.133.0.55:8443: connect: connection refused"
Sep 06 19:45:13.823085 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:13.823044    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:13.907150 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:13.907085    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:13.968492 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:13.968458    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:13.992174 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:13.992149    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"
Sep 06 19:45:14.010115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.010087    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5"
Sep 06 19:45:14.074073 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.074042    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqcd7\" (UniqueName: \"kubernetes.io/projected/08c95479-6158-4a9c-87e9-355644b0fca3-kube-api-access-gqcd7\") pod \"08c95479-6158-4a9c-87e9-355644b0fca3\" (UID: \"08c95479-6158-4a9c-87e9-355644b0fca3\") "
Sep 06 19:45:14.074278 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.074091    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c962d24a-8656-44bd-acfe-f6c3bbff9f20-openshift-service-ca\") pod \"c962d24a-8656-44bd-acfe-f6c3bbff9f20\" (UID: \"c962d24a-8656-44bd-acfe-f6c3bbff9f20\") "
Sep 06 19:45:14.074278 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.074146    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c962d24a-8656-44bd-acfe-f6c3bbff9f20-maas-api-tls\") pod \"c962d24a-8656-44bd-acfe-f6c3bbff9f20\" (UID: \"c962d24a-8656-44bd-acfe-f6c3bbff9f20\") "
Sep 06 19:45:14.074278 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.074183    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdnkv\" (UniqueName: \"kubernetes.io/projected/c962d24a-8656-44bd-acfe-f6c3bbff9f20-kube-api-access-zdnkv\") pod \"c962d24a-8656-44bd-acfe-f6c3bbff9f20\" (UID: \"c962d24a-8656-44bd-acfe-f6c3bbff9f20\") "
Sep 06 19:45:14.074278 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.074227    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c962d24a-8656-44bd-acfe-f6c3bbff9f20-metrics-certs\") pod \"c962d24a-8656-44bd-acfe-f6c3bbff9f20\" (UID: \"c962d24a-8656-44bd-acfe-f6c3bbff9f20\") "
Sep 06 19:45:14.074278 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.074261    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08c95479-6158-4a9c-87e9-355644b0fca3-plugins-config-volume\") pod \"08c95479-6158-4a9c-87e9-355644b0fca3\" (UID: \"08c95479-6158-4a9c-87e9-355644b0fca3\") "
Sep 06 19:45:14.074619 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.074584    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c962d24a-8656-44bd-acfe-f6c3bbff9f20-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c962d24a-8656-44bd-acfe-f6c3bbff9f20" (UID: "c962d24a-8656-44bd-acfe-f6c3bbff9f20"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:45:14.074816 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.074757    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08c95479-6158-4a9c-87e9-355644b0fca3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "08c95479-6158-4a9c-87e9-355644b0fca3" (UID: "08c95479-6158-4a9c-87e9-355644b0fca3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:45:14.076551 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.076520    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c962d24a-8656-44bd-acfe-f6c3bbff9f20-kube-api-access-zdnkv" (OuterVolumeSpecName: "kube-api-access-zdnkv") pod "c962d24a-8656-44bd-acfe-f6c3bbff9f20" (UID: "c962d24a-8656-44bd-acfe-f6c3bbff9f20"). InnerVolumeSpecName "kube-api-access-zdnkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:45:14.076551 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.076536    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c962d24a-8656-44bd-acfe-f6c3bbff9f20-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c962d24a-8656-44bd-acfe-f6c3bbff9f20" (UID: "c962d24a-8656-44bd-acfe-f6c3bbff9f20"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:45:14.076903 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.076885    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08c95479-6158-4a9c-87e9-355644b0fca3-kube-api-access-gqcd7" (OuterVolumeSpecName: "kube-api-access-gqcd7") pod "08c95479-6158-4a9c-87e9-355644b0fca3" (UID: "08c95479-6158-4a9c-87e9-355644b0fca3"). InnerVolumeSpecName "kube-api-access-gqcd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:45:14.076903 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.076882    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c962d24a-8656-44bd-acfe-f6c3bbff9f20-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c962d24a-8656-44bd-acfe-f6c3bbff9f20" (UID: "c962d24a-8656-44bd-acfe-f6c3bbff9f20"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:45:14.175336 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.175233    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdnkv\" (UniqueName: \"kubernetes.io/projected/c962d24a-8656-44bd-acfe-f6c3bbff9f20-kube-api-access-zdnkv\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:45:14.175336 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.175267    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c962d24a-8656-44bd-acfe-f6c3bbff9f20-metrics-certs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:45:14.175336 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.175281    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08c95479-6158-4a9c-87e9-355644b0fca3-plugins-config-volume\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:45:14.175336 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.175293    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqcd7\" (UniqueName: \"kubernetes.io/projected/08c95479-6158-4a9c-87e9-355644b0fca3-kube-api-access-gqcd7\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:45:14.175336 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.175305    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c962d24a-8656-44bd-acfe-f6c3bbff9f20-openshift-service-ca\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:45:14.175336 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.175316    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c962d24a-8656-44bd-acfe-f6c3bbff9f20-maas-api-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:45:14.202700 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.202665    2568 generic.go:356] "Generic (PLEG): container finished" podID="c962d24a-8656-44bd-acfe-f6c3bbff9f20" containerID="2ba881e8bce5ade2fb53098a7bf5fe217aaf6598cdd08e3d5b6454a93bdb2044" exitCode=0
Sep 06 19:45:14.202923 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.202711    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"
Sep 06 19:45:14.202923 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.202751    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd" event={"ID":"c962d24a-8656-44bd-acfe-f6c3bbff9f20","Type":"ContainerDied","Data":"2ba881e8bce5ade2fb53098a7bf5fe217aaf6598cdd08e3d5b6454a93bdb2044"}
Sep 06 19:45:14.202923 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.202828    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd" event={"ID":"c962d24a-8656-44bd-acfe-f6c3bbff9f20","Type":"ContainerDied","Data":"547a385029a08444d30f33a2fb5b52881a6f5af2740b94b6a5b5cdc9e9aa7250"}
Sep 06 19:45:14.202923 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.202860    2568 scope.go:117] "RemoveContainer" containerID="2ba881e8bce5ade2fb53098a7bf5fe217aaf6598cdd08e3d5b6454a93bdb2044"
Sep 06 19:45:14.204400 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.204377    2568 generic.go:356] "Generic (PLEG): container finished" podID="08c95479-6158-4a9c-87e9-355644b0fca3" containerID="d08f941f4ebba45f2c62c5c58e4354c12802e280dfc605d0f066223f7c74b70c" exitCode=0
Sep 06 19:45:14.204505 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.204411    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5" event={"ID":"08c95479-6158-4a9c-87e9-355644b0fca3","Type":"ContainerDied","Data":"d08f941f4ebba45f2c62c5c58e4354c12802e280dfc605d0f066223f7c74b70c"}
Sep 06 19:45:14.204505 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.204427    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5"
Sep 06 19:45:14.204505 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.204465    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5" event={"ID":"08c95479-6158-4a9c-87e9-355644b0fca3","Type":"ContainerDied","Data":"39875b968088da69821e6f5b5157b63fc1220fe8c05c56f04a621032439ad6ed"}
Sep 06 19:45:14.213495 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.213479    2568 scope.go:117] "RemoveContainer" containerID="2ba881e8bce5ade2fb53098a7bf5fe217aaf6598cdd08e3d5b6454a93bdb2044"
Sep 06 19:45:14.213829 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:45:14.213769    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ba881e8bce5ade2fb53098a7bf5fe217aaf6598cdd08e3d5b6454a93bdb2044\": container with ID starting with 2ba881e8bce5ade2fb53098a7bf5fe217aaf6598cdd08e3d5b6454a93bdb2044 not found: ID does not exist" containerID="2ba881e8bce5ade2fb53098a7bf5fe217aaf6598cdd08e3d5b6454a93bdb2044"
Sep 06 19:45:14.213945 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.213883    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ba881e8bce5ade2fb53098a7bf5fe217aaf6598cdd08e3d5b6454a93bdb2044"} err="failed to get container status \"2ba881e8bce5ade2fb53098a7bf5fe217aaf6598cdd08e3d5b6454a93bdb2044\": rpc error: code = NotFound desc = could not find container \"2ba881e8bce5ade2fb53098a7bf5fe217aaf6598cdd08e3d5b6454a93bdb2044\": container with ID starting with 2ba881e8bce5ade2fb53098a7bf5fe217aaf6598cdd08e3d5b6454a93bdb2044 not found: ID does not exist"
Sep 06 19:45:14.213945 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.213914    2568 scope.go:117] "RemoveContainer" containerID="d08f941f4ebba45f2c62c5c58e4354c12802e280dfc605d0f066223f7c74b70c"
Sep 06 19:45:14.221881 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.221858    2568 scope.go:117] "RemoveContainer" containerID="d08f941f4ebba45f2c62c5c58e4354c12802e280dfc605d0f066223f7c74b70c"
Sep 06 19:45:14.222223 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:45:14.222196    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d08f941f4ebba45f2c62c5c58e4354c12802e280dfc605d0f066223f7c74b70c\": container with ID starting with d08f941f4ebba45f2c62c5c58e4354c12802e280dfc605d0f066223f7c74b70c not found: ID does not exist" containerID="d08f941f4ebba45f2c62c5c58e4354c12802e280dfc605d0f066223f7c74b70c"
Sep 06 19:45:14.222328 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.222232    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d08f941f4ebba45f2c62c5c58e4354c12802e280dfc605d0f066223f7c74b70c"} err="failed to get container status \"d08f941f4ebba45f2c62c5c58e4354c12802e280dfc605d0f066223f7c74b70c\": rpc error: code = NotFound desc = could not find container \"d08f941f4ebba45f2c62c5c58e4354c12802e280dfc605d0f066223f7c74b70c\": container with ID starting with d08f941f4ebba45f2c62c5c58e4354c12802e280dfc605d0f066223f7c74b70c not found: ID does not exist"
Sep 06 19:45:14.224375 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.224354    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"]
Sep 06 19:45:14.228158 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.228138    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-838def-dff9fcdd5-lv6zd"]
Sep 06 19:45:14.237135 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.237116    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5"]
Sep 06 19:45:14.240953 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.240933    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-838def-6cc8cf64f-l4xt5"]
Sep 06 19:45:14.282025 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:14.281993    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:15.117869 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:15.117770    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08c95479-6158-4a9c-87e9-355644b0fca3" path="/var/lib/kubelet/pods/08c95479-6158-4a9c-87e9-355644b0fca3/volumes"
Sep 06 19:45:15.118220 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:15.118209    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c962d24a-8656-44bd-acfe-f6c3bbff9f20" path="/var/lib/kubelet/pods/c962d24a-8656-44bd-acfe-f6c3bbff9f20/volumes"
Sep 06 19:45:17.339610 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:17.339570    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:17.400167 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:17.400122    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:17.985638 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:17.985606    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:19.347019 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:19.346953    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:20.044637 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:20.044595    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:20.145540 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:20.145503    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:20.270318 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:20.270281    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:20.750975 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:20.750928    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:20.968467 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:20.968435    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:21.134326 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:21.134293    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:22.677326 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:22.677282    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:22.776900 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:22.776870    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:22.877905 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:22.877867    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:23.960280 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:23.960244    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:24.020592 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:24.020560    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:24.179191 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:24.179152    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:24.471699 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:24.471662    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:24.811183 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:24.811093    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:27.255978 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:27.255937    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:27.353741 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:27.353699    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:28.346974 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.346936    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"]
Sep 06 19:45:28.347461 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.347370    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c962d24a-8656-44bd-acfe-f6c3bbff9f20" containerName="maas-api"
Sep 06 19:45:28.347461 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.347382    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c962d24a-8656-44bd-acfe-f6c3bbff9f20" containerName="maas-api"
Sep 06 19:45:28.347461 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.347399    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08c95479-6158-4a9c-87e9-355644b0fca3" containerName="payload-processing"
Sep 06 19:45:28.347461 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.347405    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="08c95479-6158-4a9c-87e9-355644b0fca3" containerName="payload-processing"
Sep 06 19:45:28.347684 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.347498    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c962d24a-8656-44bd-acfe-f6c3bbff9f20" containerName="maas-api"
Sep 06 19:45:28.347684 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.347509    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="08c95479-6158-4a9c-87e9-355644b0fca3" containerName="payload-processing"
Sep 06 19:45:28.352250 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.352224    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"
Sep 06 19:45:28.354587 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.354565    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-eb3b3780-serving-cert\""
Sep 06 19:45:28.360750 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.360295    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"]
Sep 06 19:45:28.379352 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.379317    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:28.484066 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.484031    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:28.506905 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.506870    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cef8acaa-4cee-4a51-a536-7321c19cec22-metrics-certs\") pod \"maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g\" (UID: \"cef8acaa-4cee-4a51-a536-7321c19cec22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"
Sep 06 19:45:28.507071 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.506949    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cef8acaa-4cee-4a51-a536-7321c19cec22-maas-api-tls\") pod \"maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g\" (UID: \"cef8acaa-4cee-4a51-a536-7321c19cec22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"
Sep 06 19:45:28.507071 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.506976    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6wd8\" (UniqueName: \"kubernetes.io/projected/cef8acaa-4cee-4a51-a536-7321c19cec22-kube-api-access-j6wd8\") pod \"maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g\" (UID: \"cef8acaa-4cee-4a51-a536-7321c19cec22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"
Sep 06 19:45:28.507071 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.507003    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cef8acaa-4cee-4a51-a536-7321c19cec22-openshift-service-ca\") pod \"maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g\" (UID: \"cef8acaa-4cee-4a51-a536-7321c19cec22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"
Sep 06 19:45:28.607914 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.607813    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cef8acaa-4cee-4a51-a536-7321c19cec22-metrics-certs\") pod \"maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g\" (UID: \"cef8acaa-4cee-4a51-a536-7321c19cec22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"
Sep 06 19:45:28.607914 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.607871    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cef8acaa-4cee-4a51-a536-7321c19cec22-maas-api-tls\") pod \"maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g\" (UID: \"cef8acaa-4cee-4a51-a536-7321c19cec22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"
Sep 06 19:45:28.608162 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.608003    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6wd8\" (UniqueName: \"kubernetes.io/projected/cef8acaa-4cee-4a51-a536-7321c19cec22-kube-api-access-j6wd8\") pod \"maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g\" (UID: \"cef8acaa-4cee-4a51-a536-7321c19cec22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"
Sep 06 19:45:28.608162 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.608051    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cef8acaa-4cee-4a51-a536-7321c19cec22-openshift-service-ca\") pod \"maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g\" (UID: \"cef8acaa-4cee-4a51-a536-7321c19cec22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"
Sep 06 19:45:28.608762 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.608706    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cef8acaa-4cee-4a51-a536-7321c19cec22-openshift-service-ca\") pod \"maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g\" (UID: \"cef8acaa-4cee-4a51-a536-7321c19cec22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"
Sep 06 19:45:28.610548 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.610522    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cef8acaa-4cee-4a51-a536-7321c19cec22-metrics-certs\") pod \"maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g\" (UID: \"cef8acaa-4cee-4a51-a536-7321c19cec22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"
Sep 06 19:45:28.610644 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.610577    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cef8acaa-4cee-4a51-a536-7321c19cec22-maas-api-tls\") pod \"maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g\" (UID: \"cef8acaa-4cee-4a51-a536-7321c19cec22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"
Sep 06 19:45:28.615750 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.615728    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6wd8\" (UniqueName: \"kubernetes.io/projected/cef8acaa-4cee-4a51-a536-7321c19cec22-kube-api-access-j6wd8\") pod \"maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g\" (UID: \"cef8acaa-4cee-4a51-a536-7321c19cec22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"
Sep 06 19:45:28.628946 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.628921    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:28.665334 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.665301    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"
Sep 06 19:45:28.838860 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.838810    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:28.937499 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.937459    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:28.946184 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.946138    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"]
Sep 06 19:45:28.947988 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.947964    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n"]
Sep 06 19:45:28.949308 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:45:28.949283    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcef8acaa_4cee_4a51_a536_7321c19cec22.slice/crio-e605fc337d9e890d8fcca6bf0cd33fdb97f9386c01d0b72d02b96dfc8ee39d63 WatchSource:0}: Error finding container e605fc337d9e890d8fcca6bf0cd33fdb97f9386c01d0b72d02b96dfc8ee39d63: Status 404 returned error can't find the container with id e605fc337d9e890d8fcca6bf0cd33fdb97f9386c01d0b72d02b96dfc8ee39d63
Sep 06 19:45:28.952699 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.952680    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n"
Sep 06 19:45:28.955185 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.955164    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-eb3b3780\""
Sep 06 19:45:28.955276 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.955210    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-eb3b3780-dockercfg-mxbxb\""
Sep 06 19:45:28.964154 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.964133    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n"]
Sep 06 19:45:28.988503 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.988464    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh"]
Sep 06 19:45:28.992679 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:28.992651    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh"
Sep 06 19:45:29.000790 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:29.000748    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh"]
Sep 06 19:45:29.113176 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:29.113145    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95c9e945-b018-49cc-98b1-10737e5247bd-plugins-config-volume\") pod \"payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh\" (UID: \"95c9e945-b018-49cc-98b1-10737e5247bd\") " pod="openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh"
Sep 06 19:45:29.113367 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:29.113199    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmknt\" (UniqueName: \"kubernetes.io/projected/95c9e945-b018-49cc-98b1-10737e5247bd-kube-api-access-pmknt\") pod \"payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh\" (UID: \"95c9e945-b018-49cc-98b1-10737e5247bd\") " pod="openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh"
Sep 06 19:45:29.113367 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:29.113274    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc62272d-5d0e-4585-887c-08ae8994c3b9-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n\" (UID: \"bc62272d-5d0e-4585-887c-08ae8994c3b9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n"
Sep 06 19:45:29.113367 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:29.113324    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwbkd\" (UniqueName: \"kubernetes.io/projected/bc62272d-5d0e-4585-887c-08ae8994c3b9-kube-api-access-zwbkd\") pod \"payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n\" (UID: \"bc62272d-5d0e-4585-887c-08ae8994c3b9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n"
Sep 06 19:45:29.214525 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:29.214439    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwbkd\" (UniqueName: \"kubernetes.io/projected/bc62272d-5d0e-4585-887c-08ae8994c3b9-kube-api-access-zwbkd\") pod \"payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n\" (UID: \"bc62272d-5d0e-4585-887c-08ae8994c3b9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n"
Sep 06 19:45:29.214525 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:29.214494    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95c9e945-b018-49cc-98b1-10737e5247bd-plugins-config-volume\") pod \"payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh\" (UID: \"95c9e945-b018-49cc-98b1-10737e5247bd\") " pod="openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh"
Sep 06 19:45:29.214762 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:29.214536    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmknt\" (UniqueName: \"kubernetes.io/projected/95c9e945-b018-49cc-98b1-10737e5247bd-kube-api-access-pmknt\") pod \"payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh\" (UID: \"95c9e945-b018-49cc-98b1-10737e5247bd\") " pod="openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh"
Sep 06 19:45:29.214762 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:29.214585    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc62272d-5d0e-4585-887c-08ae8994c3b9-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n\" (UID: \"bc62272d-5d0e-4585-887c-08ae8994c3b9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n"
Sep 06 19:45:29.215328 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:29.215305    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc62272d-5d0e-4585-887c-08ae8994c3b9-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n\" (UID: \"bc62272d-5d0e-4585-887c-08ae8994c3b9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n"
Sep 06 19:45:29.215370 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:29.215333    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95c9e945-b018-49cc-98b1-10737e5247bd-plugins-config-volume\") pod \"payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh\" (UID: \"95c9e945-b018-49cc-98b1-10737e5247bd\") " pod="openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh"
Sep 06 19:45:29.222165 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:29.222134    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwbkd\" (UniqueName: \"kubernetes.io/projected/bc62272d-5d0e-4585-887c-08ae8994c3b9-kube-api-access-zwbkd\") pod \"payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n\" (UID: \"bc62272d-5d0e-4585-887c-08ae8994c3b9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n"
Sep 06 19:45:29.222165 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:29.222152    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmknt\" (UniqueName: \"kubernetes.io/projected/95c9e945-b018-49cc-98b1-10737e5247bd-kube-api-access-pmknt\") pod \"payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh\" (UID: \"95c9e945-b018-49cc-98b1-10737e5247bd\") " pod="openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh"
Sep 06 19:45:29.267269 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:29.267250    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n"
Sep 06 19:45:29.293356 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:29.293328    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g" event={"ID":"cef8acaa-4cee-4a51-a536-7321c19cec22","Type":"ContainerStarted","Data":"e605fc337d9e890d8fcca6bf0cd33fdb97f9386c01d0b72d02b96dfc8ee39d63"}
Sep 06 19:45:29.305830 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:29.305772    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh"
Sep 06 19:45:29.551151 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:29.551118    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n"]
Sep 06 19:45:29.553144 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:45:29.553117    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc62272d_5d0e_4585_887c_08ae8994c3b9.slice/crio-688b9e5cd52abed92f087fdf8f57747bdab09bcfa90fd608db28c7b6bc84327f WatchSource:0}: Error finding container 688b9e5cd52abed92f087fdf8f57747bdab09bcfa90fd608db28c7b6bc84327f: Status 404 returned error can't find the container with id 688b9e5cd52abed92f087fdf8f57747bdab09bcfa90fd608db28c7b6bc84327f
Sep 06 19:45:29.594958 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:29.594932    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh"]
Sep 06 19:45:29.598222 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:45:29.598196    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95c9e945_b018_49cc_98b1_10737e5247bd.slice/crio-ad096defc35dafb6a7b8b28663d7f22b992e170110ccb9fad0ad5544804c8102 WatchSource:0}: Error finding container ad096defc35dafb6a7b8b28663d7f22b992e170110ccb9fad0ad5544804c8102: Status 404 returned error can't find the container with id ad096defc35dafb6a7b8b28663d7f22b992e170110ccb9fad0ad5544804c8102
Sep 06 19:45:30.301505 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:30.301462    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n" event={"ID":"bc62272d-5d0e-4585-887c-08ae8994c3b9","Type":"ContainerStarted","Data":"90a66d988cf042d163b264017b6408137484a83194d7605d5e5855f7a3c45b95"}
Sep 06 19:45:30.301731 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:30.301534    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n" event={"ID":"bc62272d-5d0e-4585-887c-08ae8994c3b9","Type":"ContainerStarted","Data":"688b9e5cd52abed92f087fdf8f57747bdab09bcfa90fd608db28c7b6bc84327f"}
Sep 06 19:45:30.301731 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:30.301566    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n"
Sep 06 19:45:30.303265 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:30.303242    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g" event={"ID":"cef8acaa-4cee-4a51-a536-7321c19cec22","Type":"ContainerStarted","Data":"2b23fc39b4ceff1ff464080d9f7be8d980b6cf4acf49015e2b4965e3c1a2eb92"}
Sep 06 19:45:30.303406 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:30.303289    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"
Sep 06 19:45:30.305001 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:30.304972    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh" event={"ID":"95c9e945-b018-49cc-98b1-10737e5247bd","Type":"ContainerStarted","Data":"32ace1e0f15834b97b12c3670936037acb84f6b493fb84581de84d5317e8800c"}
Sep 06 19:45:30.305132 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:30.305017    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh" event={"ID":"95c9e945-b018-49cc-98b1-10737e5247bd","Type":"ContainerStarted","Data":"ad096defc35dafb6a7b8b28663d7f22b992e170110ccb9fad0ad5544804c8102"}
Sep 06 19:45:30.305132 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:30.305079    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh"
Sep 06 19:45:30.317209 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:30.317149    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n" podStartSLOduration=2.317127425 podStartE2EDuration="2.317127425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:45:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:45:30.314874402 +0000 UTC m=+1093.719833473" watchObservedRunningTime="2026-09-06 19:45:30.317127425 +0000 UTC m=+1093.722086497"
Sep 06 19:45:30.329954 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:30.329906    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh" podStartSLOduration=2.329890996 podStartE2EDuration="2.329890996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:45:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:45:30.328921344 +0000 UTC m=+1093.733880416" watchObservedRunningTime="2026-09-06 19:45:30.329890996 +0000 UTC m=+1093.734850064"
Sep 06 19:45:30.345356 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:30.345315    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g" podStartSLOduration=2.035445736 podStartE2EDuration="2.345300775s" totalImagesPullingTime="309.855039ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:45:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:45:30.343107853 +0000 UTC m=+1093.748066924" watchObservedRunningTime="2026-09-06 19:45:30.345300775 +0000 UTC m=+1093.750259843"
Sep 06 19:45:36.316077 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:36.316047    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"
Sep 06 19:45:41.312359 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:41.312319    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n"
Sep 06 19:45:41.312848 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:41.312404    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh"
Sep 06 19:45:47.571190 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:47.571149    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:49.648357 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:49.648326    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:50.643461 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:50.643423    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:50.750575 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:50.750530    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:50.959960 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:50.959876    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:51.068076 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:51.068039    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:51.949272 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:51.949216    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:52.153706 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:52.153664    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:52.259904 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:52.259745    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:52.778857 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:52.778828    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:52.878722 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:52.878682    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:53.196666 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:53.196622    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:56.089273 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:56.089236    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:59.007974 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:59.007936    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:59.108332 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:59.108293    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:45:59.550591 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:45:59.550554    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:02.158202 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:02.158146    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:02.718417 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:02.718368    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"]
Sep 06 19:46:02.718953 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:02.718921    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww" podUID="771ddfb7-7f35-4c2e-a994-58eb4d7262ca" containerName="maas-api" containerID="cri-o://551ea58a9d01c0369867ea46093a1c1fcffac7aec27f58c7742effc27dcf5711" gracePeriod=30
Sep 06 19:46:02.748896 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:02.748861    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:02.771357 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:02.771320    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8"]
Sep 06 19:46:02.771630 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:02.771599    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8" podUID="90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd" containerName="payload-processing" containerID="cri-o://8673d915e0eb3039fa7af17a8f85bc4d516fc633dee4e6b7fda136427db4bcbc" gracePeriod=30
Sep 06 19:46:02.850051 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:02.850012    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:02.874094 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:02.874048    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww" podUID="771ddfb7-7f35-4c2e-a994-58eb4d7262ca" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.46:8443/health\": dial tcp 10.133.0.46:8443: connect: connection refused"
Sep 06 19:46:02.925512 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:02.925476    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:02.985935 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:02.985844    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:03.026826 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.026797    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"
Sep 06 19:46:03.062754 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.062729    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8"
Sep 06 19:46:03.125914 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.125881    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7rhq\" (UniqueName: \"kubernetes.io/projected/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-kube-api-access-b7rhq\") pod \"771ddfb7-7f35-4c2e-a994-58eb4d7262ca\" (UID: \"771ddfb7-7f35-4c2e-a994-58eb4d7262ca\") "
Sep 06 19:46:03.126081 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.125924    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-openshift-service-ca\") pod \"771ddfb7-7f35-4c2e-a994-58eb4d7262ca\" (UID: \"771ddfb7-7f35-4c2e-a994-58eb4d7262ca\") "
Sep 06 19:46:03.126081 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.125940    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmpzr\" (UniqueName: \"kubernetes.io/projected/90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd-kube-api-access-hmpzr\") pod \"90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd\" (UID: \"90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd\") "
Sep 06 19:46:03.126081 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.125971    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-metrics-certs\") pod \"771ddfb7-7f35-4c2e-a994-58eb4d7262ca\" (UID: \"771ddfb7-7f35-4c2e-a994-58eb4d7262ca\") "
Sep 06 19:46:03.126081 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.126018    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd-plugins-config-volume\") pod \"90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd\" (UID: \"90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd\") "
Sep 06 19:46:03.126081 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.126070    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-maas-api-tls\") pod \"771ddfb7-7f35-4c2e-a994-58eb4d7262ca\" (UID: \"771ddfb7-7f35-4c2e-a994-58eb4d7262ca\") "
Sep 06 19:46:03.126383 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.126318    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "771ddfb7-7f35-4c2e-a994-58eb4d7262ca" (UID: "771ddfb7-7f35-4c2e-a994-58eb4d7262ca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:46:03.126463 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.126400    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd" (UID: "90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:46:03.128399 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.128371    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-kube-api-access-b7rhq" (OuterVolumeSpecName: "kube-api-access-b7rhq") pod "771ddfb7-7f35-4c2e-a994-58eb4d7262ca" (UID: "771ddfb7-7f35-4c2e-a994-58eb4d7262ca"). InnerVolumeSpecName "kube-api-access-b7rhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:46:03.128399 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.128378    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd-kube-api-access-hmpzr" (OuterVolumeSpecName: "kube-api-access-hmpzr") pod "90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd" (UID: "90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd"). InnerVolumeSpecName "kube-api-access-hmpzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:46:03.128399 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.128384    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "771ddfb7-7f35-4c2e-a994-58eb4d7262ca" (UID: "771ddfb7-7f35-4c2e-a994-58eb4d7262ca"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:46:03.128598 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.128414    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "771ddfb7-7f35-4c2e-a994-58eb4d7262ca" (UID: "771ddfb7-7f35-4c2e-a994-58eb4d7262ca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:46:03.227654 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.227569    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-metrics-certs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:46:03.227654 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.227601    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd-plugins-config-volume\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:46:03.227654 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.227612    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-maas-api-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:46:03.227654 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.227621    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7rhq\" (UniqueName: \"kubernetes.io/projected/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-kube-api-access-b7rhq\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:46:03.227654 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.227629    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/771ddfb7-7f35-4c2e-a994-58eb4d7262ca-openshift-service-ca\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:46:03.227654 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.227638    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmpzr\" (UniqueName: \"kubernetes.io/projected/90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd-kube-api-access-hmpzr\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:46:03.296956 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.296913    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:03.494325 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.494228    2568 generic.go:356] "Generic (PLEG): container finished" podID="771ddfb7-7f35-4c2e-a994-58eb4d7262ca" containerID="551ea58a9d01c0369867ea46093a1c1fcffac7aec27f58c7742effc27dcf5711" exitCode=0
Sep 06 19:46:03.494325 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.494291    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"
Sep 06 19:46:03.494539 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.494312    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww" event={"ID":"771ddfb7-7f35-4c2e-a994-58eb4d7262ca","Type":"ContainerDied","Data":"551ea58a9d01c0369867ea46093a1c1fcffac7aec27f58c7742effc27dcf5711"}
Sep 06 19:46:03.494539 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.494416    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww" event={"ID":"771ddfb7-7f35-4c2e-a994-58eb4d7262ca","Type":"ContainerDied","Data":"f6d18e1c9e52327f2a7272f71c49a10df81e52a2e5b221ca8046f816bc23fdfa"}
Sep 06 19:46:03.494539 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.494451    2568 scope.go:117] "RemoveContainer" containerID="551ea58a9d01c0369867ea46093a1c1fcffac7aec27f58c7742effc27dcf5711"
Sep 06 19:46:03.496405 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.496365    2568 generic.go:356] "Generic (PLEG): container finished" podID="90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd" containerID="8673d915e0eb3039fa7af17a8f85bc4d516fc633dee4e6b7fda136427db4bcbc" exitCode=0
Sep 06 19:46:03.496548 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.496428    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8"
Sep 06 19:46:03.496548 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.496431    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8" event={"ID":"90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd","Type":"ContainerDied","Data":"8673d915e0eb3039fa7af17a8f85bc4d516fc633dee4e6b7fda136427db4bcbc"}
Sep 06 19:46:03.496548 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.496490    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8" event={"ID":"90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd","Type":"ContainerDied","Data":"9be1e94223474b9273c9f26c46a03aa30f3998d8e191942d7ecf960227765d94"}
Sep 06 19:46:03.505944 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.505915    2568 scope.go:117] "RemoveContainer" containerID="551ea58a9d01c0369867ea46093a1c1fcffac7aec27f58c7742effc27dcf5711"
Sep 06 19:46:03.506378 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:46:03.506348    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"551ea58a9d01c0369867ea46093a1c1fcffac7aec27f58c7742effc27dcf5711\": container with ID starting with 551ea58a9d01c0369867ea46093a1c1fcffac7aec27f58c7742effc27dcf5711 not found: ID does not exist" containerID="551ea58a9d01c0369867ea46093a1c1fcffac7aec27f58c7742effc27dcf5711"
Sep 06 19:46:03.506504 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.506388    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"551ea58a9d01c0369867ea46093a1c1fcffac7aec27f58c7742effc27dcf5711"} err="failed to get container status \"551ea58a9d01c0369867ea46093a1c1fcffac7aec27f58c7742effc27dcf5711\": rpc error: code = NotFound desc = could not find container \"551ea58a9d01c0369867ea46093a1c1fcffac7aec27f58c7742effc27dcf5711\": container with ID starting with 551ea58a9d01c0369867ea46093a1c1fcffac7aec27f58c7742effc27dcf5711 not found: ID does not exist"
Sep 06 19:46:03.506504 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.506414    2568 scope.go:117] "RemoveContainer" containerID="8673d915e0eb3039fa7af17a8f85bc4d516fc633dee4e6b7fda136427db4bcbc"
Sep 06 19:46:03.515535 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.515518    2568 scope.go:117] "RemoveContainer" containerID="8673d915e0eb3039fa7af17a8f85bc4d516fc633dee4e6b7fda136427db4bcbc"
Sep 06 19:46:03.515883 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:46:03.515864    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8673d915e0eb3039fa7af17a8f85bc4d516fc633dee4e6b7fda136427db4bcbc\": container with ID starting with 8673d915e0eb3039fa7af17a8f85bc4d516fc633dee4e6b7fda136427db4bcbc not found: ID does not exist" containerID="8673d915e0eb3039fa7af17a8f85bc4d516fc633dee4e6b7fda136427db4bcbc"
Sep 06 19:46:03.515942 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.515891    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8673d915e0eb3039fa7af17a8f85bc4d516fc633dee4e6b7fda136427db4bcbc"} err="failed to get container status \"8673d915e0eb3039fa7af17a8f85bc4d516fc633dee4e6b7fda136427db4bcbc\": rpc error: code = NotFound desc = could not find container \"8673d915e0eb3039fa7af17a8f85bc4d516fc633dee4e6b7fda136427db4bcbc\": container with ID starting with 8673d915e0eb3039fa7af17a8f85bc4d516fc633dee4e6b7fda136427db4bcbc not found: ID does not exist"
Sep 06 19:46:03.526873 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.526840    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"]
Sep 06 19:46:03.530635 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.530607    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6433a6-6dc9cfccd7-5jkww"]
Sep 06 19:46:03.539876 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.539852    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8"]
Sep 06 19:46:03.543828 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:03.543804    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6433a6-58cdb44d79-t24k8"]
Sep 06 19:46:05.116146 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:05.116108    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="771ddfb7-7f35-4c2e-a994-58eb4d7262ca" path="/var/lib/kubelet/pods/771ddfb7-7f35-4c2e-a994-58eb4d7262ca/volumes"
Sep 06 19:46:05.116675 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:05.116636    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd" path="/var/lib/kubelet/pods/90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd/volumes"
Sep 06 19:46:09.093104 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:09.093063    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:09.149380 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:09.149342    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:09.335167 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:09.335132    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:09.468181 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:09.468140    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:10.260065 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:10.260005    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:10.757930 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:10.757893    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"]
Sep 06 19:46:10.758465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:10.758426    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g" podUID="cef8acaa-4cee-4a51-a536-7321c19cec22" containerName="maas-api" containerID="cri-o://2b23fc39b4ceff1ff464080d9f7be8d980b6cf4acf49015e2b4965e3c1a2eb92" gracePeriod=30
Sep 06 19:46:10.785188 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:10.785142    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:10.806520 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:10.806489    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh"]
Sep 06 19:46:10.806723 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:10.806690    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh" podUID="95c9e945-b018-49cc-98b1-10737e5247bd" containerName="payload-processing" containerID="cri-o://32ace1e0f15834b97b12c3670936037acb84f6b493fb84581de84d5317e8800c" gracePeriod=30
Sep 06 19:46:10.814570 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:10.814544    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n"]
Sep 06 19:46:10.814814 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:10.814769    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n" podUID="bc62272d-5d0e-4585-887c-08ae8994c3b9" containerName="payload-pre-processing" containerID="cri-o://90a66d988cf042d163b264017b6408137484a83194d7605d5e5855f7a3c45b95" gracePeriod=30
Sep 06 19:46:10.844913 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:10.844881    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:10.899585 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:10.899550    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:10.953396 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:10.953349    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:11.008747 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.008669    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:11.088808 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.088744    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh"
Sep 06 19:46:11.125210 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.125163    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"
Sep 06 19:46:11.128606 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.128582    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n"
Sep 06 19:46:11.200339 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.200304    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cef8acaa-4cee-4a51-a536-7321c19cec22-metrics-certs\") pod \"cef8acaa-4cee-4a51-a536-7321c19cec22\" (UID: \"cef8acaa-4cee-4a51-a536-7321c19cec22\") "
Sep 06 19:46:11.200504 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.200372    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6wd8\" (UniqueName: \"kubernetes.io/projected/cef8acaa-4cee-4a51-a536-7321c19cec22-kube-api-access-j6wd8\") pod \"cef8acaa-4cee-4a51-a536-7321c19cec22\" (UID: \"cef8acaa-4cee-4a51-a536-7321c19cec22\") "
Sep 06 19:46:11.200504 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.200395    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwbkd\" (UniqueName: \"kubernetes.io/projected/bc62272d-5d0e-4585-887c-08ae8994c3b9-kube-api-access-zwbkd\") pod \"bc62272d-5d0e-4585-887c-08ae8994c3b9\" (UID: \"bc62272d-5d0e-4585-887c-08ae8994c3b9\") "
Sep 06 19:46:11.200504 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.200435    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc62272d-5d0e-4585-887c-08ae8994c3b9-plugins-config-volume\") pod \"bc62272d-5d0e-4585-887c-08ae8994c3b9\" (UID: \"bc62272d-5d0e-4585-887c-08ae8994c3b9\") "
Sep 06 19:46:11.200504 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.200458    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95c9e945-b018-49cc-98b1-10737e5247bd-plugins-config-volume\") pod \"95c9e945-b018-49cc-98b1-10737e5247bd\" (UID: \"95c9e945-b018-49cc-98b1-10737e5247bd\") "
Sep 06 19:46:11.200742 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.200516    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cef8acaa-4cee-4a51-a536-7321c19cec22-openshift-service-ca\") pod \"cef8acaa-4cee-4a51-a536-7321c19cec22\" (UID: \"cef8acaa-4cee-4a51-a536-7321c19cec22\") "
Sep 06 19:46:11.200742 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.200579    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmknt\" (UniqueName: \"kubernetes.io/projected/95c9e945-b018-49cc-98b1-10737e5247bd-kube-api-access-pmknt\") pod \"95c9e945-b018-49cc-98b1-10737e5247bd\" (UID: \"95c9e945-b018-49cc-98b1-10737e5247bd\") "
Sep 06 19:46:11.200742 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.200610    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cef8acaa-4cee-4a51-a536-7321c19cec22-maas-api-tls\") pod \"cef8acaa-4cee-4a51-a536-7321c19cec22\" (UID: \"cef8acaa-4cee-4a51-a536-7321c19cec22\") "
Sep 06 19:46:11.201176 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.200959    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95c9e945-b018-49cc-98b1-10737e5247bd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "95c9e945-b018-49cc-98b1-10737e5247bd" (UID: "95c9e945-b018-49cc-98b1-10737e5247bd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:46:11.201176 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.201107    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc62272d-5d0e-4585-887c-08ae8994c3b9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bc62272d-5d0e-4585-887c-08ae8994c3b9" (UID: "bc62272d-5d0e-4585-887c-08ae8994c3b9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:46:11.201375 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.201279    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cef8acaa-4cee-4a51-a536-7321c19cec22-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cef8acaa-4cee-4a51-a536-7321c19cec22" (UID: "cef8acaa-4cee-4a51-a536-7321c19cec22"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:46:11.203133 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.203109    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cef8acaa-4cee-4a51-a536-7321c19cec22-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cef8acaa-4cee-4a51-a536-7321c19cec22" (UID: "cef8acaa-4cee-4a51-a536-7321c19cec22"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:46:11.203275 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.203257    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95c9e945-b018-49cc-98b1-10737e5247bd-kube-api-access-pmknt" (OuterVolumeSpecName: "kube-api-access-pmknt") pod "95c9e945-b018-49cc-98b1-10737e5247bd" (UID: "95c9e945-b018-49cc-98b1-10737e5247bd"). InnerVolumeSpecName "kube-api-access-pmknt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:46:11.203351 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.203315    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cef8acaa-4cee-4a51-a536-7321c19cec22-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cef8acaa-4cee-4a51-a536-7321c19cec22" (UID: "cef8acaa-4cee-4a51-a536-7321c19cec22"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:46:11.203394 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.203372    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc62272d-5d0e-4585-887c-08ae8994c3b9-kube-api-access-zwbkd" (OuterVolumeSpecName: "kube-api-access-zwbkd") pod "bc62272d-5d0e-4585-887c-08ae8994c3b9" (UID: "bc62272d-5d0e-4585-887c-08ae8994c3b9"). InnerVolumeSpecName "kube-api-access-zwbkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:46:11.203427 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.203388    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cef8acaa-4cee-4a51-a536-7321c19cec22-kube-api-access-j6wd8" (OuterVolumeSpecName: "kube-api-access-j6wd8") pod "cef8acaa-4cee-4a51-a536-7321c19cec22" (UID: "cef8acaa-4cee-4a51-a536-7321c19cec22"). InnerVolumeSpecName "kube-api-access-j6wd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:46:11.301446 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.301363    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc62272d-5d0e-4585-887c-08ae8994c3b9-plugins-config-volume\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:46:11.301446 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.301397    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95c9e945-b018-49cc-98b1-10737e5247bd-plugins-config-volume\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:46:11.301446 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.301412    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cef8acaa-4cee-4a51-a536-7321c19cec22-openshift-service-ca\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:46:11.301446 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.301422    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmknt\" (UniqueName: \"kubernetes.io/projected/95c9e945-b018-49cc-98b1-10737e5247bd-kube-api-access-pmknt\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:46:11.301446 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.301437    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cef8acaa-4cee-4a51-a536-7321c19cec22-maas-api-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:46:11.301446 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.301434    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:11.301994 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.301451    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cef8acaa-4cee-4a51-a536-7321c19cec22-metrics-certs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:46:11.301994 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.301488    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6wd8\" (UniqueName: \"kubernetes.io/projected/cef8acaa-4cee-4a51-a536-7321c19cec22-kube-api-access-j6wd8\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:46:11.301994 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.301500    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwbkd\" (UniqueName: \"kubernetes.io/projected/bc62272d-5d0e-4585-887c-08ae8994c3b9-kube-api-access-zwbkd\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:46:11.545738 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.545704    2568 generic.go:356] "Generic (PLEG): container finished" podID="bc62272d-5d0e-4585-887c-08ae8994c3b9" containerID="90a66d988cf042d163b264017b6408137484a83194d7605d5e5855f7a3c45b95" exitCode=0
Sep 06 19:46:11.545738 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.545744    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n"
Sep 06 19:46:11.545999 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.545819    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n" event={"ID":"bc62272d-5d0e-4585-887c-08ae8994c3b9","Type":"ContainerDied","Data":"90a66d988cf042d163b264017b6408137484a83194d7605d5e5855f7a3c45b95"}
Sep 06 19:46:11.545999 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.545878    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n" event={"ID":"bc62272d-5d0e-4585-887c-08ae8994c3b9","Type":"ContainerDied","Data":"688b9e5cd52abed92f087fdf8f57747bdab09bcfa90fd608db28c7b6bc84327f"}
Sep 06 19:46:11.545999 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.545910    2568 scope.go:117] "RemoveContainer" containerID="90a66d988cf042d163b264017b6408137484a83194d7605d5e5855f7a3c45b95"
Sep 06 19:46:11.547256 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.547233    2568 generic.go:356] "Generic (PLEG): container finished" podID="cef8acaa-4cee-4a51-a536-7321c19cec22" containerID="2b23fc39b4ceff1ff464080d9f7be8d980b6cf4acf49015e2b4965e3c1a2eb92" exitCode=0
Sep 06 19:46:11.547381 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.547264    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g" event={"ID":"cef8acaa-4cee-4a51-a536-7321c19cec22","Type":"ContainerDied","Data":"2b23fc39b4ceff1ff464080d9f7be8d980b6cf4acf49015e2b4965e3c1a2eb92"}
Sep 06 19:46:11.547381 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.547284    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"
Sep 06 19:46:11.547381 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.547320    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g" event={"ID":"cef8acaa-4cee-4a51-a536-7321c19cec22","Type":"ContainerDied","Data":"e605fc337d9e890d8fcca6bf0cd33fdb97f9386c01d0b72d02b96dfc8ee39d63"}
Sep 06 19:46:11.548715 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.548695    2568 generic.go:356] "Generic (PLEG): container finished" podID="95c9e945-b018-49cc-98b1-10737e5247bd" containerID="32ace1e0f15834b97b12c3670936037acb84f6b493fb84581de84d5317e8800c" exitCode=0
Sep 06 19:46:11.548846 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.548731    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh"
Sep 06 19:46:11.548846 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.548807    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh" event={"ID":"95c9e945-b018-49cc-98b1-10737e5247bd","Type":"ContainerDied","Data":"32ace1e0f15834b97b12c3670936037acb84f6b493fb84581de84d5317e8800c"}
Sep 06 19:46:11.548932 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.548857    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh" event={"ID":"95c9e945-b018-49cc-98b1-10737e5247bd","Type":"ContainerDied","Data":"ad096defc35dafb6a7b8b28663d7f22b992e170110ccb9fad0ad5544804c8102"}
Sep 06 19:46:11.564042 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.564019    2568 scope.go:117] "RemoveContainer" containerID="90a66d988cf042d163b264017b6408137484a83194d7605d5e5855f7a3c45b95"
Sep 06 19:46:11.564511 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:46:11.564485    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90a66d988cf042d163b264017b6408137484a83194d7605d5e5855f7a3c45b95\": container with ID starting with 90a66d988cf042d163b264017b6408137484a83194d7605d5e5855f7a3c45b95 not found: ID does not exist" containerID="90a66d988cf042d163b264017b6408137484a83194d7605d5e5855f7a3c45b95"
Sep 06 19:46:11.564621 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.564525    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90a66d988cf042d163b264017b6408137484a83194d7605d5e5855f7a3c45b95"} err="failed to get container status \"90a66d988cf042d163b264017b6408137484a83194d7605d5e5855f7a3c45b95\": rpc error: code = NotFound desc = could not find container \"90a66d988cf042d163b264017b6408137484a83194d7605d5e5855f7a3c45b95\": container with ID starting with 90a66d988cf042d163b264017b6408137484a83194d7605d5e5855f7a3c45b95 not found: ID does not exist"
Sep 06 19:46:11.564621 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.564550    2568 scope.go:117] "RemoveContainer" containerID="2b23fc39b4ceff1ff464080d9f7be8d980b6cf4acf49015e2b4965e3c1a2eb92"
Sep 06 19:46:11.573902 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.573877    2568 scope.go:117] "RemoveContainer" containerID="2b23fc39b4ceff1ff464080d9f7be8d980b6cf4acf49015e2b4965e3c1a2eb92"
Sep 06 19:46:11.574264 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:46:11.574238    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b23fc39b4ceff1ff464080d9f7be8d980b6cf4acf49015e2b4965e3c1a2eb92\": container with ID starting with 2b23fc39b4ceff1ff464080d9f7be8d980b6cf4acf49015e2b4965e3c1a2eb92 not found: ID does not exist" containerID="2b23fc39b4ceff1ff464080d9f7be8d980b6cf4acf49015e2b4965e3c1a2eb92"
Sep 06 19:46:11.574342 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.574274    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b23fc39b4ceff1ff464080d9f7be8d980b6cf4acf49015e2b4965e3c1a2eb92"} err="failed to get container status \"2b23fc39b4ceff1ff464080d9f7be8d980b6cf4acf49015e2b4965e3c1a2eb92\": rpc error: code = NotFound desc = could not find container \"2b23fc39b4ceff1ff464080d9f7be8d980b6cf4acf49015e2b4965e3c1a2eb92\": container with ID starting with 2b23fc39b4ceff1ff464080d9f7be8d980b6cf4acf49015e2b4965e3c1a2eb92 not found: ID does not exist"
Sep 06 19:46:11.574342 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.574294    2568 scope.go:117] "RemoveContainer" containerID="32ace1e0f15834b97b12c3670936037acb84f6b493fb84581de84d5317e8800c"
Sep 06 19:46:11.575145 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.575117    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"]
Sep 06 19:46:11.579980 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.579954    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-eb3b3780-5cdfc7946b-xc92g"]
Sep 06 19:46:11.583500 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.583483    2568 scope.go:117] "RemoveContainer" containerID="32ace1e0f15834b97b12c3670936037acb84f6b493fb84581de84d5317e8800c"
Sep 06 19:46:11.583762 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:46:11.583746    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32ace1e0f15834b97b12c3670936037acb84f6b493fb84581de84d5317e8800c\": container with ID starting with 32ace1e0f15834b97b12c3670936037acb84f6b493fb84581de84d5317e8800c not found: ID does not exist" containerID="32ace1e0f15834b97b12c3670936037acb84f6b493fb84581de84d5317e8800c"
Sep 06 19:46:11.583882 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.583768    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32ace1e0f15834b97b12c3670936037acb84f6b493fb84581de84d5317e8800c"} err="failed to get container status \"32ace1e0f15834b97b12c3670936037acb84f6b493fb84581de84d5317e8800c\": rpc error: code = NotFound desc = could not find container \"32ace1e0f15834b97b12c3670936037acb84f6b493fb84581de84d5317e8800c\": container with ID starting with 32ace1e0f15834b97b12c3670936037acb84f6b493fb84581de84d5317e8800c not found: ID does not exist"
Sep 06 19:46:11.588660 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.588638    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh"]
Sep 06 19:46:11.591429 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.591405    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-eb3b3780-5c8887d957-759rh"]
Sep 06 19:46:11.601792 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.601745    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n"]
Sep 06 19:46:11.605212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:11.605178    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-eb3b3780-55bd69dcc4-5bx4n"]
Sep 06 19:46:12.535238 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:12.535205    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:12.635743 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:12.635701    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:13.117559 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:13.117524    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95c9e945-b018-49cc-98b1-10737e5247bd" path="/var/lib/kubelet/pods/95c9e945-b018-49cc-98b1-10737e5247bd/volumes"
Sep 06 19:46:13.117901 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:13.117886    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc62272d-5d0e-4585-887c-08ae8994c3b9" path="/var/lib/kubelet/pods/bc62272d-5d0e-4585-887c-08ae8994c3b9/volumes"
Sep 06 19:46:13.118222 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:13.118210    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cef8acaa-4cee-4a51-a536-7321c19cec22" path="/var/lib/kubelet/pods/cef8acaa-4cee-4a51-a536-7321c19cec22/volumes"
Sep 06 19:46:16.919930 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:16.919890    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:17.021171 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:17.021137    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:17.176291 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:17.176203    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:17.501050 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:17.500929    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:17.605502 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:17.605468    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:17.702583 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:17.702542    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:20.000824 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.000772    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"]
Sep 06 19:46:20.001608 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.001575    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4" podUID="2fd5a435-07da-44d3-9f78-6a6e1a827a98" containerName="maas-api" containerID="cri-o://d9c3e44650177885451a93b4abc24c35e4b39152d8b68c1014512ae4f8c21f4d" gracePeriod=30
Sep 06 19:46:20.027556 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.027513    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:20.067099 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:46:20.067058    2568 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd5a435_07da_44d3_9f78_6a6e1a827a98.slice/crio-conmon-d9c3e44650177885451a93b4abc24c35e4b39152d8b68c1014512ae4f8c21f4d.scope\": RecentStats: unable to find data in memory cache]"
Sep 06 19:46:20.095341 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.095294    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:20.194906 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.194830    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:20.248417 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.248384    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:20.260425 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.260358    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"
Sep 06 19:46:20.384706 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.384666    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd5a435-07da-44d3-9f78-6a6e1a827a98-openshift-service-ca\") pod \"2fd5a435-07da-44d3-9f78-6a6e1a827a98\" (UID: \"2fd5a435-07da-44d3-9f78-6a6e1a827a98\") "
Sep 06 19:46:20.384909 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.384718    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcv5g\" (UniqueName: \"kubernetes.io/projected/2fd5a435-07da-44d3-9f78-6a6e1a827a98-kube-api-access-gcv5g\") pod \"2fd5a435-07da-44d3-9f78-6a6e1a827a98\" (UID: \"2fd5a435-07da-44d3-9f78-6a6e1a827a98\") "
Sep 06 19:46:20.384909 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.384788    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fd5a435-07da-44d3-9f78-6a6e1a827a98-maas-api-tls\") pod \"2fd5a435-07da-44d3-9f78-6a6e1a827a98\" (UID: \"2fd5a435-07da-44d3-9f78-6a6e1a827a98\") "
Sep 06 19:46:20.384909 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.384807    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fd5a435-07da-44d3-9f78-6a6e1a827a98-metrics-certs\") pod \"2fd5a435-07da-44d3-9f78-6a6e1a827a98\" (UID: \"2fd5a435-07da-44d3-9f78-6a6e1a827a98\") "
Sep 06 19:46:20.385110 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.385080    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fd5a435-07da-44d3-9f78-6a6e1a827a98-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2fd5a435-07da-44d3-9f78-6a6e1a827a98" (UID: "2fd5a435-07da-44d3-9f78-6a6e1a827a98"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:46:20.387204 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.387154    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fd5a435-07da-44d3-9f78-6a6e1a827a98-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2fd5a435-07da-44d3-9f78-6a6e1a827a98" (UID: "2fd5a435-07da-44d3-9f78-6a6e1a827a98"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:46:20.387204 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.387166    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fd5a435-07da-44d3-9f78-6a6e1a827a98-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2fd5a435-07da-44d3-9f78-6a6e1a827a98" (UID: "2fd5a435-07da-44d3-9f78-6a6e1a827a98"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:46:20.387348 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.387216    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fd5a435-07da-44d3-9f78-6a6e1a827a98-kube-api-access-gcv5g" (OuterVolumeSpecName: "kube-api-access-gcv5g") pod "2fd5a435-07da-44d3-9f78-6a6e1a827a98" (UID: "2fd5a435-07da-44d3-9f78-6a6e1a827a98"). InnerVolumeSpecName "kube-api-access-gcv5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:46:20.485645 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.485591    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcv5g\" (UniqueName: \"kubernetes.io/projected/2fd5a435-07da-44d3-9f78-6a6e1a827a98-kube-api-access-gcv5g\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:46:20.485645 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.485636    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fd5a435-07da-44d3-9f78-6a6e1a827a98-maas-api-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:46:20.485645 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.485648    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fd5a435-07da-44d3-9f78-6a6e1a827a98-metrics-certs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:46:20.485645 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.485656    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd5a435-07da-44d3-9f78-6a6e1a827a98-openshift-service-ca\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:46:20.534702 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.534624    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:20.598212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.598179    2568 generic.go:356] "Generic (PLEG): container finished" podID="2fd5a435-07da-44d3-9f78-6a6e1a827a98" containerID="d9c3e44650177885451a93b4abc24c35e4b39152d8b68c1014512ae4f8c21f4d" exitCode=0
Sep 06 19:46:20.598391 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.598228    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"
Sep 06 19:46:20.598391 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.598252    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4" event={"ID":"2fd5a435-07da-44d3-9f78-6a6e1a827a98","Type":"ContainerDied","Data":"d9c3e44650177885451a93b4abc24c35e4b39152d8b68c1014512ae4f8c21f4d"}
Sep 06 19:46:20.598391 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.598293    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4" event={"ID":"2fd5a435-07da-44d3-9f78-6a6e1a827a98","Type":"ContainerDied","Data":"ae7709d46c97219d31deafeaed5763a498b6ebcfc87b5cb495097515630631c7"}
Sep 06 19:46:20.598391 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.598314    2568 scope.go:117] "RemoveContainer" containerID="d9c3e44650177885451a93b4abc24c35e4b39152d8b68c1014512ae4f8c21f4d"
Sep 06 19:46:20.608462 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.608442    2568 scope.go:117] "RemoveContainer" containerID="d9c3e44650177885451a93b4abc24c35e4b39152d8b68c1014512ae4f8c21f4d"
Sep 06 19:46:20.608803 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:46:20.608760    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9c3e44650177885451a93b4abc24c35e4b39152d8b68c1014512ae4f8c21f4d\": container with ID starting with d9c3e44650177885451a93b4abc24c35e4b39152d8b68c1014512ae4f8c21f4d not found: ID does not exist" containerID="d9c3e44650177885451a93b4abc24c35e4b39152d8b68c1014512ae4f8c21f4d"
Sep 06 19:46:20.608919 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.608811    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9c3e44650177885451a93b4abc24c35e4b39152d8b68c1014512ae4f8c21f4d"} err="failed to get container status \"d9c3e44650177885451a93b4abc24c35e4b39152d8b68c1014512ae4f8c21f4d\": rpc error: code = NotFound desc = could not find container \"d9c3e44650177885451a93b4abc24c35e4b39152d8b68c1014512ae4f8c21f4d\": container with ID starting with d9c3e44650177885451a93b4abc24c35e4b39152d8b68c1014512ae4f8c21f4d not found: ID does not exist"
Sep 06 19:46:20.620711 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.620681    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"]
Sep 06 19:46:20.623961 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:20.623938    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d5bb2d-78bb95df44-cdpr4"]
Sep 06 19:46:21.116307 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:21.116272    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fd5a435-07da-44d3-9f78-6a6e1a827a98" path="/var/lib/kubelet/pods/2fd5a435-07da-44d3-9f78-6a6e1a827a98/volumes"
Sep 06 19:46:23.388243 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:23.388205    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:23.444231 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:23.444188    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:23.516996 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:23.516961    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:23.614278 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:23.614223    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:23.720673 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:23.720574    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:26.223024 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:26.222986    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:26.322930 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:26.322895    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:26.476527 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:26.476443    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:26.999896 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:26.999861    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:27.480981 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:27.480945    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:27.581590 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:27.581555    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:29.505977 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:29.505938    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:29.608354 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:29.608315    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:30.347764 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:30.347725    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:30.707842 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:30.707800    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:30.799456 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:30.799397    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:31.055590 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.055501    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:31.940356 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.940322    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"]
Sep 06 19:46:31.940953 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.940933    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95c9e945-b018-49cc-98b1-10737e5247bd" containerName="payload-processing"
Sep 06 19:46:31.941010 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.940958    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="95c9e945-b018-49cc-98b1-10737e5247bd" containerName="payload-processing"
Sep 06 19:46:31.941010 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.940986    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd" containerName="payload-processing"
Sep 06 19:46:31.941010 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.940994    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd" containerName="payload-processing"
Sep 06 19:46:31.941010 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.941004    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd5a435-07da-44d3-9f78-6a6e1a827a98" containerName="maas-api"
Sep 06 19:46:31.941139 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.941012    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd5a435-07da-44d3-9f78-6a6e1a827a98" containerName="maas-api"
Sep 06 19:46:31.941139 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.941025    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cef8acaa-4cee-4a51-a536-7321c19cec22" containerName="maas-api"
Sep 06 19:46:31.941139 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.941033    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cef8acaa-4cee-4a51-a536-7321c19cec22" containerName="maas-api"
Sep 06 19:46:31.941139 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.941042    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc62272d-5d0e-4585-887c-08ae8994c3b9" containerName="payload-pre-processing"
Sep 06 19:46:31.941139 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.941050    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc62272d-5d0e-4585-887c-08ae8994c3b9" containerName="payload-pre-processing"
Sep 06 19:46:31.941139 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.941067    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="771ddfb7-7f35-4c2e-a994-58eb4d7262ca" containerName="maas-api"
Sep 06 19:46:31.941139 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.941074    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="771ddfb7-7f35-4c2e-a994-58eb4d7262ca" containerName="maas-api"
Sep 06 19:46:31.941577 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.941185    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fd5a435-07da-44d3-9f78-6a6e1a827a98" containerName="maas-api"
Sep 06 19:46:31.941577 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.941197    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc62272d-5d0e-4585-887c-08ae8994c3b9" containerName="payload-pre-processing"
Sep 06 19:46:31.941577 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.941214    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cef8acaa-4cee-4a51-a536-7321c19cec22" containerName="maas-api"
Sep 06 19:46:31.941577 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.941223    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="771ddfb7-7f35-4c2e-a994-58eb4d7262ca" containerName="maas-api"
Sep 06 19:46:31.941577 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.941232    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="95c9e945-b018-49cc-98b1-10737e5247bd" containerName="payload-processing"
Sep 06 19:46:31.941577 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.941241    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="90b4fd34-ebb0-41f6-ad4b-3960ff62c7cd" containerName="payload-processing"
Sep 06 19:46:31.946212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.946189    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"
Sep 06 19:46:31.948829 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.948807    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-b571c4-serving-cert\""
Sep 06 19:46:31.955142 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.955115    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"]
Sep 06 19:46:31.972150 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.972118    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:31.981288 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.981259    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f\" (UID: \"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"
Sep 06 19:46:31.981443 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.981292    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfmbl\" (UniqueName: \"kubernetes.io/projected/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-kube-api-access-qfmbl\") pod \"maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f\" (UID: \"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"
Sep 06 19:46:31.981443 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.981320    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f\" (UID: \"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"
Sep 06 19:46:31.981443 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:31.981385    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f\" (UID: \"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"
Sep 06 19:46:32.031425 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.031388    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:32.082205 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.082165    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f\" (UID: \"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"
Sep 06 19:46:32.082407 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.082239    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f\" (UID: \"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"
Sep 06 19:46:32.082407 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.082261    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfmbl\" (UniqueName: \"kubernetes.io/projected/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-kube-api-access-qfmbl\") pod \"maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f\" (UID: \"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"
Sep 06 19:46:32.082407 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.082285    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f\" (UID: \"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"
Sep 06 19:46:32.082407 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:46:32.082389    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-serving-cert: secret "maas-api-e2e-shared-a-w3-b571c4-serving-cert" not found
Sep 06 19:46:32.082636 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:46:32.082449    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-maas-api-tls podName:38d7f13e-7ef0-41d9-ab80-ac79a7f85a69 nodeName:}" failed. No retries permitted until 2026-09-06 19:46:32.582432536 +0000 UTC m=+1155.987391583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-maas-api-tls") pod "maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f" (UID: "38d7f13e-7ef0-41d9-ab80-ac79a7f85a69") : secret "maas-api-e2e-shared-a-w3-b571c4-serving-cert" not found
Sep 06 19:46:32.083080 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.083053    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f\" (UID: \"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"
Sep 06 19:46:32.084719 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.084698    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f\" (UID: \"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"
Sep 06 19:46:32.091713 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.091665    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfmbl\" (UniqueName: \"kubernetes.io/projected/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-kube-api-access-qfmbl\") pod \"maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f\" (UID: \"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"
Sep 06 19:46:32.410586 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.410552    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:32.513807 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.513757    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76"]
Sep 06 19:46:32.516183 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.516152    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:32.517546 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.517530    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76"
Sep 06 19:46:32.521593 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.521570    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-b571c4-dockercfg-fv4n5\""
Sep 06 19:46:32.521593 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.521587    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-b571c4\""
Sep 06 19:46:32.529433 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.529411    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76"]
Sep 06 19:46:32.554445 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.554413    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd"]
Sep 06 19:46:32.557848 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.557832    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd"
Sep 06 19:46:32.567550 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.567519    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd"]
Sep 06 19:46:32.585398 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.585368    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbvzr\" (UniqueName: \"kubernetes.io/projected/815430f6-7d8d-4ea1-8146-c29135b5c131-kube-api-access-fbvzr\") pod \"payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76\" (UID: \"815430f6-7d8d-4ea1-8146-c29135b5c131\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76"
Sep 06 19:46:32.585563 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.585412    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7f55c96-0eff-45dc-bcfb-0395dbd92fc1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd\" (UID: \"b7f55c96-0eff-45dc-bcfb-0395dbd92fc1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd"
Sep 06 19:46:32.585563 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.585464    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/815430f6-7d8d-4ea1-8146-c29135b5c131-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76\" (UID: \"815430f6-7d8d-4ea1-8146-c29135b5c131\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76"
Sep 06 19:46:32.585563 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.585516    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p4gg\" (UniqueName: \"kubernetes.io/projected/b7f55c96-0eff-45dc-bcfb-0395dbd92fc1-kube-api-access-5p4gg\") pod \"payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd\" (UID: \"b7f55c96-0eff-45dc-bcfb-0395dbd92fc1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd"
Sep 06 19:46:32.585695 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.585574    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f\" (UID: \"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"
Sep 06 19:46:32.588522 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.588496    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f\" (UID: \"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"
Sep 06 19:46:32.592328 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.592288    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:32.686385 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.686291    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/815430f6-7d8d-4ea1-8146-c29135b5c131-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76\" (UID: \"815430f6-7d8d-4ea1-8146-c29135b5c131\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76"
Sep 06 19:46:32.686385 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.686363    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p4gg\" (UniqueName: \"kubernetes.io/projected/b7f55c96-0eff-45dc-bcfb-0395dbd92fc1-kube-api-access-5p4gg\") pod \"payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd\" (UID: \"b7f55c96-0eff-45dc-bcfb-0395dbd92fc1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd"
Sep 06 19:46:32.686634 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.686455    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbvzr\" (UniqueName: \"kubernetes.io/projected/815430f6-7d8d-4ea1-8146-c29135b5c131-kube-api-access-fbvzr\") pod \"payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76\" (UID: \"815430f6-7d8d-4ea1-8146-c29135b5c131\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76"
Sep 06 19:46:32.686634 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.686492    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7f55c96-0eff-45dc-bcfb-0395dbd92fc1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd\" (UID: \"b7f55c96-0eff-45dc-bcfb-0395dbd92fc1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd"
Sep 06 19:46:32.687144 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.687115    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/815430f6-7d8d-4ea1-8146-c29135b5c131-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76\" (UID: \"815430f6-7d8d-4ea1-8146-c29135b5c131\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76"
Sep 06 19:46:32.687350 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.687327    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7f55c96-0eff-45dc-bcfb-0395dbd92fc1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd\" (UID: \"b7f55c96-0eff-45dc-bcfb-0395dbd92fc1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd"
Sep 06 19:46:32.694351 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.694327    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p4gg\" (UniqueName: \"kubernetes.io/projected/b7f55c96-0eff-45dc-bcfb-0395dbd92fc1-kube-api-access-5p4gg\") pod \"payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd\" (UID: \"b7f55c96-0eff-45dc-bcfb-0395dbd92fc1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd"
Sep 06 19:46:32.694464 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.694444    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbvzr\" (UniqueName: \"kubernetes.io/projected/815430f6-7d8d-4ea1-8146-c29135b5c131-kube-api-access-fbvzr\") pod \"payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76\" (UID: \"815430f6-7d8d-4ea1-8146-c29135b5c131\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76"
Sep 06 19:46:32.829740 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.829699    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76"
Sep 06 19:46:32.860115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.860080    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"
Sep 06 19:46:32.869699 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:32.869676    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd"
Sep 06 19:46:33.115895 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:46:33.115852    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod815430f6_7d8d_4ea1_8146_c29135b5c131.slice/crio-def4a4aeb42c8355e3cb210a0ac13d378bd60e5d88854a4fea477487a67d89b5 WatchSource:0}: Error finding container def4a4aeb42c8355e3cb210a0ac13d378bd60e5d88854a4fea477487a67d89b5: Status 404 returned error can't find the container with id def4a4aeb42c8355e3cb210a0ac13d378bd60e5d88854a4fea477487a67d89b5
Sep 06 19:46:33.118343 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:33.118318    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76"]
Sep 06 19:46:33.153624 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:33.153524    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"]
Sep 06 19:46:33.157996 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:46:33.157964    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d7f13e_7ef0_41d9_ab80_ac79a7f85a69.slice/crio-f1a1fb1b474c0881b73845b31b300ae226ac626cc96c064f95e954d71703f7b2 WatchSource:0}: Error finding container f1a1fb1b474c0881b73845b31b300ae226ac626cc96c064f95e954d71703f7b2: Status 404 returned error can't find the container with id f1a1fb1b474c0881b73845b31b300ae226ac626cc96c064f95e954d71703f7b2
Sep 06 19:46:33.164198 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:33.164173    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd"]
Sep 06 19:46:33.167114 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:46:33.167089    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7f55c96_0eff_45dc_bcfb_0395dbd92fc1.slice/crio-14054694a0129712b38b6e21cc1e398ec96c66d4b5762456c915197d1261c407 WatchSource:0}: Error finding container 14054694a0129712b38b6e21cc1e398ec96c66d4b5762456c915197d1261c407: Status 404 returned error can't find the container with id 14054694a0129712b38b6e21cc1e398ec96c66d4b5762456c915197d1261c407
Sep 06 19:46:33.581254 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:33.581219    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:33.673245 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:33.673211    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f" event={"ID":"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69","Type":"ContainerStarted","Data":"4f095bdd9f2c7472e143bfad6de906003850045edd03d302ae9170bfa911aaab"}
Sep 06 19:46:33.673456 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:33.673262    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f" event={"ID":"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69","Type":"ContainerStarted","Data":"f1a1fb1b474c0881b73845b31b300ae226ac626cc96c064f95e954d71703f7b2"}
Sep 06 19:46:33.673456 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:33.673415    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"
Sep 06 19:46:33.675044 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:33.675016    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd" event={"ID":"b7f55c96-0eff-45dc-bcfb-0395dbd92fc1","Type":"ContainerStarted","Data":"91f854471c085e9b7c55679767684a2a33a7e373c9c9a05e5119b15582f259c7"}
Sep 06 19:46:33.675196 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:33.675069    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd" event={"ID":"b7f55c96-0eff-45dc-bcfb-0395dbd92fc1","Type":"ContainerStarted","Data":"14054694a0129712b38b6e21cc1e398ec96c66d4b5762456c915197d1261c407"}
Sep 06 19:46:33.675196 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:33.675101    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd"
Sep 06 19:46:33.676748 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:33.676724    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76" event={"ID":"815430f6-7d8d-4ea1-8146-c29135b5c131","Type":"ContainerStarted","Data":"e73aa2e7bc848a29a85fcd76a7df234b1b0f5932ed2cf3f4f9bae3c13d4e144b"}
Sep 06 19:46:33.676875 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:33.676769    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76" event={"ID":"815430f6-7d8d-4ea1-8146-c29135b5c131","Type":"ContainerStarted","Data":"def4a4aeb42c8355e3cb210a0ac13d378bd60e5d88854a4fea477487a67d89b5"}
Sep 06 19:46:33.676875 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:33.676868    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76"
Sep 06 19:46:33.706547 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:33.706487    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd" podStartSLOduration=1.706466488 podStartE2EDuration="1.706466488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:46:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:46:33.706032162 +0000 UTC m=+1157.110991231" watchObservedRunningTime="2026-09-06 19:46:33.706466488 +0000 UTC m=+1157.111425558"
Sep 06 19:46:33.708078 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:33.708027    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f" podStartSLOduration=2.3467965729999998 podStartE2EDuration="2.708014186s" totalImagesPullingTime="361.217613ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:46:33.691220812 +0000 UTC m=+1157.096179884" watchObservedRunningTime="2026-09-06 19:46:33.708014186 +0000 UTC m=+1157.112973298"
Sep 06 19:46:33.723006 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:33.722939    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76" podStartSLOduration=1.7229191130000001 podStartE2EDuration="1.722919113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:46:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:46:33.72095414 +0000 UTC m=+1157.125913210" watchObservedRunningTime="2026-09-06 19:46:33.722919113 +0000 UTC m=+1157.127878230"
Sep 06 19:46:33.915509 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:33.915465    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:33.967215 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:33.967172    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:35.036429 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:35.036394    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"]
Sep 06 19:46:35.040481 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:35.040453    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"
Sep 06 19:46:35.043349 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:35.043312    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-b12ed2-serving-cert\""
Sep 06 19:46:35.052815 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:35.052758    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"]
Sep 06 19:46:35.070964 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:35.070931    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:35.111162 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:35.111130    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzlvv\" (UniqueName: \"kubernetes.io/projected/50facaa1-6c1d-4e35-bfec-971a9d14b185-kube-api-access-tzlvv\") pod \"maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc\" (UID: \"50facaa1-6c1d-4e35-bfec-971a9d14b185\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"
Sep 06 19:46:35.111162 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:35.111178    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50facaa1-6c1d-4e35-bfec-971a9d14b185-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc\" (UID: \"50facaa1-6c1d-4e35-bfec-971a9d14b185\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"
Sep 06 19:46:35.111405 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:35.111236    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50facaa1-6c1d-4e35-bfec-971a9d14b185-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc\" (UID: \"50facaa1-6c1d-4e35-bfec-971a9d14b185\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"
Sep 06 19:46:35.111405 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:35.111276    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50facaa1-6c1d-4e35-bfec-971a9d14b185-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc\" (UID: \"50facaa1-6c1d-4e35-bfec-971a9d14b185\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"
Sep 06 19:46:35.156044 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:35.156002    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:35.212461 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:35.212424    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50facaa1-6c1d-4e35-bfec-971a9d14b185-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc\" (UID: \"50facaa1-6c1d-4e35-bfec-971a9d14b185\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"
Sep 06 19:46:35.212612 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:35.212473    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50facaa1-6c1d-4e35-bfec-971a9d14b185-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc\" (UID: \"50facaa1-6c1d-4e35-bfec-971a9d14b185\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"
Sep 06 19:46:35.212612 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:35.212514    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50facaa1-6c1d-4e35-bfec-971a9d14b185-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc\" (UID: \"50facaa1-6c1d-4e35-bfec-971a9d14b185\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"
Sep 06 19:46:35.212612 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:35.212595    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzlvv\" (UniqueName: \"kubernetes.io/projected/50facaa1-6c1d-4e35-bfec-971a9d14b185-kube-api-access-tzlvv\") pod \"maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc\" (UID: \"50facaa1-6c1d-4e35-bfec-971a9d14b185\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"
Sep 06 19:46:35.212757 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:46:35.212610    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-serving-cert: secret "maas-api-e2e-shared-a-w2-b12ed2-serving-cert" not found
Sep 06 19:46:35.212757 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:46:35.212675    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50facaa1-6c1d-4e35-bfec-971a9d14b185-maas-api-tls podName:50facaa1-6c1d-4e35-bfec-971a9d14b185 nodeName:}" failed. No retries permitted until 2026-09-06 19:46:35.712654577 +0000 UTC m=+1159.117613644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/50facaa1-6c1d-4e35-bfec-971a9d14b185-maas-api-tls") pod "maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc" (UID: "50facaa1-6c1d-4e35-bfec-971a9d14b185") : secret "maas-api-e2e-shared-a-w2-b12ed2-serving-cert" not found
Sep 06 19:46:35.213213 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:35.213182    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50facaa1-6c1d-4e35-bfec-971a9d14b185-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc\" (UID: \"50facaa1-6c1d-4e35-bfec-971a9d14b185\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"
Sep 06 19:46:35.215176 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:35.215159    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50facaa1-6c1d-4e35-bfec-971a9d14b185-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc\" (UID: \"50facaa1-6c1d-4e35-bfec-971a9d14b185\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"
Sep 06 19:46:35.222461 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:35.222441    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzlvv\" (UniqueName: \"kubernetes.io/projected/50facaa1-6c1d-4e35-bfec-971a9d14b185-kube-api-access-tzlvv\") pod \"maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc\" (UID: \"50facaa1-6c1d-4e35-bfec-971a9d14b185\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"
Sep 06 19:46:35.362070 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:35.361960    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:35.639811 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:35.639733    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:35.717117 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:35.717082    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50facaa1-6c1d-4e35-bfec-971a9d14b185-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc\" (UID: \"50facaa1-6c1d-4e35-bfec-971a9d14b185\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"
Sep 06 19:46:35.719816 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:35.719763    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50facaa1-6c1d-4e35-bfec-971a9d14b185-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc\" (UID: \"50facaa1-6c1d-4e35-bfec-971a9d14b185\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"
Sep 06 19:46:35.740319 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:35.740266    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:35.955974 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:35.955871    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"
Sep 06 19:46:36.231625 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:36.231600    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"]
Sep 06 19:46:36.234137 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:46:36.234110    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50facaa1_6c1d_4e35_bfec_971a9d14b185.slice/crio-2a64afb03ef78b726645d47bd1d380a288b51da5228312c3963916a86672e985 WatchSource:0}: Error finding container 2a64afb03ef78b726645d47bd1d380a288b51da5228312c3963916a86672e985: Status 404 returned error can't find the container with id 2a64afb03ef78b726645d47bd1d380a288b51da5228312c3963916a86672e985
Sep 06 19:46:36.696281 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:36.696246    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc" event={"ID":"50facaa1-6c1d-4e35-bfec-971a9d14b185","Type":"ContainerStarted","Data":"19620ddead54622d48cf121328fecf687510a1d8ed99af6b53c6f2b7c862e546"}
Sep 06 19:46:36.696467 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:36.696303    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc" event={"ID":"50facaa1-6c1d-4e35-bfec-971a9d14b185","Type":"ContainerStarted","Data":"2a64afb03ef78b726645d47bd1d380a288b51da5228312c3963916a86672e985"}
Sep 06 19:46:36.696467 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:36.696339    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"
Sep 06 19:46:36.711448 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:36.711384    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc" podStartSLOduration=1.3705842750000001 podStartE2EDuration="1.711366436s" totalImagesPullingTime="340.782161ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:46:36.710457409 +0000 UTC m=+1160.115416503" watchObservedRunningTime="2026-09-06 19:46:36.711366436 +0000 UTC m=+1160.116325505"
Sep 06 19:46:39.687660 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:39.687576    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"
Sep 06 19:46:42.709061 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:42.709027    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"
Sep 06 19:46:44.683722 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:44.683691    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76"
Sep 06 19:46:44.684156 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:44.683760    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd"
Sep 06 19:46:52.769368 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:52.769311    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:55.563033 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:55.562992    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:55.887292 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:55.887238    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:55.996274 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:55.996212    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:56.197038 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:56.196949    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:56.368837 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:56.368801    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:58.691410 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:58.691375    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:58.793368 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:58.793316    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:58.892271 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:58.892234    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:59.025280 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:59.025173    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:59.320832 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:59.320708    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:59.630911 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:59.630877    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:46:59.925724 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:59.925644    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"]
Sep 06 19:46:59.929453 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:59.929427    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"
Sep 06 19:46:59.932206 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:59.932186    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-712616-serving-cert\""
Sep 06 19:46:59.944378 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:59.944339    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"]
Sep 06 19:46:59.971935 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:46:59.971905    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:00.030030 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:00.029994    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cb91197-5432-411b-9967-3e3a0b4e958d-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7\" (UID: \"5cb91197-5432-411b-9967-3e3a0b4e958d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"
Sep 06 19:47:00.030202 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:00.030057    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cb91197-5432-411b-9967-3e3a0b4e958d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7\" (UID: \"5cb91197-5432-411b-9967-3e3a0b4e958d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"
Sep 06 19:47:00.030202 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:00.030110    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cb91197-5432-411b-9967-3e3a0b4e958d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7\" (UID: \"5cb91197-5432-411b-9967-3e3a0b4e958d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"
Sep 06 19:47:00.030202 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:00.030150    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjrlm\" (UniqueName: \"kubernetes.io/projected/5cb91197-5432-411b-9967-3e3a0b4e958d-kube-api-access-gjrlm\") pod \"maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7\" (UID: \"5cb91197-5432-411b-9967-3e3a0b4e958d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"
Sep 06 19:47:00.072382 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:00.072342    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:00.130851 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:00.130806    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cb91197-5432-411b-9967-3e3a0b4e958d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7\" (UID: \"5cb91197-5432-411b-9967-3e3a0b4e958d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"
Sep 06 19:47:00.131049 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:00.130860    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjrlm\" (UniqueName: \"kubernetes.io/projected/5cb91197-5432-411b-9967-3e3a0b4e958d-kube-api-access-gjrlm\") pod \"maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7\" (UID: \"5cb91197-5432-411b-9967-3e3a0b4e958d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"
Sep 06 19:47:00.131049 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:00.130904    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cb91197-5432-411b-9967-3e3a0b4e958d-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7\" (UID: \"5cb91197-5432-411b-9967-3e3a0b4e958d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"
Sep 06 19:47:00.131049 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:00.130940    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cb91197-5432-411b-9967-3e3a0b4e958d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7\" (UID: \"5cb91197-5432-411b-9967-3e3a0b4e958d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"
Sep 06 19:47:00.131455 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:00.131432    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cb91197-5432-411b-9967-3e3a0b4e958d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7\" (UID: \"5cb91197-5432-411b-9967-3e3a0b4e958d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"
Sep 06 19:47:00.133512 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:00.133490    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cb91197-5432-411b-9967-3e3a0b4e958d-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7\" (UID: \"5cb91197-5432-411b-9967-3e3a0b4e958d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"
Sep 06 19:47:00.133598 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:00.133523    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cb91197-5432-411b-9967-3e3a0b4e958d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7\" (UID: \"5cb91197-5432-411b-9967-3e3a0b4e958d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"
Sep 06 19:47:00.138319 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:00.138292    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjrlm\" (UniqueName: \"kubernetes.io/projected/5cb91197-5432-411b-9967-3e3a0b4e958d-kube-api-access-gjrlm\") pod \"maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7\" (UID: \"5cb91197-5432-411b-9967-3e3a0b4e958d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"
Sep 06 19:47:00.167395 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:00.167358    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:00.240830 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:00.240724    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"
Sep 06 19:47:00.433600 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:00.433561    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:00.519947 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:00.519904    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"]
Sep 06 19:47:00.521269 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:00.521238    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:00.522201 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:47:00.522176    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cb91197_5432_411b_9967_3e3a0b4e958d.slice/crio-f27ae6d648b549ffbbe989ca02b2077de60f51916e2f810153d6a2be7865b0e0 WatchSource:0}: Error finding container f27ae6d648b549ffbbe989ca02b2077de60f51916e2f810153d6a2be7865b0e0: Status 404 returned error can't find the container with id f27ae6d648b549ffbbe989ca02b2077de60f51916e2f810153d6a2be7865b0e0
Sep 06 19:47:00.828829 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:00.828710    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7" event={"ID":"5cb91197-5432-411b-9967-3e3a0b4e958d","Type":"ContainerStarted","Data":"f27ae6d648b549ffbbe989ca02b2077de60f51916e2f810153d6a2be7865b0e0"}
Sep 06 19:47:01.836078 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:01.836031    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7" event={"ID":"5cb91197-5432-411b-9967-3e3a0b4e958d","Type":"ContainerStarted","Data":"937c177321f3dc35f54e15a63669029546fb47b7e1b087c0a0fb1f4f35d6fb5a"}
Sep 06 19:47:01.836510 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:01.836237    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"
Sep 06 19:47:01.851430 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:01.851376    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7" podStartSLOduration=2.461140779 podStartE2EDuration="2.851359873s" totalImagesPullingTime="390.219094ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:47:01.850951829 +0000 UTC m=+1185.255910924" watchObservedRunningTime="2026-09-06 19:47:01.851359873 +0000 UTC m=+1185.256318944"
Sep 06 19:47:02.795607 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:02.795569    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:02.895382 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:02.895333    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:03.968712 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:03.968664    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:04.024912 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:04.024878    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:04.244553 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:04.244459    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:04.408808 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:04.408732    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:04.505974 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:04.505883    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:04.713346 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:04.713304    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8"]
Sep 06 19:47:04.718250 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:04.718225    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8"
Sep 06 19:47:04.720849 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:04.720824    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-6ddeb5-dockercfg-bkq2g\""
Sep 06 19:47:04.721026 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:04.721005    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-6ddeb5\""
Sep 06 19:47:04.729857 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:04.729833    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8"]
Sep 06 19:47:04.779031 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:04.778934    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cfc8f596-9e7c-4f98-84ce-e2b6df598f39-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8\" (UID: \"cfc8f596-9e7c-4f98-84ce-e2b6df598f39\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8"
Sep 06 19:47:04.779031 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:04.778971    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkp8b\" (UniqueName: \"kubernetes.io/projected/cfc8f596-9e7c-4f98-84ce-e2b6df598f39-kube-api-access-fkp8b\") pod \"payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8\" (UID: \"cfc8f596-9e7c-4f98-84ce-e2b6df598f39\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8"
Sep 06 19:47:04.879954 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:04.879918    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cfc8f596-9e7c-4f98-84ce-e2b6df598f39-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8\" (UID: \"cfc8f596-9e7c-4f98-84ce-e2b6df598f39\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8"
Sep 06 19:47:04.879954 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:04.879953    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkp8b\" (UniqueName: \"kubernetes.io/projected/cfc8f596-9e7c-4f98-84ce-e2b6df598f39-kube-api-access-fkp8b\") pod \"payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8\" (UID: \"cfc8f596-9e7c-4f98-84ce-e2b6df598f39\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8"
Sep 06 19:47:04.880635 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:04.880612    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cfc8f596-9e7c-4f98-84ce-e2b6df598f39-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8\" (UID: \"cfc8f596-9e7c-4f98-84ce-e2b6df598f39\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8"
Sep 06 19:47:04.887520 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:04.887495    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkp8b\" (UniqueName: \"kubernetes.io/projected/cfc8f596-9e7c-4f98-84ce-e2b6df598f39-kube-api-access-fkp8b\") pod \"payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8\" (UID: \"cfc8f596-9e7c-4f98-84ce-e2b6df598f39\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8"
Sep 06 19:47:05.030132 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:05.030053    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8"
Sep 06 19:47:05.307119 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:05.306978    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8"]
Sep 06 19:47:05.309408 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:47:05.309369    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfc8f596_9e7c_4f98_84ce_e2b6df598f39.slice/crio-07bf3ab2699f82dc31fdbefaa09c55806cedb9cb24d2b27aac5dda240674db83 WatchSource:0}: Error finding container 07bf3ab2699f82dc31fdbefaa09c55806cedb9cb24d2b27aac5dda240674db83: Status 404 returned error can't find the container with id 07bf3ab2699f82dc31fdbefaa09c55806cedb9cb24d2b27aac5dda240674db83
Sep 06 19:47:05.860836 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:05.860796    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8" event={"ID":"cfc8f596-9e7c-4f98-84ce-e2b6df598f39","Type":"ContainerStarted","Data":"33277e8b97c87ed38484725c3526ee6df93783430af171448dcb54ff805ff601"}
Sep 06 19:47:05.861030 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:05.860855    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8" event={"ID":"cfc8f596-9e7c-4f98-84ce-e2b6df598f39","Type":"ContainerStarted","Data":"07bf3ab2699f82dc31fdbefaa09c55806cedb9cb24d2b27aac5dda240674db83"}
Sep 06 19:47:05.861030 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:05.860877    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8"
Sep 06 19:47:05.877039 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:05.876985    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8" podStartSLOduration=1.8769668529999999 podStartE2EDuration="1.876966853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:47:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:47:05.874857985 +0000 UTC m=+1189.279817053" watchObservedRunningTime="2026-09-06 19:47:05.876966853 +0000 UTC m=+1189.281925922"
Sep 06 19:47:07.846617 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:07.846587    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"
Sep 06 19:47:16.868282 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:16.868250    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8"
Sep 06 19:47:20.880137 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:20.880094    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:23.698620 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:23.698579    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:24.987251 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:24.987208    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:27.717792 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:27.717743    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:31.034345 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:31.034306    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:40.991596 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:40.991545    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:41.271622 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:41.271502    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:41.936291 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:41.936253    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:44.118090 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:44.118046    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:44.220513 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:44.220479    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:45.279091 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:45.279056    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:45.379013 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:45.378958    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:45.725130 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:45.725095    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:45.846086 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:45.846053    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:45.938209 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:45.938165    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:47:45.997156 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:45.997071    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc"]
Sep 06 19:47:46.001300 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:46.001273    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc"
Sep 06 19:47:46.004111 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:46.004088    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-0936e642-dockercfg-9lzs7\""
Sep 06 19:47:46.004260 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:46.004127    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-0936e642\""
Sep 06 19:47:46.008076 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:46.008047    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc"]
Sep 06 19:47:46.065661 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:46.065627    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5af37713-64a0-45e0-84a8-bfddb5392fbf-plugins-config-volume\") pod \"payload-processing-e2e-mt-0936e642-7dd549669-nftrc\" (UID: \"5af37713-64a0-45e0-84a8-bfddb5392fbf\") " pod="openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc"
Sep 06 19:47:46.065848 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:46.065698    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tzzd\" (UniqueName: \"kubernetes.io/projected/5af37713-64a0-45e0-84a8-bfddb5392fbf-kube-api-access-9tzzd\") pod \"payload-processing-e2e-mt-0936e642-7dd549669-nftrc\" (UID: \"5af37713-64a0-45e0-84a8-bfddb5392fbf\") " pod="openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc"
Sep 06 19:47:46.166963 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:46.166933    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5af37713-64a0-45e0-84a8-bfddb5392fbf-plugins-config-volume\") pod \"payload-processing-e2e-mt-0936e642-7dd549669-nftrc\" (UID: \"5af37713-64a0-45e0-84a8-bfddb5392fbf\") " pod="openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc"
Sep 06 19:47:46.166963 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:46.166964    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tzzd\" (UniqueName: \"kubernetes.io/projected/5af37713-64a0-45e0-84a8-bfddb5392fbf-kube-api-access-9tzzd\") pod \"payload-processing-e2e-mt-0936e642-7dd549669-nftrc\" (UID: \"5af37713-64a0-45e0-84a8-bfddb5392fbf\") " pod="openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc"
Sep 06 19:47:46.167605 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:46.167586    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5af37713-64a0-45e0-84a8-bfddb5392fbf-plugins-config-volume\") pod \"payload-processing-e2e-mt-0936e642-7dd549669-nftrc\" (UID: \"5af37713-64a0-45e0-84a8-bfddb5392fbf\") " pod="openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc"
Sep 06 19:47:46.175735 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:46.175708    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tzzd\" (UniqueName: \"kubernetes.io/projected/5af37713-64a0-45e0-84a8-bfddb5392fbf-kube-api-access-9tzzd\") pod \"payload-processing-e2e-mt-0936e642-7dd549669-nftrc\" (UID: \"5af37713-64a0-45e0-84a8-bfddb5392fbf\") " pod="openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc"
Sep 06 19:47:46.314188 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:46.314085    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc"
Sep 06 19:47:46.587957 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:46.587926    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc"]
Sep 06 19:47:47.082860 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:47.082827    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc" event={"ID":"5af37713-64a0-45e0-84a8-bfddb5392fbf","Type":"ContainerStarted","Data":"384bc38fa8e61b5d50b6b6bd8e477ca6e31401f503379b9c3c7b752a5a8c7b9b"}
Sep 06 19:47:47.083067 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:47.082898    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc"
Sep 06 19:47:47.083067 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:47.082922    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc" event={"ID":"5af37713-64a0-45e0-84a8-bfddb5392fbf","Type":"ContainerStarted","Data":"53a636cada86b07e5c35cfcedd93d76d40b0c6211af02218201b994c9767f4e6"}
Sep 06 19:47:47.099934 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:47.099874    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc" podStartSLOduration=2.099856459 podStartE2EDuration="2.099856459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:47:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:47:47.098236158 +0000 UTC m=+1230.503195232" watchObservedRunningTime="2026-09-06 19:47:47.099856459 +0000 UTC m=+1230.504815529"
Sep 06 19:47:58.091353 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:47:58.091312    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc"
Sep 06 19:48:09.068467 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:09.068378    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:48:10.658121 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:10.658084    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:48:14.959549 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:14.959492    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:48:17.265869 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:17.265838    2568 scope.go:117] "RemoveContainer" containerID="833b6f2822a259145e6478d0a6d4a4033959af5623e33134232da1cb543c404c"
Sep 06 19:48:20.930843 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:20.930802    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:48:38.350878 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.350839    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"]
Sep 06 19:48:38.356131 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.356106    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:38.359618 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.359587    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0936e642\"/\"kube-root-ca.crt\""
Sep 06 19:48:38.359999 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.359591    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0936e642\"/\"openshift-service-ca.crt\""
Sep 06 19:48:38.360232 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.359694    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0936e642\"/\"default-dockercfg-68xgg\""
Sep 06 19:48:38.360307 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.359751    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0936e642\"/\"e2e-lifecycle-model-0936e642-kserve-self-signed-certs\""
Sep 06 19:48:38.362469 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.362446    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"]
Sep 06 19:48:38.366449 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.366416    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:48:38.440089 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.440045    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-tmp-dir\") pod \"e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") " pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:38.440089 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.440098    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-home\") pod \"e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") " pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:38.440349 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.440124    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lsvv\" (UniqueName: \"kubernetes.io/projected/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-kube-api-access-5lsvv\") pod \"e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") " pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:38.440349 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.440181    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-tls-certs\") pod \"e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") " pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:38.440349 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.440224    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-model-cache\") pod \"e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") " pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:38.440349 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.440254    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-dshm\") pod \"e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") " pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:38.541483 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.541443    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-model-cache\") pod \"e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") " pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:38.541678 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.541492    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-dshm\") pod \"e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") " pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:38.541678 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.541547    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-tmp-dir\") pod \"e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") " pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:38.541678 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.541576    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-home\") pod \"e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") " pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:38.541678 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.541607    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lsvv\" (UniqueName: \"kubernetes.io/projected/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-kube-api-access-5lsvv\") pod \"e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") " pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:38.541678 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.541651    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-tls-certs\") pod \"e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") " pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:38.541951 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.541912    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-model-cache\") pod \"e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") " pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:38.541951 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.541926    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-tmp-dir\") pod \"e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") " pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:38.542083 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.541998    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-home\") pod \"e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") " pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:38.543919 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.543898    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-dshm\") pod \"e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") " pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:38.544200 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.544181    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-tls-certs\") pod \"e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") " pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:38.549004 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.548982    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lsvv\" (UniqueName: \"kubernetes.io/projected/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-kube-api-access-5lsvv\") pod \"e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") " pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:38.667973 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.667936    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:38.944434 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:38.944410    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"]
Sep 06 19:48:38.947008 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:48:38.946978    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1f8a47c_a0f7_4272_93ab_9f5143b03d1f.slice/crio-c85e7ec82ec74b861314bdd27f283fd57a2661f5850166efd1faac28d231d27c WatchSource:0}: Error finding container c85e7ec82ec74b861314bdd27f283fd57a2661f5850166efd1faac28d231d27c: Status 404 returned error can't find the container with id c85e7ec82ec74b861314bdd27f283fd57a2661f5850166efd1faac28d231d27c
Sep 06 19:48:39.382454 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:39.382420    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts" event={"ID":"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f","Type":"ContainerStarted","Data":"1f2b11ee9cd0ce8ff65ab64a1e5b911f562d3dcf9cf5435605908faad4d2db21"}
Sep 06 19:48:39.382861 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:39.382468    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts" event={"ID":"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f","Type":"ContainerStarted","Data":"c85e7ec82ec74b861314bdd27f283fd57a2661f5850166efd1faac28d231d27c"}
Sep 06 19:48:39.398450 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:39.398397    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts" podStartSLOduration=1.398380698 podStartE2EDuration="1.398380698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:48:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:48:39.396073819 +0000 UTC m=+1282.801032886" watchObservedRunningTime="2026-09-06 19:48:39.398380698 +0000 UTC m=+1282.803339828"
Sep 06 19:48:48.668852 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:48.668808    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:48.669343 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:48.668877    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:48.681394 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:48.681365    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:49.447983 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:49.447949    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:48:58.698557 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:58.698480    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:48:58.796323 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:48:58.796275    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:49:14.353590 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:49:14.353539    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:49:14.402082 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:49:14.402047    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:49:55.138158 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:49:55.138117    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:50:10.470486 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:10.470442    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:50:10.495360 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:10.495331    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc"]
Sep 06 19:50:10.495593 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:10.495560    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc" podUID="5af37713-64a0-45e0-84a8-bfddb5392fbf" containerName="payload-processing" containerID="cri-o://384bc38fa8e61b5d50b6b6bd8e477ca6e31401f503379b9c3c7b752a5a8c7b9b" gracePeriod=30
Sep 06 19:50:10.570404 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:10.570364    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:50:10.657544 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:10.657502    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:50:10.707168 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:10.707131    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:50:10.754318 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:10.754289    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc"
Sep 06 19:50:10.816209 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:10.816172    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5af37713-64a0-45e0-84a8-bfddb5392fbf-plugins-config-volume\") pod \"5af37713-64a0-45e0-84a8-bfddb5392fbf\" (UID: \"5af37713-64a0-45e0-84a8-bfddb5392fbf\") "
Sep 06 19:50:10.816403 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:10.816216    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tzzd\" (UniqueName: \"kubernetes.io/projected/5af37713-64a0-45e0-84a8-bfddb5392fbf-kube-api-access-9tzzd\") pod \"5af37713-64a0-45e0-84a8-bfddb5392fbf\" (UID: \"5af37713-64a0-45e0-84a8-bfddb5392fbf\") "
Sep 06 19:50:10.816550 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:10.816528    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5af37713-64a0-45e0-84a8-bfddb5392fbf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5af37713-64a0-45e0-84a8-bfddb5392fbf" (UID: "5af37713-64a0-45e0-84a8-bfddb5392fbf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:50:10.818422 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:10.818399    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5af37713-64a0-45e0-84a8-bfddb5392fbf-kube-api-access-9tzzd" (OuterVolumeSpecName: "kube-api-access-9tzzd") pod "5af37713-64a0-45e0-84a8-bfddb5392fbf" (UID: "5af37713-64a0-45e0-84a8-bfddb5392fbf"). InnerVolumeSpecName "kube-api-access-9tzzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:50:10.882794 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:10.882754    2568 generic.go:356] "Generic (PLEG): container finished" podID="5af37713-64a0-45e0-84a8-bfddb5392fbf" containerID="384bc38fa8e61b5d50b6b6bd8e477ca6e31401f503379b9c3c7b752a5a8c7b9b" exitCode=0
Sep 06 19:50:10.882970 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:10.882822    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc"
Sep 06 19:50:10.882970 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:10.882867    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc" event={"ID":"5af37713-64a0-45e0-84a8-bfddb5392fbf","Type":"ContainerDied","Data":"384bc38fa8e61b5d50b6b6bd8e477ca6e31401f503379b9c3c7b752a5a8c7b9b"}
Sep 06 19:50:10.882970 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:10.882919    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc" event={"ID":"5af37713-64a0-45e0-84a8-bfddb5392fbf","Type":"ContainerDied","Data":"53a636cada86b07e5c35cfcedd93d76d40b0c6211af02218201b994c9767f4e6"}
Sep 06 19:50:10.882970 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:10.882940    2568 scope.go:117] "RemoveContainer" containerID="384bc38fa8e61b5d50b6b6bd8e477ca6e31401f503379b9c3c7b752a5a8c7b9b"
Sep 06 19:50:10.896882 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:10.896859    2568 scope.go:117] "RemoveContainer" containerID="384bc38fa8e61b5d50b6b6bd8e477ca6e31401f503379b9c3c7b752a5a8c7b9b"
Sep 06 19:50:10.897229 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:50:10.897200    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"384bc38fa8e61b5d50b6b6bd8e477ca6e31401f503379b9c3c7b752a5a8c7b9b\": container with ID starting with 384bc38fa8e61b5d50b6b6bd8e477ca6e31401f503379b9c3c7b752a5a8c7b9b not found: ID does not exist" containerID="384bc38fa8e61b5d50b6b6bd8e477ca6e31401f503379b9c3c7b752a5a8c7b9b"
Sep 06 19:50:10.897323 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:10.897239    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"384bc38fa8e61b5d50b6b6bd8e477ca6e31401f503379b9c3c7b752a5a8c7b9b"} err="failed to get container status \"384bc38fa8e61b5d50b6b6bd8e477ca6e31401f503379b9c3c7b752a5a8c7b9b\": rpc error: code = NotFound desc = could not find container \"384bc38fa8e61b5d50b6b6bd8e477ca6e31401f503379b9c3c7b752a5a8c7b9b\": container with ID starting with 384bc38fa8e61b5d50b6b6bd8e477ca6e31401f503379b9c3c7b752a5a8c7b9b not found: ID does not exist"
Sep 06 19:50:10.910406 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:10.910372    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc"]
Sep 06 19:50:10.915086 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:10.915056    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0936e642-7dd549669-nftrc"]
Sep 06 19:50:10.917169 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:10.917141    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5af37713-64a0-45e0-84a8-bfddb5392fbf-plugins-config-volume\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:50:10.917169 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:10.917164    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tzzd\" (UniqueName: \"kubernetes.io/projected/5af37713-64a0-45e0-84a8-bfddb5392fbf-kube-api-access-9tzzd\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:50:11.115935 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:11.115849    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5af37713-64a0-45e0-84a8-bfddb5392fbf" path="/var/lib/kubelet/pods/5af37713-64a0-45e0-84a8-bfddb5392fbf/volumes"
Sep 06 19:50:13.589759 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:13.589728    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:50:18.582066 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:18.582026    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"]
Sep 06 19:50:18.626383 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:18.626337    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:50:33.603230 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:33.603183    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts" podUID="f1f8a47c-a0f7-4272-93ab-9f5143b03d1f" containerName="main" containerID="cri-o://1f2b11ee9cd0ce8ff65ab64a1e5b911f562d3dcf9cf5435605908faad4d2db21" gracePeriod=45
Sep 06 19:50:33.863036 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:33.862978    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:50:34.008274 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.008239    2568 generic.go:356] "Generic (PLEG): container finished" podID="f1f8a47c-a0f7-4272-93ab-9f5143b03d1f" containerID="1f2b11ee9cd0ce8ff65ab64a1e5b911f562d3dcf9cf5435605908faad4d2db21" exitCode=0
Sep 06 19:50:34.008446 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.008292    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"
Sep 06 19:50:34.008446 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.008322    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts" event={"ID":"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f","Type":"ContainerDied","Data":"1f2b11ee9cd0ce8ff65ab64a1e5b911f562d3dcf9cf5435605908faad4d2db21"}
Sep 06 19:50:34.008446 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.008369    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts" event={"ID":"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f","Type":"ContainerDied","Data":"c85e7ec82ec74b861314bdd27f283fd57a2661f5850166efd1faac28d231d27c"}
Sep 06 19:50:34.008446 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.008386    2568 scope.go:117] "RemoveContainer" containerID="1f2b11ee9cd0ce8ff65ab64a1e5b911f562d3dcf9cf5435605908faad4d2db21"
Sep 06 19:50:34.016924 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.016849    2568 scope.go:117] "RemoveContainer" containerID="1f2b11ee9cd0ce8ff65ab64a1e5b911f562d3dcf9cf5435605908faad4d2db21"
Sep 06 19:50:34.017147 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:50:34.017127    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f2b11ee9cd0ce8ff65ab64a1e5b911f562d3dcf9cf5435605908faad4d2db21\": container with ID starting with 1f2b11ee9cd0ce8ff65ab64a1e5b911f562d3dcf9cf5435605908faad4d2db21 not found: ID does not exist" containerID="1f2b11ee9cd0ce8ff65ab64a1e5b911f562d3dcf9cf5435605908faad4d2db21"
Sep 06 19:50:34.017235 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.017162    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f2b11ee9cd0ce8ff65ab64a1e5b911f562d3dcf9cf5435605908faad4d2db21"} err="failed to get container status \"1f2b11ee9cd0ce8ff65ab64a1e5b911f562d3dcf9cf5435605908faad4d2db21\": rpc error: code = NotFound desc = could not find container \"1f2b11ee9cd0ce8ff65ab64a1e5b911f562d3dcf9cf5435605908faad4d2db21\": container with ID starting with 1f2b11ee9cd0ce8ff65ab64a1e5b911f562d3dcf9cf5435605908faad4d2db21 not found: ID does not exist"
Sep 06 19:50:34.026364 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.026343    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-dshm\") pod \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") "
Sep 06 19:50:34.026474 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.026385    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-model-cache\") pod \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") "
Sep 06 19:50:34.026474 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.026441    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lsvv\" (UniqueName: \"kubernetes.io/projected/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-kube-api-access-5lsvv\") pod \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") "
Sep 06 19:50:34.026474 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.026471    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-tls-certs\") pod \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") "
Sep 06 19:50:34.026626 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.026554    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-tmp-dir\") pod \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") "
Sep 06 19:50:34.026626 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.026595    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-home\") pod \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\" (UID: \"f1f8a47c-a0f7-4272-93ab-9f5143b03d1f\") "
Sep 06 19:50:34.026716 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.026669    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-model-cache" (OuterVolumeSpecName: "model-cache") pod "f1f8a47c-a0f7-4272-93ab-9f5143b03d1f" (UID: "f1f8a47c-a0f7-4272-93ab-9f5143b03d1f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 19:50:34.026858 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.026837    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f1f8a47c-a0f7-4272-93ab-9f5143b03d1f" (UID: "f1f8a47c-a0f7-4272-93ab-9f5143b03d1f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 19:50:34.026935 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.026891    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-model-cache\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:50:34.026935 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.026894    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-home" (OuterVolumeSpecName: "home") pod "f1f8a47c-a0f7-4272-93ab-9f5143b03d1f" (UID: "f1f8a47c-a0f7-4272-93ab-9f5143b03d1f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 19:50:34.028611 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.028592    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-dshm" (OuterVolumeSpecName: "dshm") pod "f1f8a47c-a0f7-4272-93ab-9f5143b03d1f" (UID: "f1f8a47c-a0f7-4272-93ab-9f5143b03d1f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 19:50:34.028689 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.028646    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f1f8a47c-a0f7-4272-93ab-9f5143b03d1f" (UID: "f1f8a47c-a0f7-4272-93ab-9f5143b03d1f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:50:34.028689 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.028678    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-kube-api-access-5lsvv" (OuterVolumeSpecName: "kube-api-access-5lsvv") pod "f1f8a47c-a0f7-4272-93ab-9f5143b03d1f" (UID: "f1f8a47c-a0f7-4272-93ab-9f5143b03d1f"). InnerVolumeSpecName "kube-api-access-5lsvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:50:34.128320 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.128289    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-home\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:50:34.128320 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.128319    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-dshm\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:50:34.128520 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.128329    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lsvv\" (UniqueName: \"kubernetes.io/projected/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-kube-api-access-5lsvv\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:50:34.128520 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.128339    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-tls-certs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:50:34.128520 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.128348    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f-tmp-dir\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:50:34.329505 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.329471    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"]
Sep 06 19:50:34.333188 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:34.333158    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-0936e642/e2e-lifecycle-model-0936e642-kserve-7d584677f5-wj6ts"]
Sep 06 19:50:35.115258 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:35.115222    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1f8a47c-a0f7-4272-93ab-9f5143b03d1f" path="/var/lib/kubelet/pods/f1f8a47c-a0f7-4272-93ab-9f5143b03d1f/volumes"
Sep 06 19:50:54.210075 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:54.210037    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7639-583249"]
Sep 06 19:50:54.210484 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:54.210448    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5af37713-64a0-45e0-84a8-bfddb5392fbf" containerName="payload-processing"
Sep 06 19:50:54.210484 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:54.210460    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5af37713-64a0-45e0-84a8-bfddb5392fbf" containerName="payload-processing"
Sep 06 19:50:54.210484 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:54.210474    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1f8a47c-a0f7-4272-93ab-9f5143b03d1f" containerName="main"
Sep 06 19:50:54.210484 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:54.210479    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1f8a47c-a0f7-4272-93ab-9f5143b03d1f" containerName="main"
Sep 06 19:50:54.210643 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:54.210548    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5af37713-64a0-45e0-84a8-bfddb5392fbf" containerName="payload-processing"
Sep 06 19:50:54.210643 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:54.210557    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1f8a47c-a0f7-4272-93ab-9f5143b03d1f" containerName="main"
Sep 06 19:50:54.213436 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:54.213419    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7639-583249"
Sep 06 19:50:54.215689 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:54.215649    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kn2d6\""
Sep 06 19:50:54.219274 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:54.219247    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7639-583249"]
Sep 06 19:50:54.316804 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:54.316720    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtm9p\" (UniqueName: \"kubernetes.io/projected/3216648a-4906-43d6-9850-61ca5bef8481-kube-api-access-gtm9p\") pod \"mt-curl-7639-583249\" (UID: \"3216648a-4906-43d6-9850-61ca5bef8481\") " pod="opendatahub/mt-curl-7639-583249"
Sep 06 19:50:54.417946 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:54.417906    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtm9p\" (UniqueName: \"kubernetes.io/projected/3216648a-4906-43d6-9850-61ca5bef8481-kube-api-access-gtm9p\") pod \"mt-curl-7639-583249\" (UID: \"3216648a-4906-43d6-9850-61ca5bef8481\") " pod="opendatahub/mt-curl-7639-583249"
Sep 06 19:50:54.425447 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:54.425424    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtm9p\" (UniqueName: \"kubernetes.io/projected/3216648a-4906-43d6-9850-61ca5bef8481-kube-api-access-gtm9p\") pod \"mt-curl-7639-583249\" (UID: \"3216648a-4906-43d6-9850-61ca5bef8481\") " pod="opendatahub/mt-curl-7639-583249"
Sep 06 19:50:54.524999 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:54.524912    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7639-583249"
Sep 06 19:50:54.716953 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:54.716916    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:50:54.797736 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:54.797703    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7639-583249"]
Sep 06 19:50:54.799403 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:50:54.799366    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3216648a_4906_43d6_9850_61ca5bef8481.slice/crio-f5f2f933347a194ad207834ca80e5b836ee51383e05411ea4f566ee341105a2a WatchSource:0}: Error finding container f5f2f933347a194ad207834ca80e5b836ee51383e05411ea4f566ee341105a2a: Status 404 returned error can't find the container with id f5f2f933347a194ad207834ca80e5b836ee51383e05411ea4f566ee341105a2a
Sep 06 19:50:54.801184 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:54.801163    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 19:50:55.131801 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:55.131744    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7639-583249" event={"ID":"3216648a-4906-43d6-9850-61ca5bef8481","Type":"ContainerStarted","Data":"f5f2f933347a194ad207834ca80e5b836ee51383e05411ea4f566ee341105a2a"}
Sep 06 19:50:55.501331 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:55.501226    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:50:56.138043 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:56.138008    2568 generic.go:356] "Generic (PLEG): container finished" podID="3216648a-4906-43d6-9850-61ca5bef8481" containerID="e6444eaf4984960fc8c7a943bf8f7ff41b86f523d81652f7fc2363e2d0e70fe5" exitCode=0
Sep 06 19:50:56.138213 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:56.138098    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7639-583249" event={"ID":"3216648a-4906-43d6-9850-61ca5bef8481","Type":"ContainerDied","Data":"e6444eaf4984960fc8c7a943bf8f7ff41b86f523d81652f7fc2363e2d0e70fe5"}
Sep 06 19:50:57.279828 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:57.279798    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7639-583249"
Sep 06 19:50:57.297538 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:57.297494    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7639-583249_3216648a-4906-43d6-9850-61ca5bef8481/mt-curl-7639-583249/0.log"
Sep 06 19:50:57.319928 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:57.319892    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7639-583249"]
Sep 06 19:50:57.322989 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:57.322966    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7639-583249"]
Sep 06 19:50:57.344295 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:57.344263    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtm9p\" (UniqueName: \"kubernetes.io/projected/3216648a-4906-43d6-9850-61ca5bef8481-kube-api-access-gtm9p\") pod \"3216648a-4906-43d6-9850-61ca5bef8481\" (UID: \"3216648a-4906-43d6-9850-61ca5bef8481\") "
Sep 06 19:50:57.346450 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:57.346421    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3216648a-4906-43d6-9850-61ca5bef8481-kube-api-access-gtm9p" (OuterVolumeSpecName: "kube-api-access-gtm9p") pod "3216648a-4906-43d6-9850-61ca5bef8481" (UID: "3216648a-4906-43d6-9850-61ca5bef8481"). InnerVolumeSpecName "kube-api-access-gtm9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:50:57.445728 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:57.445635    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtm9p\" (UniqueName: \"kubernetes.io/projected/3216648a-4906-43d6-9850-61ca5bef8481-kube-api-access-gtm9p\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:50:58.148998 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:58.148968    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7639-583249"
Sep 06 19:50:58.148998 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:58.149002    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5f2f933347a194ad207834ca80e5b836ee51383e05411ea4f566ee341105a2a"
Sep 06 19:50:58.158367 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:50:58.158336    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7639-583249\" is forbidden: User \"system:node:ip-10-0-135-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-174.ec2.internal' and this object" podUID="3216648a-4906-43d6-9850-61ca5bef8481" pod="opendatahub/mt-curl-7639-583249"
Sep 06 19:50:59.115692 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:50:59.115653    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3216648a-4906-43d6-9850-61ca5bef8481" path="/var/lib/kubelet/pods/3216648a-4906-43d6-9850-61ca5bef8481/volumes"
Sep 06 19:51:08.261032 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:08.260957    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:09.470909 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:09.470872    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:12.547724 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.547670    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"]
Sep 06 19:51:12.548147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.548132    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3216648a-4906-43d6-9850-61ca5bef8481" containerName="mt-curl-7639-583249"
Sep 06 19:51:12.548200 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.548149    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3216648a-4906-43d6-9850-61ca5bef8481" containerName="mt-curl-7639-583249"
Sep 06 19:51:12.548236 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.548218    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3216648a-4906-43d6-9850-61ca5bef8481" containerName="mt-curl-7639-583249"
Sep 06 19:51:12.551546 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.551522    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:12.554238 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.554213    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-b571c4\"/\"kube-root-ca.crt\""
Sep 06 19:51:12.555279 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.555258    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-b571c4\"/\"openshift-service-ca.crt\""
Sep 06 19:51:12.555426 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.555400    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-b571c4\"/\"default-dockercfg-7dl84\""
Sep 06 19:51:12.555498 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.555443    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-b571c4\"/\"sub-test-model-b571c4-kserve-self-signed-certs\""
Sep 06 19:51:12.558641 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.558614    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"]
Sep 06 19:51:12.567752 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.567707    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:12.688163 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.688126    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-dshm\") pod \"sub-test-model-b571c4-kserve-9cfdffbc-rpqh8\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") " pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:12.688341 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.688180    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-home\") pod \"sub-test-model-b571c4-kserve-9cfdffbc-rpqh8\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") " pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:12.688341 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.688264    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n8f2\" (UniqueName: \"kubernetes.io/projected/19a341ef-9e8a-47cb-859f-2bd56f6a8381-kube-api-access-2n8f2\") pod \"sub-test-model-b571c4-kserve-9cfdffbc-rpqh8\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") " pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:12.688341 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.688295    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-model-cache\") pod \"sub-test-model-b571c4-kserve-9cfdffbc-rpqh8\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") " pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:12.688475 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.688359    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19a341ef-9e8a-47cb-859f-2bd56f6a8381-tls-certs\") pod \"sub-test-model-b571c4-kserve-9cfdffbc-rpqh8\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") " pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:12.688475 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.688409    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-tmp-dir\") pod \"sub-test-model-b571c4-kserve-9cfdffbc-rpqh8\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") " pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:12.789423 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.789390    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-home\") pod \"sub-test-model-b571c4-kserve-9cfdffbc-rpqh8\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") " pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:12.789615 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.789475    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n8f2\" (UniqueName: \"kubernetes.io/projected/19a341ef-9e8a-47cb-859f-2bd56f6a8381-kube-api-access-2n8f2\") pod \"sub-test-model-b571c4-kserve-9cfdffbc-rpqh8\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") " pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:12.789615 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.789504    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-model-cache\") pod \"sub-test-model-b571c4-kserve-9cfdffbc-rpqh8\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") " pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:12.789615 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.789559    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19a341ef-9e8a-47cb-859f-2bd56f6a8381-tls-certs\") pod \"sub-test-model-b571c4-kserve-9cfdffbc-rpqh8\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") " pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:12.789615 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.789594    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-tmp-dir\") pod \"sub-test-model-b571c4-kserve-9cfdffbc-rpqh8\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") " pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:12.789893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.789640    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-dshm\") pod \"sub-test-model-b571c4-kserve-9cfdffbc-rpqh8\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") " pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:12.789893 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.789841    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-home\") pod \"sub-test-model-b571c4-kserve-9cfdffbc-rpqh8\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") " pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:12.790118 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.790094    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-model-cache\") pod \"sub-test-model-b571c4-kserve-9cfdffbc-rpqh8\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") " pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:12.790196 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.790136    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-tmp-dir\") pod \"sub-test-model-b571c4-kserve-9cfdffbc-rpqh8\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") " pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:12.791979 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.791951    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-dshm\") pod \"sub-test-model-b571c4-kserve-9cfdffbc-rpqh8\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") " pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:12.792480 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.792461    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19a341ef-9e8a-47cb-859f-2bd56f6a8381-tls-certs\") pod \"sub-test-model-b571c4-kserve-9cfdffbc-rpqh8\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") " pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:12.798040 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.797971    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n8f2\" (UniqueName: \"kubernetes.io/projected/19a341ef-9e8a-47cb-859f-2bd56f6a8381-kube-api-access-2n8f2\") pod \"sub-test-model-b571c4-kserve-9cfdffbc-rpqh8\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") " pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:12.861393 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:12.861356    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:13.134487 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:13.134465    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"]
Sep 06 19:51:13.137227 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:51:13.137193    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19a341ef_9e8a_47cb_859f_2bd56f6a8381.slice/crio-7755e85191822352c871168f021f8c8348e967f90f78d9c83248f070c564c9ec WatchSource:0}: Error finding container 7755e85191822352c871168f021f8c8348e967f90f78d9c83248f070c564c9ec: Status 404 returned error can't find the container with id 7755e85191822352c871168f021f8c8348e967f90f78d9c83248f070c564c9ec
Sep 06 19:51:13.227096 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:13.227059    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8" event={"ID":"19a341ef-9e8a-47cb-859f-2bd56f6a8381","Type":"ContainerStarted","Data":"906fa452b9d74b898dbdcfc840037204c88bf734cc4da00bc049f951a3586aab"}
Sep 06 19:51:13.227255 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:13.227109    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8" event={"ID":"19a341ef-9e8a-47cb-859f-2bd56f6a8381","Type":"ContainerStarted","Data":"7755e85191822352c871168f021f8c8348e967f90f78d9c83248f070c564c9ec"}
Sep 06 19:51:13.242081 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:13.242002    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8" podStartSLOduration=1.241977507 podStartE2EDuration="1.241977507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:51:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:51:13.240859438 +0000 UTC m=+1436.645818507" watchObservedRunningTime="2026-09-06 19:51:13.241977507 +0000 UTC m=+1436.646936762"
Sep 06 19:51:18.093245 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:18.093202    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:18.193444 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:18.193399    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:18.357546 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:18.357448    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:19.525023 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:19.524979    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:19.624019 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:19.623980    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:19.734792 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:19.734741    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:20.277797 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:20.277752    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:20.377704 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:20.377663    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:20.479152 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:20.479113    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:21.653631 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:21.653589    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:22.861650 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:22.861615    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:22.862111 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:22.861670    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:22.874163 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:22.874138    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:23.291036 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:23.291006    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:51:27.186760 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:27.186730    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:27.287831 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:27.287769    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:27.837376 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:27.837320    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:33.549967 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:33.549929    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:33.609859 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:33.609818    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:33.686246 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:33.686212    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:33.785905 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:33.785873    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:33.989941 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:33.989893    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:44.217274 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:44.217218    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:44.420526 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:44.420485    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:53.474249 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:53.474205    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:51:56.814012 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:51:56.813975    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:05.301159 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:05.301096    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:11.021569 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:11.021530    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:11.080668 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:11.080623    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:11.323749 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:11.323658    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:11.609401 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:11.609267    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:11.760520 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:11.760478    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:14.636130 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:14.636092    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:14.734720 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:14.734680    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:15.767700 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:15.767663    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:15.869420 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:15.869382    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:16.317406 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:16.317375    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:16.412321 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:16.412279    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:16.460097 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:16.460069    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc"]
Sep 06 19:52:16.463566 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:16.463550    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc"
Sep 06 19:52:16.466201 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:16.466171    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-cf16ea-dockercfg-7nzz4\""
Sep 06 19:52:16.466331 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:16.466240    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-cf16ea\""
Sep 06 19:52:16.473136 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:16.473114    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc"]
Sep 06 19:52:16.473539 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:16.473514    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrrd6\" (UniqueName: \"kubernetes.io/projected/f3390460-bcd4-421d-b14a-0ef30b7472e3-kube-api-access-rrrd6\") pod \"payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc\" (UID: \"f3390460-bcd4-421d-b14a-0ef30b7472e3\") " pod="openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc"
Sep 06 19:52:16.473698 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:16.473673    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3390460-bcd4-421d-b14a-0ef30b7472e3-plugins-config-volume\") pod \"payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc\" (UID: \"f3390460-bcd4-421d-b14a-0ef30b7472e3\") " pod="openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc"
Sep 06 19:52:16.489558 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:16.489398    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:16.574428 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:16.574331    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3390460-bcd4-421d-b14a-0ef30b7472e3-plugins-config-volume\") pod \"payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc\" (UID: \"f3390460-bcd4-421d-b14a-0ef30b7472e3\") " pod="openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc"
Sep 06 19:52:16.574601 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:16.574440    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrrd6\" (UniqueName: \"kubernetes.io/projected/f3390460-bcd4-421d-b14a-0ef30b7472e3-kube-api-access-rrrd6\") pod \"payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc\" (UID: \"f3390460-bcd4-421d-b14a-0ef30b7472e3\") " pod="openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc"
Sep 06 19:52:16.575069 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:16.575050    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3390460-bcd4-421d-b14a-0ef30b7472e3-plugins-config-volume\") pod \"payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc\" (UID: \"f3390460-bcd4-421d-b14a-0ef30b7472e3\") " pod="openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc"
Sep 06 19:52:16.583223 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:16.583198    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrrd6\" (UniqueName: \"kubernetes.io/projected/f3390460-bcd4-421d-b14a-0ef30b7472e3-kube-api-access-rrrd6\") pod \"payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc\" (UID: \"f3390460-bcd4-421d-b14a-0ef30b7472e3\") " pod="openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc"
Sep 06 19:52:16.775230 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:16.775186    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc"
Sep 06 19:52:17.050658 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:17.050632    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc"]
Sep 06 19:52:17.053136 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:52:17.053105    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3390460_bcd4_421d_b14a_0ef30b7472e3.slice/crio-40193cf607e31e5c1040141ea4fe6e66ea209f252e43170d1e51fe2c1e593bc9 WatchSource:0}: Error finding container 40193cf607e31e5c1040141ea4fe6e66ea209f252e43170d1e51fe2c1e593bc9: Status 404 returned error can't find the container with id 40193cf607e31e5c1040141ea4fe6e66ea209f252e43170d1e51fe2c1e593bc9
Sep 06 19:52:17.579863 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:17.579817    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc" event={"ID":"f3390460-bcd4-421d-b14a-0ef30b7472e3","Type":"ContainerStarted","Data":"0c5da457b38ba93aae94d7be26889f6a6098d3b981fee5296647877c856f6dd4"}
Sep 06 19:52:17.580078 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:17.579908    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc"
Sep 06 19:52:17.580078 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:17.579925    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc" event={"ID":"f3390460-bcd4-421d-b14a-0ef30b7472e3","Type":"ContainerStarted","Data":"40193cf607e31e5c1040141ea4fe6e66ea209f252e43170d1e51fe2c1e593bc9"}
Sep 06 19:52:17.595494 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:17.595427    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc" podStartSLOduration=1.595405274 podStartE2EDuration="1.595405274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:52:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:52:17.594544125 +0000 UTC m=+1500.999503193" watchObservedRunningTime="2026-09-06 19:52:17.595405274 +0000 UTC m=+1501.000364343"
Sep 06 19:52:18.130085 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:18.130042    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"]
Sep 06 19:52:18.146812 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:18.146752    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:19.692431 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:19.692390    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:21.566213 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:21.566171    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:24.372696 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:24.372664    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:24.420261 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:24.420225    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:25.765222 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:25.765172    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:27.964441 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:27.964407    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:28.587989 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:28.587960    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc"
Sep 06 19:52:33.150874 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.150838    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8" podUID="19a341ef-9e8a-47cb-859f-2bd56f6a8381" containerName="main" containerID="cri-o://906fa452b9d74b898dbdcfc840037204c88bf734cc4da00bc049f951a3586aab" gracePeriod=45
Sep 06 19:52:33.279974 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.279934    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8" podUID="19a341ef-9e8a-47cb-859f-2bd56f6a8381" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": dial tcp 10.133.0.69:8000: connect: connection refused"
Sep 06 19:52:33.407548 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.407481    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:52:33.533417 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.533380    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-dshm\") pod \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") "
Sep 06 19:52:33.533611 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.533509    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n8f2\" (UniqueName: \"kubernetes.io/projected/19a341ef-9e8a-47cb-859f-2bd56f6a8381-kube-api-access-2n8f2\") pod \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") "
Sep 06 19:52:33.533611 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.533532    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-tmp-dir\") pod \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") "
Sep 06 19:52:33.533611 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.533562    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-home\") pod \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") "
Sep 06 19:52:33.533611 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.533600    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19a341ef-9e8a-47cb-859f-2bd56f6a8381-tls-certs\") pod \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") "
Sep 06 19:52:33.533859 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.533625    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-model-cache\") pod \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\" (UID: \"19a341ef-9e8a-47cb-859f-2bd56f6a8381\") "
Sep 06 19:52:33.533859 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.533838    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "19a341ef-9e8a-47cb-859f-2bd56f6a8381" (UID: "19a341ef-9e8a-47cb-859f-2bd56f6a8381"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 19:52:33.533973 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.533859    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-home" (OuterVolumeSpecName: "home") pod "19a341ef-9e8a-47cb-859f-2bd56f6a8381" (UID: "19a341ef-9e8a-47cb-859f-2bd56f6a8381"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 19:52:33.533973 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.533968    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-tmp-dir\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:52:33.534047 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.533982    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-home\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:52:33.534047 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.533974    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-model-cache" (OuterVolumeSpecName: "model-cache") pod "19a341ef-9e8a-47cb-859f-2bd56f6a8381" (UID: "19a341ef-9e8a-47cb-859f-2bd56f6a8381"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 19:52:33.535934 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.535905    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-dshm" (OuterVolumeSpecName: "dshm") pod "19a341ef-9e8a-47cb-859f-2bd56f6a8381" (UID: "19a341ef-9e8a-47cb-859f-2bd56f6a8381"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 19:52:33.535934 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.535914    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19a341ef-9e8a-47cb-859f-2bd56f6a8381-kube-api-access-2n8f2" (OuterVolumeSpecName: "kube-api-access-2n8f2") pod "19a341ef-9e8a-47cb-859f-2bd56f6a8381" (UID: "19a341ef-9e8a-47cb-859f-2bd56f6a8381"). InnerVolumeSpecName "kube-api-access-2n8f2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:52:33.535934 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.535915    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19a341ef-9e8a-47cb-859f-2bd56f6a8381-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "19a341ef-9e8a-47cb-859f-2bd56f6a8381" (UID: "19a341ef-9e8a-47cb-859f-2bd56f6a8381"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:52:33.634854 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.634813    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n8f2\" (UniqueName: \"kubernetes.io/projected/19a341ef-9e8a-47cb-859f-2bd56f6a8381-kube-api-access-2n8f2\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:52:33.634854 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.634848    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19a341ef-9e8a-47cb-859f-2bd56f6a8381-tls-certs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:52:33.634854 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.634864    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-model-cache\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:52:33.635106 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.634875    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19a341ef-9e8a-47cb-859f-2bd56f6a8381-dshm\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:52:33.671007 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.670910    2568 generic.go:356] "Generic (PLEG): container finished" podID="19a341ef-9e8a-47cb-859f-2bd56f6a8381" containerID="906fa452b9d74b898dbdcfc840037204c88bf734cc4da00bc049f951a3586aab" exitCode=0
Sep 06 19:52:33.671007 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.670959    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"
Sep 06 19:52:33.671242 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.671000    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8" event={"ID":"19a341ef-9e8a-47cb-859f-2bd56f6a8381","Type":"ContainerDied","Data":"906fa452b9d74b898dbdcfc840037204c88bf734cc4da00bc049f951a3586aab"}
Sep 06 19:52:33.671242 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.671051    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8" event={"ID":"19a341ef-9e8a-47cb-859f-2bd56f6a8381","Type":"ContainerDied","Data":"7755e85191822352c871168f021f8c8348e967f90f78d9c83248f070c564c9ec"}
Sep 06 19:52:33.671242 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.671073    2568 scope.go:117] "RemoveContainer" containerID="906fa452b9d74b898dbdcfc840037204c88bf734cc4da00bc049f951a3586aab"
Sep 06 19:52:33.686905 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.686872    2568 scope.go:117] "RemoveContainer" containerID="906fa452b9d74b898dbdcfc840037204c88bf734cc4da00bc049f951a3586aab"
Sep 06 19:52:33.687354 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:52:33.687281    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"906fa452b9d74b898dbdcfc840037204c88bf734cc4da00bc049f951a3586aab\": container with ID starting with 906fa452b9d74b898dbdcfc840037204c88bf734cc4da00bc049f951a3586aab not found: ID does not exist" containerID="906fa452b9d74b898dbdcfc840037204c88bf734cc4da00bc049f951a3586aab"
Sep 06 19:52:33.687354 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.687320    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"906fa452b9d74b898dbdcfc840037204c88bf734cc4da00bc049f951a3586aab"} err="failed to get container status \"906fa452b9d74b898dbdcfc840037204c88bf734cc4da00bc049f951a3586aab\": rpc error: code = NotFound desc = could not find container \"906fa452b9d74b898dbdcfc840037204c88bf734cc4da00bc049f951a3586aab\": container with ID starting with 906fa452b9d74b898dbdcfc840037204c88bf734cc4da00bc049f951a3586aab not found: ID does not exist"
Sep 06 19:52:33.700069 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.700033    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"]
Sep 06 19:52:33.703364 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:33.703335    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-b571c4/sub-test-model-b571c4-kserve-9cfdffbc-rpqh8"]
Sep 06 19:52:35.118212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:35.118177    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19a341ef-9e8a-47cb-859f-2bd56f6a8381" path="/var/lib/kubelet/pods/19a341ef-9e8a-47cb-859f-2bd56f6a8381/volumes"
Sep 06 19:52:38.139558 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:38.139458    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:39.630099 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:39.630060    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:40.000379 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:40.000280    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:40.321069 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:40.320978    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:40.463731 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:40.463697    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:43.836579 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:43.836533    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:43.935144 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:43.935107    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:44.942992 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:44.942960    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"]
Sep 06 19:52:44.943403 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:44.943391    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a341ef-9e8a-47cb-859f-2bd56f6a8381" containerName="main"
Sep 06 19:52:44.943452 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:44.943404    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a341ef-9e8a-47cb-859f-2bd56f6a8381" containerName="main"
Sep 06 19:52:44.943493 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:44.943482    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="19a341ef-9e8a-47cb-859f-2bd56f6a8381" containerName="main"
Sep 06 19:52:44.948054 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:44.948031    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"
Sep 06 19:52:44.950435 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:44.950412    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-d50bae-serving-cert\""
Sep 06 19:52:44.954897 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:44.954859    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"]
Sep 06 19:52:44.973143 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:44.973109    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:45.042721 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:45.042668    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-metrics-certs\") pod \"maas-api-e2e-api-b-d50bae-db6b7f69-jgslz\" (UID: \"a08cfd4d-5984-429f-9ce4-41bb2ccc2635\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"
Sep 06 19:52:45.042721 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:45.042714    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-maas-api-tls\") pod \"maas-api-e2e-api-b-d50bae-db6b7f69-jgslz\" (UID: \"a08cfd4d-5984-429f-9ce4-41bb2ccc2635\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"
Sep 06 19:52:45.042997 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:45.042753    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-openshift-service-ca\") pod \"maas-api-e2e-api-b-d50bae-db6b7f69-jgslz\" (UID: \"a08cfd4d-5984-429f-9ce4-41bb2ccc2635\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"
Sep 06 19:52:45.042997 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:45.042886    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz6p5\" (UniqueName: \"kubernetes.io/projected/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-kube-api-access-dz6p5\") pod \"maas-api-e2e-api-b-d50bae-db6b7f69-jgslz\" (UID: \"a08cfd4d-5984-429f-9ce4-41bb2ccc2635\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"
Sep 06 19:52:45.074401 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:45.074363    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:45.129685 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:45.129643    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:45.144044 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:45.144010    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-openshift-service-ca\") pod \"maas-api-e2e-api-b-d50bae-db6b7f69-jgslz\" (UID: \"a08cfd4d-5984-429f-9ce4-41bb2ccc2635\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"
Sep 06 19:52:45.144205 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:45.144094    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz6p5\" (UniqueName: \"kubernetes.io/projected/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-kube-api-access-dz6p5\") pod \"maas-api-e2e-api-b-d50bae-db6b7f69-jgslz\" (UID: \"a08cfd4d-5984-429f-9ce4-41bb2ccc2635\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"
Sep 06 19:52:45.144205 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:45.144142    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-metrics-certs\") pod \"maas-api-e2e-api-b-d50bae-db6b7f69-jgslz\" (UID: \"a08cfd4d-5984-429f-9ce4-41bb2ccc2635\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"
Sep 06 19:52:45.144205 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:45.144173    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-maas-api-tls\") pod \"maas-api-e2e-api-b-d50bae-db6b7f69-jgslz\" (UID: \"a08cfd4d-5984-429f-9ce4-41bb2ccc2635\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"
Sep 06 19:52:45.144739 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:45.144716    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-openshift-service-ca\") pod \"maas-api-e2e-api-b-d50bae-db6b7f69-jgslz\" (UID: \"a08cfd4d-5984-429f-9ce4-41bb2ccc2635\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"
Sep 06 19:52:45.146724 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:45.146700    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-metrics-certs\") pod \"maas-api-e2e-api-b-d50bae-db6b7f69-jgslz\" (UID: \"a08cfd4d-5984-429f-9ce4-41bb2ccc2635\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"
Sep 06 19:52:45.146884 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:45.146863    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-maas-api-tls\") pod \"maas-api-e2e-api-b-d50bae-db6b7f69-jgslz\" (UID: \"a08cfd4d-5984-429f-9ce4-41bb2ccc2635\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"
Sep 06 19:52:45.155128 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:45.155099    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz6p5\" (UniqueName: \"kubernetes.io/projected/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-kube-api-access-dz6p5\") pod \"maas-api-e2e-api-b-d50bae-db6b7f69-jgslz\" (UID: \"a08cfd4d-5984-429f-9ce4-41bb2ccc2635\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"
Sep 06 19:52:45.261427 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:45.261333    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"
Sep 06 19:52:45.537373 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:45.537335    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"]
Sep 06 19:52:45.539093 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:52:45.539065    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda08cfd4d_5984_429f_9ce4_41bb2ccc2635.slice/crio-835fe3b4dc7e7b3ba6c1dc14748b1532afc2c49c029b4084e7510e37c7dfbe32 WatchSource:0}: Error finding container 835fe3b4dc7e7b3ba6c1dc14748b1532afc2c49c029b4084e7510e37c7dfbe32: Status 404 returned error can't find the container with id 835fe3b4dc7e7b3ba6c1dc14748b1532afc2c49c029b4084e7510e37c7dfbe32
Sep 06 19:52:45.544263 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:45.544225    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:45.642874 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:45.642831    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:45.745543 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:45.745510    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz" event={"ID":"a08cfd4d-5984-429f-9ce4-41bb2ccc2635","Type":"ContainerStarted","Data":"835fe3b4dc7e7b3ba6c1dc14748b1532afc2c49c029b4084e7510e37c7dfbe32"}
Sep 06 19:52:46.752793 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:46.752739    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz" event={"ID":"a08cfd4d-5984-429f-9ce4-41bb2ccc2635","Type":"ContainerStarted","Data":"12ffdf2ae6fc289487371803c6cc2142e1c918d434ba9d7e876234eaf6df5766"}
Sep 06 19:52:46.753284 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:46.752821    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"
Sep 06 19:52:46.768211 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:46.768158    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz" podStartSLOduration=2.498029874 podStartE2EDuration="2.768140547s" totalImagesPullingTime="270.110673ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:52:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:52:46.767057148 +0000 UTC m=+1530.172016217" watchObservedRunningTime="2026-09-06 19:52:46.768140547 +0000 UTC m=+1530.173099615"
Sep 06 19:52:52.763923 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:52.763890    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"
Sep 06 19:52:59.631661 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:59.631620    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:52:59.761786 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:52:59.761746    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:08.773648 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:08.773599    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:11.371149 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:11.371108    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:12.080150 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:12.080116    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:27.064767 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:27.064732    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:27.098715 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:27.098673    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc"]
Sep 06 19:53:27.099005 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:27.098969    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc" podUID="f3390460-bcd4-421d-b14a-0ef30b7472e3" containerName="payload-processing" containerID="cri-o://0c5da457b38ba93aae94d7be26889f6a6098d3b981fee5296647877c856f6dd4" gracePeriod=30
Sep 06 19:53:27.361759 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:27.361732    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc"
Sep 06 19:53:27.427629 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:27.427591    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrrd6\" (UniqueName: \"kubernetes.io/projected/f3390460-bcd4-421d-b14a-0ef30b7472e3-kube-api-access-rrrd6\") pod \"f3390460-bcd4-421d-b14a-0ef30b7472e3\" (UID: \"f3390460-bcd4-421d-b14a-0ef30b7472e3\") "
Sep 06 19:53:27.427849 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:27.427714    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3390460-bcd4-421d-b14a-0ef30b7472e3-plugins-config-volume\") pod \"f3390460-bcd4-421d-b14a-0ef30b7472e3\" (UID: \"f3390460-bcd4-421d-b14a-0ef30b7472e3\") "
Sep 06 19:53:27.428119 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:27.428093    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3390460-bcd4-421d-b14a-0ef30b7472e3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f3390460-bcd4-421d-b14a-0ef30b7472e3" (UID: "f3390460-bcd4-421d-b14a-0ef30b7472e3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:53:27.429966 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:27.429939    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3390460-bcd4-421d-b14a-0ef30b7472e3-kube-api-access-rrrd6" (OuterVolumeSpecName: "kube-api-access-rrrd6") pod "f3390460-bcd4-421d-b14a-0ef30b7472e3" (UID: "f3390460-bcd4-421d-b14a-0ef30b7472e3"). InnerVolumeSpecName "kube-api-access-rrrd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:53:27.528708 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:27.528669    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrrd6\" (UniqueName: \"kubernetes.io/projected/f3390460-bcd4-421d-b14a-0ef30b7472e3-kube-api-access-rrrd6\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:53:27.528708 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:27.528704    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3390460-bcd4-421d-b14a-0ef30b7472e3-plugins-config-volume\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:53:27.979178 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:27.979137    2568 generic.go:356] "Generic (PLEG): container finished" podID="f3390460-bcd4-421d-b14a-0ef30b7472e3" containerID="0c5da457b38ba93aae94d7be26889f6a6098d3b981fee5296647877c856f6dd4" exitCode=0
Sep 06 19:53:27.979387 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:27.979187    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc"
Sep 06 19:53:27.979387 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:27.979221    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc" event={"ID":"f3390460-bcd4-421d-b14a-0ef30b7472e3","Type":"ContainerDied","Data":"0c5da457b38ba93aae94d7be26889f6a6098d3b981fee5296647877c856f6dd4"}
Sep 06 19:53:27.979387 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:27.979276    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc" event={"ID":"f3390460-bcd4-421d-b14a-0ef30b7472e3","Type":"ContainerDied","Data":"40193cf607e31e5c1040141ea4fe6e66ea209f252e43170d1e51fe2c1e593bc9"}
Sep 06 19:53:27.979387 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:27.979300    2568 scope.go:117] "RemoveContainer" containerID="0c5da457b38ba93aae94d7be26889f6a6098d3b981fee5296647877c856f6dd4"
Sep 06 19:53:27.990201 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:27.990173    2568 scope.go:117] "RemoveContainer" containerID="0c5da457b38ba93aae94d7be26889f6a6098d3b981fee5296647877c856f6dd4"
Sep 06 19:53:27.990606 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:53:27.990579    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c5da457b38ba93aae94d7be26889f6a6098d3b981fee5296647877c856f6dd4\": container with ID starting with 0c5da457b38ba93aae94d7be26889f6a6098d3b981fee5296647877c856f6dd4 not found: ID does not exist" containerID="0c5da457b38ba93aae94d7be26889f6a6098d3b981fee5296647877c856f6dd4"
Sep 06 19:53:27.990683 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:27.990634    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c5da457b38ba93aae94d7be26889f6a6098d3b981fee5296647877c856f6dd4"} err="failed to get container status \"0c5da457b38ba93aae94d7be26889f6a6098d3b981fee5296647877c856f6dd4\": rpc error: code = NotFound desc = could not find container \"0c5da457b38ba93aae94d7be26889f6a6098d3b981fee5296647877c856f6dd4\": container with ID starting with 0c5da457b38ba93aae94d7be26889f6a6098d3b981fee5296647877c856f6dd4 not found: ID does not exist"
Sep 06 19:53:28.001161 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:28.001128    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc"]
Sep 06 19:53:28.013247 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:28.013207    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cf16ea-5c964f64cf-f4hfc"]
Sep 06 19:53:28.155035 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:28.155000    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:29.115672 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:29.115635    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3390460-bcd4-421d-b14a-0ef30b7472e3" path="/var/lib/kubelet/pods/f3390460-bcd4-421d-b14a-0ef30b7472e3/volumes"
Sep 06 19:53:33.312639 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:33.312595    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:33.413121 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:33.413081    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:33.556704 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:33.556669    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:34.049195 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:34.049156    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:49.318519 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:49.318481    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"]
Sep 06 19:53:49.319064 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:49.318829    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz" podUID="a08cfd4d-5984-429f-9ce4-41bb2ccc2635" containerName="maas-api" containerID="cri-o://12ffdf2ae6fc289487371803c6cc2142e1c918d434ba9d7e876234eaf6df5766" gracePeriod=30
Sep 06 19:53:49.341439 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:49.341387    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:49.404053 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:49.404014    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:49.461849 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:49.461708    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:49.515657 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:49.515614    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:49.573204 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:49.573137    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"
Sep 06 19:53:49.634856 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:49.634815    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-maas-api-tls\") pod \"a08cfd4d-5984-429f-9ce4-41bb2ccc2635\" (UID: \"a08cfd4d-5984-429f-9ce4-41bb2ccc2635\") "
Sep 06 19:53:49.635044 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:49.634878    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-metrics-certs\") pod \"a08cfd4d-5984-429f-9ce4-41bb2ccc2635\" (UID: \"a08cfd4d-5984-429f-9ce4-41bb2ccc2635\") "
Sep 06 19:53:49.635044 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:49.634935    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-openshift-service-ca\") pod \"a08cfd4d-5984-429f-9ce4-41bb2ccc2635\" (UID: \"a08cfd4d-5984-429f-9ce4-41bb2ccc2635\") "
Sep 06 19:53:49.635044 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:49.634981    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dz6p5\" (UniqueName: \"kubernetes.io/projected/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-kube-api-access-dz6p5\") pod \"a08cfd4d-5984-429f-9ce4-41bb2ccc2635\" (UID: \"a08cfd4d-5984-429f-9ce4-41bb2ccc2635\") "
Sep 06 19:53:49.635283 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:49.635262    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a08cfd4d-5984-429f-9ce4-41bb2ccc2635" (UID: "a08cfd4d-5984-429f-9ce4-41bb2ccc2635"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:53:49.637338 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:49.637303    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-kube-api-access-dz6p5" (OuterVolumeSpecName: "kube-api-access-dz6p5") pod "a08cfd4d-5984-429f-9ce4-41bb2ccc2635" (UID: "a08cfd4d-5984-429f-9ce4-41bb2ccc2635"). InnerVolumeSpecName "kube-api-access-dz6p5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:53:49.637494 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:49.637349    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a08cfd4d-5984-429f-9ce4-41bb2ccc2635" (UID: "a08cfd4d-5984-429f-9ce4-41bb2ccc2635"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:53:49.637494 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:49.637369    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a08cfd4d-5984-429f-9ce4-41bb2ccc2635" (UID: "a08cfd4d-5984-429f-9ce4-41bb2ccc2635"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:53:49.736385 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:49.736341    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-maas-api-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:53:49.736385 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:49.736378    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-metrics-certs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:53:49.736385 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:49.736387    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-openshift-service-ca\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:53:49.736385 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:49.736397    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dz6p5\" (UniqueName: \"kubernetes.io/projected/a08cfd4d-5984-429f-9ce4-41bb2ccc2635-kube-api-access-dz6p5\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:53:49.871427 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:49.871337    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:50.110276 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:50.110240    2568 generic.go:356] "Generic (PLEG): container finished" podID="a08cfd4d-5984-429f-9ce4-41bb2ccc2635" containerID="12ffdf2ae6fc289487371803c6cc2142e1c918d434ba9d7e876234eaf6df5766" exitCode=0
Sep 06 19:53:50.110484 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:50.110292    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"
Sep 06 19:53:50.110484 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:50.110322    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz" event={"ID":"a08cfd4d-5984-429f-9ce4-41bb2ccc2635","Type":"ContainerDied","Data":"12ffdf2ae6fc289487371803c6cc2142e1c918d434ba9d7e876234eaf6df5766"}
Sep 06 19:53:50.110484 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:50.110375    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz" event={"ID":"a08cfd4d-5984-429f-9ce4-41bb2ccc2635","Type":"ContainerDied","Data":"835fe3b4dc7e7b3ba6c1dc14748b1532afc2c49c029b4084e7510e37c7dfbe32"}
Sep 06 19:53:50.110484 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:50.110400    2568 scope.go:117] "RemoveContainer" containerID="12ffdf2ae6fc289487371803c6cc2142e1c918d434ba9d7e876234eaf6df5766"
Sep 06 19:53:50.120084 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:50.120064    2568 scope.go:117] "RemoveContainer" containerID="12ffdf2ae6fc289487371803c6cc2142e1c918d434ba9d7e876234eaf6df5766"
Sep 06 19:53:50.120428 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:53:50.120409    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12ffdf2ae6fc289487371803c6cc2142e1c918d434ba9d7e876234eaf6df5766\": container with ID starting with 12ffdf2ae6fc289487371803c6cc2142e1c918d434ba9d7e876234eaf6df5766 not found: ID does not exist" containerID="12ffdf2ae6fc289487371803c6cc2142e1c918d434ba9d7e876234eaf6df5766"
Sep 06 19:53:50.120480 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:50.120438    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12ffdf2ae6fc289487371803c6cc2142e1c918d434ba9d7e876234eaf6df5766"} err="failed to get container status \"12ffdf2ae6fc289487371803c6cc2142e1c918d434ba9d7e876234eaf6df5766\": rpc error: code = NotFound desc = could not find container \"12ffdf2ae6fc289487371803c6cc2142e1c918d434ba9d7e876234eaf6df5766\": container with ID starting with 12ffdf2ae6fc289487371803c6cc2142e1c918d434ba9d7e876234eaf6df5766 not found: ID does not exist"
Sep 06 19:53:50.130465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:50.130435    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"]
Sep 06 19:53:50.133585 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:50.133564    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d50bae-db6b7f69-jgslz"]
Sep 06 19:53:51.117955 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:51.117916    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a08cfd4d-5984-429f-9ce4-41bb2ccc2635" path="/var/lib/kubelet/pods/a08cfd4d-5984-429f-9ce4-41bb2ccc2635/volumes"
Sep 06 19:53:51.345161 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:51.345116    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:52.366400 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:52.366362    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:52.775665 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:52.775615    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:53.093660 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:53.093561    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:53.357176 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:53.357081    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:55.624181 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:55.624146    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:55.724720 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:55.724667    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:55.869173 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:55.869134    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:56.275614 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:56.275578    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:56.447759 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:56.447722    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:56.545836 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:56.545728    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:57.543312 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.543278    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"]
Sep 06 19:53:57.543955 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.543932    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a08cfd4d-5984-429f-9ce4-41bb2ccc2635" containerName="maas-api"
Sep 06 19:53:57.544072 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.543958    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a08cfd4d-5984-429f-9ce4-41bb2ccc2635" containerName="maas-api"
Sep 06 19:53:57.544072 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.543970    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3390460-bcd4-421d-b14a-0ef30b7472e3" containerName="payload-processing"
Sep 06 19:53:57.544072 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.543978    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3390460-bcd4-421d-b14a-0ef30b7472e3" containerName="payload-processing"
Sep 06 19:53:57.544229 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.544116    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3390460-bcd4-421d-b14a-0ef30b7472e3" containerName="payload-processing"
Sep 06 19:53:57.544229 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.544129    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a08cfd4d-5984-429f-9ce4-41bb2ccc2635" containerName="maas-api"
Sep 06 19:53:57.548604 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.548584    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"
Sep 06 19:53:57.551118 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.551097    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-a30d6c-serving-cert\""
Sep 06 19:53:57.557919 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.557726    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"]
Sep 06 19:53:57.575822 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.575770    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:57.612077 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.612037    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t\" (UID: \"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"
Sep 06 19:53:57.612077 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.612075    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-metrics-certs\") pod \"maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t\" (UID: \"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"
Sep 06 19:53:57.612319 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.612121    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t\" (UID: \"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"
Sep 06 19:53:57.612319 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.612147    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xm7h\" (UniqueName: \"kubernetes.io/projected/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-kube-api-access-4xm7h\") pod \"maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t\" (UID: \"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"
Sep 06 19:53:57.676981 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.676943    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:57.712910 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.712871    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t\" (UID: \"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"
Sep 06 19:53:57.713070 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.712918    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-metrics-certs\") pod \"maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t\" (UID: \"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"
Sep 06 19:53:57.713070 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.712956    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t\" (UID: \"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"
Sep 06 19:53:57.713070 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.712982    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xm7h\" (UniqueName: \"kubernetes.io/projected/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-kube-api-access-4xm7h\") pod \"maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t\" (UID: \"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"
Sep 06 19:53:57.713070 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:53:57.713018    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-serving-cert: secret "maas-api-e2e-ipp-a-a30d6c-serving-cert" not found
Sep 06 19:53:57.713207 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:53:57.713089    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-maas-api-tls podName:a82dbadd-cc4e-4c95-8a88-f9ef9eb847db nodeName:}" failed. No retries permitted until 2026-09-06 19:53:58.213067803 +0000 UTC m=+1601.618026857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-maas-api-tls") pod "maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t" (UID: "a82dbadd-cc4e-4c95-8a88-f9ef9eb847db") : secret "maas-api-e2e-ipp-a-a30d6c-serving-cert" not found
Sep 06 19:53:57.713588 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.713569    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t\" (UID: \"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"
Sep 06 19:53:57.715671 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.715639    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-metrics-certs\") pod \"maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t\" (UID: \"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"
Sep 06 19:53:57.723566 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.723546    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xm7h\" (UniqueName: \"kubernetes.io/projected/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-kube-api-access-4xm7h\") pod \"maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t\" (UID: \"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"
Sep 06 19:53:57.801598 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:57.801511    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:58.134421 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:58.134384    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:58.216890 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:58.216839    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t\" (UID: \"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"
Sep 06 19:53:58.219536 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:58.219509    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t\" (UID: \"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"
Sep 06 19:53:58.250034 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:58.249998    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:53:58.353119 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:58.353074    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5"]
Sep 06 19:53:58.357201 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:58.357177    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5"
Sep 06 19:53:58.359865 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:58.359842    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-a30d6c-dockercfg-zwm4b\""
Sep 06 19:53:58.359988 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:58.359851    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-a30d6c\""
Sep 06 19:53:58.367394 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:58.367372    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5"]
Sep 06 19:53:58.419371 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:58.419295    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbj64\" (UniqueName: \"kubernetes.io/projected/d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828-kube-api-access-rbj64\") pod \"payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5\" (UID: \"d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5"
Sep 06 19:53:58.419515 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:58.419413    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5\" (UID: \"d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5"
Sep 06 19:53:58.462969 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:58.462936    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"
Sep 06 19:53:58.520504 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:58.520450    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5\" (UID: \"d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5"
Sep 06 19:53:58.520655 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:58.520590    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbj64\" (UniqueName: \"kubernetes.io/projected/d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828-kube-api-access-rbj64\") pod \"payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5\" (UID: \"d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5"
Sep 06 19:53:58.521687 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:58.521632    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5\" (UID: \"d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5"
Sep 06 19:53:58.529595 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:58.529567    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbj64\" (UniqueName: \"kubernetes.io/projected/d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828-kube-api-access-rbj64\") pod \"payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5\" (UID: \"d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5"
Sep 06 19:53:58.670174 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:58.670073    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5"
Sep 06 19:53:58.744276 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:58.744243    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"]
Sep 06 19:53:58.746390 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:53:58.746335    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda82dbadd_cc4e_4c95_8a88_f9ef9eb847db.slice/crio-8ff3f1fe3e85645b227f9cbae1c1573f6fe8a4afc3bce551363d90ec898c85c2 WatchSource:0}: Error finding container 8ff3f1fe3e85645b227f9cbae1c1573f6fe8a4afc3bce551363d90ec898c85c2: Status 404 returned error can't find the container with id 8ff3f1fe3e85645b227f9cbae1c1573f6fe8a4afc3bce551363d90ec898c85c2
Sep 06 19:53:58.948968 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:58.948938    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5"]
Sep 06 19:53:58.951095 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:53:58.951064    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2f7c5c4_1d51_4e82_ac38_e9ee34dc6828.slice/crio-5fe6e73736a250225d984d89b26ba5d23b3c1ec6cf2e01ba1d5875ebc3e64897 WatchSource:0}: Error finding container 5fe6e73736a250225d984d89b26ba5d23b3c1ec6cf2e01ba1d5875ebc3e64897: Status 404 returned error can't find the container with id 5fe6e73736a250225d984d89b26ba5d23b3c1ec6cf2e01ba1d5875ebc3e64897
Sep 06 19:53:59.165129 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:59.165093    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5" event={"ID":"d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828","Type":"ContainerStarted","Data":"4c31d34e02949a9cdf857d7abe586dbfb5bbf9838ea0c8fa0d23cb226b700b52"}
Sep 06 19:53:59.165313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:59.165150    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5" event={"ID":"d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828","Type":"ContainerStarted","Data":"5fe6e73736a250225d984d89b26ba5d23b3c1ec6cf2e01ba1d5875ebc3e64897"}
Sep 06 19:53:59.165313 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:59.165288    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5"
Sep 06 19:53:59.166957 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:59.166928    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t" event={"ID":"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db","Type":"ContainerStarted","Data":"f17e0c45de73f556d8d71ff5ab4d9e0b65540cd579764948a1b1bc8c92d45a09"}
Sep 06 19:53:59.167089 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:59.166976    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t" event={"ID":"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db","Type":"ContainerStarted","Data":"8ff3f1fe3e85645b227f9cbae1c1573f6fe8a4afc3bce551363d90ec898c85c2"}
Sep 06 19:53:59.167089 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:59.167013    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"
Sep 06 19:53:59.181355 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:59.181297    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5" podStartSLOduration=1.18128022 podStartE2EDuration="1.18128022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:53:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:53:59.179538412 +0000 UTC m=+1602.584497484" watchObservedRunningTime="2026-09-06 19:53:59.18128022 +0000 UTC m=+1602.586239286"
Sep 06 19:53:59.200193 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:53:59.200073    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t" podStartSLOduration=1.8749832880000001 podStartE2EDuration="2.200048998s" totalImagesPullingTime="325.06571ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:53:59.198587515 +0000 UTC m=+1602.603546586" watchObservedRunningTime="2026-09-06 19:53:59.200048998 +0000 UTC m=+1602.605008070"
Sep 06 19:54:00.994566 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:00.994530    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:05.178941 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:05.178911    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"
Sep 06 19:54:06.301319 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:06.301279    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:06.805512 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:06.805454    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"]
Sep 06 19:54:06.805754 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:06.805726    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc" podUID="50facaa1-6c1d-4e35-bfec-971a9d14b185" containerName="maas-api" containerID="cri-o://19620ddead54622d48cf121328fecf687510a1d8ed99af6b53c6f2b7c862e546" gracePeriod=30
Sep 06 19:54:06.827287 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:06.827256    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:06.882472 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:06.882402    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:06.939428 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:06.939393    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:06.995621 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:06.995584    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:07.056115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.056002    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:07.073385 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.073355    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"
Sep 06 19:54:07.205294 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.205249    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzlvv\" (UniqueName: \"kubernetes.io/projected/50facaa1-6c1d-4e35-bfec-971a9d14b185-kube-api-access-tzlvv\") pod \"50facaa1-6c1d-4e35-bfec-971a9d14b185\" (UID: \"50facaa1-6c1d-4e35-bfec-971a9d14b185\") "
Sep 06 19:54:07.205294 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.205300    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50facaa1-6c1d-4e35-bfec-971a9d14b185-metrics-certs\") pod \"50facaa1-6c1d-4e35-bfec-971a9d14b185\" (UID: \"50facaa1-6c1d-4e35-bfec-971a9d14b185\") "
Sep 06 19:54:07.205557 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.205345    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50facaa1-6c1d-4e35-bfec-971a9d14b185-openshift-service-ca\") pod \"50facaa1-6c1d-4e35-bfec-971a9d14b185\" (UID: \"50facaa1-6c1d-4e35-bfec-971a9d14b185\") "
Sep 06 19:54:07.205557 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.205372    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50facaa1-6c1d-4e35-bfec-971a9d14b185-maas-api-tls\") pod \"50facaa1-6c1d-4e35-bfec-971a9d14b185\" (UID: \"50facaa1-6c1d-4e35-bfec-971a9d14b185\") "
Sep 06 19:54:07.205796 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.205750    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50facaa1-6c1d-4e35-bfec-971a9d14b185-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "50facaa1-6c1d-4e35-bfec-971a9d14b185" (UID: "50facaa1-6c1d-4e35-bfec-971a9d14b185"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:54:07.207831 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.207766    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50facaa1-6c1d-4e35-bfec-971a9d14b185-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "50facaa1-6c1d-4e35-bfec-971a9d14b185" (UID: "50facaa1-6c1d-4e35-bfec-971a9d14b185"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:54:07.208336 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.208311    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50facaa1-6c1d-4e35-bfec-971a9d14b185-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "50facaa1-6c1d-4e35-bfec-971a9d14b185" (UID: "50facaa1-6c1d-4e35-bfec-971a9d14b185"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:54:07.208393 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.208331    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50facaa1-6c1d-4e35-bfec-971a9d14b185-kube-api-access-tzlvv" (OuterVolumeSpecName: "kube-api-access-tzlvv") pod "50facaa1-6c1d-4e35-bfec-971a9d14b185" (UID: "50facaa1-6c1d-4e35-bfec-971a9d14b185"). InnerVolumeSpecName "kube-api-access-tzlvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:54:07.214429 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.214402    2568 generic.go:356] "Generic (PLEG): container finished" podID="50facaa1-6c1d-4e35-bfec-971a9d14b185" containerID="19620ddead54622d48cf121328fecf687510a1d8ed99af6b53c6f2b7c862e546" exitCode=0
Sep 06 19:54:07.214563 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.214450    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"
Sep 06 19:54:07.214563 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.214486    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc" event={"ID":"50facaa1-6c1d-4e35-bfec-971a9d14b185","Type":"ContainerDied","Data":"19620ddead54622d48cf121328fecf687510a1d8ed99af6b53c6f2b7c862e546"}
Sep 06 19:54:07.214563 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.214547    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc" event={"ID":"50facaa1-6c1d-4e35-bfec-971a9d14b185","Type":"ContainerDied","Data":"2a64afb03ef78b726645d47bd1d380a288b51da5228312c3963916a86672e985"}
Sep 06 19:54:07.214727 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.214577    2568 scope.go:117] "RemoveContainer" containerID="19620ddead54622d48cf121328fecf687510a1d8ed99af6b53c6f2b7c862e546"
Sep 06 19:54:07.229807 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.229762    2568 scope.go:117] "RemoveContainer" containerID="19620ddead54622d48cf121328fecf687510a1d8ed99af6b53c6f2b7c862e546"
Sep 06 19:54:07.230215 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:54:07.230166    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19620ddead54622d48cf121328fecf687510a1d8ed99af6b53c6f2b7c862e546\": container with ID starting with 19620ddead54622d48cf121328fecf687510a1d8ed99af6b53c6f2b7c862e546 not found: ID does not exist" containerID="19620ddead54622d48cf121328fecf687510a1d8ed99af6b53c6f2b7c862e546"
Sep 06 19:54:07.230297 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.230211    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19620ddead54622d48cf121328fecf687510a1d8ed99af6b53c6f2b7c862e546"} err="failed to get container status \"19620ddead54622d48cf121328fecf687510a1d8ed99af6b53c6f2b7c862e546\": rpc error: code = NotFound desc = could not find container \"19620ddead54622d48cf121328fecf687510a1d8ed99af6b53c6f2b7c862e546\": container with ID starting with 19620ddead54622d48cf121328fecf687510a1d8ed99af6b53c6f2b7c862e546 not found: ID does not exist"
Sep 06 19:54:07.239938 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.239904    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"]
Sep 06 19:54:07.247302 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.247270    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b12ed2-fd885ffcd-8jlrc"]
Sep 06 19:54:07.307349 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.307245    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzlvv\" (UniqueName: \"kubernetes.io/projected/50facaa1-6c1d-4e35-bfec-971a9d14b185-kube-api-access-tzlvv\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:54:07.308188 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.307512    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50facaa1-6c1d-4e35-bfec-971a9d14b185-metrics-certs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:54:07.308188 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.307889    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50facaa1-6c1d-4e35-bfec-971a9d14b185-openshift-service-ca\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:54:07.308188 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.307909    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50facaa1-6c1d-4e35-bfec-971a9d14b185-maas-api-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:54:07.339655 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:07.339621    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:09.116525 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:09.116427    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50facaa1-6c1d-4e35-bfec-971a9d14b185" path="/var/lib/kubelet/pods/50facaa1-6c1d-4e35-bfec-971a9d14b185/volumes"
Sep 06 19:54:10.176247 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:10.176214    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5"
Sep 06 19:54:12.916044 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:12.916006    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:12.968921 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:12.968890    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:13.159131 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:13.159093    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:13.754385 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:13.754347    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:18.569431 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:18.569383    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:18.884726 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:18.884696    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:18.983525 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:18.983491    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:21.261513 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:21.261472    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:21.907962 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:21.907921    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:22.206412 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:22.206324    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:23.106683 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:23.106646    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:23.653465 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:23.653419    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:24.254528 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:24.254489    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:24.276181 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:24.276148    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8"]
Sep 06 19:54:24.276433 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:24.276403    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8" podUID="cfc8f596-9e7c-4f98-84ce-e2b6df598f39" containerName="payload-processing" containerID="cri-o://33277e8b97c87ed38484725c3526ee6df93783430af171448dcb54ff805ff601" gracePeriod=30
Sep 06 19:54:24.354810 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:24.354747    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:24.455664 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:24.455627    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:24.516019 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:24.515928    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:24.545385 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:24.545363    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8"
Sep 06 19:54:24.562111 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:24.562082    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkp8b\" (UniqueName: \"kubernetes.io/projected/cfc8f596-9e7c-4f98-84ce-e2b6df598f39-kube-api-access-fkp8b\") pod \"cfc8f596-9e7c-4f98-84ce-e2b6df598f39\" (UID: \"cfc8f596-9e7c-4f98-84ce-e2b6df598f39\") "
Sep 06 19:54:24.562259 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:24.562162    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cfc8f596-9e7c-4f98-84ce-e2b6df598f39-plugins-config-volume\") pod \"cfc8f596-9e7c-4f98-84ce-e2b6df598f39\" (UID: \"cfc8f596-9e7c-4f98-84ce-e2b6df598f39\") "
Sep 06 19:54:24.562840 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:24.562770    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfc8f596-9e7c-4f98-84ce-e2b6df598f39-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cfc8f596-9e7c-4f98-84ce-e2b6df598f39" (UID: "cfc8f596-9e7c-4f98-84ce-e2b6df598f39"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:54:24.564722 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:24.564697    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfc8f596-9e7c-4f98-84ce-e2b6df598f39-kube-api-access-fkp8b" (OuterVolumeSpecName: "kube-api-access-fkp8b") pod "cfc8f596-9e7c-4f98-84ce-e2b6df598f39" (UID: "cfc8f596-9e7c-4f98-84ce-e2b6df598f39"). InnerVolumeSpecName "kube-api-access-fkp8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:54:24.663806 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:24.663748    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkp8b\" (UniqueName: \"kubernetes.io/projected/cfc8f596-9e7c-4f98-84ce-e2b6df598f39-kube-api-access-fkp8b\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:54:24.663806 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:24.663810    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cfc8f596-9e7c-4f98-84ce-e2b6df598f39-plugins-config-volume\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:54:24.822095 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:24.822003    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:25.316726 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:25.316696    2568 generic.go:356] "Generic (PLEG): container finished" podID="cfc8f596-9e7c-4f98-84ce-e2b6df598f39" containerID="33277e8b97c87ed38484725c3526ee6df93783430af171448dcb54ff805ff601" exitCode=0
Sep 06 19:54:25.317176 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:25.316747    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8"
Sep 06 19:54:25.317176 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:25.316825    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8" event={"ID":"cfc8f596-9e7c-4f98-84ce-e2b6df598f39","Type":"ContainerDied","Data":"33277e8b97c87ed38484725c3526ee6df93783430af171448dcb54ff805ff601"}
Sep 06 19:54:25.317176 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:25.316874    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8" event={"ID":"cfc8f596-9e7c-4f98-84ce-e2b6df598f39","Type":"ContainerDied","Data":"07bf3ab2699f82dc31fdbefaa09c55806cedb9cb24d2b27aac5dda240674db83"}
Sep 06 19:54:25.317176 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:25.316900    2568 scope.go:117] "RemoveContainer" containerID="33277e8b97c87ed38484725c3526ee6df93783430af171448dcb54ff805ff601"
Sep 06 19:54:25.326462 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:25.326442    2568 scope.go:117] "RemoveContainer" containerID="33277e8b97c87ed38484725c3526ee6df93783430af171448dcb54ff805ff601"
Sep 06 19:54:25.326846 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:54:25.326805    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33277e8b97c87ed38484725c3526ee6df93783430af171448dcb54ff805ff601\": container with ID starting with 33277e8b97c87ed38484725c3526ee6df93783430af171448dcb54ff805ff601 not found: ID does not exist" containerID="33277e8b97c87ed38484725c3526ee6df93783430af171448dcb54ff805ff601"
Sep 06 19:54:25.326955 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:25.326852    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33277e8b97c87ed38484725c3526ee6df93783430af171448dcb54ff805ff601"} err="failed to get container status \"33277e8b97c87ed38484725c3526ee6df93783430af171448dcb54ff805ff601\": rpc error: code = NotFound desc = could not find container \"33277e8b97c87ed38484725c3526ee6df93783430af171448dcb54ff805ff601\": container with ID starting with 33277e8b97c87ed38484725c3526ee6df93783430af171448dcb54ff805ff601 not found: ID does not exist"
Sep 06 19:54:25.333037 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:25.333013    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8"]
Sep 06 19:54:25.337157 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:25.337131    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6ddeb5-67f4df6955-wmnr8"]
Sep 06 19:54:25.643382 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:25.643332    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:25.742066 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:25.742033    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:26.789874 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:26.789789    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:26.845589 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:26.845545    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:26.947219 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:26.947171    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:27.115498 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:27.115414    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfc8f596-9e7c-4f98-84ce-e2b6df598f39" path="/var/lib/kubelet/pods/cfc8f596-9e7c-4f98-84ce-e2b6df598f39/volumes"
Sep 06 19:54:27.242740 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:27.242703    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:27.325589 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:27.325558    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:30.333673 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:30.333634    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:30.390682 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:30.390647    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:30.592652 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:30.592562    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:54:50.400166 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:54:50.400128    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:55:06.166890 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:06.166830    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:55:26.014347 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:26.014303    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:55:51.873760 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:51.873662    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:55:52.175406 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:52.175304    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:55:52.655147 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:52.655112    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:55:54.920481 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:54.920442    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:55:55.019544 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:55.019440    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:55:56.075950 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.075910    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:55:56.173309 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.173256    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:55:56.525366 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.525326    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:55:56.627063 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.627026    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:55:56.637892 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.637858    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm"]
Sep 06 19:55:56.638317 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.638304    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50facaa1-6c1d-4e35-bfec-971a9d14b185" containerName="maas-api"
Sep 06 19:55:56.638361 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.638319    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="50facaa1-6c1d-4e35-bfec-971a9d14b185" containerName="maas-api"
Sep 06 19:55:56.638361 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.638331    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfc8f596-9e7c-4f98-84ce-e2b6df598f39" containerName="payload-processing"
Sep 06 19:55:56.638361 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.638337    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfc8f596-9e7c-4f98-84ce-e2b6df598f39" containerName="payload-processing"
Sep 06 19:55:56.638462 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.638409    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="50facaa1-6c1d-4e35-bfec-971a9d14b185" containerName="maas-api"
Sep 06 19:55:56.638462 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.638418    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfc8f596-9e7c-4f98-84ce-e2b6df598f39" containerName="payload-processing"
Sep 06 19:55:56.641468 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.641452    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm"
Sep 06 19:55:56.644114 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.644091    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-c95664\""
Sep 06 19:55:56.644315 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.644302    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-c95664-dockercfg-2zrrt\""
Sep 06 19:55:56.651293 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.651266    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm"]
Sep 06 19:55:56.670455 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.670413    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55"]
Sep 06 19:55:56.674395 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.674354    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55"
Sep 06 19:55:56.686119 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.686057    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55"]
Sep 06 19:55:56.810675 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.810576    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdqkk\" (UniqueName: \"kubernetes.io/projected/e2a5fc40-62cf-45c7-8bfb-266a322cf4d2-kube-api-access-zdqkk\") pod \"payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm\" (UID: \"e2a5fc40-62cf-45c7-8bfb-266a322cf4d2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm"
Sep 06 19:55:56.810878 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.810673    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxrpc\" (UniqueName: \"kubernetes.io/projected/25d99783-e9b9-4dd6-82d2-3e83c0f14b5c-kube-api-access-rxrpc\") pod \"payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55\" (UID: \"25d99783-e9b9-4dd6-82d2-3e83c0f14b5c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55"
Sep 06 19:55:56.810878 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.810743    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2a5fc40-62cf-45c7-8bfb-266a322cf4d2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm\" (UID: \"e2a5fc40-62cf-45c7-8bfb-266a322cf4d2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm"
Sep 06 19:55:56.810878 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.810841    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25d99783-e9b9-4dd6-82d2-3e83c0f14b5c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55\" (UID: \"25d99783-e9b9-4dd6-82d2-3e83c0f14b5c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55"
Sep 06 19:55:56.912148 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.912109    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdqkk\" (UniqueName: \"kubernetes.io/projected/e2a5fc40-62cf-45c7-8bfb-266a322cf4d2-kube-api-access-zdqkk\") pod \"payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm\" (UID: \"e2a5fc40-62cf-45c7-8bfb-266a322cf4d2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm"
Sep 06 19:55:56.912365 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.912165    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxrpc\" (UniqueName: \"kubernetes.io/projected/25d99783-e9b9-4dd6-82d2-3e83c0f14b5c-kube-api-access-rxrpc\") pod \"payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55\" (UID: \"25d99783-e9b9-4dd6-82d2-3e83c0f14b5c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55"
Sep 06 19:55:56.912365 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.912196    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2a5fc40-62cf-45c7-8bfb-266a322cf4d2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm\" (UID: \"e2a5fc40-62cf-45c7-8bfb-266a322cf4d2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm"
Sep 06 19:55:56.912365 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.912231    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25d99783-e9b9-4dd6-82d2-3e83c0f14b5c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55\" (UID: \"25d99783-e9b9-4dd6-82d2-3e83c0f14b5c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55"
Sep 06 19:55:56.912981 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.912951    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25d99783-e9b9-4dd6-82d2-3e83c0f14b5c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55\" (UID: \"25d99783-e9b9-4dd6-82d2-3e83c0f14b5c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55"
Sep 06 19:55:56.913107 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.913059    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2a5fc40-62cf-45c7-8bfb-266a322cf4d2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm\" (UID: \"e2a5fc40-62cf-45c7-8bfb-266a322cf4d2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm"
Sep 06 19:55:56.920288 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.920259    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdqkk\" (UniqueName: \"kubernetes.io/projected/e2a5fc40-62cf-45c7-8bfb-266a322cf4d2-kube-api-access-zdqkk\") pod \"payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm\" (UID: \"e2a5fc40-62cf-45c7-8bfb-266a322cf4d2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm"
Sep 06 19:55:56.920431 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.920304    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxrpc\" (UniqueName: \"kubernetes.io/projected/25d99783-e9b9-4dd6-82d2-3e83c0f14b5c-kube-api-access-rxrpc\") pod \"payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55\" (UID: \"25d99783-e9b9-4dd6-82d2-3e83c0f14b5c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55"
Sep 06 19:55:56.953398 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.953355    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm"
Sep 06 19:55:56.996091 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:56.995935    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55"
Sep 06 19:55:57.233689 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:57.233665    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm"]
Sep 06 19:55:57.235954 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:55:57.235927    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2a5fc40_62cf_45c7_8bfb_266a322cf4d2.slice/crio-0b4a00ddb0d7fcab73540b4321d2211bc41144a83fd8ed211008168aafd04559 WatchSource:0}: Error finding container 0b4a00ddb0d7fcab73540b4321d2211bc41144a83fd8ed211008168aafd04559: Status 404 returned error can't find the container with id 0b4a00ddb0d7fcab73540b4321d2211bc41144a83fd8ed211008168aafd04559
Sep 06 19:55:57.281644 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:57.281614    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55"]
Sep 06 19:55:57.283687 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:55:57.283652    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d99783_e9b9_4dd6_82d2_3e83c0f14b5c.slice/crio-bc3f459cb6634fe1f3bd9e22412ce7bee4829de6e61e016025c21130304db55b WatchSource:0}: Error finding container bc3f459cb6634fe1f3bd9e22412ce7bee4829de6e61e016025c21130304db55b: Status 404 returned error can't find the container with id bc3f459cb6634fe1f3bd9e22412ce7bee4829de6e61e016025c21130304db55b
Sep 06 19:55:57.822396 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:57.822360    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55" event={"ID":"25d99783-e9b9-4dd6-82d2-3e83c0f14b5c","Type":"ContainerStarted","Data":"f93930d416dc9b7303485a5a14633945eb4095f901e855b156947364d2ed16af"}
Sep 06 19:55:57.822604 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:57.822420    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55" event={"ID":"25d99783-e9b9-4dd6-82d2-3e83c0f14b5c","Type":"ContainerStarted","Data":"bc3f459cb6634fe1f3bd9e22412ce7bee4829de6e61e016025c21130304db55b"}
Sep 06 19:55:57.822604 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:57.822545    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55"
Sep 06 19:55:57.824244 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:57.824217    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm" event={"ID":"e2a5fc40-62cf-45c7-8bfb-266a322cf4d2","Type":"ContainerStarted","Data":"596f3f2865e42a5627e5d4fb5be22067b78e69619a18cf2ebd07b85183cfa21b"}
Sep 06 19:55:57.824406 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:57.824270    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm"
Sep 06 19:55:57.824406 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:57.824294    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm" event={"ID":"e2a5fc40-62cf-45c7-8bfb-266a322cf4d2","Type":"ContainerStarted","Data":"0b4a00ddb0d7fcab73540b4321d2211bc41144a83fd8ed211008168aafd04559"}
Sep 06 19:55:57.836859 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:57.836810    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55" podStartSLOduration=1.8367625140000001 podStartE2EDuration="1.836762514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:55:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:55:57.836121333 +0000 UTC m=+1721.241080405" watchObservedRunningTime="2026-09-06 19:55:57.836762514 +0000 UTC m=+1721.241721615"
Sep 06 19:55:57.852640 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:55:57.852583    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm" podStartSLOduration=1.85256454 podStartE2EDuration="1.85256454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:55:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:55:57.850861381 +0000 UTC m=+1721.255820463" watchObservedRunningTime="2026-09-06 19:55:57.85256454 +0000 UTC m=+1721.257523609"
Sep 06 19:56:00.823213 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:00.823171    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:56:08.832550 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:08.832507    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm"
Sep 06 19:56:08.832999 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:08.832584    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55"
Sep 06 19:56:19.908283 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:19.908234    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:56:26.551206 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.551169    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:56:26.572752 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.572716    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55"]
Sep 06 19:56:26.573054 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.573014    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55" podUID="25d99783-e9b9-4dd6-82d2-3e83c0f14b5c" containerName="payload-processing" containerID="cri-o://f93930d416dc9b7303485a5a14633945eb4095f901e855b156947364d2ed16af" gracePeriod=30
Sep 06 19:56:26.582120 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.582038    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm"]
Sep 06 19:56:26.583135 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.582276    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm" podUID="e2a5fc40-62cf-45c7-8bfb-266a322cf4d2" containerName="payload-pre-processing" containerID="cri-o://596f3f2865e42a5627e5d4fb5be22067b78e69619a18cf2ebd07b85183cfa21b" gracePeriod=30
Sep 06 19:56:26.610357 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.610274    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:56:26.672089 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.672057    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:56:26.728964 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.728934    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:56:26.781257 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.781206    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:56:26.869365 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.869343    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm"
Sep 06 19:56:26.872017 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.872000    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55"
Sep 06 19:56:26.978631 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.978592    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdqkk\" (UniqueName: \"kubernetes.io/projected/e2a5fc40-62cf-45c7-8bfb-266a322cf4d2-kube-api-access-zdqkk\") pod \"e2a5fc40-62cf-45c7-8bfb-266a322cf4d2\" (UID: \"e2a5fc40-62cf-45c7-8bfb-266a322cf4d2\") "
Sep 06 19:56:26.978870 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.978687    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25d99783-e9b9-4dd6-82d2-3e83c0f14b5c-plugins-config-volume\") pod \"25d99783-e9b9-4dd6-82d2-3e83c0f14b5c\" (UID: \"25d99783-e9b9-4dd6-82d2-3e83c0f14b5c\") "
Sep 06 19:56:26.978870 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.978756    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxrpc\" (UniqueName: \"kubernetes.io/projected/25d99783-e9b9-4dd6-82d2-3e83c0f14b5c-kube-api-access-rxrpc\") pod \"25d99783-e9b9-4dd6-82d2-3e83c0f14b5c\" (UID: \"25d99783-e9b9-4dd6-82d2-3e83c0f14b5c\") "
Sep 06 19:56:26.978870 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.978856    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2a5fc40-62cf-45c7-8bfb-266a322cf4d2-plugins-config-volume\") pod \"e2a5fc40-62cf-45c7-8bfb-266a322cf4d2\" (UID: \"e2a5fc40-62cf-45c7-8bfb-266a322cf4d2\") "
Sep 06 19:56:26.979127 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.979099    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25d99783-e9b9-4dd6-82d2-3e83c0f14b5c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "25d99783-e9b9-4dd6-82d2-3e83c0f14b5c" (UID: "25d99783-e9b9-4dd6-82d2-3e83c0f14b5c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:56:26.979247 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.979212    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2a5fc40-62cf-45c7-8bfb-266a322cf4d2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e2a5fc40-62cf-45c7-8bfb-266a322cf4d2" (UID: "e2a5fc40-62cf-45c7-8bfb-266a322cf4d2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:56:26.979247 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.979237    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25d99783-e9b9-4dd6-82d2-3e83c0f14b5c-plugins-config-volume\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:56:26.981011 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.980990    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2a5fc40-62cf-45c7-8bfb-266a322cf4d2-kube-api-access-zdqkk" (OuterVolumeSpecName: "kube-api-access-zdqkk") pod "e2a5fc40-62cf-45c7-8bfb-266a322cf4d2" (UID: "e2a5fc40-62cf-45c7-8bfb-266a322cf4d2"). InnerVolumeSpecName "kube-api-access-zdqkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:56:26.981078 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.981030    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25d99783-e9b9-4dd6-82d2-3e83c0f14b5c-kube-api-access-rxrpc" (OuterVolumeSpecName: "kube-api-access-rxrpc") pod "25d99783-e9b9-4dd6-82d2-3e83c0f14b5c" (UID: "25d99783-e9b9-4dd6-82d2-3e83c0f14b5c"). InnerVolumeSpecName "kube-api-access-rxrpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:56:26.992016 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.991985    2568 generic.go:356] "Generic (PLEG): container finished" podID="25d99783-e9b9-4dd6-82d2-3e83c0f14b5c" containerID="f93930d416dc9b7303485a5a14633945eb4095f901e855b156947364d2ed16af" exitCode=0
Sep 06 19:56:26.992132 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.992035    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55"
Sep 06 19:56:26.992132 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.992088    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55" event={"ID":"25d99783-e9b9-4dd6-82d2-3e83c0f14b5c","Type":"ContainerDied","Data":"f93930d416dc9b7303485a5a14633945eb4095f901e855b156947364d2ed16af"}
Sep 06 19:56:26.992254 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.992153    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55" event={"ID":"25d99783-e9b9-4dd6-82d2-3e83c0f14b5c","Type":"ContainerDied","Data":"bc3f459cb6634fe1f3bd9e22412ce7bee4829de6e61e016025c21130304db55b"}
Sep 06 19:56:26.992254 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.992188    2568 scope.go:117] "RemoveContainer" containerID="f93930d416dc9b7303485a5a14633945eb4095f901e855b156947364d2ed16af"
Sep 06 19:56:26.993587 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.993561    2568 generic.go:356] "Generic (PLEG): container finished" podID="e2a5fc40-62cf-45c7-8bfb-266a322cf4d2" containerID="596f3f2865e42a5627e5d4fb5be22067b78e69619a18cf2ebd07b85183cfa21b" exitCode=0
Sep 06 19:56:26.993695 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.993602    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm"
Sep 06 19:56:26.993695 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.993612    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm" event={"ID":"e2a5fc40-62cf-45c7-8bfb-266a322cf4d2","Type":"ContainerDied","Data":"596f3f2865e42a5627e5d4fb5be22067b78e69619a18cf2ebd07b85183cfa21b"}
Sep 06 19:56:26.993695 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:26.993652    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm" event={"ID":"e2a5fc40-62cf-45c7-8bfb-266a322cf4d2","Type":"ContainerDied","Data":"0b4a00ddb0d7fcab73540b4321d2211bc41144a83fd8ed211008168aafd04559"}
Sep 06 19:56:27.003666 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:27.003641    2568 scope.go:117] "RemoveContainer" containerID="f93930d416dc9b7303485a5a14633945eb4095f901e855b156947364d2ed16af"
Sep 06 19:56:27.004088 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:56:27.004056    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f93930d416dc9b7303485a5a14633945eb4095f901e855b156947364d2ed16af\": container with ID starting with f93930d416dc9b7303485a5a14633945eb4095f901e855b156947364d2ed16af not found: ID does not exist" containerID="f93930d416dc9b7303485a5a14633945eb4095f901e855b156947364d2ed16af"
Sep 06 19:56:27.004189 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:27.004096    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f93930d416dc9b7303485a5a14633945eb4095f901e855b156947364d2ed16af"} err="failed to get container status \"f93930d416dc9b7303485a5a14633945eb4095f901e855b156947364d2ed16af\": rpc error: code = NotFound desc = could not find container \"f93930d416dc9b7303485a5a14633945eb4095f901e855b156947364d2ed16af\": container with ID starting with f93930d416dc9b7303485a5a14633945eb4095f901e855b156947364d2ed16af not found: ID does not exist"
Sep 06 19:56:27.004189 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:27.004114    2568 scope.go:117] "RemoveContainer" containerID="596f3f2865e42a5627e5d4fb5be22067b78e69619a18cf2ebd07b85183cfa21b"
Sep 06 19:56:27.012950 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:27.012922    2568 scope.go:117] "RemoveContainer" containerID="596f3f2865e42a5627e5d4fb5be22067b78e69619a18cf2ebd07b85183cfa21b"
Sep 06 19:56:27.013248 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:56:27.013228    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"596f3f2865e42a5627e5d4fb5be22067b78e69619a18cf2ebd07b85183cfa21b\": container with ID starting with 596f3f2865e42a5627e5d4fb5be22067b78e69619a18cf2ebd07b85183cfa21b not found: ID does not exist" containerID="596f3f2865e42a5627e5d4fb5be22067b78e69619a18cf2ebd07b85183cfa21b"
Sep 06 19:56:27.013319 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:27.013254    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"596f3f2865e42a5627e5d4fb5be22067b78e69619a18cf2ebd07b85183cfa21b"} err="failed to get container status \"596f3f2865e42a5627e5d4fb5be22067b78e69619a18cf2ebd07b85183cfa21b\": rpc error: code = NotFound desc = could not find container \"596f3f2865e42a5627e5d4fb5be22067b78e69619a18cf2ebd07b85183cfa21b\": container with ID starting with 596f3f2865e42a5627e5d4fb5be22067b78e69619a18cf2ebd07b85183cfa21b not found: ID does not exist"
Sep 06 19:56:27.018554 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:27.018531    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm"]
Sep 06 19:56:27.022197 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:27.022176    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c95664-6f4bd4d778-v79gm"]
Sep 06 19:56:27.031454 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:27.031421    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55"]
Sep 06 19:56:27.033220 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:27.033188    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-c95664-7f87ff69d9-mrt55"]
Sep 06 19:56:27.080346 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:27.080306    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxrpc\" (UniqueName: \"kubernetes.io/projected/25d99783-e9b9-4dd6-82d2-3e83c0f14b5c-kube-api-access-rxrpc\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:56:27.080346 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:27.080339    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2a5fc40-62cf-45c7-8bfb-266a322cf4d2-plugins-config-volume\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:56:27.080346 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:27.080354    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdqkk\" (UniqueName: \"kubernetes.io/projected/e2a5fc40-62cf-45c7-8bfb-266a322cf4d2-kube-api-access-zdqkk\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:56:27.091738 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:27.091655    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:56:27.115977 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:27.115946    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25d99783-e9b9-4dd6-82d2-3e83c0f14b5c" path="/var/lib/kubelet/pods/25d99783-e9b9-4dd6-82d2-3e83c0f14b5c/volumes"
Sep 06 19:56:27.116317 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:27.116304    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2a5fc40-62cf-45c7-8bfb-266a322cf4d2" path="/var/lib/kubelet/pods/e2a5fc40-62cf-45c7-8bfb-266a322cf4d2/volumes"
Sep 06 19:56:32.888382 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:32.888345    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:56:32.989178 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:32.989135    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:56:33.141263 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:33.141171    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:56:36.697872 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:36.697830    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:56:52.068476 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.068427    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"]
Sep 06 19:56:52.069073 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.068715    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t" podUID="a82dbadd-cc4e-4c95-8a88-f9ef9eb847db" containerName="maas-api" containerID="cri-o://f17e0c45de73f556d8d71ff5ab4d9e0b65540cd579764948a1b1bc8c92d45a09" gracePeriod=30
Sep 06 19:56:52.094649 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.094612    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:56:52.121532 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.121493    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5"]
Sep 06 19:56:52.121803 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.121756    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5" podUID="d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828" containerName="payload-pre-processing" containerID="cri-o://4c31d34e02949a9cdf857d7abe586dbfb5bbf9838ea0c8fa0d23cb226b700b52" gracePeriod=30
Sep 06 19:56:52.195056 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.195013    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:56:52.262034 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.261952    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:56:52.318140 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.318049    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:56:52.385576 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.385548    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"
Sep 06 19:56:52.407769 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.407739    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xm7h\" (UniqueName: \"kubernetes.io/projected/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-kube-api-access-4xm7h\") pod \"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db\" (UID: \"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db\") "
Sep 06 19:56:52.408010 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.407887    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-metrics-certs\") pod \"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db\" (UID: \"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db\") "
Sep 06 19:56:52.408284 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.408259    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-openshift-service-ca\") pod \"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db\" (UID: \"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db\") "
Sep 06 19:56:52.408658 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.408609    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a82dbadd-cc4e-4c95-8a88-f9ef9eb847db" (UID: "a82dbadd-cc4e-4c95-8a88-f9ef9eb847db"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:56:52.408902 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.408884    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-maas-api-tls\") pod \"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db\" (UID: \"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db\") "
Sep 06 19:56:52.409579 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.409560    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-openshift-service-ca\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:56:52.410900 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.410838    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-kube-api-access-4xm7h" (OuterVolumeSpecName: "kube-api-access-4xm7h") pod "a82dbadd-cc4e-4c95-8a88-f9ef9eb847db" (UID: "a82dbadd-cc4e-4c95-8a88-f9ef9eb847db"). InnerVolumeSpecName "kube-api-access-4xm7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:56:52.411131 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.411111    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a82dbadd-cc4e-4c95-8a88-f9ef9eb847db" (UID: "a82dbadd-cc4e-4c95-8a88-f9ef9eb847db"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:56:52.411654 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.411621    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a82dbadd-cc4e-4c95-8a88-f9ef9eb847db" (UID: "a82dbadd-cc4e-4c95-8a88-f9ef9eb847db"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:56:52.423049 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.423027    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5"
Sep 06 19:56:52.510422 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.510393    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbj64\" (UniqueName: \"kubernetes.io/projected/d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828-kube-api-access-rbj64\") pod \"d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828\" (UID: \"d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828\") "
Sep 06 19:56:52.510603 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.510500    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828-plugins-config-volume\") pod \"d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828\" (UID: \"d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828\") "
Sep 06 19:56:52.510657 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.510647    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-maas-api-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:56:52.510693 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.510658    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xm7h\" (UniqueName: \"kubernetes.io/projected/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-kube-api-access-4xm7h\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:56:52.510693 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.510668    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db-metrics-certs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:56:52.510860 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.510835    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828" (UID: "d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:56:52.512699 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.512670    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828-kube-api-access-rbj64" (OuterVolumeSpecName: "kube-api-access-rbj64") pod "d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828" (UID: "d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828"). InnerVolumeSpecName "kube-api-access-rbj64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:56:52.611386 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.611296    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828-plugins-config-volume\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:56:52.611386 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.611328    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbj64\" (UniqueName: \"kubernetes.io/projected/d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828-kube-api-access-rbj64\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:56:52.628134 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:52.628095    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:56:53.138772 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:53.138741    2568 generic.go:356] "Generic (PLEG): container finished" podID="a82dbadd-cc4e-4c95-8a88-f9ef9eb847db" containerID="f17e0c45de73f556d8d71ff5ab4d9e0b65540cd579764948a1b1bc8c92d45a09" exitCode=0
Sep 06 19:56:53.139177 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:53.138826    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"
Sep 06 19:56:53.139177 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:53.138843    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t" event={"ID":"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db","Type":"ContainerDied","Data":"f17e0c45de73f556d8d71ff5ab4d9e0b65540cd579764948a1b1bc8c92d45a09"}
Sep 06 19:56:53.139177 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:53.138893    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t" event={"ID":"a82dbadd-cc4e-4c95-8a88-f9ef9eb847db","Type":"ContainerDied","Data":"8ff3f1fe3e85645b227f9cbae1c1573f6fe8a4afc3bce551363d90ec898c85c2"}
Sep 06 19:56:53.139177 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:53.138914    2568 scope.go:117] "RemoveContainer" containerID="f17e0c45de73f556d8d71ff5ab4d9e0b65540cd579764948a1b1bc8c92d45a09"
Sep 06 19:56:53.140570 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:53.140545    2568 generic.go:356] "Generic (PLEG): container finished" podID="d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828" containerID="4c31d34e02949a9cdf857d7abe586dbfb5bbf9838ea0c8fa0d23cb226b700b52" exitCode=0
Sep 06 19:56:53.140685 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:53.140618    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5" event={"ID":"d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828","Type":"ContainerDied","Data":"4c31d34e02949a9cdf857d7abe586dbfb5bbf9838ea0c8fa0d23cb226b700b52"}
Sep 06 19:56:53.140685 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:53.140651    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5"
Sep 06 19:56:53.140685 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:53.140662    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5" event={"ID":"d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828","Type":"ContainerDied","Data":"5fe6e73736a250225d984d89b26ba5d23b3c1ec6cf2e01ba1d5875ebc3e64897"}
Sep 06 19:56:53.148835 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:53.148818    2568 scope.go:117] "RemoveContainer" containerID="f17e0c45de73f556d8d71ff5ab4d9e0b65540cd579764948a1b1bc8c92d45a09"
Sep 06 19:56:53.149111 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:56:53.149091    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f17e0c45de73f556d8d71ff5ab4d9e0b65540cd579764948a1b1bc8c92d45a09\": container with ID starting with f17e0c45de73f556d8d71ff5ab4d9e0b65540cd579764948a1b1bc8c92d45a09 not found: ID does not exist" containerID="f17e0c45de73f556d8d71ff5ab4d9e0b65540cd579764948a1b1bc8c92d45a09"
Sep 06 19:56:53.149161 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:53.149121    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f17e0c45de73f556d8d71ff5ab4d9e0b65540cd579764948a1b1bc8c92d45a09"} err="failed to get container status \"f17e0c45de73f556d8d71ff5ab4d9e0b65540cd579764948a1b1bc8c92d45a09\": rpc error: code = NotFound desc = could not find container \"f17e0c45de73f556d8d71ff5ab4d9e0b65540cd579764948a1b1bc8c92d45a09\": container with ID starting with f17e0c45de73f556d8d71ff5ab4d9e0b65540cd579764948a1b1bc8c92d45a09 not found: ID does not exist"
Sep 06 19:56:53.149161 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:53.149142    2568 scope.go:117] "RemoveContainer" containerID="4c31d34e02949a9cdf857d7abe586dbfb5bbf9838ea0c8fa0d23cb226b700b52"
Sep 06 19:56:53.157754 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:53.157723    2568 scope.go:117] "RemoveContainer" containerID="4c31d34e02949a9cdf857d7abe586dbfb5bbf9838ea0c8fa0d23cb226b700b52"
Sep 06 19:56:53.158219 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:56:53.158181    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c31d34e02949a9cdf857d7abe586dbfb5bbf9838ea0c8fa0d23cb226b700b52\": container with ID starting with 4c31d34e02949a9cdf857d7abe586dbfb5bbf9838ea0c8fa0d23cb226b700b52 not found: ID does not exist" containerID="4c31d34e02949a9cdf857d7abe586dbfb5bbf9838ea0c8fa0d23cb226b700b52"
Sep 06 19:56:53.158324 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:53.158225    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c31d34e02949a9cdf857d7abe586dbfb5bbf9838ea0c8fa0d23cb226b700b52"} err="failed to get container status \"4c31d34e02949a9cdf857d7abe586dbfb5bbf9838ea0c8fa0d23cb226b700b52\": rpc error: code = NotFound desc = could not find container \"4c31d34e02949a9cdf857d7abe586dbfb5bbf9838ea0c8fa0d23cb226b700b52\": container with ID starting with 4c31d34e02949a9cdf857d7abe586dbfb5bbf9838ea0c8fa0d23cb226b700b52 not found: ID does not exist"
Sep 06 19:56:53.160198 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:53.160180    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5"]
Sep 06 19:56:53.164271 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:53.164252    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a30d6c-5b7545995d-nkwh5"]
Sep 06 19:56:53.173615 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:53.173592    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"]
Sep 06 19:56:53.175428 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:53.175408    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a30d6c-5cf555cd99-vsr8t"]
Sep 06 19:56:54.174956 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:54.174917    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:56:55.116107 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:55.116022    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a82dbadd-cc4e-4c95-8a88-f9ef9eb847db" path="/var/lib/kubelet/pods/a82dbadd-cc4e-4c95-8a88-f9ef9eb847db/volumes"
Sep 06 19:56:55.116384 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:55.116371    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828" path="/var/lib/kubelet/pods/d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828/volumes"
Sep 06 19:56:57.652862 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:56:57.652826    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:57:17.393402 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:57:17.393363    2568 scope.go:117] "RemoveContainer" containerID="e6444eaf4984960fc8c7a943bf8f7ff41b86f523d81652f7fc2363e2d0e70fe5"
Sep 06 19:57:22.149396 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:57:22.149358    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:57:33.745217 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:57:33.745146    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:57:34.731262 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:57:34.731226    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:57:40.118131 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:57:40.118090    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:57:40.181993 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:57:40.181953    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:57:40.400121 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:57:40.400081    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:57:40.959289 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:57:40.959253    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:57:51.128736 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:57:51.128695    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:57:51.196858 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:57:51.196825    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:57:51.255408 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:57:51.255369    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:57:51.314386 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:57:51.314350    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:57:51.653795 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:57:51.653740    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:57:57.299208 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:57:57.299169    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:57:57.352024 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:57:57.351986    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:57:57.569887 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:57:57.569739    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:57:57.983365 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:57:57.983323    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:58:08.416241 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.415739    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"]
Sep 06 19:58:08.416241 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.416026    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f" podUID="38d7f13e-7ef0-41d9-ab80-ac79a7f85a69" containerName="maas-api" containerID="cri-o://4f095bdd9f2c7472e143bfad6de906003850045edd03d302ae9170bfa911aaab" gracePeriod=30
Sep 06 19:58:08.442792 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.442735    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:58:08.467498 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.467463    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd"]
Sep 06 19:58:08.467711 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.467673    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd" podUID="b7f55c96-0eff-45dc-bcfb-0395dbd92fc1" containerName="payload-processing" containerID="cri-o://91f854471c085e9b7c55679767684a2a33a7e373c9c9a05e5119b15582f259c7" gracePeriod=30
Sep 06 19:58:08.476503 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.476468    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76"]
Sep 06 19:58:08.477757 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.476711    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76" podUID="815430f6-7d8d-4ea1-8146-c29135b5c131" containerName="payload-pre-processing" containerID="cri-o://e73aa2e7bc848a29a85fcd76a7df234b1b0f5932ed2cf3f4f9bae3c13d4e144b" gracePeriod=30
Sep 06 19:58:08.507852 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.507765    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:58:08.544589 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.544540    2568 generic.go:356] "Generic (PLEG): container finished" podID="38d7f13e-7ef0-41d9-ab80-ac79a7f85a69" containerID="4f095bdd9f2c7472e143bfad6de906003850045edd03d302ae9170bfa911aaab" exitCode=0
Sep 06 19:58:08.544804 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.544604    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f" event={"ID":"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69","Type":"ContainerDied","Data":"4f095bdd9f2c7472e143bfad6de906003850045edd03d302ae9170bfa911aaab"}
Sep 06 19:58:08.565086 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.565042    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:58:08.623155 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.623094    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:58:08.676315 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.676169    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:58:08.755990 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.755955    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd"
Sep 06 19:58:08.783352 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.783324    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76"
Sep 06 19:58:08.794344 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.794310    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"
Sep 06 19:58:08.914569 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.914527    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-openshift-service-ca\") pod \"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69\" (UID: \"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69\") "
Sep 06 19:58:08.914763 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.914599    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbvzr\" (UniqueName: \"kubernetes.io/projected/815430f6-7d8d-4ea1-8146-c29135b5c131-kube-api-access-fbvzr\") pod \"815430f6-7d8d-4ea1-8146-c29135b5c131\" (UID: \"815430f6-7d8d-4ea1-8146-c29135b5c131\") "
Sep 06 19:58:08.914763 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.914728    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5p4gg\" (UniqueName: \"kubernetes.io/projected/b7f55c96-0eff-45dc-bcfb-0395dbd92fc1-kube-api-access-5p4gg\") pod \"b7f55c96-0eff-45dc-bcfb-0395dbd92fc1\" (UID: \"b7f55c96-0eff-45dc-bcfb-0395dbd92fc1\") "
Sep 06 19:58:08.914934 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.914772    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfmbl\" (UniqueName: \"kubernetes.io/projected/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-kube-api-access-qfmbl\") pod \"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69\" (UID: \"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69\") "
Sep 06 19:58:08.914934 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.914845    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-metrics-certs\") pod \"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69\" (UID: \"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69\") "
Sep 06 19:58:08.914934 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.914871    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/815430f6-7d8d-4ea1-8146-c29135b5c131-plugins-config-volume\") pod \"815430f6-7d8d-4ea1-8146-c29135b5c131\" (UID: \"815430f6-7d8d-4ea1-8146-c29135b5c131\") "
Sep 06 19:58:08.914934 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.914903    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-maas-api-tls\") pod \"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69\" (UID: \"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69\") "
Sep 06 19:58:08.914934 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.914921    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7f55c96-0eff-45dc-bcfb-0395dbd92fc1-plugins-config-volume\") pod \"b7f55c96-0eff-45dc-bcfb-0395dbd92fc1\" (UID: \"b7f55c96-0eff-45dc-bcfb-0395dbd92fc1\") "
Sep 06 19:58:08.915205 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.914973    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "38d7f13e-7ef0-41d9-ab80-ac79a7f85a69" (UID: "38d7f13e-7ef0-41d9-ab80-ac79a7f85a69"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:58:08.915340 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.915313    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7f55c96-0eff-45dc-bcfb-0395dbd92fc1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b7f55c96-0eff-45dc-bcfb-0395dbd92fc1" (UID: "b7f55c96-0eff-45dc-bcfb-0395dbd92fc1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:58:08.915546 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.915370    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-openshift-service-ca\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:58:08.915546 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.915531    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/815430f6-7d8d-4ea1-8146-c29135b5c131-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "815430f6-7d8d-4ea1-8146-c29135b5c131" (UID: "815430f6-7d8d-4ea1-8146-c29135b5c131"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:58:08.917150 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.917117    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7f55c96-0eff-45dc-bcfb-0395dbd92fc1-kube-api-access-5p4gg" (OuterVolumeSpecName: "kube-api-access-5p4gg") pod "b7f55c96-0eff-45dc-bcfb-0395dbd92fc1" (UID: "b7f55c96-0eff-45dc-bcfb-0395dbd92fc1"). InnerVolumeSpecName "kube-api-access-5p4gg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:58:08.917150 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.917129    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "38d7f13e-7ef0-41d9-ab80-ac79a7f85a69" (UID: "38d7f13e-7ef0-41d9-ab80-ac79a7f85a69"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:58:08.917330 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.917225    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "38d7f13e-7ef0-41d9-ab80-ac79a7f85a69" (UID: "38d7f13e-7ef0-41d9-ab80-ac79a7f85a69"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:58:08.917548 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.917527    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/815430f6-7d8d-4ea1-8146-c29135b5c131-kube-api-access-fbvzr" (OuterVolumeSpecName: "kube-api-access-fbvzr") pod "815430f6-7d8d-4ea1-8146-c29135b5c131" (UID: "815430f6-7d8d-4ea1-8146-c29135b5c131"). InnerVolumeSpecName "kube-api-access-fbvzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:58:08.917548 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.917534    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-kube-api-access-qfmbl" (OuterVolumeSpecName: "kube-api-access-qfmbl") pod "38d7f13e-7ef0-41d9-ab80-ac79a7f85a69" (UID: "38d7f13e-7ef0-41d9-ab80-ac79a7f85a69"). InnerVolumeSpecName "kube-api-access-qfmbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:58:08.992847 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:08.992706    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:58:09.016298 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.016266    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbvzr\" (UniqueName: \"kubernetes.io/projected/815430f6-7d8d-4ea1-8146-c29135b5c131-kube-api-access-fbvzr\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:58:09.016298 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.016296    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5p4gg\" (UniqueName: \"kubernetes.io/projected/b7f55c96-0eff-45dc-bcfb-0395dbd92fc1-kube-api-access-5p4gg\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:58:09.016298 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.016306    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfmbl\" (UniqueName: \"kubernetes.io/projected/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-kube-api-access-qfmbl\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:58:09.016596 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.016316    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-metrics-certs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:58:09.016596 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.016324    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/815430f6-7d8d-4ea1-8146-c29135b5c131-plugins-config-volume\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:58:09.016596 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.016332    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69-maas-api-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:58:09.016596 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.016340    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7f55c96-0eff-45dc-bcfb-0395dbd92fc1-plugins-config-volume\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:58:09.551755 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.551712    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"
Sep 06 19:58:09.552276 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.551712    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f" event={"ID":"38d7f13e-7ef0-41d9-ab80-ac79a7f85a69","Type":"ContainerDied","Data":"f1a1fb1b474c0881b73845b31b300ae226ac626cc96c064f95e954d71703f7b2"}
Sep 06 19:58:09.552276 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.551851    2568 scope.go:117] "RemoveContainer" containerID="4f095bdd9f2c7472e143bfad6de906003850045edd03d302ae9170bfa911aaab"
Sep 06 19:58:09.553342 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.553318    2568 generic.go:356] "Generic (PLEG): container finished" podID="b7f55c96-0eff-45dc-bcfb-0395dbd92fc1" containerID="91f854471c085e9b7c55679767684a2a33a7e373c9c9a05e5119b15582f259c7" exitCode=0
Sep 06 19:58:09.553418 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.553358    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd"
Sep 06 19:58:09.553418 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.553402    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd" event={"ID":"b7f55c96-0eff-45dc-bcfb-0395dbd92fc1","Type":"ContainerDied","Data":"91f854471c085e9b7c55679767684a2a33a7e373c9c9a05e5119b15582f259c7"}
Sep 06 19:58:09.553581 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.553447    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd" event={"ID":"b7f55c96-0eff-45dc-bcfb-0395dbd92fc1","Type":"ContainerDied","Data":"14054694a0129712b38b6e21cc1e398ec96c66d4b5762456c915197d1261c407"}
Sep 06 19:58:09.554981 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.554958    2568 generic.go:356] "Generic (PLEG): container finished" podID="815430f6-7d8d-4ea1-8146-c29135b5c131" containerID="e73aa2e7bc848a29a85fcd76a7df234b1b0f5932ed2cf3f4f9bae3c13d4e144b" exitCode=0
Sep 06 19:58:09.555091 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.555009    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76"
Sep 06 19:58:09.555091 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.555039    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76" event={"ID":"815430f6-7d8d-4ea1-8146-c29135b5c131","Type":"ContainerDied","Data":"e73aa2e7bc848a29a85fcd76a7df234b1b0f5932ed2cf3f4f9bae3c13d4e144b"}
Sep 06 19:58:09.555182 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.555090    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76" event={"ID":"815430f6-7d8d-4ea1-8146-c29135b5c131","Type":"ContainerDied","Data":"def4a4aeb42c8355e3cb210a0ac13d378bd60e5d88854a4fea477487a67d89b5"}
Sep 06 19:58:09.561842 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.561824    2568 scope.go:117] "RemoveContainer" containerID="91f854471c085e9b7c55679767684a2a33a7e373c9c9a05e5119b15582f259c7"
Sep 06 19:58:09.569966 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.569949    2568 scope.go:117] "RemoveContainer" containerID="91f854471c085e9b7c55679767684a2a33a7e373c9c9a05e5119b15582f259c7"
Sep 06 19:58:09.570245 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:58:09.570226    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91f854471c085e9b7c55679767684a2a33a7e373c9c9a05e5119b15582f259c7\": container with ID starting with 91f854471c085e9b7c55679767684a2a33a7e373c9c9a05e5119b15582f259c7 not found: ID does not exist" containerID="91f854471c085e9b7c55679767684a2a33a7e373c9c9a05e5119b15582f259c7"
Sep 06 19:58:09.570299 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.570252    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91f854471c085e9b7c55679767684a2a33a7e373c9c9a05e5119b15582f259c7"} err="failed to get container status \"91f854471c085e9b7c55679767684a2a33a7e373c9c9a05e5119b15582f259c7\": rpc error: code = NotFound desc = could not find container \"91f854471c085e9b7c55679767684a2a33a7e373c9c9a05e5119b15582f259c7\": container with ID starting with 91f854471c085e9b7c55679767684a2a33a7e373c9c9a05e5119b15582f259c7 not found: ID does not exist"
Sep 06 19:58:09.570299 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.570268    2568 scope.go:117] "RemoveContainer" containerID="e73aa2e7bc848a29a85fcd76a7df234b1b0f5932ed2cf3f4f9bae3c13d4e144b"
Sep 06 19:58:09.578049 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.578028    2568 scope.go:117] "RemoveContainer" containerID="e73aa2e7bc848a29a85fcd76a7df234b1b0f5932ed2cf3f4f9bae3c13d4e144b"
Sep 06 19:58:09.578362 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:58:09.578342    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e73aa2e7bc848a29a85fcd76a7df234b1b0f5932ed2cf3f4f9bae3c13d4e144b\": container with ID starting with e73aa2e7bc848a29a85fcd76a7df234b1b0f5932ed2cf3f4f9bae3c13d4e144b not found: ID does not exist" containerID="e73aa2e7bc848a29a85fcd76a7df234b1b0f5932ed2cf3f4f9bae3c13d4e144b"
Sep 06 19:58:09.578434 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.578371    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e73aa2e7bc848a29a85fcd76a7df234b1b0f5932ed2cf3f4f9bae3c13d4e144b"} err="failed to get container status \"e73aa2e7bc848a29a85fcd76a7df234b1b0f5932ed2cf3f4f9bae3c13d4e144b\": rpc error: code = NotFound desc = could not find container \"e73aa2e7bc848a29a85fcd76a7df234b1b0f5932ed2cf3f4f9bae3c13d4e144b\": container with ID starting with e73aa2e7bc848a29a85fcd76a7df234b1b0f5932ed2cf3f4f9bae3c13d4e144b not found: ID does not exist"
Sep 06 19:58:09.592384 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.592358    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"]
Sep 06 19:58:09.597333 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.597308    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b571c4-6f45f45c89-cjw2f"]
Sep 06 19:58:09.610670 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.610636    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd"]
Sep 06 19:58:09.614498 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.614470    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-b571c4-df5775df9-jbvhd"]
Sep 06 19:58:09.624994 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.624964    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76"]
Sep 06 19:58:09.628748 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:09.628714    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b571c4-7c99cccb9d-wpw76"]
Sep 06 19:58:11.117732 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:11.117698    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38d7f13e-7ef0-41d9-ab80-ac79a7f85a69" path="/var/lib/kubelet/pods/38d7f13e-7ef0-41d9-ab80-ac79a7f85a69/volumes"
Sep 06 19:58:11.118321 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:11.118289    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="815430f6-7d8d-4ea1-8146-c29135b5c131" path="/var/lib/kubelet/pods/815430f6-7d8d-4ea1-8146-c29135b5c131/volumes"
Sep 06 19:58:11.118736 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:11.118713    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7f55c96-0eff-45dc-bcfb-0395dbd92fc1" path="/var/lib/kubelet/pods/b7f55c96-0eff-45dc-bcfb-0395dbd92fc1/volumes"
Sep 06 19:58:12.107473 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:12.107438    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:58:15.134075 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:15.134038    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:58:15.234876 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:15.234825    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:58:15.408412 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:15.408318    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:58:15.972540 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:15.972485    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:58:26.126068 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.126026    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"]
Sep 06 19:58:26.126972 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.126897    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7" podUID="5cb91197-5432-411b-9967-3e3a0b4e958d" containerName="maas-api" containerID="cri-o://937c177321f3dc35f54e15a63669029546fb47b7e1b087c0a0fb1f4f35d6fb5a" gracePeriod=30
Sep 06 19:58:26.155638 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.155598    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:58:26.221548 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.221504    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:58:26.321725 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.321613    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:58:26.376744 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.376660    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:58:26.393140 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.393115    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"
Sep 06 19:58:26.573593 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.573564    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cb91197-5432-411b-9967-3e3a0b4e958d-openshift-service-ca\") pod \"5cb91197-5432-411b-9967-3e3a0b4e958d\" (UID: \"5cb91197-5432-411b-9967-3e3a0b4e958d\") "
Sep 06 19:58:26.573829 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.573615    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cb91197-5432-411b-9967-3e3a0b4e958d-metrics-certs\") pod \"5cb91197-5432-411b-9967-3e3a0b4e958d\" (UID: \"5cb91197-5432-411b-9967-3e3a0b4e958d\") "
Sep 06 19:58:26.573829 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.573648    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cb91197-5432-411b-9967-3e3a0b4e958d-maas-api-tls\") pod \"5cb91197-5432-411b-9967-3e3a0b4e958d\" (UID: \"5cb91197-5432-411b-9967-3e3a0b4e958d\") "
Sep 06 19:58:26.573829 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.573672    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjrlm\" (UniqueName: \"kubernetes.io/projected/5cb91197-5432-411b-9967-3e3a0b4e958d-kube-api-access-gjrlm\") pod \"5cb91197-5432-411b-9967-3e3a0b4e958d\" (UID: \"5cb91197-5432-411b-9967-3e3a0b4e958d\") "
Sep 06 19:58:26.574009 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.573951    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cb91197-5432-411b-9967-3e3a0b4e958d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5cb91197-5432-411b-9967-3e3a0b4e958d" (UID: "5cb91197-5432-411b-9967-3e3a0b4e958d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 19:58:26.575892 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.575862    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cb91197-5432-411b-9967-3e3a0b4e958d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5cb91197-5432-411b-9967-3e3a0b4e958d" (UID: "5cb91197-5432-411b-9967-3e3a0b4e958d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:58:26.576008 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.575899    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cb91197-5432-411b-9967-3e3a0b4e958d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5cb91197-5432-411b-9967-3e3a0b4e958d" (UID: "5cb91197-5432-411b-9967-3e3a0b4e958d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:58:26.576008 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.575959    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cb91197-5432-411b-9967-3e3a0b4e958d-kube-api-access-gjrlm" (OuterVolumeSpecName: "kube-api-access-gjrlm") pod "5cb91197-5432-411b-9967-3e3a0b4e958d" (UID: "5cb91197-5432-411b-9967-3e3a0b4e958d"). InnerVolumeSpecName "kube-api-access-gjrlm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:58:26.647315 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.647221    2568 generic.go:356] "Generic (PLEG): container finished" podID="5cb91197-5432-411b-9967-3e3a0b4e958d" containerID="937c177321f3dc35f54e15a63669029546fb47b7e1b087c0a0fb1f4f35d6fb5a" exitCode=0
Sep 06 19:58:26.647315 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.647277    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"
Sep 06 19:58:26.647315 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.647305    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7" event={"ID":"5cb91197-5432-411b-9967-3e3a0b4e958d","Type":"ContainerDied","Data":"937c177321f3dc35f54e15a63669029546fb47b7e1b087c0a0fb1f4f35d6fb5a"}
Sep 06 19:58:26.647594 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.647357    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7" event={"ID":"5cb91197-5432-411b-9967-3e3a0b4e958d","Type":"ContainerDied","Data":"f27ae6d648b549ffbbe989ca02b2077de60f51916e2f810153d6a2be7865b0e0"}
Sep 06 19:58:26.647594 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.647380    2568 scope.go:117] "RemoveContainer" containerID="937c177321f3dc35f54e15a63669029546fb47b7e1b087c0a0fb1f4f35d6fb5a"
Sep 06 19:58:26.656705 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.656684    2568 scope.go:117] "RemoveContainer" containerID="937c177321f3dc35f54e15a63669029546fb47b7e1b087c0a0fb1f4f35d6fb5a"
Sep 06 19:58:26.657016 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:58:26.656991    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"937c177321f3dc35f54e15a63669029546fb47b7e1b087c0a0fb1f4f35d6fb5a\": container with ID starting with 937c177321f3dc35f54e15a63669029546fb47b7e1b087c0a0fb1f4f35d6fb5a not found: ID does not exist" containerID="937c177321f3dc35f54e15a63669029546fb47b7e1b087c0a0fb1f4f35d6fb5a"
Sep 06 19:58:26.657100 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.657028    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"937c177321f3dc35f54e15a63669029546fb47b7e1b087c0a0fb1f4f35d6fb5a"} err="failed to get container status \"937c177321f3dc35f54e15a63669029546fb47b7e1b087c0a0fb1f4f35d6fb5a\": rpc error: code = NotFound desc = could not find container \"937c177321f3dc35f54e15a63669029546fb47b7e1b087c0a0fb1f4f35d6fb5a\": container with ID starting with 937c177321f3dc35f54e15a63669029546fb47b7e1b087c0a0fb1f4f35d6fb5a not found: ID does not exist"
Sep 06 19:58:26.667743 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.667717    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"]
Sep 06 19:58:26.673137 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.673116    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-712616-6589795869-8hzc7"]
Sep 06 19:58:26.674644 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.674622    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cb91197-5432-411b-9967-3e3a0b4e958d-maas-api-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:58:26.674644 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.674641    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjrlm\" (UniqueName: \"kubernetes.io/projected/5cb91197-5432-411b-9967-3e3a0b4e958d-kube-api-access-gjrlm\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:58:26.674809 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.674651    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cb91197-5432-411b-9967-3e3a0b4e958d-openshift-service-ca\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:58:26.674809 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.674660    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cb91197-5432-411b-9967-3e3a0b4e958d-metrics-certs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:58:26.726456 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:26.726421    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:58:27.115933 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:27.115852    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cb91197-5432-411b-9967-3e3a0b4e958d" path="/var/lib/kubelet/pods/5cb91197-5432-411b-9967-3e3a0b4e958d/volumes"
Sep 06 19:58:32.351954 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:32.351901    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:58:33.513606 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:33.513564    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:58:35.239769 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:35.239731    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-785588cb-8rcpm"]
Sep 06 19:58:35.240233 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:35.239977    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-785588cb-8rcpm" podUID="22502a87-c696-4516-9f31-338877e8d756" containerName="manager" containerID="cri-o://7cd0e43bef3b821e232866337af1a2f8f9e72b346338490f548e06850f508f8c" gracePeriod=30
Sep 06 19:58:35.487829 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:35.487770    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-785588cb-8rcpm"
Sep 06 19:58:35.541275 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:35.541184    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22502a87-c696-4516-9f31-338877e8d756-webhook-cert\") pod \"22502a87-c696-4516-9f31-338877e8d756\" (UID: \"22502a87-c696-4516-9f31-338877e8d756\") "
Sep 06 19:58:35.541419 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:35.541277    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22502a87-c696-4516-9f31-338877e8d756-metrics-certs\") pod \"22502a87-c696-4516-9f31-338877e8d756\" (UID: \"22502a87-c696-4516-9f31-338877e8d756\") "
Sep 06 19:58:35.541419 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:35.541332    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rb9xr\" (UniqueName: \"kubernetes.io/projected/22502a87-c696-4516-9f31-338877e8d756-kube-api-access-rb9xr\") pod \"22502a87-c696-4516-9f31-338877e8d756\" (UID: \"22502a87-c696-4516-9f31-338877e8d756\") "
Sep 06 19:58:35.543357 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:35.543327    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22502a87-c696-4516-9f31-338877e8d756-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "22502a87-c696-4516-9f31-338877e8d756" (UID: "22502a87-c696-4516-9f31-338877e8d756"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:58:35.543503 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:35.543479    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22502a87-c696-4516-9f31-338877e8d756-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "22502a87-c696-4516-9f31-338877e8d756" (UID: "22502a87-c696-4516-9f31-338877e8d756"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:58:35.543590 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:35.543572    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22502a87-c696-4516-9f31-338877e8d756-kube-api-access-rb9xr" (OuterVolumeSpecName: "kube-api-access-rb9xr") pod "22502a87-c696-4516-9f31-338877e8d756" (UID: "22502a87-c696-4516-9f31-338877e8d756"). InnerVolumeSpecName "kube-api-access-rb9xr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:58:35.642609 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:35.642567    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22502a87-c696-4516-9f31-338877e8d756-metrics-certs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:58:35.642609 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:35.642599    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rb9xr\" (UniqueName: \"kubernetes.io/projected/22502a87-c696-4516-9f31-338877e8d756-kube-api-access-rb9xr\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:58:35.642609 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:35.642612    2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22502a87-c696-4516-9f31-338877e8d756-webhook-cert\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:58:35.694309 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:35.694274    2568 generic.go:356] "Generic (PLEG): container finished" podID="22502a87-c696-4516-9f31-338877e8d756" containerID="7cd0e43bef3b821e232866337af1a2f8f9e72b346338490f548e06850f508f8c" exitCode=0
Sep 06 19:58:35.694447 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:35.694318    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-785588cb-8rcpm"
Sep 06 19:58:35.694447 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:35.694357    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-785588cb-8rcpm" event={"ID":"22502a87-c696-4516-9f31-338877e8d756","Type":"ContainerDied","Data":"7cd0e43bef3b821e232866337af1a2f8f9e72b346338490f548e06850f508f8c"}
Sep 06 19:58:35.694447 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:35.694409    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-785588cb-8rcpm" event={"ID":"22502a87-c696-4516-9f31-338877e8d756","Type":"ContainerDied","Data":"87bb40e6f65c948d6c36b136ac5445d084fedc5c592d2b4c19716bf5aca83c99"}
Sep 06 19:58:35.694447 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:35.694433    2568 scope.go:117] "RemoveContainer" containerID="7cd0e43bef3b821e232866337af1a2f8f9e72b346338490f548e06850f508f8c"
Sep 06 19:58:35.704413 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:35.704393    2568 scope.go:117] "RemoveContainer" containerID="7cd0e43bef3b821e232866337af1a2f8f9e72b346338490f548e06850f508f8c"
Sep 06 19:58:35.704735 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:58:35.704712    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cd0e43bef3b821e232866337af1a2f8f9e72b346338490f548e06850f508f8c\": container with ID starting with 7cd0e43bef3b821e232866337af1a2f8f9e72b346338490f548e06850f508f8c not found: ID does not exist" containerID="7cd0e43bef3b821e232866337af1a2f8f9e72b346338490f548e06850f508f8c"
Sep 06 19:58:35.704818 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:35.704761    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cd0e43bef3b821e232866337af1a2f8f9e72b346338490f548e06850f508f8c"} err="failed to get container status \"7cd0e43bef3b821e232866337af1a2f8f9e72b346338490f548e06850f508f8c\": rpc error: code = NotFound desc = could not find container \"7cd0e43bef3b821e232866337af1a2f8f9e72b346338490f548e06850f508f8c\": container with ID starting with 7cd0e43bef3b821e232866337af1a2f8f9e72b346338490f548e06850f508f8c not found: ID does not exist"
Sep 06 19:58:35.716337 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:35.716303    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-785588cb-8rcpm"]
Sep 06 19:58:35.720100 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:35.720072    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-785588cb-8rcpm"]
Sep 06 19:58:37.121241 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:58:37.121199    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22502a87-c696-4516-9f31-338877e8d756" path="/var/lib/kubelet/pods/22502a87-c696-4516-9f31-338877e8d756/volumes"
Sep 06 19:59:36.518670 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.518632    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-785588cb-rcvjg"]
Sep 06 19:59:36.519212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519047    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38d7f13e-7ef0-41d9-ab80-ac79a7f85a69" containerName="maas-api"
Sep 06 19:59:36.519212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519060    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="38d7f13e-7ef0-41d9-ab80-ac79a7f85a69" containerName="maas-api"
Sep 06 19:59:36.519212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519070    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7f55c96-0eff-45dc-bcfb-0395dbd92fc1" containerName="payload-processing"
Sep 06 19:59:36.519212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519076    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7f55c96-0eff-45dc-bcfb-0395dbd92fc1" containerName="payload-processing"
Sep 06 19:59:36.519212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519083    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cb91197-5432-411b-9967-3e3a0b4e958d" containerName="maas-api"
Sep 06 19:59:36.519212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519089    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cb91197-5432-411b-9967-3e3a0b4e958d" containerName="maas-api"
Sep 06 19:59:36.519212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519098    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a82dbadd-cc4e-4c95-8a88-f9ef9eb847db" containerName="maas-api"
Sep 06 19:59:36.519212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519103    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a82dbadd-cc4e-4c95-8a88-f9ef9eb847db" containerName="maas-api"
Sep 06 19:59:36.519212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519109    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2a5fc40-62cf-45c7-8bfb-266a322cf4d2" containerName="payload-pre-processing"
Sep 06 19:59:36.519212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519114    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2a5fc40-62cf-45c7-8bfb-266a322cf4d2" containerName="payload-pre-processing"
Sep 06 19:59:36.519212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519124    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22502a87-c696-4516-9f31-338877e8d756" containerName="manager"
Sep 06 19:59:36.519212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519129    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="22502a87-c696-4516-9f31-338877e8d756" containerName="manager"
Sep 06 19:59:36.519212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519135    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25d99783-e9b9-4dd6-82d2-3e83c0f14b5c" containerName="payload-processing"
Sep 06 19:59:36.519212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519140    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="25d99783-e9b9-4dd6-82d2-3e83c0f14b5c" containerName="payload-processing"
Sep 06 19:59:36.519212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519150    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828" containerName="payload-pre-processing"
Sep 06 19:59:36.519212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519155    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828" containerName="payload-pre-processing"
Sep 06 19:59:36.519212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519163    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="815430f6-7d8d-4ea1-8146-c29135b5c131" containerName="payload-pre-processing"
Sep 06 19:59:36.519212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519168    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="815430f6-7d8d-4ea1-8146-c29135b5c131" containerName="payload-pre-processing"
Sep 06 19:59:36.519212 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519222    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="815430f6-7d8d-4ea1-8146-c29135b5c131" containerName="payload-pre-processing"
Sep 06 19:59:36.519918 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519231    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="38d7f13e-7ef0-41d9-ab80-ac79a7f85a69" containerName="maas-api"
Sep 06 19:59:36.519918 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519236    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cb91197-5432-411b-9967-3e3a0b4e958d" containerName="maas-api"
Sep 06 19:59:36.519918 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519243    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7f55c96-0eff-45dc-bcfb-0395dbd92fc1" containerName="payload-processing"
Sep 06 19:59:36.519918 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519249    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2a5fc40-62cf-45c7-8bfb-266a322cf4d2" containerName="payload-pre-processing"
Sep 06 19:59:36.519918 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519254    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2f7c5c4-1d51-4e82-ac38-e9ee34dc6828" containerName="payload-pre-processing"
Sep 06 19:59:36.519918 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519260    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="22502a87-c696-4516-9f31-338877e8d756" containerName="manager"
Sep 06 19:59:36.519918 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519266    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="25d99783-e9b9-4dd6-82d2-3e83c0f14b5c" containerName="payload-processing"
Sep 06 19:59:36.519918 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.519271    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a82dbadd-cc4e-4c95-8a88-f9ef9eb847db" containerName="maas-api"
Sep 06 19:59:36.522298 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.522283    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-785588cb-rcvjg"
Sep 06 19:59:36.525807 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.525755    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 06 19:59:36.525807 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.525795    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 06 19:59:36.525807 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.525764    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 06 19:59:36.526036 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.525764    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-clffn\""
Sep 06 19:59:36.529936 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.529739    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-785588cb-rcvjg"]
Sep 06 19:59:36.595391 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.595353    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f294a5e-5947-4f9d-b607-796f8f0ca63e-webhook-cert\") pod \"maas-controller-785588cb-rcvjg\" (UID: \"6f294a5e-5947-4f9d-b607-796f8f0ca63e\") " pod="opendatahub/maas-controller-785588cb-rcvjg"
Sep 06 19:59:36.595569 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.595412    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmzcx\" (UniqueName: \"kubernetes.io/projected/6f294a5e-5947-4f9d-b607-796f8f0ca63e-kube-api-access-pmzcx\") pod \"maas-controller-785588cb-rcvjg\" (UID: \"6f294a5e-5947-4f9d-b607-796f8f0ca63e\") " pod="opendatahub/maas-controller-785588cb-rcvjg"
Sep 06 19:59:36.595569 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.595494    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f294a5e-5947-4f9d-b607-796f8f0ca63e-metrics-certs\") pod \"maas-controller-785588cb-rcvjg\" (UID: \"6f294a5e-5947-4f9d-b607-796f8f0ca63e\") " pod="opendatahub/maas-controller-785588cb-rcvjg"
Sep 06 19:59:36.696685 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.696630    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmzcx\" (UniqueName: \"kubernetes.io/projected/6f294a5e-5947-4f9d-b607-796f8f0ca63e-kube-api-access-pmzcx\") pod \"maas-controller-785588cb-rcvjg\" (UID: \"6f294a5e-5947-4f9d-b607-796f8f0ca63e\") " pod="opendatahub/maas-controller-785588cb-rcvjg"
Sep 06 19:59:36.696887 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.696704    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f294a5e-5947-4f9d-b607-796f8f0ca63e-metrics-certs\") pod \"maas-controller-785588cb-rcvjg\" (UID: \"6f294a5e-5947-4f9d-b607-796f8f0ca63e\") " pod="opendatahub/maas-controller-785588cb-rcvjg"
Sep 06 19:59:36.696887 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.696806    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f294a5e-5947-4f9d-b607-796f8f0ca63e-webhook-cert\") pod \"maas-controller-785588cb-rcvjg\" (UID: \"6f294a5e-5947-4f9d-b607-796f8f0ca63e\") " pod="opendatahub/maas-controller-785588cb-rcvjg"
Sep 06 19:59:36.706178 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.699730    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f294a5e-5947-4f9d-b607-796f8f0ca63e-webhook-cert\") pod \"maas-controller-785588cb-rcvjg\" (UID: \"6f294a5e-5947-4f9d-b607-796f8f0ca63e\") " pod="opendatahub/maas-controller-785588cb-rcvjg"
Sep 06 19:59:36.706178 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.699769    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f294a5e-5947-4f9d-b607-796f8f0ca63e-metrics-certs\") pod \"maas-controller-785588cb-rcvjg\" (UID: \"6f294a5e-5947-4f9d-b607-796f8f0ca63e\") " pod="opendatahub/maas-controller-785588cb-rcvjg"
Sep 06 19:59:36.709388 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.709359    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmzcx\" (UniqueName: \"kubernetes.io/projected/6f294a5e-5947-4f9d-b607-796f8f0ca63e-kube-api-access-pmzcx\") pod \"maas-controller-785588cb-rcvjg\" (UID: \"6f294a5e-5947-4f9d-b607-796f8f0ca63e\") " pod="opendatahub/maas-controller-785588cb-rcvjg"
Sep 06 19:59:36.833170 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:36.833062    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-785588cb-rcvjg"
Sep 06 19:59:37.105739 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:37.105662    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-785588cb-rcvjg"]
Sep 06 19:59:37.108489 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:59:37.108460    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f294a5e_5947_4f9d_b607_796f8f0ca63e.slice/crio-abaf4011b1b1e657d30881e47eda38ad2fd90333547e979c38d4340c6aad8458 WatchSource:0}: Error finding container abaf4011b1b1e657d30881e47eda38ad2fd90333547e979c38d4340c6aad8458: Status 404 returned error can't find the container with id abaf4011b1b1e657d30881e47eda38ad2fd90333547e979c38d4340c6aad8458
Sep 06 19:59:37.109935 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:37.109913    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 19:59:38.005237 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:38.005189    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-785588cb-rcvjg" event={"ID":"6f294a5e-5947-4f9d-b607-796f8f0ca63e","Type":"ContainerStarted","Data":"4eca26e34a1a9d9ccb1fcd52d14ebe174af4332d7f53a0e29a6c3dfd159f24ac"}
Sep 06 19:59:38.005676 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:38.005252    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-785588cb-rcvjg" event={"ID":"6f294a5e-5947-4f9d-b607-796f8f0ca63e","Type":"ContainerStarted","Data":"abaf4011b1b1e657d30881e47eda38ad2fd90333547e979c38d4340c6aad8458"}
Sep 06 19:59:38.005676 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:38.005376    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-785588cb-rcvjg"
Sep 06 19:59:38.021679 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:38.021624    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-785588cb-rcvjg" podStartSLOduration=1.520053235 podStartE2EDuration="2.021604436s" totalImagesPullingTime="501.551201ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:59:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:59:38.020251812 +0000 UTC m=+1941.425210894" watchObservedRunningTime="2026-09-06 19:59:38.021604436 +0000 UTC m=+1941.426563506"
Sep 06 19:59:49.013487 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:49.013453    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-785588cb-rcvjg"
Sep 06 19:59:55.562340 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:55.562304    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:59:56.142075 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:56.142021    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:59:56.233115 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:56.233071    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-785588cb-rcvjg"]
Sep 06 19:59:56.233339 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:56.233280    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-785588cb-rcvjg" podUID="6f294a5e-5947-4f9d-b607-796f8f0ca63e" containerName="manager" containerID="cri-o://4eca26e34a1a9d9ccb1fcd52d14ebe174af4332d7f53a0e29a6c3dfd159f24ac" gracePeriod=30
Sep 06 19:59:56.488886 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:56.488849    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-785588cb-rcvjg"
Sep 06 19:59:56.574296 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:56.574261    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f294a5e-5947-4f9d-b607-796f8f0ca63e-metrics-certs\") pod \"6f294a5e-5947-4f9d-b607-796f8f0ca63e\" (UID: \"6f294a5e-5947-4f9d-b607-796f8f0ca63e\") "
Sep 06 19:59:56.574666 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:56.574339    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmzcx\" (UniqueName: \"kubernetes.io/projected/6f294a5e-5947-4f9d-b607-796f8f0ca63e-kube-api-access-pmzcx\") pod \"6f294a5e-5947-4f9d-b607-796f8f0ca63e\" (UID: \"6f294a5e-5947-4f9d-b607-796f8f0ca63e\") "
Sep 06 19:59:56.574666 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:56.574386    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f294a5e-5947-4f9d-b607-796f8f0ca63e-webhook-cert\") pod \"6f294a5e-5947-4f9d-b607-796f8f0ca63e\" (UID: \"6f294a5e-5947-4f9d-b607-796f8f0ca63e\") "
Sep 06 19:59:56.576567 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:56.576520    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f294a5e-5947-4f9d-b607-796f8f0ca63e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6f294a5e-5947-4f9d-b607-796f8f0ca63e" (UID: "6f294a5e-5947-4f9d-b607-796f8f0ca63e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:59:56.576698 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:56.576591    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f294a5e-5947-4f9d-b607-796f8f0ca63e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6f294a5e-5947-4f9d-b607-796f8f0ca63e" (UID: "6f294a5e-5947-4f9d-b607-796f8f0ca63e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 19:59:56.576698 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:56.576596    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f294a5e-5947-4f9d-b607-796f8f0ca63e-kube-api-access-pmzcx" (OuterVolumeSpecName: "kube-api-access-pmzcx") pod "6f294a5e-5947-4f9d-b607-796f8f0ca63e" (UID: "6f294a5e-5947-4f9d-b607-796f8f0ca63e"). InnerVolumeSpecName "kube-api-access-pmzcx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 19:59:56.675548 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:56.675463    2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f294a5e-5947-4f9d-b607-796f8f0ca63e-webhook-cert\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:59:56.675548 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:56.675493    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f294a5e-5947-4f9d-b607-796f8f0ca63e-metrics-certs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:59:56.675548 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:56.675505    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmzcx\" (UniqueName: \"kubernetes.io/projected/6f294a5e-5947-4f9d-b607-796f8f0ca63e-kube-api-access-pmzcx\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 19:59:57.098127 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:57.098030    2568 generic.go:356] "Generic (PLEG): container finished" podID="6f294a5e-5947-4f9d-b607-796f8f0ca63e" containerID="4eca26e34a1a9d9ccb1fcd52d14ebe174af4332d7f53a0e29a6c3dfd159f24ac" exitCode=0
Sep 06 19:59:57.098127 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:57.098080    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-785588cb-rcvjg"
Sep 06 19:59:57.098312 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:57.098116    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-785588cb-rcvjg" event={"ID":"6f294a5e-5947-4f9d-b607-796f8f0ca63e","Type":"ContainerDied","Data":"4eca26e34a1a9d9ccb1fcd52d14ebe174af4332d7f53a0e29a6c3dfd159f24ac"}
Sep 06 19:59:57.098312 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:57.098193    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-785588cb-rcvjg" event={"ID":"6f294a5e-5947-4f9d-b607-796f8f0ca63e","Type":"ContainerDied","Data":"abaf4011b1b1e657d30881e47eda38ad2fd90333547e979c38d4340c6aad8458"}
Sep 06 19:59:57.098312 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:57.098215    2568 scope.go:117] "RemoveContainer" containerID="4eca26e34a1a9d9ccb1fcd52d14ebe174af4332d7f53a0e29a6c3dfd159f24ac"
Sep 06 19:59:57.107565 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:57.107546    2568 scope.go:117] "RemoveContainer" containerID="4eca26e34a1a9d9ccb1fcd52d14ebe174af4332d7f53a0e29a6c3dfd159f24ac"
Sep 06 19:59:57.107860 ip-10-0-135-174 kubenswrapper[2568]: E0906 19:59:57.107836    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4eca26e34a1a9d9ccb1fcd52d14ebe174af4332d7f53a0e29a6c3dfd159f24ac\": container with ID starting with 4eca26e34a1a9d9ccb1fcd52d14ebe174af4332d7f53a0e29a6c3dfd159f24ac not found: ID does not exist" containerID="4eca26e34a1a9d9ccb1fcd52d14ebe174af4332d7f53a0e29a6c3dfd159f24ac"
Sep 06 19:59:57.107959 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:57.107866    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eca26e34a1a9d9ccb1fcd52d14ebe174af4332d7f53a0e29a6c3dfd159f24ac"} err="failed to get container status \"4eca26e34a1a9d9ccb1fcd52d14ebe174af4332d7f53a0e29a6c3dfd159f24ac\": rpc error: code = NotFound desc = could not find container \"4eca26e34a1a9d9ccb1fcd52d14ebe174af4332d7f53a0e29a6c3dfd159f24ac\": container with ID starting with 4eca26e34a1a9d9ccb1fcd52d14ebe174af4332d7f53a0e29a6c3dfd159f24ac not found: ID does not exist"
Sep 06 19:59:57.118952 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:57.118922    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-785588cb-rcvjg"]
Sep 06 19:59:57.120485 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:57.120464    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-785588cb-rcvjg"]
Sep 06 19:59:57.776419 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:57.776381    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 19:59:57.899312 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:57.899277    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-785588cb-vww97"]
Sep 06 19:59:57.899751 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:57.899735    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f294a5e-5947-4f9d-b607-796f8f0ca63e" containerName="manager"
Sep 06 19:59:57.899844 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:57.899754    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f294a5e-5947-4f9d-b607-796f8f0ca63e" containerName="manager"
Sep 06 19:59:57.899903 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:57.899849    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f294a5e-5947-4f9d-b607-796f8f0ca63e" containerName="manager"
Sep 06 19:59:57.904163 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:57.904139    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-785588cb-vww97"
Sep 06 19:59:57.907905 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:57.907884    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-clffn\""
Sep 06 19:59:57.907905 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:57.907897    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 06 19:59:57.908104 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:57.907884    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 06 19:59:57.908104 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:57.907935    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 06 19:59:57.911527 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:57.911505    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-785588cb-vww97"]
Sep 06 19:59:57.986528 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:57.986481    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/66b766ab-0cfa-42a2-adcc-9052341e3666-webhook-cert\") pod \"maas-controller-785588cb-vww97\" (UID: \"66b766ab-0cfa-42a2-adcc-9052341e3666\") " pod="opendatahub/maas-controller-785588cb-vww97"
Sep 06 19:59:57.986528 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:57.986533    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66b766ab-0cfa-42a2-adcc-9052341e3666-metrics-certs\") pod \"maas-controller-785588cb-vww97\" (UID: \"66b766ab-0cfa-42a2-adcc-9052341e3666\") " pod="opendatahub/maas-controller-785588cb-vww97"
Sep 06 19:59:57.986772 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:57.986651    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbm2c\" (UniqueName: \"kubernetes.io/projected/66b766ab-0cfa-42a2-adcc-9052341e3666-kube-api-access-kbm2c\") pod \"maas-controller-785588cb-vww97\" (UID: \"66b766ab-0cfa-42a2-adcc-9052341e3666\") " pod="opendatahub/maas-controller-785588cb-vww97"
Sep 06 19:59:58.087890 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:58.087771    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbm2c\" (UniqueName: \"kubernetes.io/projected/66b766ab-0cfa-42a2-adcc-9052341e3666-kube-api-access-kbm2c\") pod \"maas-controller-785588cb-vww97\" (UID: \"66b766ab-0cfa-42a2-adcc-9052341e3666\") " pod="opendatahub/maas-controller-785588cb-vww97"
Sep 06 19:59:58.087890 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:58.087881    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/66b766ab-0cfa-42a2-adcc-9052341e3666-webhook-cert\") pod \"maas-controller-785588cb-vww97\" (UID: \"66b766ab-0cfa-42a2-adcc-9052341e3666\") " pod="opendatahub/maas-controller-785588cb-vww97"
Sep 06 19:59:58.088104 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:58.087915    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66b766ab-0cfa-42a2-adcc-9052341e3666-metrics-certs\") pod \"maas-controller-785588cb-vww97\" (UID: \"66b766ab-0cfa-42a2-adcc-9052341e3666\") " pod="opendatahub/maas-controller-785588cb-vww97"
Sep 06 19:59:58.090724 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:58.090692    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66b766ab-0cfa-42a2-adcc-9052341e3666-metrics-certs\") pod \"maas-controller-785588cb-vww97\" (UID: \"66b766ab-0cfa-42a2-adcc-9052341e3666\") " pod="opendatahub/maas-controller-785588cb-vww97"
Sep 06 19:59:58.090903 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:58.090692    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/66b766ab-0cfa-42a2-adcc-9052341e3666-webhook-cert\") pod \"maas-controller-785588cb-vww97\" (UID: \"66b766ab-0cfa-42a2-adcc-9052341e3666\") " pod="opendatahub/maas-controller-785588cb-vww97"
Sep 06 19:59:58.095157 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:58.095132    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbm2c\" (UniqueName: \"kubernetes.io/projected/66b766ab-0cfa-42a2-adcc-9052341e3666-kube-api-access-kbm2c\") pod \"maas-controller-785588cb-vww97\" (UID: \"66b766ab-0cfa-42a2-adcc-9052341e3666\") " pod="opendatahub/maas-controller-785588cb-vww97"
Sep 06 19:59:58.215898 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:58.215863    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-785588cb-vww97"
Sep 06 19:59:58.487570 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:58.487545    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-785588cb-vww97"]
Sep 06 19:59:58.489290 ip-10-0-135-174 kubenswrapper[2568]: W0906 19:59:58.489260    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66b766ab_0cfa_42a2_adcc_9052341e3666.slice/crio-8618ebb15cb7e7a69aa935d49aecedde768aa5d6cd1bb4e4dca58d96cf6960aa WatchSource:0}: Error finding container 8618ebb15cb7e7a69aa935d49aecedde768aa5d6cd1bb4e4dca58d96cf6960aa: Status 404 returned error can't find the container with id 8618ebb15cb7e7a69aa935d49aecedde768aa5d6cd1bb4e4dca58d96cf6960aa
Sep 06 19:59:59.117145 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:59.117054    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f294a5e-5947-4f9d-b607-796f8f0ca63e" path="/var/lib/kubelet/pods/6f294a5e-5947-4f9d-b607-796f8f0ca63e/volumes"
Sep 06 19:59:59.117514 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:59.117426    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-785588cb-vww97"
Sep 06 19:59:59.117514 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:59.117482    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-785588cb-vww97" event={"ID":"66b766ab-0cfa-42a2-adcc-9052341e3666","Type":"ContainerStarted","Data":"b375b907b568f7e3ccb8b950dc0c39367f6c561a3cca72f637fd2fdaf04907f1"}
Sep 06 19:59:59.117514 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:59.117509    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-785588cb-vww97" event={"ID":"66b766ab-0cfa-42a2-adcc-9052341e3666","Type":"ContainerStarted","Data":"8618ebb15cb7e7a69aa935d49aecedde768aa5d6cd1bb4e4dca58d96cf6960aa"}
Sep 06 19:59:59.131622 ip-10-0-135-174 kubenswrapper[2568]: I0906 19:59:59.131573    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-785588cb-vww97" podStartSLOduration=1.786215238 podStartE2EDuration="2.131559453s" totalImagesPullingTime="345.344215ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 19:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 19:59:59.130134422 +0000 UTC m=+1962.535093492" watchObservedRunningTime="2026-09-06 19:59:59.131559453 +0000 UTC m=+1962.536518522"
Sep 06 20:00:04.778139 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:00:04.778101    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 20:00:10.120362 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:00:10.120269    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-785588cb-vww97"
Sep 06 20:00:57.013068 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:00:57.013024    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw"]
Sep 06 20:00:57.013539 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:00:57.013310    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw" podUID="544bdb4e-a2c9-4be3-ad11-69ccf819a939" containerName="manager" containerID="cri-o://5ed304c68b2dc18e45b8bd926b379c092ade0a73854766d0adb74d1aeaf07b70" gracePeriod=10
Sep 06 20:00:58.062609 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:00:58.062585    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw"
Sep 06 20:00:58.206485 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:00:58.206388    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rvqk\" (UniqueName: \"kubernetes.io/projected/544bdb4e-a2c9-4be3-ad11-69ccf819a939-kube-api-access-5rvqk\") pod \"544bdb4e-a2c9-4be3-ad11-69ccf819a939\" (UID: \"544bdb4e-a2c9-4be3-ad11-69ccf819a939\") "
Sep 06 20:00:58.206485 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:00:58.206461    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/544bdb4e-a2c9-4be3-ad11-69ccf819a939-extensions-socket-volume\") pod \"544bdb4e-a2c9-4be3-ad11-69ccf819a939\" (UID: \"544bdb4e-a2c9-4be3-ad11-69ccf819a939\") "
Sep 06 20:00:58.206873 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:00:58.206843    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/544bdb4e-a2c9-4be3-ad11-69ccf819a939-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "544bdb4e-a2c9-4be3-ad11-69ccf819a939" (UID: "544bdb4e-a2c9-4be3-ad11-69ccf819a939"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 20:00:58.208730 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:00:58.208706    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/544bdb4e-a2c9-4be3-ad11-69ccf819a939-kube-api-access-5rvqk" (OuterVolumeSpecName: "kube-api-access-5rvqk") pod "544bdb4e-a2c9-4be3-ad11-69ccf819a939" (UID: "544bdb4e-a2c9-4be3-ad11-69ccf819a939"). InnerVolumeSpecName "kube-api-access-5rvqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 20:00:58.307176 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:00:58.307134    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/544bdb4e-a2c9-4be3-ad11-69ccf819a939-extensions-socket-volume\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 20:00:58.307176 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:00:58.307168    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rvqk\" (UniqueName: \"kubernetes.io/projected/544bdb4e-a2c9-4be3-ad11-69ccf819a939-kube-api-access-5rvqk\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 20:00:58.418498 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:00:58.418463    2568 generic.go:356] "Generic (PLEG): container finished" podID="544bdb4e-a2c9-4be3-ad11-69ccf819a939" containerID="5ed304c68b2dc18e45b8bd926b379c092ade0a73854766d0adb74d1aeaf07b70" exitCode=0
Sep 06 20:00:58.418685 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:00:58.418505    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw"
Sep 06 20:00:58.418685 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:00:58.418539    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw" event={"ID":"544bdb4e-a2c9-4be3-ad11-69ccf819a939","Type":"ContainerDied","Data":"5ed304c68b2dc18e45b8bd926b379c092ade0a73854766d0adb74d1aeaf07b70"}
Sep 06 20:00:58.418685 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:00:58.418584    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw" event={"ID":"544bdb4e-a2c9-4be3-ad11-69ccf819a939","Type":"ContainerDied","Data":"18d68553a63265d151a7e0e6c672ea3db1f0a18e84f19e7f05b523e41025bd07"}
Sep 06 20:00:58.418685 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:00:58.418605    2568 scope.go:117] "RemoveContainer" containerID="5ed304c68b2dc18e45b8bd926b379c092ade0a73854766d0adb74d1aeaf07b70"
Sep 06 20:00:58.428671 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:00:58.428649    2568 scope.go:117] "RemoveContainer" containerID="5ed304c68b2dc18e45b8bd926b379c092ade0a73854766d0adb74d1aeaf07b70"
Sep 06 20:00:58.428973 ip-10-0-135-174 kubenswrapper[2568]: E0906 20:00:58.428952    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ed304c68b2dc18e45b8bd926b379c092ade0a73854766d0adb74d1aeaf07b70\": container with ID starting with 5ed304c68b2dc18e45b8bd926b379c092ade0a73854766d0adb74d1aeaf07b70 not found: ID does not exist" containerID="5ed304c68b2dc18e45b8bd926b379c092ade0a73854766d0adb74d1aeaf07b70"
Sep 06 20:00:58.429039 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:00:58.428983    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ed304c68b2dc18e45b8bd926b379c092ade0a73854766d0adb74d1aeaf07b70"} err="failed to get container status \"5ed304c68b2dc18e45b8bd926b379c092ade0a73854766d0adb74d1aeaf07b70\": rpc error: code = NotFound desc = could not find container \"5ed304c68b2dc18e45b8bd926b379c092ade0a73854766d0adb74d1aeaf07b70\": container with ID starting with 5ed304c68b2dc18e45b8bd926b379c092ade0a73854766d0adb74d1aeaf07b70 not found: ID does not exist"
Sep 06 20:00:58.441410 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:00:58.441378    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw"]
Sep 06 20:00:58.445234 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:00:58.445211    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8pgjw"]
Sep 06 20:00:59.115561 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:00:59.115525    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="544bdb4e-a2c9-4be3-ad11-69ccf819a939" path="/var/lib/kubelet/pods/544bdb4e-a2c9-4be3-ad11-69ccf819a939/volumes"
Sep 06 20:01:06.466267 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:01:06.466224    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 20:01:36.376343 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:01:36.376298    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 20:01:57.689959 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:01:57.689928    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5pg4p"]
Sep 06 20:01:57.690401 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:01:57.690286    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="544bdb4e-a2c9-4be3-ad11-69ccf819a939" containerName="manager"
Sep 06 20:01:57.690401 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:01:57.690297    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="544bdb4e-a2c9-4be3-ad11-69ccf819a939" containerName="manager"
Sep 06 20:01:57.690401 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:01:57.690369    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="544bdb4e-a2c9-4be3-ad11-69ccf819a939" containerName="manager"
Sep 06 20:01:57.693253 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:01:57.693236    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5pg4p"
Sep 06 20:01:57.695720 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:01:57.695689    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-986z8\""
Sep 06 20:01:57.706181 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:01:57.706157    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5pg4p"]
Sep 06 20:01:57.745362 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:01:57.745327    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqsfq\" (UniqueName: \"kubernetes.io/projected/1f2743e9-1d22-4088-96da-526e4e3a6a60-kube-api-access-sqsfq\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-5pg4p\" (UID: \"1f2743e9-1d22-4088-96da-526e4e3a6a60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5pg4p"
Sep 06 20:01:57.745512 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:01:57.745382    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f2743e9-1d22-4088-96da-526e4e3a6a60-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-5pg4p\" (UID: \"1f2743e9-1d22-4088-96da-526e4e3a6a60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5pg4p"
Sep 06 20:01:57.846549 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:01:57.846516    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqsfq\" (UniqueName: \"kubernetes.io/projected/1f2743e9-1d22-4088-96da-526e4e3a6a60-kube-api-access-sqsfq\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-5pg4p\" (UID: \"1f2743e9-1d22-4088-96da-526e4e3a6a60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5pg4p"
Sep 06 20:01:57.846724 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:01:57.846585    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f2743e9-1d22-4088-96da-526e4e3a6a60-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-5pg4p\" (UID: \"1f2743e9-1d22-4088-96da-526e4e3a6a60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5pg4p"
Sep 06 20:01:57.847023 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:01:57.847003    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f2743e9-1d22-4088-96da-526e4e3a6a60-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-5pg4p\" (UID: \"1f2743e9-1d22-4088-96da-526e4e3a6a60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5pg4p"
Sep 06 20:01:57.855370 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:01:57.855342    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqsfq\" (UniqueName: \"kubernetes.io/projected/1f2743e9-1d22-4088-96da-526e4e3a6a60-kube-api-access-sqsfq\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-5pg4p\" (UID: \"1f2743e9-1d22-4088-96da-526e4e3a6a60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5pg4p"
Sep 06 20:01:58.004071 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:01:58.003977    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5pg4p"
Sep 06 20:01:58.286316 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:01:58.286292    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5pg4p"]
Sep 06 20:01:58.289408 ip-10-0-135-174 kubenswrapper[2568]: W0906 20:01:58.289383    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f2743e9_1d22_4088_96da_526e4e3a6a60.slice/crio-96c4974deadfb276b9c5adb4825b5041f9746e0a9f1c6ffcae0ba141ebe9c7fe WatchSource:0}: Error finding container 96c4974deadfb276b9c5adb4825b5041f9746e0a9f1c6ffcae0ba141ebe9c7fe: Status 404 returned error can't find the container with id 96c4974deadfb276b9c5adb4825b5041f9746e0a9f1c6ffcae0ba141ebe9c7fe
Sep 06 20:01:58.715697 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:01:58.715660    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5pg4p" event={"ID":"1f2743e9-1d22-4088-96da-526e4e3a6a60","Type":"ContainerStarted","Data":"6405ea42e63855a305fd73b150f601719d43844ec65d4eb9651738797346e76e"}
Sep 06 20:01:58.716130 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:01:58.715714    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5pg4p" event={"ID":"1f2743e9-1d22-4088-96da-526e4e3a6a60","Type":"ContainerStarted","Data":"96c4974deadfb276b9c5adb4825b5041f9746e0a9f1c6ffcae0ba141ebe9c7fe"}
Sep 06 20:01:58.716130 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:01:58.715885    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5pg4p"
Sep 06 20:01:58.735361 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:01:58.735308    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5pg4p" podStartSLOduration=1.735286922 podStartE2EDuration="1.735286922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 20:01:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 20:01:58.734166531 +0000 UTC m=+2082.139125600" watchObservedRunningTime="2026-09-06 20:01:58.735286922 +0000 UTC m=+2082.140245991"
Sep 06 20:02:09.723857 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:09.723823    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-5pg4p"
Sep 06 20:02:43.070000 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:43.069965    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 20:02:52.536348 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.536313    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"]
Sep 06 20:02:52.540114 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.540087    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:02:52.542820 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.542792    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-90c1ebd6-kserve-self-signed-certs\""
Sep 06 20:02:52.550869 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.550842    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"]
Sep 06 20:02:52.561999 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.561964    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 20:02:52.625899 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.625857    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a1b77c6-357a-48d5-800d-8eb600000924-tls-certs\") pod \"e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") " pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:02:52.626080 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.625912    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-home\") pod \"e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") " pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:02:52.626080 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.625970    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-dshm\") pod \"e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") " pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:02:52.626080 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.625986    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-model-cache\") pod \"e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") " pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:02:52.626080 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.626003    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-tmp-dir\") pod \"e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") " pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:02:52.626080 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.626022    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lj47\" (UniqueName: \"kubernetes.io/projected/5a1b77c6-357a-48d5-800d-8eb600000924-kube-api-access-6lj47\") pod \"e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") " pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:02:52.727273 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.727226    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a1b77c6-357a-48d5-800d-8eb600000924-tls-certs\") pod \"e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") " pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:02:52.727273 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.727278    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-home\") pod \"e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") " pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:02:52.727550 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.727317    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-dshm\") pod \"e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") " pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:02:52.727550 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.727341    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-model-cache\") pod \"e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") " pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:02:52.727550 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.727362    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-tmp-dir\") pod \"e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") " pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:02:52.727550 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.727386    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lj47\" (UniqueName: \"kubernetes.io/projected/5a1b77c6-357a-48d5-800d-8eb600000924-kube-api-access-6lj47\") pod \"e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") " pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:02:52.727853 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.727833    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-home\") pod \"e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") " pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:02:52.727906 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.727889    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-model-cache\") pod \"e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") " pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:02:52.727949 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.727933    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-tmp-dir\") pod \"e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") " pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:02:52.729895 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.729875    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-dshm\") pod \"e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") " pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:02:52.730054 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.730036    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a1b77c6-357a-48d5-800d-8eb600000924-tls-certs\") pod \"e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") " pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:02:52.734126 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.734105    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lj47\" (UniqueName: \"kubernetes.io/projected/5a1b77c6-357a-48d5-800d-8eb600000924-kube-api-access-6lj47\") pod \"e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") " pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:02:52.851916 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:52.851817    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:02:53.126913 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:53.126887    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"]
Sep 06 20:02:53.129663 ip-10-0-135-174 kubenswrapper[2568]: W0906 20:02:53.129624    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a1b77c6_357a_48d5_800d_8eb600000924.slice/crio-713488df21e7d35cdc8e72fb01eca7e534cf131ce1b535fb9ac6debb6389d2b7 WatchSource:0}: Error finding container 713488df21e7d35cdc8e72fb01eca7e534cf131ce1b535fb9ac6debb6389d2b7: Status 404 returned error can't find the container with id 713488df21e7d35cdc8e72fb01eca7e534cf131ce1b535fb9ac6debb6389d2b7
Sep 06 20:02:54.006614 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:54.006575    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7" event={"ID":"5a1b77c6-357a-48d5-800d-8eb600000924","Type":"ContainerStarted","Data":"5a8179f06775dcfc37ea724720f5f691d436ca75bf99fd35d510278fbb07e362"}
Sep 06 20:02:54.006614 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:54.006617    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7" event={"ID":"5a1b77c6-357a-48d5-800d-8eb600000924","Type":"ContainerStarted","Data":"713488df21e7d35cdc8e72fb01eca7e534cf131ce1b535fb9ac6debb6389d2b7"}
Sep 06 20:02:54.022486 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:02:54.022426    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7" podStartSLOduration=2.022407629 podStartE2EDuration="2.022407629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 20:02:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 20:02:54.020824254 +0000 UTC m=+2137.425783319" watchObservedRunningTime="2026-09-06 20:02:54.022407629 +0000 UTC m=+2137.427366740"
Sep 06 20:03:02.852348 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:02.852292    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:03:02.852348 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:02.852361    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:03:02.865530 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:02.865505    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:03:03.063874 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:03.063845    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:03:15.887900 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:15.887862    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 20:03:17.324843 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:17.324806    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"]
Sep 06 20:03:17.335160 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:17.335129    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 20:03:18.285338 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:18.285300    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 20:03:18.423358 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:18.423320    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 20:03:32.346039 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:32.345989    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7" podUID="5a1b77c6-357a-48d5-800d-8eb600000924" containerName="main" containerID="cri-o://5a8179f06775dcfc37ea724720f5f691d436ca75bf99fd35d510278fbb07e362" gracePeriod=45
Sep 06 20:03:32.609759 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:32.609692    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:03:32.682790 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:32.682737    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a1b77c6-357a-48d5-800d-8eb600000924-tls-certs\") pod \"5a1b77c6-357a-48d5-800d-8eb600000924\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") "
Sep 06 20:03:32.682991 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:32.682830    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-model-cache\") pod \"5a1b77c6-357a-48d5-800d-8eb600000924\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") "
Sep 06 20:03:32.682991 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:32.682860    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-tmp-dir\") pod \"5a1b77c6-357a-48d5-800d-8eb600000924\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") "
Sep 06 20:03:32.682991 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:32.682927    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lj47\" (UniqueName: \"kubernetes.io/projected/5a1b77c6-357a-48d5-800d-8eb600000924-kube-api-access-6lj47\") pod \"5a1b77c6-357a-48d5-800d-8eb600000924\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") "
Sep 06 20:03:32.682991 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:32.682948    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-home\") pod \"5a1b77c6-357a-48d5-800d-8eb600000924\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") "
Sep 06 20:03:32.682991 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:32.682966    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-dshm\") pod \"5a1b77c6-357a-48d5-800d-8eb600000924\" (UID: \"5a1b77c6-357a-48d5-800d-8eb600000924\") "
Sep 06 20:03:32.683274 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:32.683122    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-model-cache" (OuterVolumeSpecName: "model-cache") pod "5a1b77c6-357a-48d5-800d-8eb600000924" (UID: "5a1b77c6-357a-48d5-800d-8eb600000924"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 20:03:32.683274 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:32.683244    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-model-cache\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 20:03:32.683274 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:32.683255    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5a1b77c6-357a-48d5-800d-8eb600000924" (UID: "5a1b77c6-357a-48d5-800d-8eb600000924"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 20:03:32.683394 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:32.683269    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-home" (OuterVolumeSpecName: "home") pod "5a1b77c6-357a-48d5-800d-8eb600000924" (UID: "5a1b77c6-357a-48d5-800d-8eb600000924"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 20:03:32.685309 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:32.685281    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a1b77c6-357a-48d5-800d-8eb600000924-kube-api-access-6lj47" (OuterVolumeSpecName: "kube-api-access-6lj47") pod "5a1b77c6-357a-48d5-800d-8eb600000924" (UID: "5a1b77c6-357a-48d5-800d-8eb600000924"). InnerVolumeSpecName "kube-api-access-6lj47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 20:03:32.685309 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:32.685297    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-dshm" (OuterVolumeSpecName: "dshm") pod "5a1b77c6-357a-48d5-800d-8eb600000924" (UID: "5a1b77c6-357a-48d5-800d-8eb600000924"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 20:03:32.685417 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:32.685339    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a1b77c6-357a-48d5-800d-8eb600000924-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5a1b77c6-357a-48d5-800d-8eb600000924" (UID: "5a1b77c6-357a-48d5-800d-8eb600000924"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 20:03:32.784451 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:32.784409    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a1b77c6-357a-48d5-800d-8eb600000924-tls-certs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 20:03:32.784451 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:32.784439    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-tmp-dir\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 20:03:32.784451 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:32.784454    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lj47\" (UniqueName: \"kubernetes.io/projected/5a1b77c6-357a-48d5-800d-8eb600000924-kube-api-access-6lj47\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 20:03:32.784684 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:32.784465    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-home\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 20:03:32.784684 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:32.784474    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a1b77c6-357a-48d5-800d-8eb600000924-dshm\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 20:03:33.199971 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:33.199930    2568 generic.go:356] "Generic (PLEG): container finished" podID="5a1b77c6-357a-48d5-800d-8eb600000924" containerID="5a8179f06775dcfc37ea724720f5f691d436ca75bf99fd35d510278fbb07e362" exitCode=0
Sep 06 20:03:33.200161 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:33.200005    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"
Sep 06 20:03:33.200161 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:33.200023    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7" event={"ID":"5a1b77c6-357a-48d5-800d-8eb600000924","Type":"ContainerDied","Data":"5a8179f06775dcfc37ea724720f5f691d436ca75bf99fd35d510278fbb07e362"}
Sep 06 20:03:33.200161 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:33.200075    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7" event={"ID":"5a1b77c6-357a-48d5-800d-8eb600000924","Type":"ContainerDied","Data":"713488df21e7d35cdc8e72fb01eca7e534cf131ce1b535fb9ac6debb6389d2b7"}
Sep 06 20:03:33.200161 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:33.200098    2568 scope.go:117] "RemoveContainer" containerID="5a8179f06775dcfc37ea724720f5f691d436ca75bf99fd35d510278fbb07e362"
Sep 06 20:03:33.209278 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:33.209258    2568 scope.go:117] "RemoveContainer" containerID="5a8179f06775dcfc37ea724720f5f691d436ca75bf99fd35d510278fbb07e362"
Sep 06 20:03:33.209559 ip-10-0-135-174 kubenswrapper[2568]: E0906 20:03:33.209540    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a8179f06775dcfc37ea724720f5f691d436ca75bf99fd35d510278fbb07e362\": container with ID starting with 5a8179f06775dcfc37ea724720f5f691d436ca75bf99fd35d510278fbb07e362 not found: ID does not exist" containerID="5a8179f06775dcfc37ea724720f5f691d436ca75bf99fd35d510278fbb07e362"
Sep 06 20:03:33.209609 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:33.209571    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a8179f06775dcfc37ea724720f5f691d436ca75bf99fd35d510278fbb07e362"} err="failed to get container status \"5a8179f06775dcfc37ea724720f5f691d436ca75bf99fd35d510278fbb07e362\": rpc error: code = NotFound desc = could not find container \"5a8179f06775dcfc37ea724720f5f691d436ca75bf99fd35d510278fbb07e362\": container with ID starting with 5a8179f06775dcfc37ea724720f5f691d436ca75bf99fd35d510278fbb07e362 not found: ID does not exist"
Sep 06 20:03:33.214755 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:33.214730    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"]
Sep 06 20:03:33.218149 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:33.218124    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-90c1ebd6-kserve-64c8495659-8z7h7"]
Sep 06 20:03:35.115421 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:35.115385    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a1b77c6-357a-48d5-800d-8eb600000924" path="/var/lib/kubelet/pods/5a1b77c6-357a-48d5-800d-8eb600000924/volumes"
Sep 06 20:03:36.275050 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:36.275016    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-59b97887bd-4hjwk"]
Sep 06 20:03:36.275418 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:36.275381    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a1b77c6-357a-48d5-800d-8eb600000924" containerName="main"
Sep 06 20:03:36.275418 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:36.275392    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a1b77c6-357a-48d5-800d-8eb600000924" containerName="main"
Sep 06 20:03:36.275490 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:36.275469    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a1b77c6-357a-48d5-800d-8eb600000924" containerName="main"
Sep 06 20:03:36.280396 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:36.280373    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59b97887bd-4hjwk"
Sep 06 20:03:36.289937 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:36.289904    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59b97887bd-4hjwk"]
Sep 06 20:03:36.312763 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:36.312722    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzznq\" (UniqueName: \"kubernetes.io/projected/8f627deb-d7e0-4241-bf77-c809bcb90552-kube-api-access-zzznq\") pod \"maas-api-59b97887bd-4hjwk\" (UID: \"8f627deb-d7e0-4241-bf77-c809bcb90552\") " pod="odh-ai-gateway-infra/maas-api-59b97887bd-4hjwk"
Sep 06 20:03:36.312965 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:36.312802    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f627deb-d7e0-4241-bf77-c809bcb90552-metrics-certs\") pod \"maas-api-59b97887bd-4hjwk\" (UID: \"8f627deb-d7e0-4241-bf77-c809bcb90552\") " pod="odh-ai-gateway-infra/maas-api-59b97887bd-4hjwk"
Sep 06 20:03:36.312965 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:36.312843    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f627deb-d7e0-4241-bf77-c809bcb90552-maas-api-tls\") pod \"maas-api-59b97887bd-4hjwk\" (UID: \"8f627deb-d7e0-4241-bf77-c809bcb90552\") " pod="odh-ai-gateway-infra/maas-api-59b97887bd-4hjwk"
Sep 06 20:03:36.312965 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:36.312920    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f627deb-d7e0-4241-bf77-c809bcb90552-openshift-service-ca\") pod \"maas-api-59b97887bd-4hjwk\" (UID: \"8f627deb-d7e0-4241-bf77-c809bcb90552\") " pod="odh-ai-gateway-infra/maas-api-59b97887bd-4hjwk"
Sep 06 20:03:36.414237 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:36.414197    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f627deb-d7e0-4241-bf77-c809bcb90552-maas-api-tls\") pod \"maas-api-59b97887bd-4hjwk\" (UID: \"8f627deb-d7e0-4241-bf77-c809bcb90552\") " pod="odh-ai-gateway-infra/maas-api-59b97887bd-4hjwk"
Sep 06 20:03:36.414445 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:36.414287    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f627deb-d7e0-4241-bf77-c809bcb90552-openshift-service-ca\") pod \"maas-api-59b97887bd-4hjwk\" (UID: \"8f627deb-d7e0-4241-bf77-c809bcb90552\") " pod="odh-ai-gateway-infra/maas-api-59b97887bd-4hjwk"
Sep 06 20:03:36.414445 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:36.414336    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzznq\" (UniqueName: \"kubernetes.io/projected/8f627deb-d7e0-4241-bf77-c809bcb90552-kube-api-access-zzznq\") pod \"maas-api-59b97887bd-4hjwk\" (UID: \"8f627deb-d7e0-4241-bf77-c809bcb90552\") " pod="odh-ai-gateway-infra/maas-api-59b97887bd-4hjwk"
Sep 06 20:03:36.414445 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:36.414369    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f627deb-d7e0-4241-bf77-c809bcb90552-metrics-certs\") pod \"maas-api-59b97887bd-4hjwk\" (UID: \"8f627deb-d7e0-4241-bf77-c809bcb90552\") " pod="odh-ai-gateway-infra/maas-api-59b97887bd-4hjwk"
Sep 06 20:03:36.415003 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:36.414981    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f627deb-d7e0-4241-bf77-c809bcb90552-openshift-service-ca\") pod \"maas-api-59b97887bd-4hjwk\" (UID: \"8f627deb-d7e0-4241-bf77-c809bcb90552\") " pod="odh-ai-gateway-infra/maas-api-59b97887bd-4hjwk"
Sep 06 20:03:36.417003 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:36.416976    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f627deb-d7e0-4241-bf77-c809bcb90552-maas-api-tls\") pod \"maas-api-59b97887bd-4hjwk\" (UID: \"8f627deb-d7e0-4241-bf77-c809bcb90552\") " pod="odh-ai-gateway-infra/maas-api-59b97887bd-4hjwk"
Sep 06 20:03:36.417091 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:36.416983    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f627deb-d7e0-4241-bf77-c809bcb90552-metrics-certs\") pod \"maas-api-59b97887bd-4hjwk\" (UID: \"8f627deb-d7e0-4241-bf77-c809bcb90552\") " pod="odh-ai-gateway-infra/maas-api-59b97887bd-4hjwk"
Sep 06 20:03:36.421486 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:36.421462    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzznq\" (UniqueName: \"kubernetes.io/projected/8f627deb-d7e0-4241-bf77-c809bcb90552-kube-api-access-zzznq\") pod \"maas-api-59b97887bd-4hjwk\" (UID: \"8f627deb-d7e0-4241-bf77-c809bcb90552\") " pod="odh-ai-gateway-infra/maas-api-59b97887bd-4hjwk"
Sep 06 20:03:36.595801 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:36.595688    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59b97887bd-4hjwk"
Sep 06 20:03:36.870112 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:36.870082    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59b97887bd-4hjwk"]
Sep 06 20:03:36.872371 ip-10-0-135-174 kubenswrapper[2568]: W0906 20:03:36.872346    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f627deb_d7e0_4241_bf77_c809bcb90552.slice/crio-c323929f93a242272193ab464300d513bd987832ae78e6d4834df430f4387736 WatchSource:0}: Error finding container c323929f93a242272193ab464300d513bd987832ae78e6d4834df430f4387736: Status 404 returned error can't find the container with id c323929f93a242272193ab464300d513bd987832ae78e6d4834df430f4387736
Sep 06 20:03:37.222868 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:37.222830    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59b97887bd-4hjwk" event={"ID":"8f627deb-d7e0-4241-bf77-c809bcb90552","Type":"ContainerStarted","Data":"c323929f93a242272193ab464300d513bd987832ae78e6d4834df430f4387736"}
Sep 06 20:03:38.229287 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:38.229252    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59b97887bd-4hjwk" event={"ID":"8f627deb-d7e0-4241-bf77-c809bcb90552","Type":"ContainerStarted","Data":"acd1c26e4d80dc185de2ff52968030b9c175bc015932032fa185f8ab27692053"}
Sep 06 20:03:38.229754 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:38.229356    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-59b97887bd-4hjwk"
Sep 06 20:03:38.248799 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:38.245835    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-59b97887bd-4hjwk" podStartSLOduration=1.824237584 podStartE2EDuration="2.245814544s" totalImagesPullingTime="421.57696ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 20:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 20:03:38.243623842 +0000 UTC m=+2181.648582923" watchObservedRunningTime="2026-09-06 20:03:38.245814544 +0000 UTC m=+2181.650773611"
Sep 06 20:03:44.240561 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:44.240527    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-59b97887bd-4hjwk"
Sep 06 20:03:44.284484 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:44.284452    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"]
Sep 06 20:03:44.284848 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:44.284806    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4" podUID="634cc9c8-a072-49d3-9b01-4af02ecc62f4" containerName="maas-api" containerID="cri-o://078aad114d6ce7b36611d364f2209998cb72b71ce2ecde4bfea104b059369bfd" gracePeriod=30
Sep 06 20:03:45.544140 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:45.544111    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"
Sep 06 20:03:45.591746 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:45.591706    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/634cc9c8-a072-49d3-9b01-4af02ecc62f4-maas-api-tls\") pod \"634cc9c8-a072-49d3-9b01-4af02ecc62f4\" (UID: \"634cc9c8-a072-49d3-9b01-4af02ecc62f4\") "
Sep 06 20:03:45.591941 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:45.591772    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hppbf\" (UniqueName: \"kubernetes.io/projected/634cc9c8-a072-49d3-9b01-4af02ecc62f4-kube-api-access-hppbf\") pod \"634cc9c8-a072-49d3-9b01-4af02ecc62f4\" (UID: \"634cc9c8-a072-49d3-9b01-4af02ecc62f4\") "
Sep 06 20:03:45.591941 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:45.591923    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/634cc9c8-a072-49d3-9b01-4af02ecc62f4-openshift-service-ca\") pod \"634cc9c8-a072-49d3-9b01-4af02ecc62f4\" (UID: \"634cc9c8-a072-49d3-9b01-4af02ecc62f4\") "
Sep 06 20:03:45.592034 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:45.591948    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/634cc9c8-a072-49d3-9b01-4af02ecc62f4-metrics-certs\") pod \"634cc9c8-a072-49d3-9b01-4af02ecc62f4\" (UID: \"634cc9c8-a072-49d3-9b01-4af02ecc62f4\") "
Sep 06 20:03:45.592304 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:45.592259    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/634cc9c8-a072-49d3-9b01-4af02ecc62f4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "634cc9c8-a072-49d3-9b01-4af02ecc62f4" (UID: "634cc9c8-a072-49d3-9b01-4af02ecc62f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 20:03:45.594224 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:45.594196    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/634cc9c8-a072-49d3-9b01-4af02ecc62f4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "634cc9c8-a072-49d3-9b01-4af02ecc62f4" (UID: "634cc9c8-a072-49d3-9b01-4af02ecc62f4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 20:03:45.594352 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:45.594205    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/634cc9c8-a072-49d3-9b01-4af02ecc62f4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "634cc9c8-a072-49d3-9b01-4af02ecc62f4" (UID: "634cc9c8-a072-49d3-9b01-4af02ecc62f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 20:03:45.594352 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:45.594328    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/634cc9c8-a072-49d3-9b01-4af02ecc62f4-kube-api-access-hppbf" (OuterVolumeSpecName: "kube-api-access-hppbf") pod "634cc9c8-a072-49d3-9b01-4af02ecc62f4" (UID: "634cc9c8-a072-49d3-9b01-4af02ecc62f4"). InnerVolumeSpecName "kube-api-access-hppbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 20:03:45.693167 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:45.693055    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/634cc9c8-a072-49d3-9b01-4af02ecc62f4-openshift-service-ca\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 20:03:45.693167 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:45.693109    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/634cc9c8-a072-49d3-9b01-4af02ecc62f4-metrics-certs\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 20:03:45.693167 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:45.693121    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/634cc9c8-a072-49d3-9b01-4af02ecc62f4-maas-api-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 20:03:45.693167 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:45.693132    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hppbf\" (UniqueName: \"kubernetes.io/projected/634cc9c8-a072-49d3-9b01-4af02ecc62f4-kube-api-access-hppbf\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
Sep 06 20:03:46.276945 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:46.276909    2568 generic.go:356] "Generic (PLEG): container finished" podID="634cc9c8-a072-49d3-9b01-4af02ecc62f4" containerID="078aad114d6ce7b36611d364f2209998cb72b71ce2ecde4bfea104b059369bfd" exitCode=0
Sep 06 20:03:46.277149 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:46.276966    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"
Sep 06 20:03:46.277149 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:46.276991    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4" event={"ID":"634cc9c8-a072-49d3-9b01-4af02ecc62f4","Type":"ContainerDied","Data":"078aad114d6ce7b36611d364f2209998cb72b71ce2ecde4bfea104b059369bfd"}
Sep 06 20:03:46.277149 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:46.277062    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4" event={"ID":"634cc9c8-a072-49d3-9b01-4af02ecc62f4","Type":"ContainerDied","Data":"c673e23d4bac4ea09a1df654dfcd71a577b67587752d0080aae784e1b118f2d1"}
Sep 06 20:03:46.277149 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:46.277083    2568 scope.go:117] "RemoveContainer" containerID="078aad114d6ce7b36611d364f2209998cb72b71ce2ecde4bfea104b059369bfd"
Sep 06 20:03:46.287128 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:46.287104    2568 scope.go:117] "RemoveContainer" containerID="078aad114d6ce7b36611d364f2209998cb72b71ce2ecde4bfea104b059369bfd"
Sep 06 20:03:46.287439 ip-10-0-135-174 kubenswrapper[2568]: E0906 20:03:46.287417    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"078aad114d6ce7b36611d364f2209998cb72b71ce2ecde4bfea104b059369bfd\": container with ID starting with 078aad114d6ce7b36611d364f2209998cb72b71ce2ecde4bfea104b059369bfd not found: ID does not exist" containerID="078aad114d6ce7b36611d364f2209998cb72b71ce2ecde4bfea104b059369bfd"
Sep 06 20:03:46.287523 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:46.287447    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"078aad114d6ce7b36611d364f2209998cb72b71ce2ecde4bfea104b059369bfd"} err="failed to get container status \"078aad114d6ce7b36611d364f2209998cb72b71ce2ecde4bfea104b059369bfd\": rpc error: code = NotFound desc = could not find container \"078aad114d6ce7b36611d364f2209998cb72b71ce2ecde4bfea104b059369bfd\": container with ID starting with 078aad114d6ce7b36611d364f2209998cb72b71ce2ecde4bfea104b059369bfd not found: ID does not exist"
Sep 06 20:03:46.298261 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:46.298232    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"]
Sep 06 20:03:46.301659 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:46.301633    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-764cc5b8c6-2czq4"]
Sep 06 20:03:47.116008 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:03:47.115974    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="634cc9c8-a072-49d3-9b01-4af02ecc62f4" path="/var/lib/kubelet/pods/634cc9c8-a072-49d3-9b01-4af02ecc62f4/volumes"
Sep 06 20:04:16.219158 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:16.219127    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-v79g2_686c55be-e970-4a2c-9af8-366c2a9ae6f1/manager/0.log"
Sep 06 20:04:16.340643 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:16.340586    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jxv8g_1a3ebeb4-7f09-4e1e-97e1-707583cbd97c/manager/0.log"
Sep 06 20:04:16.459168 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:16.459128    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-785588cb-vww97_66b766ab-0cfa-42a2-adcc-9052341e3666/manager/0.log"
Sep 06 20:04:16.917059 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:16.917029    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f964dcc99-gj8j5_d6f3128d-2981-42bb-8c91-a145c95603c9/copy-manifests/0.log"
Sep 06 20:04:16.936819 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:16.936765    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f964dcc99-gj8j5_d6f3128d-2981-42bb-8c91-a145c95603c9/manager/0.log"
Sep 06 20:04:17.383266 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:17.383237    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-59b97887bd-4hjwk_8f627deb-d7e0-4241-bf77-c809bcb90552/maas-api/0.log"
Sep 06 20:04:17.801464 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:17.801381    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-ls7kj_695ab482-5ee8-47bb-9a5b-8db1ffdebfd2/postgres/0.log"
Sep 06 20:04:18.653576 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:18.653530    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-btg8p_56b17505-b75d-4401-9dfe-fd36a7059322/manager/0.log"
Sep 06 20:04:18.758469 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:18.758422    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-srcks_7400440a-0bc8-48f0-a04c-48bd2f84d325/manager/0.log"
Sep 06 20:04:18.865168 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:18.865133    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-pf5lm_109589e5-010f-4a08-acc8-b68695feebd3/kuadrant-console-plugin/0.log"
Sep 06 20:04:18.985615 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:18.985531    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-5pg4p_1f2743e9-1d22-4088-96da-526e4e3a6a60/manager/0.log"
Sep 06 20:04:19.208507 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:19.208479    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-xbc9k_8997338c-99ab-46bc-8867-b0c60d24166d/manager/0.log"
Sep 06 20:04:19.763554 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:19.763514    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d55646b9-nc5jm_2b60b24a-c1db-4efd-8491-824719bb3c92/kube-auth-proxy/0.log"
Sep 06 20:04:20.107253 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:20.107164    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2s44b_564501d8-6ec9-471a-9bba-085afc155bc5/payload-pre-processing/0.log"
Sep 06 20:04:20.654493 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:20.654461    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-zsjvz_8d7d1eee-7ece-44cf-9e30-def2f2f05cf6/main/0.log"
Sep 06 20:04:20.876377 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:20.876347    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-2gzk9_74856547-1dbe-4517-be6c-becf90ff86ba/main/0.log"
Sep 06 20:04:20.976967 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:20.976878    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-86cc4_d854e460-158a-416f-a891-719a161297bf/main/0.log"
Sep 06 20:04:26.934433 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:26.934393    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4b6gr/must-gather-vgtkt"]
Sep 06 20:04:26.934964 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:26.934944    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="634cc9c8-a072-49d3-9b01-4af02ecc62f4" containerName="maas-api"
Sep 06 20:04:26.935053 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:26.934970    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="634cc9c8-a072-49d3-9b01-4af02ecc62f4" containerName="maas-api"
Sep 06 20:04:26.935106 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:26.935099    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="634cc9c8-a072-49d3-9b01-4af02ecc62f4" containerName="maas-api"
Sep 06 20:04:26.938249 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:26.938226    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4b6gr/must-gather-vgtkt"
Sep 06 20:04:26.941265 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:26.941239    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4b6gr\"/\"kube-root-ca.crt\""
Sep 06 20:04:26.941399 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:26.941284    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4b6gr\"/\"openshift-service-ca.crt\""
Sep 06 20:04:26.942106 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:26.942089    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4b6gr\"/\"default-dockercfg-g8zxj\""
Sep 06 20:04:26.945334 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:26.945308    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4b6gr/must-gather-vgtkt"]
Sep 06 20:04:26.951384 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:26.951353    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 20:04:26.960906 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:26.960877    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dc7361c7-5880-47fa-8d7e-b993429f0953-must-gather-output\") pod \"must-gather-vgtkt\" (UID: \"dc7361c7-5880-47fa-8d7e-b993429f0953\") " pod="openshift-must-gather-4b6gr/must-gather-vgtkt"
Sep 06 20:04:26.961040 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:26.960935    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtpgm\" (UniqueName: \"kubernetes.io/projected/dc7361c7-5880-47fa-8d7e-b993429f0953-kube-api-access-qtpgm\") pod \"must-gather-vgtkt\" (UID: \"dc7361c7-5880-47fa-8d7e-b993429f0953\") " pod="openshift-must-gather-4b6gr/must-gather-vgtkt"
Sep 06 20:04:27.062134 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:27.062090    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtpgm\" (UniqueName: \"kubernetes.io/projected/dc7361c7-5880-47fa-8d7e-b993429f0953-kube-api-access-qtpgm\") pod \"must-gather-vgtkt\" (UID: \"dc7361c7-5880-47fa-8d7e-b993429f0953\") " pod="openshift-must-gather-4b6gr/must-gather-vgtkt"
Sep 06 20:04:27.062317 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:27.062157    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dc7361c7-5880-47fa-8d7e-b993429f0953-must-gather-output\") pod \"must-gather-vgtkt\" (UID: \"dc7361c7-5880-47fa-8d7e-b993429f0953\") " pod="openshift-must-gather-4b6gr/must-gather-vgtkt"
Sep 06 20:04:27.062480 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:27.062464    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dc7361c7-5880-47fa-8d7e-b993429f0953-must-gather-output\") pod \"must-gather-vgtkt\" (UID: \"dc7361c7-5880-47fa-8d7e-b993429f0953\") " pod="openshift-must-gather-4b6gr/must-gather-vgtkt"
Sep 06 20:04:27.070521 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:27.070488    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtpgm\" (UniqueName: \"kubernetes.io/projected/dc7361c7-5880-47fa-8d7e-b993429f0953-kube-api-access-qtpgm\") pod \"must-gather-vgtkt\" (UID: \"dc7361c7-5880-47fa-8d7e-b993429f0953\") " pod="openshift-must-gather-4b6gr/must-gather-vgtkt"
Sep 06 20:04:27.249727 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:27.249637    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4b6gr/must-gather-vgtkt"
Sep 06 20:04:27.521232 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:27.521204    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4b6gr/must-gather-vgtkt"]
Sep 06 20:04:27.523693 ip-10-0-135-174 kubenswrapper[2568]: W0906 20:04:27.523663    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc7361c7_5880_47fa_8d7e_b993429f0953.slice/crio-29923819046abe50b6793885c24b57398c7f1b578927e7683e10f846af87ab95 WatchSource:0}: Error finding container 29923819046abe50b6793885c24b57398c7f1b578927e7683e10f846af87ab95: Status 404 returned error can't find the container with id 29923819046abe50b6793885c24b57398c7f1b578927e7683e10f846af87ab95
Sep 06 20:04:28.224161 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:28.224115    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log" limit=1024
Sep 06 20:04:28.495218 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:28.495139    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4b6gr/must-gather-vgtkt" event={"ID":"dc7361c7-5880-47fa-8d7e-b993429f0953","Type":"ContainerStarted","Data":"29923819046abe50b6793885c24b57398c7f1b578927e7683e10f846af87ab95"}
Sep 06 20:04:29.502355 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:29.502317    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4b6gr/must-gather-vgtkt" event={"ID":"dc7361c7-5880-47fa-8d7e-b993429f0953","Type":"ContainerStarted","Data":"ed39ac5816d09f60dfdd30ca894c222506fd32a943c1f3cd91dd4dca652e1885"}
Sep 06 20:04:29.502873 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:29.502367    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4b6gr/must-gather-vgtkt" event={"ID":"dc7361c7-5880-47fa-8d7e-b993429f0953","Type":"ContainerStarted","Data":"84f3e224c173b96e92440700a01ba724cae012265ae0e2af5329a3fc6a81863c"}
Sep 06 20:04:29.518606 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:29.518533    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4b6gr/must-gather-vgtkt" podStartSLOduration=2.567390713 podStartE2EDuration="3.518511295s" totalImagesPullingTime="951.120582ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 20:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 20:04:29.516008833 +0000 UTC m=+2232.920967902" watchObservedRunningTime="2026-09-06 20:04:29.518511295 +0000 UTC m=+2232.923470366"
Sep 06 20:04:30.049067 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:30.049032    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x5xzv_54e739ed-02ca-4f6a-82d8-bf2966672a28/global-pull-secret-syncer/0.log"
Sep 06 20:04:30.099500 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:30.099461    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-c5cf6_de2ce0c6-0449-42b3-a783-7bd9bce82ee7/konnectivity-agent/0.log"
Sep 06 20:04:30.188055 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:30.188018    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-174.ec2.internal_8c6a01d943a52353eb13a1aeaca47347/haproxy/0.log"
Sep 06 20:04:35.491499 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:35.491449    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-btg8p_56b17505-b75d-4401-9dfe-fd36a7059322/manager/0.log"
Sep 06 20:04:35.518706 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:35.518653    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-srcks_7400440a-0bc8-48f0-a04c-48bd2f84d325/manager/0.log"
Sep 06 20:04:35.544138 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:35.544100    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-pf5lm_109589e5-010f-4a08-acc8-b68695feebd3/kuadrant-console-plugin/0.log"
Sep 06 20:04:35.601115 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:35.601073    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-5pg4p_1f2743e9-1d22-4088-96da-526e4e3a6a60/manager/0.log"
Sep 06 20:04:35.718903 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:35.718872    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-xbc9k_8997338c-99ab-46bc-8867-b0c60d24166d/manager/0.log"
Sep 06 20:04:37.507877 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:37.507836    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-r9x9b_51e9c3ec-c5d6-46e0-b9df-65b9ad1c3808/cluster-monitoring-operator/0.log"
Sep 06 20:04:37.669825 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:37.669768    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bwd9k_675027e6-fdf5-4649-b98f-b0b246c1c1ca/node-exporter/0.log"
Sep 06 20:04:37.691359 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:37.691325    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bwd9k_675027e6-fdf5-4649-b98f-b0b246c1c1ca/kube-rbac-proxy/0.log"
Sep 06 20:04:37.709639 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:37.709607    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bwd9k_675027e6-fdf5-4649-b98f-b0b246c1c1ca/init-textfile/0.log"
Sep 06 20:04:38.242336 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:38.242304    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c4f978df8-c467n_1ae66aef-9b78-40f1-a71a-855e56e3db80/thanos-query/0.log"
Sep 06 20:04:38.268102 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:38.268068    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c4f978df8-c467n_1ae66aef-9b78-40f1-a71a-855e56e3db80/kube-rbac-proxy-web/0.log"
Sep 06 20:04:38.285988 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:38.285954    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c4f978df8-c467n_1ae66aef-9b78-40f1-a71a-855e56e3db80/kube-rbac-proxy/0.log"
Sep 06 20:04:38.304472 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:38.304439    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c4f978df8-c467n_1ae66aef-9b78-40f1-a71a-855e56e3db80/prom-label-proxy/0.log"
Sep 06 20:04:38.323801 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:38.323757    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c4f978df8-c467n_1ae66aef-9b78-40f1-a71a-855e56e3db80/kube-rbac-proxy-rules/0.log"
Sep 06 20:04:38.342825 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:38.342792    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c4f978df8-c467n_1ae66aef-9b78-40f1-a71a-855e56e3db80/kube-rbac-proxy-metrics/0.log"
Sep 06 20:04:40.454472 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:40.454431    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2"]
Sep 06 20:04:40.463051 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:40.463020    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2"
Sep 06 20:04:40.464292 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:40.464265    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2"]
Sep 06 20:04:40.610481 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:40.610437    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75gm9\" (UniqueName: \"kubernetes.io/projected/632243f6-33b9-4174-8c74-7cc490b347b8-kube-api-access-75gm9\") pod \"perf-node-gather-daemonset-xtcg2\" (UID: \"632243f6-33b9-4174-8c74-7cc490b347b8\") " pod="openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2"
Sep 06 20:04:40.610688 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:40.610499    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/632243f6-33b9-4174-8c74-7cc490b347b8-podres\") pod \"perf-node-gather-daemonset-xtcg2\" (UID: \"632243f6-33b9-4174-8c74-7cc490b347b8\") " pod="openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2"
Sep 06 20:04:40.610688 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:40.610596    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/632243f6-33b9-4174-8c74-7cc490b347b8-proc\") pod \"perf-node-gather-daemonset-xtcg2\" (UID: \"632243f6-33b9-4174-8c74-7cc490b347b8\") " pod="openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2"
Sep 06 20:04:40.610688 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:40.610659    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/632243f6-33b9-4174-8c74-7cc490b347b8-sys\") pod \"perf-node-gather-daemonset-xtcg2\" (UID: \"632243f6-33b9-4174-8c74-7cc490b347b8\") " pod="openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2"
Sep 06 20:04:40.610911 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:40.610688    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/632243f6-33b9-4174-8c74-7cc490b347b8-lib-modules\") pod \"perf-node-gather-daemonset-xtcg2\" (UID: \"632243f6-33b9-4174-8c74-7cc490b347b8\") " pod="openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2"
Sep 06 20:04:40.712349 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:40.712255    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75gm9\" (UniqueName: \"kubernetes.io/projected/632243f6-33b9-4174-8c74-7cc490b347b8-kube-api-access-75gm9\") pod \"perf-node-gather-daemonset-xtcg2\" (UID: \"632243f6-33b9-4174-8c74-7cc490b347b8\") " pod="openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2"
Sep 06 20:04:40.712349 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:40.712322    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/632243f6-33b9-4174-8c74-7cc490b347b8-podres\") pod \"perf-node-gather-daemonset-xtcg2\" (UID: \"632243f6-33b9-4174-8c74-7cc490b347b8\") " pod="openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2"
Sep 06 20:04:40.712604 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:40.712351    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/632243f6-33b9-4174-8c74-7cc490b347b8-proc\") pod \"perf-node-gather-daemonset-xtcg2\" (UID: \"632243f6-33b9-4174-8c74-7cc490b347b8\") " pod="openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2"
Sep 06 20:04:40.712604 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:40.712383    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/632243f6-33b9-4174-8c74-7cc490b347b8-sys\") pod \"perf-node-gather-daemonset-xtcg2\" (UID: \"632243f6-33b9-4174-8c74-7cc490b347b8\") " pod="openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2"
Sep 06 20:04:40.712604 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:40.712451    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/632243f6-33b9-4174-8c74-7cc490b347b8-sys\") pod \"perf-node-gather-daemonset-xtcg2\" (UID: \"632243f6-33b9-4174-8c74-7cc490b347b8\") " pod="openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2"
Sep 06 20:04:40.712604 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:40.712491    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/632243f6-33b9-4174-8c74-7cc490b347b8-lib-modules\") pod \"perf-node-gather-daemonset-xtcg2\" (UID: \"632243f6-33b9-4174-8c74-7cc490b347b8\") " pod="openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2"
Sep 06 20:04:40.712864 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:40.712618    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/632243f6-33b9-4174-8c74-7cc490b347b8-lib-modules\") pod \"perf-node-gather-daemonset-xtcg2\" (UID: \"632243f6-33b9-4174-8c74-7cc490b347b8\") " pod="openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2"
Sep 06 20:04:40.712864 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:40.712566    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/632243f6-33b9-4174-8c74-7cc490b347b8-proc\") pod \"perf-node-gather-daemonset-xtcg2\" (UID: \"632243f6-33b9-4174-8c74-7cc490b347b8\") " pod="openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2"
Sep 06 20:04:40.712864 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:40.712518    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/632243f6-33b9-4174-8c74-7cc490b347b8-podres\") pod \"perf-node-gather-daemonset-xtcg2\" (UID: \"632243f6-33b9-4174-8c74-7cc490b347b8\") " pod="openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2"
Sep 06 20:04:40.728495 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:40.728453    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75gm9\" (UniqueName: \"kubernetes.io/projected/632243f6-33b9-4174-8c74-7cc490b347b8-kube-api-access-75gm9\") pod \"perf-node-gather-daemonset-xtcg2\" (UID: \"632243f6-33b9-4174-8c74-7cc490b347b8\") " pod="openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2"
Sep 06 20:04:40.777807 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:40.777756    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2"
Sep 06 20:04:41.078431 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:41.078342    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2"]
Sep 06 20:04:41.082465 ip-10-0-135-174 kubenswrapper[2568]: W0906 20:04:41.082427    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod632243f6_33b9_4174_8c74_7cc490b347b8.slice/crio-d643653c86a4586163f8251ff6d983364a984b030652c784527ccde2a1147811 WatchSource:0}: Error finding container d643653c86a4586163f8251ff6d983364a984b030652c784527ccde2a1147811: Status 404 returned error can't find the container with id d643653c86a4586163f8251ff6d983364a984b030652c784527ccde2a1147811
Sep 06 20:04:41.457798 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:41.457753    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-zzvsc_8028b46f-2528-461f-9953-160fd19dbbae/volume-data-source-validator/0.log"
Sep 06 20:04:41.598509 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:41.598469    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2" event={"ID":"632243f6-33b9-4174-8c74-7cc490b347b8","Type":"ContainerStarted","Data":"63f7a33706fb932bae178d4db775fbdf486a366df7f8d514852f686761306f35"}
Sep 06 20:04:41.598737 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:41.598633    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2" event={"ID":"632243f6-33b9-4174-8c74-7cc490b347b8","Type":"ContainerStarted","Data":"d643653c86a4586163f8251ff6d983364a984b030652c784527ccde2a1147811"}
Sep 06 20:04:41.598981 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:41.598959    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2"
Sep 06 20:04:41.615444 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:41.615373    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2" podStartSLOduration=1.615351246 podStartE2EDuration="1.615351246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 20:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 20:04:41.613033047 +0000 UTC m=+2245.017992116" watchObservedRunningTime="2026-09-06 20:04:41.615351246 +0000 UTC m=+2245.020310317"
Sep 06 20:04:42.595263 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:42.595220    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-56494_28ba1dda-1c3b-4df4-b791-d138a97959a4/dns/0.log"
Sep 06 20:04:42.614377 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:42.614343    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-56494_28ba1dda-1c3b-4df4-b791-d138a97959a4/kube-rbac-proxy/0.log"
Sep 06 20:04:42.709169 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:42.709141    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z2s8x_becacc1b-0eeb-4404-908e-585e7edaa25b/dns-node-resolver/0.log"
Sep 06 20:04:43.254123 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:43.254089    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4mk76_36bfe5b6-eb77-43e5-952f-f69db221e46a/node-ca/0.log"
Sep 06 20:04:44.773578 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:44.773542    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d55646b9-nc5jm_2b60b24a-c1db-4efd-8491-824719bb3c92/kube-auth-proxy/0.log"
Sep 06 20:04:44.882205 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:44.882174    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2s44b_564501d8-6ec9-471a-9bba-085afc155bc5/payload-pre-processing/0.log"
Sep 06 20:04:45.793051 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:45.793013    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j88s9_74bff902-740b-408e-9a44-55fbc457e249/serve-healthcheck-canary/0.log"
Sep 06 20:04:46.304752 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:46.304716    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6cz9v_e040aebf-fab1-43a7-b979-e59c8f9ec6a6/kube-rbac-proxy/0.log"
Sep 06 20:04:46.322530 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:46.322496    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6cz9v_e040aebf-fab1-43a7-b979-e59c8f9ec6a6/exporter/0.log"
Sep 06 20:04:46.341634 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:46.341606    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6cz9v_e040aebf-fab1-43a7-b979-e59c8f9ec6a6/extractor/0.log"
Sep 06 20:04:47.616523 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:47.616482    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4b6gr/perf-node-gather-daemonset-xtcg2"
Sep 06 20:04:48.501700 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:48.501667    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-v79g2_686c55be-e970-4a2c-9af8-366c2a9ae6f1/manager/0.log"
Sep 06 20:04:48.814728 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:48.814643    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jxv8g_1a3ebeb4-7f09-4e1e-97e1-707583cbd97c/manager/0.log"
Sep 06 20:04:48.880622 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:48.880588    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-785588cb-vww97_66b766ab-0cfa-42a2-adcc-9052341e3666/manager/0.log"
Sep 06 20:04:49.195747 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:49.195715    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f964dcc99-gj8j5_d6f3128d-2981-42bb-8c91-a145c95603c9/manager/0.log"
Sep 06 20:04:49.210090 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:49.210065    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f964dcc99-gj8j5_d6f3128d-2981-42bb-8c91-a145c95603c9/copy-manifests/0.log"
Sep 06 20:04:50.732212 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:50.732107    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-4456c_56797bc7-f544-422d-a2f4-8b5323949f7a/openshift-lws-operator/0.log"
Sep 06 20:04:51.925039 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:51.924954    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d55646b9-nc5jm_2b60b24a-c1db-4efd-8491-824719bb3c92/kube-auth-proxy/0.log"
Sep 06 20:04:52.013122 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:52.013079    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2s44b_564501d8-6ec9-471a-9bba-085afc155bc5/payload-pre-processing/0.log"
Sep 06 20:04:54.143809 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:54.143757    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d55646b9-nc5jm_2b60b24a-c1db-4efd-8491-824719bb3c92/kube-auth-proxy/0.log"
Sep 06 20:04:54.227697 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:54.227659    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2s44b_564501d8-6ec9-471a-9bba-085afc155bc5/payload-pre-processing/0.log"
Sep 06 20:04:55.586257 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:55.586203    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-5nnhh_76572444-9723-40e9-b1fc-19f1f2687538/migrator/0.log"
Sep 06 20:04:55.604171 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:55.604131    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-5nnhh_76572444-9723-40e9-b1fc-19f1f2687538/graceful-termination/0.log"
Sep 06 20:04:56.982375 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:56.982350    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t6h6w_054ee4ba-941f-46c5-9ac3-0daa28ed1dad/kube-multus-additional-cni-plugins/0.log"
Sep 06 20:04:57.000539 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:57.000506    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t6h6w_054ee4ba-941f-46c5-9ac3-0daa28ed1dad/egress-router-binary-copy/0.log"
Sep 06 20:04:57.023036 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:57.023008    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t6h6w_054ee4ba-941f-46c5-9ac3-0daa28ed1dad/cni-plugins/0.log"
Sep 06 20:04:57.038871 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:57.038835    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t6h6w_054ee4ba-941f-46c5-9ac3-0daa28ed1dad/bond-cni-plugin/0.log"
Sep 06 20:04:57.055139 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:57.055112    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t6h6w_054ee4ba-941f-46c5-9ac3-0daa28ed1dad/routeoverride-cni/0.log"
Sep 06 20:04:57.070752 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:57.070732    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t6h6w_054ee4ba-941f-46c5-9ac3-0daa28ed1dad/whereabouts-cni-bincopy/0.log"
Sep 06 20:04:57.087174 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:57.087149    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t6h6w_054ee4ba-941f-46c5-9ac3-0daa28ed1dad/whereabouts-cni/0.log"
Sep 06 20:04:57.262681 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:57.262601    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qhj8h_e02983e8-bb51-4194-b599-083a466312d6/kube-multus/0.log"
Sep 06 20:04:57.390114 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:57.390079    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cb2dz_0ace7f43-c761-489f-b523-b01650e632df/network-metrics-daemon/0.log"
Sep 06 20:04:57.405270 ip-10-0-135-174 kubenswrapper[2568]: I0906 20:04:57.405238    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cb2dz_0ace7f43-c761-489f-b523-b01650e632df/kube-rbac-proxy/0.log"