Sep 10 19:52:18.268019 ip-10-0-133-162 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 10 19:52:18.268144 ip-10-0-133-162 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 10 19:52:18.268209 ip-10-0-133-162 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 10 19:52:18.268455 ip-10-0-133-162 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 10 19:52:28.497516 ip-10-0-133-162 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 10 19:52:28.497537 ip-10-0-133-162 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 931861b599ea40e5a2cd465e84426980 --
Sep 10 19:54:14.483329 ip-10-0-133-162 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 19:54:14.901247 ip-10-0-133-162 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 19:54:14.901247 ip-10-0-133-162 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 19:54:14.901247 ip-10-0-133-162 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 19:54:14.901247 ip-10-0-133-162 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 19:54:14.901247 ip-10-0-133-162 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 19:54:14.903370 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.903280    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 19:54:14.907429 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907410    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 19:54:14.907429 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907429    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 19:54:14.907429 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907433    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 19:54:14.907625 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907438    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 19:54:14.907625 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907443    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 19:54:14.907625 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907447    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 19:54:14.907625 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907451    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 19:54:14.907625 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907454    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 19:54:14.907625 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907459    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 19:54:14.907625 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907462    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 19:54:14.907625 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907468    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 19:54:14.907625 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907474    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 19:54:14.907625 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907478    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 19:54:14.907625 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907482    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 19:54:14.907625 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907486    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 19:54:14.907625 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907490    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 19:54:14.907625 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907494    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 19:54:14.907625 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907498    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 19:54:14.907625 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907502    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 19:54:14.907625 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907513    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 19:54:14.907625 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907517    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 19:54:14.907625 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907521    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 19:54:14.907625 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907525    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 19:54:14.908469 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907529    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 19:54:14.908469 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907533    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 19:54:14.908469 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907537    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 19:54:14.908469 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907541    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 19:54:14.908469 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907545    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 19:54:14.908469 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907549    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 19:54:14.908469 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907553    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 19:54:14.908469 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907558    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 19:54:14.908469 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907562    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 19:54:14.908469 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907567    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 19:54:14.908469 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907571    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 19:54:14.908469 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907575    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 19:54:14.908469 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907579    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 19:54:14.908469 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907585    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 19:54:14.908469 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907589    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 19:54:14.908469 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907593    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 19:54:14.908469 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907598    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 19:54:14.908469 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907605    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 19:54:14.908469 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907609    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 19:54:14.908469 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907614    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 19:54:14.909313 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907618    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 19:54:14.909313 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907622    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 19:54:14.909313 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907626    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 19:54:14.909313 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907630    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 19:54:14.909313 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907634    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 19:54:14.909313 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907639    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 19:54:14.909313 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907644    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 19:54:14.909313 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907648    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 19:54:14.909313 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907651    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 19:54:14.909313 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907656    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 19:54:14.909313 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907660    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 19:54:14.909313 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907666    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 19:54:14.909313 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907673    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 19:54:14.909313 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907677    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 19:54:14.909313 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907685    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 19:54:14.909313 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907691    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 19:54:14.909313 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907697    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 19:54:14.909313 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907701    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 19:54:14.909313 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907706    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 19:54:14.910139 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907710    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 19:54:14.910139 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907715    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 19:54:14.910139 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907719    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 19:54:14.910139 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907723    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 19:54:14.910139 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907727    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 19:54:14.910139 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907731    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 19:54:14.910139 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907736    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 19:54:14.910139 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907740    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 19:54:14.910139 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907744    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 19:54:14.910139 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907750    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 19:54:14.910139 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907754    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 19:54:14.910139 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907759    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 19:54:14.910139 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907763    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 19:54:14.910139 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907766    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 19:54:14.910139 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907771    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 19:54:14.910139 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907775    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 19:54:14.910139 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907779    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 19:54:14.910139 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907783    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 19:54:14.910139 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907788    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 19:54:14.910139 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907793    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 19:54:14.911007 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907797    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 19:54:14.911007 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907801    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 19:54:14.911007 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907805    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 19:54:14.911007 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907809    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 19:54:14.911007 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907813    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 19:54:14.911007 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907817    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 19:54:14.911007 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907821    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 19:54:14.911007 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907825    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 19:54:14.911007 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907829    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 19:54:14.911007 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907833    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 19:54:14.911007 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907838    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 19:54:14.911007 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907842    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 19:54:14.911007 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907845    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 19:54:14.911007 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907850    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 19:54:14.911007 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907854    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 19:54:14.911007 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907859    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 19:54:14.911007 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.907863    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 19:54:14.911007 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909080    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 19:54:14.911007 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909091    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 19:54:14.911007 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909097    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 19:54:14.911868 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909102    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 19:54:14.911868 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909107    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 19:54:14.911868 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909121    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 19:54:14.911868 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909126    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 19:54:14.911868 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909130    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 19:54:14.911868 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909136    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 19:54:14.911868 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909140    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 19:54:14.911868 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909144    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 19:54:14.911868 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909148    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 19:54:14.911868 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909152    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 19:54:14.911868 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909156    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 19:54:14.911868 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909160    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 19:54:14.911868 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909165    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 19:54:14.911868 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909169    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 19:54:14.911868 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909173    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 19:54:14.911868 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909177    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 19:54:14.911868 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909182    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 19:54:14.911868 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909186    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 19:54:14.911868 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909190    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 19:54:14.911868 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909194    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 19:54:14.912555 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909198    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 19:54:14.912555 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909204    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 19:54:14.912555 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909211    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 19:54:14.912555 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909218    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 19:54:14.912555 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909223    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 19:54:14.912555 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909228    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 19:54:14.912555 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909233    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 19:54:14.912555 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909237    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 19:54:14.912555 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909242    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 19:54:14.912555 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909246    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 19:54:14.912555 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909250    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 19:54:14.912555 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909255    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 19:54:14.912555 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909259    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 19:54:14.912555 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909263    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 19:54:14.912555 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909268    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 19:54:14.912555 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909272    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 19:54:14.912555 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909279    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 19:54:14.912555 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909285    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 19:54:14.912555 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909290    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 19:54:14.913112 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909294    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 19:54:14.913112 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909298    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 19:54:14.913112 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909302    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 19:54:14.913112 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909306    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 19:54:14.913112 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909310    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 19:54:14.913112 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909314    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 19:54:14.913112 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909318    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 19:54:14.913112 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909323    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 19:54:14.913112 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909327    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 19:54:14.913112 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909330    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 19:54:14.913112 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909335    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 19:54:14.913112 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909339    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 19:54:14.913112 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909343    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 19:54:14.913112 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909347    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 19:54:14.913112 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909352    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 19:54:14.913112 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909357    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 19:54:14.913112 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909362    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 19:54:14.913112 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909367    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 19:54:14.913112 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909371    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 19:54:14.913112 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909375    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 19:54:14.913610 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909379    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 19:54:14.913610 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909384    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 19:54:14.913610 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909388    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 19:54:14.913610 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909393    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 19:54:14.913610 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909398    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 19:54:14.913610 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909402    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 19:54:14.913610 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909406    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 19:54:14.913610 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909411    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 19:54:14.913610 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909415    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 19:54:14.913610 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909420    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 19:54:14.913610 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909424    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 19:54:14.913610 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909428    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 19:54:14.913610 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909433    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 19:54:14.913610 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909438    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 19:54:14.913610 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909443    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 19:54:14.913610 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909447    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 19:54:14.913610 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909451    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 19:54:14.913610 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909455    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 19:54:14.913610 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909460    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 19:54:14.913610 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909464    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 19:54:14.913610 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909468    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 19:54:14.914166 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909472    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 19:54:14.914166 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909476    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 19:54:14.914166 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909480    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 19:54:14.914166 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909484    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 19:54:14.914166 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909488    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 19:54:14.914166 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909493    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 19:54:14.914166 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909497    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 19:54:14.914166 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909502    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 19:54:14.914166 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909506    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 19:54:14.914166 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909511    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 19:54:14.914166 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909515    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 19:54:14.914166 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909519    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 19:54:14.914166 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909523    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 19:54:14.914166 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909527    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 19:54:14.914166 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909532    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 19:54:14.914166 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.909536    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 19:54:14.914166 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910193    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 19:54:14.914166 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910203    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 19:54:14.914166 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910208    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 19:54:14.914166 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910214    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 19:54:14.914745 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910220    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 19:54:14.914745 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910225    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 19:54:14.914745 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910229    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 19:54:14.914745 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910233    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 19:54:14.914745 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910238    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 19:54:14.914745 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910243    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 19:54:14.914745 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910247    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 19:54:14.914745 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910250    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 19:54:14.914745 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910255    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 19:54:14.914745 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910259    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 19:54:14.914745 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910263    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 19:54:14.914745 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910267    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 19:54:14.914745 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910271    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 19:54:14.914745 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910278    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 19:54:14.914745 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910284    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 19:54:14.914745 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910290    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 19:54:14.914745 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910295    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 19:54:14.914745 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910300    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 19:54:14.914745 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910305    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 19:54:14.914745 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910309    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 19:54:14.915369 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910313    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 19:54:14.915369 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910317    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 19:54:14.915369 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910321    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 19:54:14.915369 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910325    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 19:54:14.915369 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910329    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 19:54:14.915369 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910333    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 19:54:14.915369 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910338    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 19:54:14.915369 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910342    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 19:54:14.915369 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910347    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 19:54:14.915369 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910351    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 19:54:14.915369 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910355    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 19:54:14.915369 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910359    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 19:54:14.915369 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910363    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 19:54:14.915369 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910368    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 19:54:14.915369 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910372    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 19:54:14.915369 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910376    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 19:54:14.915369 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910380    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 19:54:14.915369 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910385    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 19:54:14.915369 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910389    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 19:54:14.915831 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910393    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 19:54:14.915831 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910397    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 19:54:14.915831 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910401    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 19:54:14.915831 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910405    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 19:54:14.915831 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910409    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 19:54:14.915831 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910413    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 19:54:14.915831 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910417    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 19:54:14.915831 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910421    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 19:54:14.915831 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910425    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 19:54:14.915831 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910430    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 19:54:14.915831 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910434    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 19:54:14.915831 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910439    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 19:54:14.915831 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910443    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 19:54:14.915831 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910447    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 19:54:14.915831 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910451    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 19:54:14.915831 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910455    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 19:54:14.915831 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910459    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 19:54:14.915831 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910463    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 19:54:14.915831 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910467    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 19:54:14.915831 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910471    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 19:54:14.916451 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910476    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 19:54:14.916451 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910483    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 19:54:14.916451 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910488    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 19:54:14.916451 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910493    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 19:54:14.916451 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910498    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 19:54:14.916451 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910502    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 19:54:14.916451 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910507    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 19:54:14.916451 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910512    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 19:54:14.916451 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910517    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 19:54:14.916451 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910521    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 19:54:14.916451 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910525    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 19:54:14.916451 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910530    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 19:54:14.916451 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910534    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 19:54:14.916451 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910539    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 19:54:14.916451 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910543    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 19:54:14.916451 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910547    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 19:54:14.916451 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910551    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 19:54:14.916451 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910556    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 19:54:14.916451 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910560    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 19:54:14.917051 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910564    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 19:54:14.917051 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910568    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 19:54:14.917051 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910572    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 19:54:14.917051 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910579    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 19:54:14.917051 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910583    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 19:54:14.917051 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910588    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 19:54:14.917051 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910592    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 19:54:14.917051 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910596    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 19:54:14.917051 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910604    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 19:54:14.917051 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910610    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 19:54:14.917051 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910615    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 19:54:14.917051 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910620    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 19:54:14.917051 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910628    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 19:54:14.917051 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910632    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 19:54:14.917051 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910636    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 19:54:14.917051 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910640    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 19:54:14.917051 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.910644    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 19:54:14.917051 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910738    2561 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 19:54:14.917051 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910792    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 19:54:14.917051 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910803    2561 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 19:54:14.917545 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910810    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 19:54:14.917545 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910817    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 19:54:14.917545 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910822    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 19:54:14.917545 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910828    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 19:54:14.917545 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910834    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 19:54:14.917545 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910839    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 19:54:14.917545 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910844    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 19:54:14.917545 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910849    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 19:54:14.917545 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910855    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 19:54:14.917545 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910859    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 19:54:14.917545 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910864    2561 flags.go:64] FLAG: --cgroup-root=""
Sep 10 19:54:14.917545 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910869    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 19:54:14.917545 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910874    2561 flags.go:64] FLAG: --client-ca-file=""
Sep 10 19:54:14.917545 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910879    2561 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 19:54:14.917545 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910884    2561 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 19:54:14.917545 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910891    2561 flags.go:64] FLAG: --cluster-domain=""
Sep 10 19:54:14.917545 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910896    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 19:54:14.917545 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910901    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 19:54:14.917545 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910906    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 19:54:14.917545 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910911    2561 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 19:54:14.917545 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910917    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 19:54:14.917545 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910922    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 19:54:14.917545 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910927    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910932    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910939    2561 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910943    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910948    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910953    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910958    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910964    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910969    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910973    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910978    2561 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.910983    2561 flags.go:64] FLAG: --enable-server="true"
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911004    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911012    2561 flags.go:64] FLAG: --event-burst="100"
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911016    2561 flags.go:64] FLAG: --event-qps="50"
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911021    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911026    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911030    2561 flags.go:64] FLAG: --eviction-hard=""
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911036    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911041    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911046    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911050    2561 flags.go:64] FLAG: --eviction-soft=""
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911055    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911060    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911065    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 19:54:14.918154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911070    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911074    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911079    2561 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911084    2561 flags.go:64] FLAG: --feature-gates=""
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911089    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911094    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911099    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911104    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911109    2561 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911116    2561 flags.go:64] FLAG: --help="false"
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911120    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-133-162.ec2.internal"
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911125    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911130    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911135    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911141    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911147    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911151    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911156    2561 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911161    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911165    2561 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911171    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911176    2561 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911181    2561 flags.go:64] FLAG: --kube-reserved=""
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911186    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 19:54:14.918776 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911190    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911195    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911199    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911205    2561 flags.go:64] FLAG: --lock-file=""
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911209    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911214    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911219    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911228    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911233    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911238    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911242    2561 flags.go:64] FLAG: --logging-format="text"
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911247    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911252    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911257    2561 flags.go:64] FLAG: --manifest-url=""
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911262    2561 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911268    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911273    2561 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911281    2561 flags.go:64] FLAG: --max-pods="110"
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911286    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911291    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911295    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911300    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911305    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911310    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911315    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 19:54:14.919463 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911330    2561 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911335    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911339    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911344    2561 flags.go:64] FLAG: --pod-cidr=""
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911350    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911358    2561 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911363    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911368    2561 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911372    2561 flags.go:64] FLAG: --port="10250"
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911377    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911382    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07cbb658fea85970a"
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911387    2561 flags.go:64] FLAG: --qos-reserved=""
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911392    2561 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911397    2561 flags.go:64] FLAG: --register-node="true"
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911402    2561 flags.go:64] FLAG: --register-with-taints=""
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911407    2561 flags.go:64] FLAG: --registry-burst="10"
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911414    2561 flags.go:64] FLAG: --registry-qps="5"
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911418    2561 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911422    2561 flags.go:64] FLAG: --reserved-memory=""
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911428    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911434    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911438    2561 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911444    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911448    2561 flags.go:64] FLAG: --runonce="false"
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911453    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 19:54:14.920101 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911459    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911464    2561 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911469    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911473    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911478    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911483    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911488    2561 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911492    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911497    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911502    2561 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911507    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911512    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911517    2561 flags.go:64] FLAG: --system-cgroups=""
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911522    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911530    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911535    2561 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911540    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911546    2561 flags.go:64] FLAG: --tls-min-version=""
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911550    2561 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911554    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911559    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911564    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911569    2561 flags.go:64] FLAG: --v="2"
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911575    2561 flags.go:64] FLAG: --version="false"
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911581    2561 flags.go:64] FLAG: --vmodule=""
Sep 10 19:54:14.920720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911587    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 19:54:14.921351 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.911592    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 19:54:14.921351 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911766    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 19:54:14.921351 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911772    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 19:54:14.921351 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911777    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 19:54:14.921351 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911781    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 19:54:14.921351 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911786    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 19:54:14.921351 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911792    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 19:54:14.921351 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911797    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 19:54:14.921351 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911801    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 19:54:14.921351 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911805    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 19:54:14.921351 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911809    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 19:54:14.921351 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911813    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 19:54:14.921351 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911818    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 19:54:14.921351 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911821    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 19:54:14.921351 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911825    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 19:54:14.921351 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911830    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 19:54:14.921351 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911834    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 19:54:14.921351 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911838    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 19:54:14.921351 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911843    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 19:54:14.921351 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911848    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 19:54:14.921879 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911852    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 19:54:14.921879 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911856    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 19:54:14.921879 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911860    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 19:54:14.921879 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911864    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 19:54:14.921879 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911868    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 19:54:14.921879 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911872    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 19:54:14.921879 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911875    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 19:54:14.921879 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911879    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 19:54:14.921879 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911885    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 19:54:14.921879 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911889    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 19:54:14.921879 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911893    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 19:54:14.921879 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911897    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 19:54:14.921879 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911901    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 19:54:14.921879 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911906    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 19:54:14.921879 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911910    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 19:54:14.921879 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911914    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 19:54:14.921879 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911919    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 19:54:14.921879 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911923    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 19:54:14.921879 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911929    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 19:54:14.921879 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911933    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 19:54:14.922391 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911936    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 19:54:14.922391 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911940    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 19:54:14.922391 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911945    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 19:54:14.922391 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911949    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 19:54:14.922391 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911953    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 19:54:14.922391 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911958    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 19:54:14.922391 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911962    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 19:54:14.922391 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911966    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 19:54:14.922391 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911972    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 19:54:14.922391 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911978    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 19:54:14.922391 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.911982    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 19:54:14.922391 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912006    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 19:54:14.922391 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912012    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 19:54:14.922391 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912016    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 19:54:14.922391 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912020    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 19:54:14.922391 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912025    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 19:54:14.922391 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912029    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 19:54:14.922391 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912033    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 19:54:14.922391 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912037    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 19:54:14.922855 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912041    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 19:54:14.922855 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912046    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 19:54:14.922855 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912050    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 19:54:14.922855 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912055    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 19:54:14.922855 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912059    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 19:54:14.922855 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912063    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 19:54:14.922855 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912068    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 19:54:14.922855 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912074    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 19:54:14.922855 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912079    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 19:54:14.922855 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912084    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 19:54:14.922855 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912088    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 19:54:14.922855 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912094    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 19:54:14.922855 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912099    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 19:54:14.922855 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912103    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 19:54:14.922855 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912107    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 19:54:14.922855 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912111    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 19:54:14.922855 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912115    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 19:54:14.922855 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912119    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 19:54:14.922855 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912123    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 19:54:14.922855 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912127    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 19:54:14.923353 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912131    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 19:54:14.923353 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912135    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 19:54:14.923353 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912139    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 19:54:14.923353 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912143    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 19:54:14.923353 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912148    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 19:54:14.923353 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912152    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 19:54:14.923353 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912157    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 19:54:14.923353 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912161    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 19:54:14.923353 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912165    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 19:54:14.923353 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912169    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 19:54:14.923353 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912173    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 19:54:14.923353 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912177    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 19:54:14.923353 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912182    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 19:54:14.923353 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912187    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 19:54:14.923353 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912191    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 19:54:14.923353 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912195    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 19:54:14.923353 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912200    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 19:54:14.923353 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912206    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 19:54:14.923353 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912218    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 19:54:14.923812 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912223    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 19:54:14.923812 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.912228    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 19:54:14.923812 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.912886    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 19:54:14.923812 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.920867    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 19:54:14.923812 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.920881    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 19:54:14.923812 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.921810    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 19:54:14.923812 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.921819    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 19:54:14.923812 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921870    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 19:54:14.923812 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921875    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 19:54:14.923812 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921878    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 19:54:14.923812 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921881    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 19:54:14.923812 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921883    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 19:54:14.923812 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921886    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 19:54:14.923812 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921889    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 19:54:14.924179 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921892    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 19:54:14.924179 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921895    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 19:54:14.924179 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921897    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 19:54:14.924179 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921900    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 19:54:14.924179 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921902    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 19:54:14.924179 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921905    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 19:54:14.924179 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921908    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 19:54:14.924179 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921911    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 19:54:14.924179 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921913    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 19:54:14.924179 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921916    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 19:54:14.924179 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921919    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 19:54:14.924179 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921921    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 19:54:14.924179 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921923    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 19:54:14.924179 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921926    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 19:54:14.924179 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921928    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 19:54:14.924179 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921931    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 19:54:14.924179 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921934    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 19:54:14.924179 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921936    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 19:54:14.924179 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921940    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 19:54:14.924179 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921944    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 19:54:14.924665 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921948    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 19:54:14.924665 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921951    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 19:54:14.924665 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921955    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 19:54:14.924665 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921957    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 19:54:14.924665 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921960    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 19:54:14.924665 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921962    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 19:54:14.924665 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921965    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 19:54:14.924665 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921967    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 19:54:14.924665 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921970    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 19:54:14.924665 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921972    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 19:54:14.924665 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921975    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 19:54:14.924665 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921978    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 19:54:14.924665 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921980    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 19:54:14.924665 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921983    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 19:54:14.924665 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.921986    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 19:54:14.924665 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922005    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 19:54:14.924665 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922008    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 19:54:14.924665 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922010    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 19:54:14.924665 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922013    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 19:54:14.924665 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922016    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 19:54:14.925222 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922018    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 19:54:14.925222 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922021    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 19:54:14.925222 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922024    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 19:54:14.925222 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922026    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 19:54:14.925222 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922029    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 19:54:14.925222 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922031    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 19:54:14.925222 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922034    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 19:54:14.925222 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922037    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 19:54:14.925222 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922041    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 19:54:14.925222 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922044    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 19:54:14.925222 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922047    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 19:54:14.925222 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922050    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 19:54:14.925222 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922054    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 19:54:14.925222 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922057    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 19:54:14.925222 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922060    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 19:54:14.925222 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922064    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 19:54:14.925222 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922067    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 19:54:14.925222 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922069    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 19:54:14.925222 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922072    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 19:54:14.925682 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922074    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 19:54:14.925682 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922077    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 19:54:14.925682 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922080    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 19:54:14.925682 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922082    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 19:54:14.925682 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922085    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 19:54:14.925682 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922087    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 19:54:14.925682 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922090    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 19:54:14.925682 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922092    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 19:54:14.925682 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922095    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 19:54:14.925682 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922097    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 19:54:14.925682 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922100    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 19:54:14.925682 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922102    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 19:54:14.925682 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922105    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 19:54:14.925682 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922107    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 19:54:14.925682 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922110    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 19:54:14.925682 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922112    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 19:54:14.925682 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922115    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 19:54:14.925682 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922117    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 19:54:14.925682 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922120    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 19:54:14.925682 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922122    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 19:54:14.926230 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922125    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 19:54:14.926230 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922127    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 19:54:14.926230 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922129    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 19:54:14.926230 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922132    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 19:54:14.926230 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922135    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 19:54:14.926230 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922139    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 19:54:14.926230 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922143    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 19:54:14.926230 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922145    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 19:54:14.926230 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922148    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 19:54:14.926230 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922151    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 19:54:14.926230 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922154    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 19:54:14.926230 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922156    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 19:54:14.926230 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922159    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 19:54:14.926230 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.922163    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 19:54:14.926573 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922264    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 19:54:14.926573 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922268    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 19:54:14.926573 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922271    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 19:54:14.926573 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922274    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 19:54:14.926573 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922277    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 19:54:14.926573 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922279    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 19:54:14.926573 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922282    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 19:54:14.926573 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922284    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 19:54:14.926573 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922287    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 19:54:14.926573 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922289    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 19:54:14.926573 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922292    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 19:54:14.926573 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922295    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 19:54:14.926573 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922297    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 19:54:14.926573 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922300    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 19:54:14.926573 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922302    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 19:54:14.926573 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922305    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 19:54:14.926573 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922308    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 19:54:14.926573 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922310    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 19:54:14.926573 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922313    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 19:54:14.926573 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922315    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 19:54:14.927080 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922318    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 19:54:14.927080 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922320    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 19:54:14.927080 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922323    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 19:54:14.927080 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922326    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 19:54:14.927080 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922328    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 19:54:14.927080 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922331    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 19:54:14.927080 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922333    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 19:54:14.927080 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922336    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 19:54:14.927080 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922338    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 19:54:14.927080 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922341    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 19:54:14.927080 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922344    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 19:54:14.927080 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922346    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 19:54:14.927080 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922348    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 19:54:14.927080 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922351    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 19:54:14.927080 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922353    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 19:54:14.927080 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922356    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 19:54:14.927080 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922358    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 19:54:14.927080 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922362    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 19:54:14.927080 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922366    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 19:54:14.927523 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922369    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 19:54:14.927523 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922371    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 19:54:14.927523 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922374    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 19:54:14.927523 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922376    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 19:54:14.927523 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922379    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 19:54:14.927523 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922381    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 19:54:14.927523 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922383    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 19:54:14.927523 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922386    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 19:54:14.927523 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922389    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 19:54:14.927523 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922391    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 19:54:14.927523 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922394    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 19:54:14.927523 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922397    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 19:54:14.927523 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922399    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 19:54:14.927523 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922402    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 19:54:14.927523 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922404    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 19:54:14.927523 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922408    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 19:54:14.927523 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922412    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 19:54:14.927523 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922415    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 19:54:14.927523 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922418    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 19:54:14.927979 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922421    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 19:54:14.927979 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922423    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 19:54:14.927979 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922426    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 19:54:14.927979 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922429    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 19:54:14.927979 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922432    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 19:54:14.927979 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922435    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 19:54:14.927979 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922438    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 19:54:14.927979 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922441    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 19:54:14.927979 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922443    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 19:54:14.927979 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922446    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 19:54:14.927979 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922448    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 19:54:14.927979 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922450    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 19:54:14.927979 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922453    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 19:54:14.927979 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922455    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 19:54:14.927979 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922458    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 19:54:14.927979 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922460    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 19:54:14.927979 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922463    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 19:54:14.927979 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922465    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 19:54:14.927979 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922468    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 19:54:14.928452 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922470    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 19:54:14.928452 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922473    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 19:54:14.928452 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922475    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 19:54:14.928452 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922478    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 19:54:14.928452 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922480    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 19:54:14.928452 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922483    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 19:54:14.928452 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922486    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 19:54:14.928452 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922489    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 19:54:14.928452 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922492    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 19:54:14.928452 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922494    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 19:54:14.928452 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922497    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 19:54:14.928452 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922500    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 19:54:14.928452 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922502    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 19:54:14.928452 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922505    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 19:54:14.928452 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922507    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 19:54:14.928452 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922510    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 19:54:14.928452 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922512    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 19:54:14.928452 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922515    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 19:54:14.928452 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922517    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 19:54:14.928452 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922520    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 19:54:14.928938 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922522    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 19:54:14.928938 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:14.922525    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 19:54:14.928938 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.922530    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 19:54:14.928938 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.922619    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 19:54:14.928938 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.924883    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 19:54:14.928938 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.925972    2561 server.go:1019] "Starting client certificate rotation"
Sep 10 19:54:14.928938 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.926076    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 19:54:14.928938 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.926105    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 19:54:14.929170 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.929126    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 19:54:14.935297 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.935273    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 19:54:14.945787 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.945770    2561 log.go:25] "Validated CRI v1 runtime API"
Sep 10 19:54:14.949304 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.949289    2561 log.go:25] "Validated CRI v1 image API"
Sep 10 19:54:14.950950 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.950936    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 19:54:14.953717 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.953686    2561 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9782c306-ca04-464f-b78b-f2458efc61a2:/dev/nvme0n1p4 e144d1a0-c42d-46a3-a1ba-1560fea4cd9f:/dev/nvme0n1p3]
Sep 10 19:54:14.953779 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.953718    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 19:54:14.958591 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.958573    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 19:54:14.959075 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.958960    2561 manager.go:216] Machine: {Timestamp:2026-09-10 19:54:14.95737031 +0000 UTC m=+0.366876542 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097828 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23b3432c83c9eb10d7ecbe044e1cda SystemUUID:ec23b343-2c83-c9eb-10d7-ecbe044e1cda BootID:931861b5-99ea-40e5-a2cd-465e84426980 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5c:fd:e5:1e:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5c:fd:e5:1e:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:45:b4:7f:25:99 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 19:54:14.959075 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.959070    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 19:54:14.959183 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.959172    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 19:54:14.962814 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.962793    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 19:54:14.962946 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.962815    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-162.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 19:54:14.963597 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.963587    2561 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 19:54:14.963635 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.963599    2561 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 19:54:14.963635 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.963607    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 19:54:14.965211 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.965200    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 19:54:14.966410 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.966400    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 19:54:14.969841 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.969829    2561 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 19:54:14.969956 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.969946    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 19:54:14.970006 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.969978    2561 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 19:54:14.970006 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.970005    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 19:54:14.970064 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.970021    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 19:54:14.970064 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.970035    2561 kubelet.go:398] "Adding apiserver pod source"
Sep 10 19:54:14.970064 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.970046    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 19:54:14.970369 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.970358    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 19:54:14.970411 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.970377    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 19:54:14.972798 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.972772    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 19:54:14.975888 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.975875    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 19:54:14.975945 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.975905    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 19:54:14.977359 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.977347    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 19:54:14.977404 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.977361    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 19:54:14.977404 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.977368    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 19:54:14.977404 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.977373    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 19:54:14.977404 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.977382    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 19:54:14.977404 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.977388    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 19:54:14.977404 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.977402    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 19:54:14.977404 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.977407    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 19:54:14.977605 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.977419    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 19:54:14.977605 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.977424    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 19:54:14.977605 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.977433    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 19:54:14.977605 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.977437    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 19:54:14.979182 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.979169    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 19:54:14.979182 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.979183    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 19:54:14.979729 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:14.979705    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 19:54:14.979803 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:14.979786    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 19:54:14.982222 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.981834    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8qd6g"
Sep 10 19:54:14.982860 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.982845    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-162.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 19:54:14.984444 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.984427    2561 server.go:1268] "Started kubelet"
Sep 10 19:54:14.984585 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.984529    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 19:54:14.984585 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.984515    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 19:54:14.984742 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.984607    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 19:54:14.985236 ip-10-0-133-162 systemd[1]: Started Kubernetes Kubelet.
Sep 10 19:54:14.986352 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.986335    2561 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 19:54:14.986352 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.986347    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 19:54:14.988895 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:14.988874    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 19:54:14.989274 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.989146    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8qd6g"
Sep 10 19:54:14.992902 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:14.991765    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-162.ec2.internal.18d40dbc71a2195c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-162.ec2.internal,UID:ip-10-0-133-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-162.ec2.internal,},FirstTimestamp:2026-09-10 19:54:14.984391004 +0000 UTC m=+0.393897237,LastTimestamp:2026-09-10 19:54:14.984391004 +0000 UTC m=+0.393897237,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-162.ec2.internal,}"
Sep 10 19:54:14.996302 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.996285    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 19:54:14.997011 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.996981    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 19:54:14.997196 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:14.997178    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-162.ec2.internal\" not found"
Sep 10 19:54:14.997832 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.997816    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 19:54:14.997832 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.997831    2561 factory.go:55] Registering systemd factory
Sep 10 19:54:14.997969 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.997841    2561 factory.go:223] Registration of the systemd container factory successfully
Sep 10 19:54:14.997969 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.997843    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 19:54:14.997969 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.997843    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 19:54:14.997969 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.997872    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 19:54:14.997969 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.997940    2561 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 19:54:14.997969 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.997947    2561 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 19:54:14.998192 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.998052    2561 factory.go:153] Registering CRI-O factory
Sep 10 19:54:14.998192 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.998068    2561 factory.go:223] Registration of the crio container factory successfully
Sep 10 19:54:14.998192 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.998086    2561 factory.go:103] Registering Raw factory
Sep 10 19:54:14.998192 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.998102    2561 manager.go:1196] Started watching for new ooms in manager
Sep 10 19:54:14.998550 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.998536    2561 manager.go:349] Starting recovery of all containers
Sep 10 19:54:14.999347 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:14.999327    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 19:54:15.002190 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:15.002153    2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-162.ec2.internal\" not found" node="ip-10-0-133-162.ec2.internal"
Sep 10 19:54:15.008813 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.008794    2561 manager.go:354] Recovery completed
Sep 10 19:54:15.015509 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.015496    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 19:54:15.017212 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.017194    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 19:54:15.017299 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.017226    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 19:54:15.017299 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.017236    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientPID"
Sep 10 19:54:15.017748 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.017735    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 19:54:15.017811 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.017749    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 19:54:15.017811 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.017769    2561 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 19:54:15.017811 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.017751    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 19:54:15.018509 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.018492    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 19:54:15.018586 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.018522    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 19:54:15.018586 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.018535    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientPID"
Sep 10 19:54:15.018870 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.018856    2561 policy_none.go:49] "None policy: Start"
Sep 10 19:54:15.018936 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.018878    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 19:54:15.018936 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.018888    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 19:54:15.019973 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.019947    2561 policy_none.go:47] "Start"
Sep 10 19:54:15.043648 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.043635    2561 manager.go:337] "Starting Device Plugin manager"
Sep 10 19:54:15.058090 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:15.043672    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 19:54:15.058090 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.043685    2561 server.go:87] "Starting device plugin registration server"
Sep 10 19:54:15.058090 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.043909    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 19:54:15.058090 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.043920    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 19:54:15.058090 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.044098    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 19:54:15.058090 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.044165    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 19:54:15.058090 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.044172    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 19:54:15.058090 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:15.047500    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 19:54:15.058090 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:15.047547    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-162.ec2.internal\" not found"
Sep 10 19:54:15.097795 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.097774    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 19:54:15.098998 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.098967    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 19:54:15.099088 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.099035    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 19:54:15.099088 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.099058    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 19:54:15.099205 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:15.099099    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 19:54:15.101482 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.101463    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 19:54:15.144852 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.144830    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 19:54:15.145652 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.145637    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 19:54:15.145726 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.145668    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 19:54:15.145726 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.145684    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientPID"
Sep 10 19:54:15.145726 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.145709    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-162.ec2.internal"
Sep 10 19:54:15.154462 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.154391    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-162.ec2.internal"
Sep 10 19:54:15.154462 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:15.154412    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-162.ec2.internal\": node \"ip-10-0-133-162.ec2.internal\" not found"
Sep 10 19:54:15.170293 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:15.170274    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-162.ec2.internal\" not found"
Sep 10 19:54:15.199512 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.199492    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-162.ec2.internal"]
Sep 10 19:54:15.199574 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.199549    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 19:54:15.200940 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.200926    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 19:54:15.201022 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.200951    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 19:54:15.201022 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.200965    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientPID"
Sep 10 19:54:15.202092 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.202080    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 19:54:15.202224 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.202206    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal"
Sep 10 19:54:15.202262 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.202240    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 19:54:15.202760 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.202746    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 19:54:15.202831 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.202767    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 19:54:15.202831 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.202751    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 19:54:15.202831 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.202809    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 19:54:15.202831 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.202779    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientPID"
Sep 10 19:54:15.202831 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.202826    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientPID"
Sep 10 19:54:15.204471 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.204455    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-162.ec2.internal"
Sep 10 19:54:15.204546 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.204485    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 19:54:15.206395 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.206378    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 19:54:15.206478 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.206403    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 19:54:15.206478 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.206412    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientPID"
Sep 10 19:54:15.233625 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:15.233609    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-162.ec2.internal\" not found" node="ip-10-0-133-162.ec2.internal"
Sep 10 19:54:15.238019 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:15.238001    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-162.ec2.internal\" not found" node="ip-10-0-133-162.ec2.internal"
Sep 10 19:54:15.270877 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:15.270858    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-162.ec2.internal\" not found"
Sep 10 19:54:15.299367 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.299349    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9db966db7197aaab6d3876e6501aadf5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal\" (UID: \"9db966db7197aaab6d3876e6501aadf5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal"
Sep 10 19:54:15.299450 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.299372    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9db966db7197aaab6d3876e6501aadf5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal\" (UID: \"9db966db7197aaab6d3876e6501aadf5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal"
Sep 10 19:54:15.299450 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.299387    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2bed3b36dfff37d8ae39ecb426eba237-config\") pod \"kube-apiserver-proxy-ip-10-0-133-162.ec2.internal\" (UID: \"2bed3b36dfff37d8ae39ecb426eba237\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-162.ec2.internal"
Sep 10 19:54:15.371949 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:15.371925    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-162.ec2.internal\" not found"
Sep 10 19:54:15.400254 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.400235    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9db966db7197aaab6d3876e6501aadf5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal\" (UID: \"9db966db7197aaab6d3876e6501aadf5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal"
Sep 10 19:54:15.400353 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.400259    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9db966db7197aaab6d3876e6501aadf5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal\" (UID: \"9db966db7197aaab6d3876e6501aadf5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal"
Sep 10 19:54:15.400353 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.400281    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2bed3b36dfff37d8ae39ecb426eba237-config\") pod \"kube-apiserver-proxy-ip-10-0-133-162.ec2.internal\" (UID: \"2bed3b36dfff37d8ae39ecb426eba237\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-162.ec2.internal"
Sep 10 19:54:15.400353 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.400339    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9db966db7197aaab6d3876e6501aadf5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal\" (UID: \"9db966db7197aaab6d3876e6501aadf5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal"
Sep 10 19:54:15.400353 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.400336    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9db966db7197aaab6d3876e6501aadf5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal\" (UID: \"9db966db7197aaab6d3876e6501aadf5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal"
Sep 10 19:54:15.400497 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.400349    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2bed3b36dfff37d8ae39ecb426eba237-config\") pod \"kube-apiserver-proxy-ip-10-0-133-162.ec2.internal\" (UID: \"2bed3b36dfff37d8ae39ecb426eba237\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-162.ec2.internal"
Sep 10 19:54:15.472646 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:15.472580    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-162.ec2.internal\" not found"
Sep 10 19:54:15.536123 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.536099    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal"
Sep 10 19:54:15.540951 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:15.540937    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-162.ec2.internal"
Sep 10 19:54:15.573655 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:15.573632    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-162.ec2.internal\" not found"
Sep 10 19:54:15.674192 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:15.674153    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-162.ec2.internal\" not found"
Sep 10 19:54:15.774736 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:15.774673    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-162.ec2.internal\" not found"
Sep 10 19:54:17.619746 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:17.619714    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-162.ec2.internal\" not found"
Sep 10 19:54:17.645126 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.645107    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 19:54:17.670370 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.670347    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 19:54:17.670775 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.670472    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 19:54:17.670775 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.670511    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 19:54:17.670775 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.670524    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 19:54:17.714752 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.714596    2561 apiserver.go:52] "Watching apiserver"
Sep 10 19:54:17.731352 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.731327    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 19:54:17.731823 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.731797    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-lqn7b","openshift-image-registry/node-ca-vrgkq","openshift-multus/multus-additional-cni-plugins-d2skk","openshift-multus/network-metrics-daemon-mxnhw","openshift-network-operator/iptables-alerter-89svr","kube-system/global-pull-secret-syncer-klxsb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r","openshift-multus/multus-krr84","openshift-network-diagnostics/network-check-target-9j5tj","openshift-ovn-kubernetes/ovnkube-node-76gvf","kube-system/konnectivity-agent-shxth","openshift-cluster-node-tuning-operator/tuned-trbgx"]
Sep 10 19:54:17.733418 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.733382    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vrgkq"
Sep 10 19:54:17.734584 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.734563    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d2skk"
Sep 10 19:54:17.735558 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.735541    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 19:54:17.735690 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.735543    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 19:54:17.735751 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.735725    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 19:54:17.735799 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.735777    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tjpk5\""
Sep 10 19:54:17.735878 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.735859    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:17.736411 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:17.735942    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxnhw" podUID="26ab4b64-59b6-42cb-b55d-ce41cecd0e85"
Sep 10 19:54:17.737015 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.736994    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 19:54:17.737095 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.737021    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 19:54:17.737161 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.737143    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 19:54:17.737322 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.737302    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 19:54:17.737386 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.737309    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 19:54:17.737662 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.737646    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-89svr"
Sep 10 19:54:17.737746 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.737648    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sr9sk\""
Sep 10 19:54:17.738168 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.738127    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 19:49:16 +0000 UTC" deadline="2028-05-02 01:13:09.583181661 +0000 UTC"
Sep 10 19:54:17.738215 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.738170    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14381h18m51.845015114s"
Sep 10 19:54:17.739149 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.739056    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r"
Sep 10 19:54:17.740090 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.740069    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 19:54:17.740189 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.740114    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 19:54:17.740248 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.740196    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 19:54:17.740439 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.740422    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.740517 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.740458    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bn7jv\""
Sep 10 19:54:17.740979 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.740959    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 19:54:17.741186 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.741171    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x8bzk\""
Sep 10 19:54:17.741315 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.741299    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 19:54:17.741368 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.741355    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 19:54:17.741577 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.741565    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal"
Sep 10 19:54:17.741993 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.741972    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:17.742068 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:17.742042    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9j5tj" podUID="b27c6a7e-d576-44de-9d2b-ac8b51b69bc7"
Sep 10 19:54:17.742458 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.742310    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 19:54:17.742458 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.742353    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 19:54:17.742792 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.742710    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2c8q7\""
Sep 10 19:54:17.743812 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.743793    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-shxth"
Sep 10 19:54:17.744907 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.744883    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.746069 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.746051    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 19:54:17.746166 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.746069    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dkrpn\""
Sep 10 19:54:17.746261 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.746247    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 19:54:17.746364 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.746348    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lqn7b"
Sep 10 19:54:17.747569 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.747554    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 19:54:17.747651 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.747571    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 19:54:17.747834 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.747816    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:17.747894 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:17.747882    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klxsb" podUID="91e2acc4-0716-4fcb-95ee-32d1668449e7"
Sep 10 19:54:17.748068 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748053    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mcln4\""
Sep 10 19:54:17.748416 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748297    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-host-run-netns\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.748416 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748328    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b2be38a9-429c-4a4d-aea8-fe09152b4a48-multus-daemon-config\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.748416 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748352    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwv22\" (UniqueName: \"kubernetes.io/projected/b2be38a9-429c-4a4d-aea8-fe09152b4a48-kube-api-access-xwv22\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.748416 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748377    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bf92bb85-73f0-46a4-b32e-b83f8d56ac82-konnectivity-ca\") pod \"konnectivity-agent-shxth\" (UID: \"bf92bb85-73f0-46a4-b32e-b83f8d56ac82\") " pod="kube-system/konnectivity-agent-shxth"
Sep 10 19:54:17.748581 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748466    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g92k\" (UniqueName: \"kubernetes.io/projected/e4b902c8-2410-4e7d-b415-41e848652a43-kube-api-access-6g92k\") pod \"aws-ebs-csi-driver-node-wlt9r\" (UID: \"e4b902c8-2410-4e7d-b415-41e848652a43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r"
Sep 10 19:54:17.748581 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748490    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-host-var-lib-cni-bin\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.748581 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748511    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-etc-kubernetes\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.748581 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748537    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee70731d-0545-406f-bc04-c0589d986e18-serviceca\") pod \"node-ca-vrgkq\" (UID: \"ee70731d-0545-406f-bc04-c0589d986e18\") " pod="openshift-image-registry/node-ca-vrgkq"
Sep 10 19:54:17.748581 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748559    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef619541-b449-44f8-a3c7-228a92fc6904-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d2skk\" (UID: \"ef619541-b449-44f8-a3c7-228a92fc6904\") " pod="openshift-multus/multus-additional-cni-plugins-d2skk"
Sep 10 19:54:17.748765 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748581    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-multus-socket-dir-parent\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.748765 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748605    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-host-run-multus-certs\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.748765 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748644    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfh5r\" (UniqueName: \"kubernetes.io/projected/ee70731d-0545-406f-bc04-c0589d986e18-kube-api-access-kfh5r\") pod \"node-ca-vrgkq\" (UID: \"ee70731d-0545-406f-bc04-c0589d986e18\") " pod="openshift-image-registry/node-ca-vrgkq"
Sep 10 19:54:17.748765 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748670    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef619541-b449-44f8-a3c7-228a92fc6904-cni-binary-copy\") pod \"multus-additional-cni-plugins-d2skk\" (UID: \"ef619541-b449-44f8-a3c7-228a92fc6904\") " pod="openshift-multus/multus-additional-cni-plugins-d2skk"
Sep 10 19:54:17.748765 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748698    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b9a8844-d413-41e5-af75-6d5c962a43ba-host-slash\") pod \"iptables-alerter-89svr\" (UID: \"7b9a8844-d413-41e5-af75-6d5c962a43ba\") " pod="openshift-network-operator/iptables-alerter-89svr"
Sep 10 19:54:17.748765 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748720    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-multus-conf-dir\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.748765 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748739    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bf92bb85-73f0-46a4-b32e-b83f8d56ac82-agent-certs\") pod \"konnectivity-agent-shxth\" (UID: \"bf92bb85-73f0-46a4-b32e-b83f8d56ac82\") " pod="kube-system/konnectivity-agent-shxth"
Sep 10 19:54:17.748765 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748762    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs\") pod \"network-metrics-daemon-mxnhw\" (UID: \"26ab4b64-59b6-42cb-b55d-ce41cecd0e85\") " pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:17.749138 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748787    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef619541-b449-44f8-a3c7-228a92fc6904-system-cni-dir\") pod \"multus-additional-cni-plugins-d2skk\" (UID: \"ef619541-b449-44f8-a3c7-228a92fc6904\") " pod="openshift-multus/multus-additional-cni-plugins-d2skk"
Sep 10 19:54:17.749138 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748806    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef619541-b449-44f8-a3c7-228a92fc6904-cnibin\") pod \"multus-additional-cni-plugins-d2skk\" (UID: \"ef619541-b449-44f8-a3c7-228a92fc6904\") " pod="openshift-multus/multus-additional-cni-plugins-d2skk"
Sep 10 19:54:17.749138 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748848    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh2kc\" (UniqueName: \"kubernetes.io/projected/ef619541-b449-44f8-a3c7-228a92fc6904-kube-api-access-nh2kc\") pod \"multus-additional-cni-plugins-d2skk\" (UID: \"ef619541-b449-44f8-a3c7-228a92fc6904\") " pod="openshift-multus/multus-additional-cni-plugins-d2skk"
Sep 10 19:54:17.749138 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748870    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b9a8844-d413-41e5-af75-6d5c962a43ba-iptables-alerter-script\") pod \"iptables-alerter-89svr\" (UID: \"7b9a8844-d413-41e5-af75-6d5c962a43ba\") " pod="openshift-network-operator/iptables-alerter-89svr"
Sep 10 19:54:17.749138 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748891    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4b902c8-2410-4e7d-b415-41e848652a43-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wlt9r\" (UID: \"e4b902c8-2410-4e7d-b415-41e848652a43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r"
Sep 10 19:54:17.749138 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748907    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xz2zl\""
Sep 10 19:54:17.749138 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748912    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4b902c8-2410-4e7d-b415-41e848652a43-socket-dir\") pod \"aws-ebs-csi-driver-node-wlt9r\" (UID: \"e4b902c8-2410-4e7d-b415-41e848652a43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r"
Sep 10 19:54:17.749138 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748921    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 19:54:17.749138 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748938    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4b902c8-2410-4e7d-b415-41e848652a43-sys-fs\") pod \"aws-ebs-csi-driver-node-wlt9r\" (UID: \"e4b902c8-2410-4e7d-b415-41e848652a43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r"
Sep 10 19:54:17.749138 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.748984    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blxj7\" (UniqueName: \"kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7\") pod \"network-check-target-9j5tj\" (UID: \"b27c6a7e-d576-44de-9d2b-ac8b51b69bc7\") " pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:17.749138 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.749029    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-system-cni-dir\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.749138 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.749077    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-host-run-k8s-cni-cncf-io\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.749138 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.749106    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-host-var-lib-kubelet\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.749138 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.749146    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 19:54:17.749784 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.749137    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-hostroot\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.749784 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.749180    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee70731d-0545-406f-bc04-c0589d986e18-host\") pod \"node-ca-vrgkq\" (UID: \"ee70731d-0545-406f-bc04-c0589d986e18\") " pod="openshift-image-registry/node-ca-vrgkq"
Sep 10 19:54:17.749784 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.749207    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef619541-b449-44f8-a3c7-228a92fc6904-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d2skk\" (UID: \"ef619541-b449-44f8-a3c7-228a92fc6904\") " pod="openshift-multus/multus-additional-cni-plugins-d2skk"
Sep 10 19:54:17.749784 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.749231    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4b902c8-2410-4e7d-b415-41e848652a43-registration-dir\") pod \"aws-ebs-csi-driver-node-wlt9r\" (UID: \"e4b902c8-2410-4e7d-b415-41e848652a43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r"
Sep 10 19:54:17.749784 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.749254    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4b902c8-2410-4e7d-b415-41e848652a43-device-dir\") pod \"aws-ebs-csi-driver-node-wlt9r\" (UID: \"e4b902c8-2410-4e7d-b415-41e848652a43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r"
Sep 10 19:54:17.749784 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.749278    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npnmq\" (UniqueName: \"kubernetes.io/projected/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-kube-api-access-npnmq\") pod \"network-metrics-daemon-mxnhw\" (UID: \"26ab4b64-59b6-42cb-b55d-ce41cecd0e85\") " pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:17.749784 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.749305    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-multus-cni-dir\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.749784 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.749340    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2be38a9-429c-4a4d-aea8-fe09152b4a48-cni-binary-copy\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.749784 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.749380    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-host-var-lib-cni-multus\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.749784 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.749444    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef619541-b449-44f8-a3c7-228a92fc6904-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d2skk\" (UID: \"ef619541-b449-44f8-a3c7-228a92fc6904\") " pod="openshift-multus/multus-additional-cni-plugins-d2skk"
Sep 10 19:54:17.749784 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.749469    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qvmd\" (UniqueName: \"kubernetes.io/projected/7b9a8844-d413-41e5-af75-6d5c962a43ba-kube-api-access-2qvmd\") pod \"iptables-alerter-89svr\" (UID: \"7b9a8844-d413-41e5-af75-6d5c962a43ba\") " pod="openshift-network-operator/iptables-alerter-89svr"
Sep 10 19:54:17.749784 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.749490    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4b902c8-2410-4e7d-b415-41e848652a43-etc-selinux\") pod \"aws-ebs-csi-driver-node-wlt9r\" (UID: \"e4b902c8-2410-4e7d-b415-41e848652a43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r"
Sep 10 19:54:17.749784 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.749519    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-cnibin\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.749784 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.749545    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.751630 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.751612    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 19:54:17.752068 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.752051    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 19:54:17.752164 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.752135    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 19:54:17.752273 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.752257    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 19:54:17.752361 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.752279    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 19:54:17.752471 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.752375    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 19:54:17.752471 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.752448    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p8vsm\""
Sep 10 19:54:17.753280 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.753265    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 19:54:17.753974 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.753937    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 19:54:17.754063 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.754004    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-162.ec2.internal"
Sep 10 19:54:17.754238 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.754224    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal"]
Sep 10 19:54:17.760650 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.760634    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-162.ec2.internal"]
Sep 10 19:54:17.760856 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.760843    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 19:54:17.770551 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.770506    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7pbk4"
Sep 10 19:54:17.776280 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.776260    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7pbk4"
Sep 10 19:54:17.808144 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:17.808120    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bed3b36dfff37d8ae39ecb426eba237.slice/crio-d0b34c47a42354ea3cc3ab11fa22a0b5a1c1bed3ba01327b632bfdb9e4064792 WatchSource:0}: Error finding container d0b34c47a42354ea3cc3ab11fa22a0b5a1c1bed3ba01327b632bfdb9e4064792: Status 404 returned error can't find the container with id d0b34c47a42354ea3cc3ab11fa22a0b5a1c1bed3ba01327b632bfdb9e4064792
Sep 10 19:54:17.808333 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:17.808319    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9db966db7197aaab6d3876e6501aadf5.slice/crio-d5542671a1074eb4f398bb4d8bdf361349007e3ac4e24d612ee28714a6b72be2 WatchSource:0}: Error finding container d5542671a1074eb4f398bb4d8bdf361349007e3ac4e24d612ee28714a6b72be2: Status 404 returned error can't find the container with id d5542671a1074eb4f398bb4d8bdf361349007e3ac4e24d612ee28714a6b72be2
Sep 10 19:54:17.814367 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.814348    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 19:54:17.843415 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.843383    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 19:54:17.846969 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.846934    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal" event={"ID":"9db966db7197aaab6d3876e6501aadf5","Type":"ContainerStarted","Data":"d5542671a1074eb4f398bb4d8bdf361349007e3ac4e24d612ee28714a6b72be2"}
Sep 10 19:54:17.847922 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.847906    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-162.ec2.internal" event={"ID":"2bed3b36dfff37d8ae39ecb426eba237","Type":"ContainerStarted","Data":"d0b34c47a42354ea3cc3ab11fa22a0b5a1c1bed3ba01327b632bfdb9e4064792"}
Sep 10 19:54:17.850130 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850112    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef619541-b449-44f8-a3c7-228a92fc6904-cni-binary-copy\") pod \"multus-additional-cni-plugins-d2skk\" (UID: \"ef619541-b449-44f8-a3c7-228a92fc6904\") " pod="openshift-multus/multus-additional-cni-plugins-d2skk"
Sep 10 19:54:17.850179 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850140    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-host-kubelet\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.850179 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850155    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-host-slash\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.850179 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850171    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-host-run-netns\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.850278 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850187    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-run-ovn\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.850278 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850235    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-host-cni-netd\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.850278 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850263    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/67db218b-f273-4db9-a124-af7c77107860-env-overrides\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.850425 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850296    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/67db218b-f273-4db9-a124-af7c77107860-ovn-node-metrics-cert\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.850425 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850316    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-etc-sysconfig\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.850425 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850330    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-var-lib-kubelet\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.850425 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850374    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-etc-tuned\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.850425 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850416    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef619541-b449-44f8-a3c7-228a92fc6904-system-cni-dir\") pod \"multus-additional-cni-plugins-d2skk\" (UID: \"ef619541-b449-44f8-a3c7-228a92fc6904\") " pod="openshift-multus/multus-additional-cni-plugins-d2skk"
Sep 10 19:54:17.850584 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850452    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef619541-b449-44f8-a3c7-228a92fc6904-system-cni-dir\") pod \"multus-additional-cni-plugins-d2skk\" (UID: \"ef619541-b449-44f8-a3c7-228a92fc6904\") " pod="openshift-multus/multus-additional-cni-plugins-d2skk"
Sep 10 19:54:17.850584 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850473    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4b902c8-2410-4e7d-b415-41e848652a43-socket-dir\") pod \"aws-ebs-csi-driver-node-wlt9r\" (UID: \"e4b902c8-2410-4e7d-b415-41e848652a43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r"
Sep 10 19:54:17.850584 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850499    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4b902c8-2410-4e7d-b415-41e848652a43-sys-fs\") pod \"aws-ebs-csi-driver-node-wlt9r\" (UID: \"e4b902c8-2410-4e7d-b415-41e848652a43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r"
Sep 10 19:54:17.850584 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850518    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r86s\" (UniqueName: \"kubernetes.io/projected/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-kube-api-access-4r86s\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.850584 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-system-cni-dir\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.850584 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850564    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-hostroot\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.850584 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850579    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4b902c8-2410-4e7d-b415-41e848652a43-sys-fs\") pod \"aws-ebs-csi-driver-node-wlt9r\" (UID: \"e4b902c8-2410-4e7d-b415-41e848652a43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r"
Sep 10 19:54:17.850886 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850587    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee70731d-0545-406f-bc04-c0589d986e18-host\") pod \"node-ca-vrgkq\" (UID: \"ee70731d-0545-406f-bc04-c0589d986e18\") " pod="openshift-image-registry/node-ca-vrgkq"
Sep 10 19:54:17.850886 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850586    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef619541-b449-44f8-a3c7-228a92fc6904-cni-binary-copy\") pod \"multus-additional-cni-plugins-d2skk\" (UID: \"ef619541-b449-44f8-a3c7-228a92fc6904\") " pod="openshift-multus/multus-additional-cni-plugins-d2skk"
Sep 10 19:54:17.850886 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850623    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee70731d-0545-406f-bc04-c0589d986e18-host\") pod \"node-ca-vrgkq\" (UID: \"ee70731d-0545-406f-bc04-c0589d986e18\") " pod="openshift-image-registry/node-ca-vrgkq"
Sep 10 19:54:17.850886 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850628    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4b902c8-2410-4e7d-b415-41e848652a43-socket-dir\") pod \"aws-ebs-csi-driver-node-wlt9r\" (UID: \"e4b902c8-2410-4e7d-b415-41e848652a43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r"
Sep 10 19:54:17.850886 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850611    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef619541-b449-44f8-a3c7-228a92fc6904-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d2skk\" (UID: \"ef619541-b449-44f8-a3c7-228a92fc6904\") " pod="openshift-multus/multus-additional-cni-plugins-d2skk"
Sep 10 19:54:17.850886 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850670    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-system-cni-dir\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.850886 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850702    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-hostroot\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.850886 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850699    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4b902c8-2410-4e7d-b415-41e848652a43-registration-dir\") pod \"aws-ebs-csi-driver-node-wlt9r\" (UID: \"e4b902c8-2410-4e7d-b415-41e848652a43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r"
Sep 10 19:54:17.850886 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850731    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef619541-b449-44f8-a3c7-228a92fc6904-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d2skk\" (UID: \"ef619541-b449-44f8-a3c7-228a92fc6904\") " pod="openshift-multus/multus-additional-cni-plugins-d2skk"
Sep 10 19:54:17.850886 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850735    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4b902c8-2410-4e7d-b415-41e848652a43-registration-dir\") pod \"aws-ebs-csi-driver-node-wlt9r\" (UID: \"e4b902c8-2410-4e7d-b415-41e848652a43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r"
Sep 10 19:54:17.850886 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850732    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4b902c8-2410-4e7d-b415-41e848652a43-device-dir\") pod \"aws-ebs-csi-driver-node-wlt9r\" (UID: \"e4b902c8-2410-4e7d-b415-41e848652a43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r"
Sep 10 19:54:17.850886 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850790    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4b902c8-2410-4e7d-b415-41e848652a43-device-dir\") pod \"aws-ebs-csi-driver-node-wlt9r\" (UID: \"e4b902c8-2410-4e7d-b415-41e848652a43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r"
Sep 10 19:54:17.850886 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850800    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-multus-cni-dir\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.850886 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850820    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-host-var-lib-cni-multus\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.850886 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850835    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwv22\" (UniqueName: \"kubernetes.io/projected/b2be38a9-429c-4a4d-aea8-fe09152b4a48-kube-api-access-xwv22\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.850886 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850852    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bf92bb85-73f0-46a4-b32e-b83f8d56ac82-konnectivity-ca\") pod \"konnectivity-agent-shxth\" (UID: \"bf92bb85-73f0-46a4-b32e-b83f8d56ac82\") " pod="kube-system/konnectivity-agent-shxth"
Sep 10 19:54:17.850886 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850859    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-host-var-lib-cni-multus\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.851563 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850868    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qvmd\" (UniqueName: \"kubernetes.io/projected/7b9a8844-d413-41e5-af75-6d5c962a43ba-kube-api-access-2qvmd\") pod \"iptables-alerter-89svr\" (UID: \"7b9a8844-d413-41e5-af75-6d5c962a43ba\") " pod="openshift-network-operator/iptables-alerter-89svr"
Sep 10 19:54:17.851563 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850886    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-multus-cni-dir\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.851563 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850890    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-host-run-netns\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.851563 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850918    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-host-run-netns\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.851563 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850926    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b2be38a9-429c-4a4d-aea8-fe09152b4a48-multus-daemon-config\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.851563 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850947    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/91e2acc4-0716-4fcb-95ee-32d1668449e7-kubelet-config\") pod \"global-pull-secret-syncer-klxsb\" (UID: \"91e2acc4-0716-4fcb-95ee-32d1668449e7\") " pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:17.851563 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850962    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-systemd-units\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.851563 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850976    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-log-socket\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.851563 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.850998    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpf78\" (UniqueName: \"kubernetes.io/projected/67db218b-f273-4db9-a124-af7c77107860-kube-api-access-wpf78\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.851563 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851067    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1686c34-4f9d-424e-9b3b-9daf34983519-tmp-dir\") pod \"node-resolver-lqn7b\" (UID: \"b1686c34-4f9d-424e-9b3b-9daf34983519\") " pod="openshift-dns/node-resolver-lqn7b"
Sep 10 19:54:17.851563 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851097    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-host-var-lib-cni-bin\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.851563 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851120    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-node-log\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.851563 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851164    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-host-var-lib-cni-bin\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.851563 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851196    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-etc-sysctl-d\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.851563 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851221    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee70731d-0545-406f-bc04-c0589d986e18-serviceca\") pod \"node-ca-vrgkq\" (UID: \"ee70731d-0545-406f-bc04-c0589d986e18\") " pod="openshift-image-registry/node-ca-vrgkq"
Sep 10 19:54:17.851563 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851238    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-multus-socket-dir-parent\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.851563 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851252    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-host-run-multus-certs\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.852347 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851272    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/67db218b-f273-4db9-a124-af7c77107860-ovnkube-config\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.852347 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851294    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-etc-kubernetes\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.852347 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851316    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-host-run-multus-certs\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.852347 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851322    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfh5r\" (UniqueName: \"kubernetes.io/projected/ee70731d-0545-406f-bc04-c0589d986e18-kube-api-access-kfh5r\") pod \"node-ca-vrgkq\" (UID: \"ee70731d-0545-406f-bc04-c0589d986e18\") " pod="openshift-image-registry/node-ca-vrgkq"
Sep 10 19:54:17.852347 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851334    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-multus-socket-dir-parent\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.852347 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851353    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b9a8844-d413-41e5-af75-6d5c962a43ba-host-slash\") pod \"iptables-alerter-89svr\" (UID: \"7b9a8844-d413-41e5-af75-6d5c962a43ba\") " pod="openshift-network-operator/iptables-alerter-89svr"
Sep 10 19:54:17.852347 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851352    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bf92bb85-73f0-46a4-b32e-b83f8d56ac82-konnectivity-ca\") pod \"konnectivity-agent-shxth\" (UID: \"bf92bb85-73f0-46a4-b32e-b83f8d56ac82\") " pod="kube-system/konnectivity-agent-shxth"
Sep 10 19:54:17.852347 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851404    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-multus-conf-dir\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.852347 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851409    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b9a8844-d413-41e5-af75-6d5c962a43ba-host-slash\") pod \"iptables-alerter-89svr\" (UID: \"7b9a8844-d413-41e5-af75-6d5c962a43ba\") " pod="openshift-network-operator/iptables-alerter-89svr"
Sep 10 19:54:17.852347 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851434    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bf92bb85-73f0-46a4-b32e-b83f8d56ac82-agent-certs\") pod \"konnectivity-agent-shxth\" (UID: \"bf92bb85-73f0-46a4-b32e-b83f8d56ac82\") " pod="kube-system/konnectivity-agent-shxth"
Sep 10 19:54:17.852347 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851469    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/67db218b-f273-4db9-a124-af7c77107860-ovnkube-script-lib\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.852347 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851480    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b2be38a9-429c-4a4d-aea8-fe09152b4a48-multus-daemon-config\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.852347 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851498    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-etc-modprobe-d\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.852347 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851504    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-multus-conf-dir\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.852347 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851521    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-run\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.852347 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851548    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs\") pod \"network-metrics-daemon-mxnhw\" (UID: \"26ab4b64-59b6-42cb-b55d-ce41cecd0e85\") " pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:17.852347 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851570    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-run-systemd\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.853037 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851594    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-lib-modules\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.853037 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851619    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef619541-b449-44f8-a3c7-228a92fc6904-cnibin\") pod \"multus-additional-cni-plugins-d2skk\" (UID: \"ef619541-b449-44f8-a3c7-228a92fc6904\") " pod="openshift-multus/multus-additional-cni-plugins-d2skk"
Sep 10 19:54:17.853037 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:17.851637    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:54:17.853037 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851642    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh2kc\" (UniqueName: \"kubernetes.io/projected/ef619541-b449-44f8-a3c7-228a92fc6904-kube-api-access-nh2kc\") pod \"multus-additional-cni-plugins-d2skk\" (UID: \"ef619541-b449-44f8-a3c7-228a92fc6904\") " pod="openshift-multus/multus-additional-cni-plugins-d2skk"
Sep 10 19:54:17.853037 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851669    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b9a8844-d413-41e5-af75-6d5c962a43ba-iptables-alerter-script\") pod \"iptables-alerter-89svr\" (UID: \"7b9a8844-d413-41e5-af75-6d5c962a43ba\") " pod="openshift-network-operator/iptables-alerter-89svr"
Sep 10 19:54:17.853037 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:17.851690    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs podName:26ab4b64-59b6-42cb-b55d-ce41cecd0e85 nodeName:}" failed. No retries permitted until 2026-09-10 19:54:18.351675278 +0000 UTC m=+2.016779502 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs") pod "network-metrics-daemon-mxnhw" (UID: "26ab4b64-59b6-42cb-b55d-ce41cecd0e85") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:54:17.853037 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851706    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee70731d-0545-406f-bc04-c0589d986e18-serviceca\") pod \"node-ca-vrgkq\" (UID: \"ee70731d-0545-406f-bc04-c0589d986e18\") " pod="openshift-image-registry/node-ca-vrgkq"
Sep 10 19:54:17.853037 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851710    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4b902c8-2410-4e7d-b415-41e848652a43-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wlt9r\" (UID: \"e4b902c8-2410-4e7d-b415-41e848652a43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r"
Sep 10 19:54:17.853037 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851731    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blxj7\" (UniqueName: \"kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7\") pod \"network-check-target-9j5tj\" (UID: \"b27c6a7e-d576-44de-9d2b-ac8b51b69bc7\") " pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:17.853037 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851745    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-host-var-lib-kubelet\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.853037 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851757    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef619541-b449-44f8-a3c7-228a92fc6904-cnibin\") pod \"multus-additional-cni-plugins-d2skk\" (UID: \"ef619541-b449-44f8-a3c7-228a92fc6904\") " pod="openshift-multus/multus-additional-cni-plugins-d2skk"
Sep 10 19:54:17.853037 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851761    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-host-cni-bin\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.853037 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851802    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-etc-systemd\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.853037 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851824    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-host-run-k8s-cni-cncf-io\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.853037 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851857    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.853037 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851885    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-tmp\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.853526 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851923    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4b902c8-2410-4e7d-b415-41e848652a43-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wlt9r\" (UID: \"e4b902c8-2410-4e7d-b415-41e848652a43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r"
Sep 10 19:54:17.853526 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851950    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b1686c34-4f9d-424e-9b3b-9daf34983519-hosts-file\") pod \"node-resolver-lqn7b\" (UID: \"b1686c34-4f9d-424e-9b3b-9daf34983519\") " pod="openshift-dns/node-resolver-lqn7b"
Sep 10 19:54:17.853526 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851956    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-host-var-lib-kubelet\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.853526 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851963    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 19:54:17.853526 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851998    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-host-run-k8s-cni-cncf-io\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.853526 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.851967    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q5tl\" (UniqueName: \"kubernetes.io/projected/b1686c34-4f9d-424e-9b3b-9daf34983519-kube-api-access-5q5tl\") pod \"node-resolver-lqn7b\" (UID: \"b1686c34-4f9d-424e-9b3b-9daf34983519\") " pod="openshift-dns/node-resolver-lqn7b"
Sep 10 19:54:17.853526 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852025    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npnmq\" (UniqueName: \"kubernetes.io/projected/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-kube-api-access-npnmq\") pod \"network-metrics-daemon-mxnhw\" (UID: \"26ab4b64-59b6-42cb-b55d-ce41cecd0e85\") " pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:17.853526 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852045    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2be38a9-429c-4a4d-aea8-fe09152b4a48-cni-binary-copy\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.853526 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852061    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-etc-openvswitch\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.853526 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852078    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef619541-b449-44f8-a3c7-228a92fc6904-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d2skk\" (UID: \"ef619541-b449-44f8-a3c7-228a92fc6904\") " pod="openshift-multus/multus-additional-cni-plugins-d2skk"
Sep 10 19:54:17.853526 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852094    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4b902c8-2410-4e7d-b415-41e848652a43-etc-selinux\") pod \"aws-ebs-csi-driver-node-wlt9r\" (UID: \"e4b902c8-2410-4e7d-b415-41e848652a43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r"
Sep 10 19:54:17.853526 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852117    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-cnibin\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.853526 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852140    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/91e2acc4-0716-4fcb-95ee-32d1668449e7-dbus\") pod \"global-pull-secret-syncer-klxsb\" (UID: \"91e2acc4-0716-4fcb-95ee-32d1668449e7\") " pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:17.853526 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852161    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-etc-sysctl-conf\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.853526 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852169    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b9a8844-d413-41e5-af75-6d5c962a43ba-iptables-alerter-script\") pod \"iptables-alerter-89svr\" (UID: \"7b9a8844-d413-41e5-af75-6d5c962a43ba\") " pod="openshift-network-operator/iptables-alerter-89svr"
Sep 10 19:54:17.853526 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852179    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-sys\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.853526 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852192    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-cnibin\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.854007 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852201    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-host\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.854007 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852221    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4b902c8-2410-4e7d-b415-41e848652a43-etc-selinux\") pod \"aws-ebs-csi-driver-node-wlt9r\" (UID: \"e4b902c8-2410-4e7d-b415-41e848652a43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r"
Sep 10 19:54:17.854007 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852239    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g92k\" (UniqueName: \"kubernetes.io/projected/e4b902c8-2410-4e7d-b415-41e848652a43-kube-api-access-6g92k\") pod \"aws-ebs-csi-driver-node-wlt9r\" (UID: \"e4b902c8-2410-4e7d-b415-41e848652a43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r"
Sep 10 19:54:17.854007 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852266    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-etc-kubernetes\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.854007 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852293    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-run-openvswitch\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.854007 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852322    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2be38a9-429c-4a4d-aea8-fe09152b4a48-etc-kubernetes\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.854007 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852323    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef619541-b449-44f8-a3c7-228a92fc6904-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d2skk\" (UID: \"ef619541-b449-44f8-a3c7-228a92fc6904\") " pod="openshift-multus/multus-additional-cni-plugins-d2skk"
Sep 10 19:54:17.854007 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852349    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret\") pod \"global-pull-secret-syncer-klxsb\" (UID: \"91e2acc4-0716-4fcb-95ee-32d1668449e7\") " pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:17.854007 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852406    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-var-lib-openvswitch\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.854007 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852436    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-host-run-ovn-kubernetes\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.854007 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852601    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef619541-b449-44f8-a3c7-228a92fc6904-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d2skk\" (UID: \"ef619541-b449-44f8-a3c7-228a92fc6904\") " pod="openshift-multus/multus-additional-cni-plugins-d2skk"
Sep 10 19:54:17.854007 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852679    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2be38a9-429c-4a4d-aea8-fe09152b4a48-cni-binary-copy\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.854007 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.852814    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef619541-b449-44f8-a3c7-228a92fc6904-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d2skk\" (UID: \"ef619541-b449-44f8-a3c7-228a92fc6904\") " pod="openshift-multus/multus-additional-cni-plugins-d2skk"
Sep 10 19:54:17.855406 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.855374    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bf92bb85-73f0-46a4-b32e-b83f8d56ac82-agent-certs\") pod \"konnectivity-agent-shxth\" (UID: \"bf92bb85-73f0-46a4-b32e-b83f8d56ac82\") " pod="kube-system/konnectivity-agent-shxth"
Sep 10 19:54:17.859255 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:17.859221    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 19:54:17.859255 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:17.859243    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 19:54:17.859255 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:17.859256    2561 projected.go:196] Error preparing data for projected volume kube-api-access-blxj7 for pod openshift-network-diagnostics/network-check-target-9j5tj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:54:17.859494 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:17.859311    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7 podName:b27c6a7e-d576-44de-9d2b-ac8b51b69bc7 nodeName:}" failed. No retries permitted until 2026-09-10 19:54:18.359295336 +0000 UTC m=+2.024399564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-blxj7" (UniqueName: "kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7") pod "network-check-target-9j5tj" (UID: "b27c6a7e-d576-44de-9d2b-ac8b51b69bc7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:54:17.859688 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.859665    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfh5r\" (UniqueName: \"kubernetes.io/projected/ee70731d-0545-406f-bc04-c0589d986e18-kube-api-access-kfh5r\") pod \"node-ca-vrgkq\" (UID: \"ee70731d-0545-406f-bc04-c0589d986e18\") " pod="openshift-image-registry/node-ca-vrgkq"
Sep 10 19:54:17.860042 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.860022    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwv22\" (UniqueName: \"kubernetes.io/projected/b2be38a9-429c-4a4d-aea8-fe09152b4a48-kube-api-access-xwv22\") pod \"multus-krr84\" (UID: \"b2be38a9-429c-4a4d-aea8-fe09152b4a48\") " pod="openshift-multus/multus-krr84"
Sep 10 19:54:17.860711 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.860694    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qvmd\" (UniqueName: \"kubernetes.io/projected/7b9a8844-d413-41e5-af75-6d5c962a43ba-kube-api-access-2qvmd\") pod \"iptables-alerter-89svr\" (UID: \"7b9a8844-d413-41e5-af75-6d5c962a43ba\") " pod="openshift-network-operator/iptables-alerter-89svr"
Sep 10 19:54:17.861291 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.861275    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g92k\" (UniqueName: \"kubernetes.io/projected/e4b902c8-2410-4e7d-b415-41e848652a43-kube-api-access-6g92k\") pod \"aws-ebs-csi-driver-node-wlt9r\" (UID: \"e4b902c8-2410-4e7d-b415-41e848652a43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r"
Sep 10 19:54:17.863095 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.863071    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npnmq\" (UniqueName: \"kubernetes.io/projected/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-kube-api-access-npnmq\") pod \"network-metrics-daemon-mxnhw\" (UID: \"26ab4b64-59b6-42cb-b55d-ce41cecd0e85\") " pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:17.863168 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.863143    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh2kc\" (UniqueName: \"kubernetes.io/projected/ef619541-b449-44f8-a3c7-228a92fc6904-kube-api-access-nh2kc\") pod \"multus-additional-cni-plugins-d2skk\" (UID: \"ef619541-b449-44f8-a3c7-228a92fc6904\") " pod="openshift-multus/multus-additional-cni-plugins-d2skk"
Sep 10 19:54:17.952669 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.952642    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-systemd-units\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.952669 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.952670    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-log-socket\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.952836 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.952686    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpf78\" (UniqueName: \"kubernetes.io/projected/67db218b-f273-4db9-a124-af7c77107860-kube-api-access-wpf78\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.952836 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.952702    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1686c34-4f9d-424e-9b3b-9daf34983519-tmp-dir\") pod \"node-resolver-lqn7b\" (UID: \"b1686c34-4f9d-424e-9b3b-9daf34983519\") " pod="openshift-dns/node-resolver-lqn7b"
Sep 10 19:54:17.952836 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.952739    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-node-log\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.952836 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.952769    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-log-socket\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.952836 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.952773    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-etc-sysctl-d\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.952836 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.952746    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-systemd-units\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.953095 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.952822    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/67db218b-f273-4db9-a124-af7c77107860-ovnkube-config\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.953095 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.952851    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-node-log\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.953095 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.952876    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-etc-sysctl-d\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.953095 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.952899    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-etc-kubernetes\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.953095 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.952928    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/67db218b-f273-4db9-a124-af7c77107860-ovnkube-script-lib\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.953095 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.952944    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-etc-modprobe-d\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.953095 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.952970    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-run\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.953095 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.952986    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1686c34-4f9d-424e-9b3b-9daf34983519-tmp-dir\") pod \"node-resolver-lqn7b\" (UID: \"b1686c34-4f9d-424e-9b3b-9daf34983519\") " pod="openshift-dns/node-resolver-lqn7b"
Sep 10 19:54:17.953095 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953000    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-etc-kubernetes\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.953095 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953003    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-run-systemd\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.953095 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953037    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-run-systemd\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.953095 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953036    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-lib-modules\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.953095 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953057    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-run\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.953095 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953057    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-etc-modprobe-d\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.953095 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953089    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-host-cni-bin\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.953762 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953112    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-etc-systemd\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.953762 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953140    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.953762 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953157    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-lib-modules\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.953762 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953165    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-tmp\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.953762 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953170    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-host-cni-bin\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.953762 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953171    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-etc-systemd\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.953762 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953187    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b1686c34-4f9d-424e-9b3b-9daf34983519-hosts-file\") pod \"node-resolver-lqn7b\" (UID: \"b1686c34-4f9d-424e-9b3b-9daf34983519\") " pod="openshift-dns/node-resolver-lqn7b"
Sep 10 19:54:17.953762 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953208    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.953762 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953211    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q5tl\" (UniqueName: \"kubernetes.io/projected/b1686c34-4f9d-424e-9b3b-9daf34983519-kube-api-access-5q5tl\") pod \"node-resolver-lqn7b\" (UID: \"b1686c34-4f9d-424e-9b3b-9daf34983519\") " pod="openshift-dns/node-resolver-lqn7b"
Sep 10 19:54:17.953762 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953257    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-etc-openvswitch\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.953762 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953268    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b1686c34-4f9d-424e-9b3b-9daf34983519-hosts-file\") pod \"node-resolver-lqn7b\" (UID: \"b1686c34-4f9d-424e-9b3b-9daf34983519\") " pod="openshift-dns/node-resolver-lqn7b"
Sep 10 19:54:17.953762 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953282    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/67db218b-f273-4db9-a124-af7c77107860-ovnkube-config\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.953762 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953286    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/91e2acc4-0716-4fcb-95ee-32d1668449e7-dbus\") pod \"global-pull-secret-syncer-klxsb\" (UID: \"91e2acc4-0716-4fcb-95ee-32d1668449e7\") " pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:17.953762 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953309    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-etc-sysctl-conf\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.953762 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953331    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-sys\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.953762 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953317    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-etc-openvswitch\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.953762 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953357    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-host\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.953762 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953383    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-run-openvswitch\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.954453 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953410    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/91e2acc4-0716-4fcb-95ee-32d1668449e7-dbus\") pod \"global-pull-secret-syncer-klxsb\" (UID: \"91e2acc4-0716-4fcb-95ee-32d1668449e7\") " pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:17.954453 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953427    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret\") pod \"global-pull-secret-syncer-klxsb\" (UID: \"91e2acc4-0716-4fcb-95ee-32d1668449e7\") " pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:17.954453 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953440    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-sys\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.954453 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953451    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-var-lib-openvswitch\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.954453 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953443    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-host\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.954453 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953460    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-run-openvswitch\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.954453 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953466    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-etc-sysctl-conf\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.954453 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953474    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-host-run-ovn-kubernetes\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.954453 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953504    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-var-lib-openvswitch\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.954453 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:17.953511    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 19:54:17.954453 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953514    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-host-run-ovn-kubernetes\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.954453 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953522    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-host-kubelet\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.954453 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953541    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-host-slash\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.954453 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953567    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-host-kubelet\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.954453 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953568    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-host-run-netns\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.954453 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:17.953586    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret podName:91e2acc4-0716-4fcb-95ee-32d1668449e7 nodeName:}" failed. No retries permitted until 2026-09-10 19:54:18.453570589 +0000 UTC m=+2.118674820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret") pod "global-pull-secret-syncer-klxsb" (UID: "91e2acc4-0716-4fcb-95ee-32d1668449e7") : object "kube-system"/"original-pull-secret" not registered
Sep 10 19:54:17.954453 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953596    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-host-run-netns\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.954994 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953615    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-run-ovn\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.954994 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953641    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-host-cni-netd\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.954994 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953648    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-run-ovn\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.954994 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953617    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-host-slash\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.954994 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953665    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/67db218b-f273-4db9-a124-af7c77107860-env-overrides\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.954994 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953688    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/67db218b-f273-4db9-a124-af7c77107860-host-cni-netd\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.954994 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953709    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/67db218b-f273-4db9-a124-af7c77107860-ovn-node-metrics-cert\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.954994 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953750    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-etc-sysconfig\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.954994 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953785    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-var-lib-kubelet\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.954994 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-etc-tuned\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.954994 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953818    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-etc-sysconfig\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.954994 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953834    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r86s\" (UniqueName: \"kubernetes.io/projected/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-kube-api-access-4r86s\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.954994 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953858    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-var-lib-kubelet\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.954994 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953868    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/91e2acc4-0716-4fcb-95ee-32d1668449e7-kubelet-config\") pod \"global-pull-secret-syncer-klxsb\" (UID: \"91e2acc4-0716-4fcb-95ee-32d1668449e7\") " pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:17.954994 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.953942    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/91e2acc4-0716-4fcb-95ee-32d1668449e7-kubelet-config\") pod \"global-pull-secret-syncer-klxsb\" (UID: \"91e2acc4-0716-4fcb-95ee-32d1668449e7\") " pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:17.954994 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.954056    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/67db218b-f273-4db9-a124-af7c77107860-env-overrides\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.954994 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.954114    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/67db218b-f273-4db9-a124-af7c77107860-ovnkube-script-lib\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.955498 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.955166    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-tmp\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.955660 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.955644    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-etc-tuned\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:17.955698 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.955682    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/67db218b-f273-4db9-a124-af7c77107860-ovn-node-metrics-cert\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.963116 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.963097    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpf78\" (UniqueName: \"kubernetes.io/projected/67db218b-f273-4db9-a124-af7c77107860-kube-api-access-wpf78\") pod \"ovnkube-node-76gvf\" (UID: \"67db218b-f273-4db9-a124-af7c77107860\") " pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:17.966022 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.966005    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q5tl\" (UniqueName: \"kubernetes.io/projected/b1686c34-4f9d-424e-9b3b-9daf34983519-kube-api-access-5q5tl\") pod \"node-resolver-lqn7b\" (UID: \"b1686c34-4f9d-424e-9b3b-9daf34983519\") " pod="openshift-dns/node-resolver-lqn7b"
Sep 10 19:54:17.966094 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:17.966036    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r86s\" (UniqueName: \"kubernetes.io/projected/6ee133f1-b49a-4448-83ef-fbd09a4b0a0a-kube-api-access-4r86s\") pod \"tuned-trbgx\" (UID: \"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a\") " pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:18.050999 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.050944    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vrgkq"
Sep 10 19:54:18.059464 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:18.059442    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee70731d_0545_406f_bc04_c0589d986e18.slice/crio-7e0fc2d206fb26132bab74105d84ecc90fc6d922eae5f34caeb659e3db512528 WatchSource:0}: Error finding container 7e0fc2d206fb26132bab74105d84ecc90fc6d922eae5f34caeb659e3db512528: Status 404 returned error can't find the container with id 7e0fc2d206fb26132bab74105d84ecc90fc6d922eae5f34caeb659e3db512528
Sep 10 19:54:18.074059 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.074041    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d2skk"
Sep 10 19:54:18.080973 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:18.080952    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef619541_b449_44f8_a3c7_228a92fc6904.slice/crio-e6af920db77b8a75e36c206cf9a24be2a07e24269b2bd418326bc6291b97d607 WatchSource:0}: Error finding container e6af920db77b8a75e36c206cf9a24be2a07e24269b2bd418326bc6291b97d607: Status 404 returned error can't find the container with id e6af920db77b8a75e36c206cf9a24be2a07e24269b2bd418326bc6291b97d607
Sep 10 19:54:18.093950 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.093931    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-89svr"
Sep 10 19:54:18.101804 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:18.100911    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b9a8844_d413_41e5_af75_6d5c962a43ba.slice/crio-2adc71f42e315a5829671077dfc7d7c9b5d770953237db6a86b696049e75492e WatchSource:0}: Error finding container 2adc71f42e315a5829671077dfc7d7c9b5d770953237db6a86b696049e75492e: Status 404 returned error can't find the container with id 2adc71f42e315a5829671077dfc7d7c9b5d770953237db6a86b696049e75492e
Sep 10 19:54:18.108593 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.108574    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r"
Sep 10 19:54:18.115368 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:18.115352    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b902c8_2410_4e7d_b415_41e848652a43.slice/crio-a28ef99e6f35e4a218851a4ddec14ea0431873c88a0de4bbea8e0738c81cb2e2 WatchSource:0}: Error finding container a28ef99e6f35e4a218851a4ddec14ea0431873c88a0de4bbea8e0738c81cb2e2: Status 404 returned error can't find the container with id a28ef99e6f35e4a218851a4ddec14ea0431873c88a0de4bbea8e0738c81cb2e2
Sep 10 19:54:18.119555 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.119538    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-krr84"
Sep 10 19:54:18.125479 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.125461    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-shxth"
Sep 10 19:54:18.125636 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:18.125620    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2be38a9_429c_4a4d_aea8_fe09152b4a48.slice/crio-76770a870d9b250b39680f9c82f90aa0bfa4b6bb3f7c13678f046cb64d938816 WatchSource:0}: Error finding container 76770a870d9b250b39680f9c82f90aa0bfa4b6bb3f7c13678f046cb64d938816: Status 404 returned error can't find the container with id 76770a870d9b250b39680f9c82f90aa0bfa4b6bb3f7c13678f046cb64d938816
Sep 10 19:54:18.130699 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.130675    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-trbgx"
Sep 10 19:54:18.136086 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.136072    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lqn7b"
Sep 10 19:54:18.137238 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:18.137221    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee133f1_b49a_4448_83ef_fbd09a4b0a0a.slice/crio-349a51a0c6cba0ed0f50f6b59d392bb53d477849a391a05adf3eed0031c20847 WatchSource:0}: Error finding container 349a51a0c6cba0ed0f50f6b59d392bb53d477849a391a05adf3eed0031c20847: Status 404 returned error can't find the container with id 349a51a0c6cba0ed0f50f6b59d392bb53d477849a391a05adf3eed0031c20847
Sep 10 19:54:18.139838 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.139825    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:18.144894 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:18.144874    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1686c34_4f9d_424e_9b3b_9daf34983519.slice/crio-758f7810b8d7bbaac2e54db563f886fb95c0f67ce25a6231e577b7b6e1fe3dcf WatchSource:0}: Error finding container 758f7810b8d7bbaac2e54db563f886fb95c0f67ce25a6231e577b7b6e1fe3dcf: Status 404 returned error can't find the container with id 758f7810b8d7bbaac2e54db563f886fb95c0f67ce25a6231e577b7b6e1fe3dcf
Sep 10 19:54:18.147431 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:18.147415    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67db218b_f273_4db9_a124_af7c77107860.slice/crio-2d8880f63b9daf3608e2f19e4c0259f138e5786cf52f9183830041a08b519470 WatchSource:0}: Error finding container 2d8880f63b9daf3608e2f19e4c0259f138e5786cf52f9183830041a08b519470: Status 404 returned error can't find the container with id 2d8880f63b9daf3608e2f19e4c0259f138e5786cf52f9183830041a08b519470
Sep 10 19:54:18.298875 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.298848    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 19:54:18.357377 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.357342    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs\") pod \"network-metrics-daemon-mxnhw\" (UID: \"26ab4b64-59b6-42cb-b55d-ce41cecd0e85\") " pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:18.357556 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:18.357491    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:54:18.357621 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:18.357565    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs podName:26ab4b64-59b6-42cb-b55d-ce41cecd0e85 nodeName:}" failed. No retries permitted until 2026-09-10 19:54:19.357545945 +0000 UTC m=+3.022650169 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs") pod "network-metrics-daemon-mxnhw" (UID: "26ab4b64-59b6-42cb-b55d-ce41cecd0e85") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:54:18.458500 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.458429    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blxj7\" (UniqueName: \"kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7\") pod \"network-check-target-9j5tj\" (UID: \"b27c6a7e-d576-44de-9d2b-ac8b51b69bc7\") " pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:18.458500 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.458495    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret\") pod \"global-pull-secret-syncer-klxsb\" (UID: \"91e2acc4-0716-4fcb-95ee-32d1668449e7\") " pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:18.458717 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:18.458627    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 19:54:18.458717 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:18.458680    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 19:54:18.458717 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:18.458701    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 19:54:18.458717 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:18.458703    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret podName:91e2acc4-0716-4fcb-95ee-32d1668449e7 nodeName:}" failed. No retries permitted until 2026-09-10 19:54:19.458684257 +0000 UTC m=+3.123788502 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret") pod "global-pull-secret-syncer-klxsb" (UID: "91e2acc4-0716-4fcb-95ee-32d1668449e7") : object "kube-system"/"original-pull-secret" not registered
Sep 10 19:54:18.458717 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:18.458714    2561 projected.go:196] Error preparing data for projected volume kube-api-access-blxj7 for pod openshift-network-diagnostics/network-check-target-9j5tj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:54:18.458912 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:18.458766    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7 podName:b27c6a7e-d576-44de-9d2b-ac8b51b69bc7 nodeName:}" failed. No retries permitted until 2026-09-10 19:54:19.458750546 +0000 UTC m=+3.123854787 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-blxj7" (UniqueName: "kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7") pod "network-check-target-9j5tj" (UID: "b27c6a7e-d576-44de-9d2b-ac8b51b69bc7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:54:18.537406 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.537367    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 19:54:18.779065 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.778904    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 19:49:17 +0000 UTC" deadline="2028-05-16 11:23:54.020944339 +0000 UTC"
Sep 10 19:54:18.779065 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.778961    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14727h29m35.241988452s"
Sep 10 19:54:18.864731 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.864697    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r" event={"ID":"e4b902c8-2410-4e7d-b415-41e848652a43","Type":"ContainerStarted","Data":"a28ef99e6f35e4a218851a4ddec14ea0431873c88a0de4bbea8e0738c81cb2e2"}
Sep 10 19:54:18.881967 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.881932    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-89svr" event={"ID":"7b9a8844-d413-41e5-af75-6d5c962a43ba","Type":"ContainerStarted","Data":"2adc71f42e315a5829671077dfc7d7c9b5d770953237db6a86b696049e75492e"}
Sep 10 19:54:18.888516 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.888485    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2skk" event={"ID":"ef619541-b449-44f8-a3c7-228a92fc6904","Type":"ContainerStarted","Data":"e6af920db77b8a75e36c206cf9a24be2a07e24269b2bd418326bc6291b97d607"}
Sep 10 19:54:18.900827 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.900783    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vrgkq" event={"ID":"ee70731d-0545-406f-bc04-c0589d986e18","Type":"ContainerStarted","Data":"7e0fc2d206fb26132bab74105d84ecc90fc6d922eae5f34caeb659e3db512528"}
Sep 10 19:54:18.920189 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.920158    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-krr84" event={"ID":"b2be38a9-429c-4a4d-aea8-fe09152b4a48","Type":"ContainerStarted","Data":"76770a870d9b250b39680f9c82f90aa0bfa4b6bb3f7c13678f046cb64d938816"}
Sep 10 19:54:18.935495 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.935466    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76gvf" event={"ID":"67db218b-f273-4db9-a124-af7c77107860","Type":"ContainerStarted","Data":"2d8880f63b9daf3608e2f19e4c0259f138e5786cf52f9183830041a08b519470"}
Sep 10 19:54:18.960164 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.960132    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lqn7b" event={"ID":"b1686c34-4f9d-424e-9b3b-9daf34983519","Type":"ContainerStarted","Data":"758f7810b8d7bbaac2e54db563f886fb95c0f67ce25a6231e577b7b6e1fe3dcf"}
Sep 10 19:54:18.969407 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.969369    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-trbgx" event={"ID":"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a","Type":"ContainerStarted","Data":"349a51a0c6cba0ed0f50f6b59d392bb53d477849a391a05adf3eed0031c20847"}
Sep 10 19:54:18.992580 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:18.991669    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-shxth" event={"ID":"bf92bb85-73f0-46a4-b32e-b83f8d56ac82","Type":"ContainerStarted","Data":"f07ac1a451d1b35b53bb0e22b11087da732872f669fd356e2ff512fa21bb8866"}
Sep 10 19:54:19.151767 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:19.151732    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 19:54:19.368015 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:19.367957    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs\") pod \"network-metrics-daemon-mxnhw\" (UID: \"26ab4b64-59b6-42cb-b55d-ce41cecd0e85\") " pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:19.368179 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:19.368111    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:54:19.368179 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:19.368177    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs podName:26ab4b64-59b6-42cb-b55d-ce41cecd0e85 nodeName:}" failed. No retries permitted until 2026-09-10 19:54:21.368156586 +0000 UTC m=+5.033260812 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs") pod "network-metrics-daemon-mxnhw" (UID: "26ab4b64-59b6-42cb-b55d-ce41cecd0e85") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:54:19.469608 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:19.469141    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blxj7\" (UniqueName: \"kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7\") pod \"network-check-target-9j5tj\" (UID: \"b27c6a7e-d576-44de-9d2b-ac8b51b69bc7\") " pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:19.469608 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:19.469201    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret\") pod \"global-pull-secret-syncer-klxsb\" (UID: \"91e2acc4-0716-4fcb-95ee-32d1668449e7\") " pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:19.469608 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:19.469337    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 19:54:19.469608 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:19.469419    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret podName:91e2acc4-0716-4fcb-95ee-32d1668449e7 nodeName:}" failed. No retries permitted until 2026-09-10 19:54:21.469386823 +0000 UTC m=+5.134491062 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret") pod "global-pull-secret-syncer-klxsb" (UID: "91e2acc4-0716-4fcb-95ee-32d1668449e7") : object "kube-system"/"original-pull-secret" not registered
Sep 10 19:54:19.469924 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:19.469817    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 19:54:19.469924 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:19.469836    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 19:54:19.469924 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:19.469848    2561 projected.go:196] Error preparing data for projected volume kube-api-access-blxj7 for pod openshift-network-diagnostics/network-check-target-9j5tj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:54:19.469924 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:19.469891    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7 podName:b27c6a7e-d576-44de-9d2b-ac8b51b69bc7 nodeName:}" failed. No retries permitted until 2026-09-10 19:54:21.469876922 +0000 UTC m=+5.134981160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-blxj7" (UniqueName: "kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7") pod "network-check-target-9j5tj" (UID: "b27c6a7e-d576-44de-9d2b-ac8b51b69bc7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:54:19.780227 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:19.780107    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 19:49:17 +0000 UTC" deadline="2028-02-04 09:54:59.958071007 +0000 UTC"
Sep 10 19:54:19.780227 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:19.780182    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12278h0m40.177894159s"
Sep 10 19:54:19.843701 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:19.843670    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:19.843882 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:19.843813    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxnhw" podUID="26ab4b64-59b6-42cb-b55d-ce41cecd0e85"
Sep 10 19:54:19.844245 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:19.844221    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:19.844333 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:19.844315    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9j5tj" podUID="b27c6a7e-d576-44de-9d2b-ac8b51b69bc7"
Sep 10 19:54:19.844595 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:19.844383    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:19.844595 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:19.844561    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klxsb" podUID="91e2acc4-0716-4fcb-95ee-32d1668449e7"
Sep 10 19:54:20.255167 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:20.254934    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 19:54:21.383287 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:21.383248    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs\") pod \"network-metrics-daemon-mxnhw\" (UID: \"26ab4b64-59b6-42cb-b55d-ce41cecd0e85\") " pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:21.383775 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:21.383474    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:54:21.383775 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:21.383563    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs podName:26ab4b64-59b6-42cb-b55d-ce41cecd0e85 nodeName:}" failed. No retries permitted until 2026-09-10 19:54:25.383542055 +0000 UTC m=+9.048646283 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs") pod "network-metrics-daemon-mxnhw" (UID: "26ab4b64-59b6-42cb-b55d-ce41cecd0e85") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:54:21.484663 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:21.484629    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blxj7\" (UniqueName: \"kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7\") pod \"network-check-target-9j5tj\" (UID: \"b27c6a7e-d576-44de-9d2b-ac8b51b69bc7\") " pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:21.484839 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:21.484699    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret\") pod \"global-pull-secret-syncer-klxsb\" (UID: \"91e2acc4-0716-4fcb-95ee-32d1668449e7\") " pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:21.484900 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:21.484860    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 19:54:21.484955 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:21.484917    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret podName:91e2acc4-0716-4fcb-95ee-32d1668449e7 nodeName:}" failed. No retries permitted until 2026-09-10 19:54:25.484900897 +0000 UTC m=+9.150005126 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret") pod "global-pull-secret-syncer-klxsb" (UID: "91e2acc4-0716-4fcb-95ee-32d1668449e7") : object "kube-system"/"original-pull-secret" not registered
Sep 10 19:54:21.485380 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:21.485358    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 19:54:21.485509 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:21.485384    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 19:54:21.485509 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:21.485411    2561 projected.go:196] Error preparing data for projected volume kube-api-access-blxj7 for pod openshift-network-diagnostics/network-check-target-9j5tj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:54:21.485509 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:21.485462    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7 podName:b27c6a7e-d576-44de-9d2b-ac8b51b69bc7 nodeName:}" failed. No retries permitted until 2026-09-10 19:54:25.485445205 +0000 UTC m=+9.150549445 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-blxj7" (UniqueName: "kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7") pod "network-check-target-9j5tj" (UID: "b27c6a7e-d576-44de-9d2b-ac8b51b69bc7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:54:21.844597 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:21.844566    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:21.844752 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:21.844693    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9j5tj" podUID="b27c6a7e-d576-44de-9d2b-ac8b51b69bc7"
Sep 10 19:54:21.845125 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:21.845053    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:21.845237 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:21.845065    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:21.845237 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:21.845178    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxnhw" podUID="26ab4b64-59b6-42cb-b55d-ce41cecd0e85"
Sep 10 19:54:21.845325 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:21.845247    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klxsb" podUID="91e2acc4-0716-4fcb-95ee-32d1668449e7"
Sep 10 19:54:23.844169 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:23.844130    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:23.845061 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:23.844959    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxnhw" podUID="26ab4b64-59b6-42cb-b55d-ce41cecd0e85"
Sep 10 19:54:23.845061 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:23.845038    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:23.845313 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:23.845266    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9j5tj" podUID="b27c6a7e-d576-44de-9d2b-ac8b51b69bc7"
Sep 10 19:54:23.845442 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:23.845293    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:23.847782 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:23.845624    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klxsb" podUID="91e2acc4-0716-4fcb-95ee-32d1668449e7"
Sep 10 19:54:25.415726 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:25.415687    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs\") pod \"network-metrics-daemon-mxnhw\" (UID: \"26ab4b64-59b6-42cb-b55d-ce41cecd0e85\") " pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:25.416143 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:25.415850    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:54:25.416143 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:25.415932    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs podName:26ab4b64-59b6-42cb-b55d-ce41cecd0e85 nodeName:}" failed. No retries permitted until 2026-09-10 19:54:33.415910849 +0000 UTC m=+17.081015080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs") pod "network-metrics-daemon-mxnhw" (UID: "26ab4b64-59b6-42cb-b55d-ce41cecd0e85") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:54:25.517032 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:25.516986    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blxj7\" (UniqueName: \"kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7\") pod \"network-check-target-9j5tj\" (UID: \"b27c6a7e-d576-44de-9d2b-ac8b51b69bc7\") " pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:25.517216 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:25.517053    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret\") pod \"global-pull-secret-syncer-klxsb\" (UID: \"91e2acc4-0716-4fcb-95ee-32d1668449e7\") " pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:25.517216 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:25.517166    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 19:54:25.517216 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:25.517172    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 19:54:25.517216 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:25.517197    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 19:54:25.517216 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:25.517211    2561 projected.go:196] Error preparing data for projected volume kube-api-access-blxj7 for pod openshift-network-diagnostics/network-check-target-9j5tj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:54:25.517494 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:25.517235    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret podName:91e2acc4-0716-4fcb-95ee-32d1668449e7 nodeName:}" failed. No retries permitted until 2026-09-10 19:54:33.517216999 +0000 UTC m=+17.182321235 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret") pod "global-pull-secret-syncer-klxsb" (UID: "91e2acc4-0716-4fcb-95ee-32d1668449e7") : object "kube-system"/"original-pull-secret" not registered
Sep 10 19:54:25.517494 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:25.517262    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7 podName:b27c6a7e-d576-44de-9d2b-ac8b51b69bc7 nodeName:}" failed. No retries permitted until 2026-09-10 19:54:33.517245226 +0000 UTC m=+17.182349456 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-blxj7" (UniqueName: "kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7") pod "network-check-target-9j5tj" (UID: "b27c6a7e-d576-44de-9d2b-ac8b51b69bc7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:54:25.843687 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:25.843653    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:25.843687 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:25.843679    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:25.843909 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:25.843655    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:25.843909 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:25.843791    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxnhw" podUID="26ab4b64-59b6-42cb-b55d-ce41cecd0e85"
Sep 10 19:54:25.843909 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:25.843853    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klxsb" podUID="91e2acc4-0716-4fcb-95ee-32d1668449e7"
Sep 10 19:54:25.844048 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:25.843918    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9j5tj" podUID="b27c6a7e-d576-44de-9d2b-ac8b51b69bc7"
Sep 10 19:54:27.844119 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:27.844085    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:27.844119 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:27.844113    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:27.844670 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:27.844113    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:27.844670 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:27.844215    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxnhw" podUID="26ab4b64-59b6-42cb-b55d-ce41cecd0e85"
Sep 10 19:54:27.844670 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:27.844295    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9j5tj" podUID="b27c6a7e-d576-44de-9d2b-ac8b51b69bc7"
Sep 10 19:54:27.844670 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:27.844376    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klxsb" podUID="91e2acc4-0716-4fcb-95ee-32d1668449e7"
Sep 10 19:54:29.844410 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:29.844329    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:29.844410 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:29.844364    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:29.845050 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:29.844480    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxnhw" podUID="26ab4b64-59b6-42cb-b55d-ce41cecd0e85"
Sep 10 19:54:29.845050 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:29.844490    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:29.845050 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:29.844579    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9j5tj" podUID="b27c6a7e-d576-44de-9d2b-ac8b51b69bc7"
Sep 10 19:54:29.845050 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:29.844670    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klxsb" podUID="91e2acc4-0716-4fcb-95ee-32d1668449e7"
Sep 10 19:54:31.844253 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:31.844211    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:31.844720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:31.844223    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:31.844720 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:31.844323    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxnhw" podUID="26ab4b64-59b6-42cb-b55d-ce41cecd0e85"
Sep 10 19:54:31.844720 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:31.844224    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:31.844720 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:31.844438    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klxsb" podUID="91e2acc4-0716-4fcb-95ee-32d1668449e7"
Sep 10 19:54:31.844720 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:31.844494    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9j5tj" podUID="b27c6a7e-d576-44de-9d2b-ac8b51b69bc7"
Sep 10 19:54:33.472845 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:33.472808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs\") pod \"network-metrics-daemon-mxnhw\" (UID: \"26ab4b64-59b6-42cb-b55d-ce41cecd0e85\") " pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:33.473268 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:33.472966    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:54:33.473268 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:33.473047    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs podName:26ab4b64-59b6-42cb-b55d-ce41cecd0e85 nodeName:}" failed. No retries permitted until 2026-09-10 19:54:49.473024956 +0000 UTC m=+33.138129202 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs") pod "network-metrics-daemon-mxnhw" (UID: "26ab4b64-59b6-42cb-b55d-ce41cecd0e85") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:54:33.573742 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:33.573702    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blxj7\" (UniqueName: \"kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7\") pod \"network-check-target-9j5tj\" (UID: \"b27c6a7e-d576-44de-9d2b-ac8b51b69bc7\") " pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:33.573929 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:33.573764    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret\") pod \"global-pull-secret-syncer-klxsb\" (UID: \"91e2acc4-0716-4fcb-95ee-32d1668449e7\") " pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:33.573929 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:33.573871    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 19:54:33.573929 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:33.573891    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 19:54:33.573929 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:33.573918    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 19:54:33.573929 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:33.573934    2561 projected.go:196] Error preparing data for projected volume kube-api-access-blxj7 for pod openshift-network-diagnostics/network-check-target-9j5tj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:54:33.574166 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:33.573936    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret podName:91e2acc4-0716-4fcb-95ee-32d1668449e7 nodeName:}" failed. No retries permitted until 2026-09-10 19:54:49.573917416 +0000 UTC m=+33.239021642 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret") pod "global-pull-secret-syncer-klxsb" (UID: "91e2acc4-0716-4fcb-95ee-32d1668449e7") : object "kube-system"/"original-pull-secret" not registered
Sep 10 19:54:33.574166 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:33.573980    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7 podName:b27c6a7e-d576-44de-9d2b-ac8b51b69bc7 nodeName:}" failed. No retries permitted until 2026-09-10 19:54:49.573965976 +0000 UTC m=+33.239070214 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-blxj7" (UniqueName: "kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7") pod "network-check-target-9j5tj" (UID: "b27c6a7e-d576-44de-9d2b-ac8b51b69bc7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:54:33.844613 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:33.844560    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:33.844613 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:33.844612    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:33.844837 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:33.844612    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:33.844837 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:33.844719    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9j5tj" podUID="b27c6a7e-d576-44de-9d2b-ac8b51b69bc7"
Sep 10 19:54:33.844923 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:33.844837    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxnhw" podUID="26ab4b64-59b6-42cb-b55d-ce41cecd0e85"
Sep 10 19:54:33.844961 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:33.844922    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klxsb" podUID="91e2acc4-0716-4fcb-95ee-32d1668449e7"
Sep 10 19:54:35.844224 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:35.844191    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:35.844694 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:35.844302    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klxsb" podUID="91e2acc4-0716-4fcb-95ee-32d1668449e7"
Sep 10 19:54:35.844694 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:35.844329    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:35.844694 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:35.844330    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:35.844694 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:35.844428    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9j5tj" podUID="b27c6a7e-d576-44de-9d2b-ac8b51b69bc7"
Sep 10 19:54:35.844694 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:35.844519    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxnhw" podUID="26ab4b64-59b6-42cb-b55d-ce41cecd0e85"
Sep 10 19:54:37.034015 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:37.033752    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-162.ec2.internal" event={"ID":"2bed3b36dfff37d8ae39ecb426eba237","Type":"ContainerStarted","Data":"95c2dc3ecfff6f9a5030e3036c38334cb9a98a5241425bd278cb3c36d43426b9"}
Sep 10 19:54:37.035260 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:37.035236    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-krr84" event={"ID":"b2be38a9-429c-4a4d-aea8-fe09152b4a48","Type":"ContainerStarted","Data":"b293c4815a48e9b9092afa45fd559a7d1547092ff1f44f595560ddd6bdfc2f97"}
Sep 10 19:54:37.036625 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:37.036598    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-trbgx" event={"ID":"6ee133f1-b49a-4448-83ef-fbd09a4b0a0a","Type":"ContainerStarted","Data":"2788bc3266286db893ad83769adbfbdaed30f911845cfa27a2f19937154d8241"}
Sep 10 19:54:37.047676 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:37.047636    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-162.ec2.internal" podStartSLOduration=20.047625284 podStartE2EDuration="20.047625284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:54:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:54:37.047318958 +0000 UTC m=+20.712423204" watchObservedRunningTime="2026-09-10 19:54:37.047625284 +0000 UTC m=+20.712729531"
Sep 10 19:54:37.063615 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:37.063581    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-krr84" podStartSLOduration=2.464678469 podStartE2EDuration="21.063568461s" totalImagesPullingTime="18.598889992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:54:37.06277201 +0000 UTC m=+20.727876267" watchObservedRunningTime="2026-09-10 19:54:37.063568461 +0000 UTC m=+20.728672707"
Sep 10 19:54:37.843662 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:37.843631    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:37.843798 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:37.843725    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:37.843798 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:37.843733    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9j5tj" podUID="b27c6a7e-d576-44de-9d2b-ac8b51b69bc7"
Sep 10 19:54:37.843862 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:37.843732    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:37.843862 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:37.843807    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klxsb" podUID="91e2acc4-0716-4fcb-95ee-32d1668449e7"
Sep 10 19:54:37.843924 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:37.843869    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxnhw" podUID="26ab4b64-59b6-42cb-b55d-ce41cecd0e85"
Sep 10 19:54:38.041780 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:38.041745    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76gvf" event={"ID":"67db218b-f273-4db9-a124-af7c77107860","Type":"ContainerStarted","Data":"a8891cbdba3e123ebfea82756ca0cebf81712920edc5c41ba8c297b3af0942ac"}
Sep 10 19:54:38.042488 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:38.041817    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76gvf" event={"ID":"67db218b-f273-4db9-a124-af7c77107860","Type":"ContainerStarted","Data":"efaf6a171d4cce72b4182576eef666c0f9805e32a5ff4ddb579e3ecc04e393b2"}
Sep 10 19:54:38.042488 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:38.041864    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76gvf" event={"ID":"67db218b-f273-4db9-a124-af7c77107860","Type":"ContainerStarted","Data":"1c4c547365e26cb91c6cf683055991e45c391488adf258a9e08e82e9287e66f1"}
Sep 10 19:54:38.042488 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:38.041896    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76gvf" event={"ID":"67db218b-f273-4db9-a124-af7c77107860","Type":"ContainerStarted","Data":"423cfa6c67c342336e4ac470ba5c1d164d1299660c61c35eb849c4f75bc80c1b"}
Sep 10 19:54:38.042488 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:38.041922    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76gvf" event={"ID":"67db218b-f273-4db9-a124-af7c77107860","Type":"ContainerStarted","Data":"c3f0225acf7406a0ee83b7145b56a6550f0e652ba1219e4893b94661f60dfbe9"}
Sep 10 19:54:38.042488 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:38.041949    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76gvf" event={"ID":"67db218b-f273-4db9-a124-af7c77107860","Type":"ContainerStarted","Data":"20e52a10f1b9126cf3fb747265623d63ef7f979769bf1b138efe9715133dbea2"}
Sep 10 19:54:38.043420 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:38.043378    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lqn7b" event={"ID":"b1686c34-4f9d-424e-9b3b-9daf34983519","Type":"ContainerStarted","Data":"e9fbb59236b010e615c41c324693406589cac9414eba36514d604abc4c3d60af"}
Sep 10 19:54:38.044780 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:38.044751    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-shxth" event={"ID":"bf92bb85-73f0-46a4-b32e-b83f8d56ac82","Type":"ContainerStarted","Data":"99cb899c75b92a1596527a54427cf622af7deea7350eb43680a136040cfa8912"}
Sep 10 19:54:38.046144 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:38.046116    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r" event={"ID":"e4b902c8-2410-4e7d-b415-41e848652a43","Type":"ContainerStarted","Data":"eedb81ea04b9fe51d3e910e5632c8880160ef1ac70e59173399fbe6b41fb47ec"}
Sep 10 19:54:38.049575 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:38.049546    2561 generic.go:356] "Generic (PLEG): container finished" podID="ef619541-b449-44f8-a3c7-228a92fc6904" containerID="b5951db888b155774108f7f5a9867c4a84fb3a1523a2e7f318e11397c826d6ee" exitCode=0
Sep 10 19:54:38.049660 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:38.049629    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2skk" event={"ID":"ef619541-b449-44f8-a3c7-228a92fc6904","Type":"ContainerDied","Data":"b5951db888b155774108f7f5a9867c4a84fb3a1523a2e7f318e11397c826d6ee"}
Sep 10 19:54:38.051915 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:38.051889    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vrgkq" event={"ID":"ee70731d-0545-406f-bc04-c0589d986e18","Type":"ContainerStarted","Data":"f89bd2d2ef0aef868e23af382913d07842819ff1e1a8deddd5754bcc5ca188fa"}
Sep 10 19:54:38.053543 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:38.053522    2561 generic.go:356] "Generic (PLEG): container finished" podID="9db966db7197aaab6d3876e6501aadf5" containerID="a38738c63c3859565627e00daa681262609c297084827e4704256e2b15eeab5d" exitCode=0
Sep 10 19:54:38.053643 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:38.053574    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal" event={"ID":"9db966db7197aaab6d3876e6501aadf5","Type":"ContainerDied","Data":"a38738c63c3859565627e00daa681262609c297084827e4704256e2b15eeab5d"}
Sep 10 19:54:38.059805 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:38.059766    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-trbgx" podStartSLOduration=3.487860492 podStartE2EDuration="22.059753869s" totalImagesPullingTime="18.571893377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:54:37.080772334 +0000 UTC m=+20.745876575" watchObservedRunningTime="2026-09-10 19:54:38.059753869 +0000 UTC m=+21.724858116"
Sep 10 19:54:38.059917 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:38.059854    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lqn7b" podStartSLOduration=2.501127889 podStartE2EDuration="21.059849829s" totalImagesPullingTime="18.55872194s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:54:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:54:38.059302499 +0000 UTC m=+21.724406748" watchObservedRunningTime="2026-09-10 19:54:38.059849829 +0000 UTC m=+21.724954077"
Sep 10 19:54:38.094754 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:38.094574    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-shxth" podStartSLOduration=11.083264529 podStartE2EDuration="22.094558001s" totalImagesPullingTime="11.011293472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:54:38.073913115 +0000 UTC m=+21.739017362" watchObservedRunningTime="2026-09-10 19:54:38.094558001 +0000 UTC m=+21.759662249"
Sep 10 19:54:38.108644 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:38.108596    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vrgkq" podStartSLOduration=3.4634907520000002 podStartE2EDuration="22.108583834s" totalImagesPullingTime="18.645093082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:54:38.108460482 +0000 UTC m=+21.773564730" watchObservedRunningTime="2026-09-10 19:54:38.108583834 +0000 UTC m=+21.773688081"
Sep 10 19:54:38.332966 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:38.332752    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 19:54:38.801852 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:38.801737    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T19:54:38.332961811Z","UUID":"54c09646-55f4-4de5-b782-163f305fde48","Handler":null,"Name":"","Endpoint":""}
Sep 10 19:54:38.803290 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:38.803271    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 19:54:38.803423 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:38.803304    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 19:54:39.058109 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:39.058031    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal" event={"ID":"9db966db7197aaab6d3876e6501aadf5","Type":"ContainerStarted","Data":"5f6c2f2d347f06af106937c8202ce83b8faf07f0929e1a8e43aa94c9434d09eb"}
Sep 10 19:54:39.060414 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:39.060362    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r" event={"ID":"e4b902c8-2410-4e7d-b415-41e848652a43","Type":"ContainerStarted","Data":"37b5c2e151e75d203070852dc6636dcd67e917cbf98a77dbb8a6a1aecd44895d"}
Sep 10 19:54:39.062292 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:39.062262    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-89svr" event={"ID":"7b9a8844-d413-41e5-af75-6d5c962a43ba","Type":"ContainerStarted","Data":"694d7450a9442f88a360521af36d637774a95c244ff6646725c9a84d968c1373"}
Sep 10 19:54:39.088947 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:39.088901    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-89svr" podStartSLOduration=4.487396447 podStartE2EDuration="23.088883373s" totalImagesPullingTime="18.601486926s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:54:39.088683798 +0000 UTC m=+22.753788047" watchObservedRunningTime="2026-09-10 19:54:39.088883373 +0000 UTC m=+22.753987620"
Sep 10 19:54:39.089507 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:39.089459    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal" podStartSLOduration=22.089447647 podStartE2EDuration="22.089447647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:54:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:54:39.073867485 +0000 UTC m=+22.738971757" watchObservedRunningTime="2026-09-10 19:54:39.089447647 +0000 UTC m=+22.754551911"
Sep 10 19:54:39.844258 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:39.844211    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:39.844258 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:39.844249    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:39.844258 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:39.844263    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:39.844561 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:39.844373    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxnhw" podUID="26ab4b64-59b6-42cb-b55d-ce41cecd0e85"
Sep 10 19:54:39.844561 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:39.844427    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klxsb" podUID="91e2acc4-0716-4fcb-95ee-32d1668449e7"
Sep 10 19:54:39.844561 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:39.844499    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9j5tj" podUID="b27c6a7e-d576-44de-9d2b-ac8b51b69bc7"
Sep 10 19:54:40.069068 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:40.068979    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76gvf" event={"ID":"67db218b-f273-4db9-a124-af7c77107860","Type":"ContainerStarted","Data":"92bb7fde4a5960690587fc4284c28ab039e9307015e30f7bfe57a53c165d33e3"}
Sep 10 19:54:40.071268 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:40.071231    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r" event={"ID":"e4b902c8-2410-4e7d-b415-41e848652a43","Type":"ContainerStarted","Data":"2c66f45985e4a77d635a51864f7bba01943ff0829a7aa93be9e2630500811647"}
Sep 10 19:54:40.090295 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:40.090246    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlt9r" podStartSLOduration=3.7431733830000002 podStartE2EDuration="24.090229496s" totalImagesPullingTime="20.347056113s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:54:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:54:40.09008057 +0000 UTC m=+23.755184817" watchObservedRunningTime="2026-09-10 19:54:40.090229496 +0000 UTC m=+23.755333744"
Sep 10 19:54:41.685434 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:41.685385    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-shxth"
Sep 10 19:54:41.686010 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:41.685972    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-shxth"
Sep 10 19:54:41.844320 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:41.844293    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:41.844470 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:41.844293    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:41.844470 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:41.844431    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxnhw" podUID="26ab4b64-59b6-42cb-b55d-ce41cecd0e85"
Sep 10 19:54:41.844592 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:41.844510    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klxsb" podUID="91e2acc4-0716-4fcb-95ee-32d1668449e7"
Sep 10 19:54:41.844592 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:41.844294    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:41.844592 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:41.844585    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9j5tj" podUID="b27c6a7e-d576-44de-9d2b-ac8b51b69bc7"
Sep 10 19:54:42.076547 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:42.076522    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-shxth"
Sep 10 19:54:42.077035 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:42.077013    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-shxth"
Sep 10 19:54:43.843962 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:43.843793    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:43.844510 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:43.843796    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:43.844510 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:43.844024    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9j5tj" podUID="b27c6a7e-d576-44de-9d2b-ac8b51b69bc7"
Sep 10 19:54:43.844510 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:43.843803    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:43.844510 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:43.844109    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klxsb" podUID="91e2acc4-0716-4fcb-95ee-32d1668449e7"
Sep 10 19:54:43.844510 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:43.844173    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxnhw" podUID="26ab4b64-59b6-42cb-b55d-ce41cecd0e85"
Sep 10 19:54:44.084066 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:44.084034    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76gvf" event={"ID":"67db218b-f273-4db9-a124-af7c77107860","Type":"ContainerStarted","Data":"bfaead4668fd5871938c411d512d72b48ee4356d93809018dcb81ec18e5cca65"}
Sep 10 19:54:44.084322 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:44.084302    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:44.084445 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:44.084405    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:44.085980 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:44.085952    2561 generic.go:356] "Generic (PLEG): container finished" podID="ef619541-b449-44f8-a3c7-228a92fc6904" containerID="61a8f50480481e1fbed12b418be565dd9dd587614e3079d398b3ab62f7a28abe" exitCode=0
Sep 10 19:54:44.086084 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:44.085993    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2skk" event={"ID":"ef619541-b449-44f8-a3c7-228a92fc6904","Type":"ContainerDied","Data":"61a8f50480481e1fbed12b418be565dd9dd587614e3079d398b3ab62f7a28abe"}
Sep 10 19:54:44.100976 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:44.100917    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:44.114793 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:44.114748    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-76gvf" podStartSLOduration=8.115819539 podStartE2EDuration="27.114736127s" totalImagesPullingTime="18.998916588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:54:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:54:44.11418376 +0000 UTC m=+27.779288044" watchObservedRunningTime="2026-09-10 19:54:44.114736127 +0000 UTC m=+27.779840373"
Sep 10 19:54:44.978116 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:44.977929    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-klxsb"]
Sep 10 19:54:44.978633 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:44.978198    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:44.978633 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:44.978286    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klxsb" podUID="91e2acc4-0716-4fcb-95ee-32d1668449e7"
Sep 10 19:54:44.980819 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:44.980775    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9j5tj"]
Sep 10 19:54:44.980938 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:44.980876    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:44.981011 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:44.980969    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9j5tj" podUID="b27c6a7e-d576-44de-9d2b-ac8b51b69bc7"
Sep 10 19:54:44.981367 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:44.981349    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mxnhw"]
Sep 10 19:54:44.981497 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:44.981451    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:44.981567 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:44.981530    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxnhw" podUID="26ab4b64-59b6-42cb-b55d-ce41cecd0e85"
Sep 10 19:54:45.090808 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:45.090774    2561 generic.go:356] "Generic (PLEG): container finished" podID="ef619541-b449-44f8-a3c7-228a92fc6904" containerID="85271ed3d459d8a0f4e10e18498c07c6d78fb71817af04fdcd161dde86c23b70" exitCode=0
Sep 10 19:54:45.090957 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:45.090847    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2skk" event={"ID":"ef619541-b449-44f8-a3c7-228a92fc6904","Type":"ContainerDied","Data":"85271ed3d459d8a0f4e10e18498c07c6d78fb71817af04fdcd161dde86c23b70"}
Sep 10 19:54:45.091292 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:45.091249    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:45.105775 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:45.105758    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:54:46.095710 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:46.095676    2561 generic.go:356] "Generic (PLEG): container finished" podID="ef619541-b449-44f8-a3c7-228a92fc6904" containerID="0b63edf90cf304c711b0193f61d3ab00640eda99ec0843b89761595d865c2f38" exitCode=0
Sep 10 19:54:46.096112 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:46.095744    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2skk" event={"ID":"ef619541-b449-44f8-a3c7-228a92fc6904","Type":"ContainerDied","Data":"0b63edf90cf304c711b0193f61d3ab00640eda99ec0843b89761595d865c2f38"}
Sep 10 19:54:46.845238 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:46.845205    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:46.845452 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:46.845280    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klxsb" podUID="91e2acc4-0716-4fcb-95ee-32d1668449e7"
Sep 10 19:54:46.845452 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:46.845299    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:46.845452 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:46.845328    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:46.845452 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:46.845410    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxnhw" podUID="26ab4b64-59b6-42cb-b55d-ce41cecd0e85"
Sep 10 19:54:46.845680 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:46.845467    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9j5tj" podUID="b27c6a7e-d576-44de-9d2b-ac8b51b69bc7"
Sep 10 19:54:48.844165 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:48.844117    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:48.844165 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:48.844137    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:48.844686 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:48.844247    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klxsb" podUID="91e2acc4-0716-4fcb-95ee-32d1668449e7"
Sep 10 19:54:48.844686 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:48.844300    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxnhw" podUID="26ab4b64-59b6-42cb-b55d-ce41cecd0e85"
Sep 10 19:54:48.844686 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:48.844346    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:48.844686 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:48.844417    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9j5tj" podUID="b27c6a7e-d576-44de-9d2b-ac8b51b69bc7"
Sep 10 19:54:49.496541 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.496502    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs\") pod \"network-metrics-daemon-mxnhw\" (UID: \"26ab4b64-59b6-42cb-b55d-ce41cecd0e85\") " pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:49.496732 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:49.496672    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:54:49.496788 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:49.496749    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs podName:26ab4b64-59b6-42cb-b55d-ce41cecd0e85 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:21.496727744 +0000 UTC m=+65.161832035 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs") pod "network-metrics-daemon-mxnhw" (UID: "26ab4b64-59b6-42cb-b55d-ce41cecd0e85") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:54:49.597451 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.597416    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blxj7\" (UniqueName: \"kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7\") pod \"network-check-target-9j5tj\" (UID: \"b27c6a7e-d576-44de-9d2b-ac8b51b69bc7\") " pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:49.597604 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.597475    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret\") pod \"global-pull-secret-syncer-klxsb\" (UID: \"91e2acc4-0716-4fcb-95ee-32d1668449e7\") " pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:49.597604 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:49.597580    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 19:54:49.597707 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:49.597624    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 19:54:49.597707 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:49.597650    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 19:54:49.597707 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:49.597654    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret podName:91e2acc4-0716-4fcb-95ee-32d1668449e7 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:21.597635849 +0000 UTC m=+65.262740082 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret") pod "global-pull-secret-syncer-klxsb" (UID: "91e2acc4-0716-4fcb-95ee-32d1668449e7") : object "kube-system"/"original-pull-secret" not registered
Sep 10 19:54:49.597707 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:49.597662    2561 projected.go:196] Error preparing data for projected volume kube-api-access-blxj7 for pod openshift-network-diagnostics/network-check-target-9j5tj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:54:49.597908 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:49.597714    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7 podName:b27c6a7e-d576-44de-9d2b-ac8b51b69bc7 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:21.597697132 +0000 UTC m=+65.262801376 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-blxj7" (UniqueName: "kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7") pod "network-check-target-9j5tj" (UID: "b27c6a7e-d576-44de-9d2b-ac8b51b69bc7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:54:49.603271 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.603246    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeReady"
Sep 10 19:54:49.603410 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.603372    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 19:54:49.659616 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.659589    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zln5l"]
Sep 10 19:54:49.671695 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.671661    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-srpmn"]
Sep 10 19:54:49.671816 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.671792    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zln5l"
Sep 10 19:54:49.674321 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.674291    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 19:54:49.674433 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.674296    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ngfwp\""
Sep 10 19:54:49.674433 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.674301    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 19:54:49.684192 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.684169    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zln5l"]
Sep 10 19:54:49.684319 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.684278    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-srpmn"
Sep 10 19:54:49.686750 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.686732    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 19:54:49.686864 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.686794    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 19:54:49.687166 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.687064    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bxvfx\""
Sep 10 19:54:49.687166 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.687154    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 19:54:49.695782 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.695760    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-srpmn"]
Sep 10 19:54:49.798510 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.798380    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c63240bf-c37d-4515-83ce-231154951432-metrics-tls\") pod \"dns-default-zln5l\" (UID: \"c63240bf-c37d-4515-83ce-231154951432\") " pod="openshift-dns/dns-default-zln5l"
Sep 10 19:54:49.798510 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.798484    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c63240bf-c37d-4515-83ce-231154951432-config-volume\") pod \"dns-default-zln5l\" (UID: \"c63240bf-c37d-4515-83ce-231154951432\") " pod="openshift-dns/dns-default-zln5l"
Sep 10 19:54:49.798510 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.798510    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0992094b-05c3-47cf-977f-bbcbfa0f813d-cert\") pod \"ingress-canary-srpmn\" (UID: \"0992094b-05c3-47cf-977f-bbcbfa0f813d\") " pod="openshift-ingress-canary/ingress-canary-srpmn"
Sep 10 19:54:49.798742 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.798559    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwfcb\" (UniqueName: \"kubernetes.io/projected/0992094b-05c3-47cf-977f-bbcbfa0f813d-kube-api-access-gwfcb\") pod \"ingress-canary-srpmn\" (UID: \"0992094b-05c3-47cf-977f-bbcbfa0f813d\") " pod="openshift-ingress-canary/ingress-canary-srpmn"
Sep 10 19:54:49.798742 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.798594    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krjtj\" (UniqueName: \"kubernetes.io/projected/c63240bf-c37d-4515-83ce-231154951432-kube-api-access-krjtj\") pod \"dns-default-zln5l\" (UID: \"c63240bf-c37d-4515-83ce-231154951432\") " pod="openshift-dns/dns-default-zln5l"
Sep 10 19:54:49.798742 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.798616    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c63240bf-c37d-4515-83ce-231154951432-tmp-dir\") pod \"dns-default-zln5l\" (UID: \"c63240bf-c37d-4515-83ce-231154951432\") " pod="openshift-dns/dns-default-zln5l"
Sep 10 19:54:49.899038 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.899009    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c63240bf-c37d-4515-83ce-231154951432-tmp-dir\") pod \"dns-default-zln5l\" (UID: \"c63240bf-c37d-4515-83ce-231154951432\") " pod="openshift-dns/dns-default-zln5l"
Sep 10 19:54:49.899451 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.899072    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c63240bf-c37d-4515-83ce-231154951432-metrics-tls\") pod \"dns-default-zln5l\" (UID: \"c63240bf-c37d-4515-83ce-231154951432\") " pod="openshift-dns/dns-default-zln5l"
Sep 10 19:54:49.899451 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.899112    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c63240bf-c37d-4515-83ce-231154951432-config-volume\") pod \"dns-default-zln5l\" (UID: \"c63240bf-c37d-4515-83ce-231154951432\") " pod="openshift-dns/dns-default-zln5l"
Sep 10 19:54:49.899451 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.899138    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0992094b-05c3-47cf-977f-bbcbfa0f813d-cert\") pod \"ingress-canary-srpmn\" (UID: \"0992094b-05c3-47cf-977f-bbcbfa0f813d\") " pod="openshift-ingress-canary/ingress-canary-srpmn"
Sep 10 19:54:49.899451 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.899183    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwfcb\" (UniqueName: \"kubernetes.io/projected/0992094b-05c3-47cf-977f-bbcbfa0f813d-kube-api-access-gwfcb\") pod \"ingress-canary-srpmn\" (UID: \"0992094b-05c3-47cf-977f-bbcbfa0f813d\") " pod="openshift-ingress-canary/ingress-canary-srpmn"
Sep 10 19:54:49.899451 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.899210    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krjtj\" (UniqueName: \"kubernetes.io/projected/c63240bf-c37d-4515-83ce-231154951432-kube-api-access-krjtj\") pod \"dns-default-zln5l\" (UID: \"c63240bf-c37d-4515-83ce-231154951432\") " pod="openshift-dns/dns-default-zln5l"
Sep 10 19:54:49.899704 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:49.899555    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 19:54:49.899704 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:49.899623    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c63240bf-c37d-4515-83ce-231154951432-metrics-tls podName:c63240bf-c37d-4515-83ce-231154951432 nodeName:}" failed. No retries permitted until 2026-09-10 19:54:50.399601486 +0000 UTC m=+34.064705729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c63240bf-c37d-4515-83ce-231154951432-metrics-tls") pod "dns-default-zln5l" (UID: "c63240bf-c37d-4515-83ce-231154951432") : secret "dns-default-metrics-tls" not found
Sep 10 19:54:49.900068 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.899812    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c63240bf-c37d-4515-83ce-231154951432-tmp-dir\") pod \"dns-default-zln5l\" (UID: \"c63240bf-c37d-4515-83ce-231154951432\") " pod="openshift-dns/dns-default-zln5l"
Sep 10 19:54:49.900068 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.900008    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c63240bf-c37d-4515-83ce-231154951432-config-volume\") pod \"dns-default-zln5l\" (UID: \"c63240bf-c37d-4515-83ce-231154951432\") " pod="openshift-dns/dns-default-zln5l"
Sep 10 19:54:49.904216 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.904172    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0992094b-05c3-47cf-977f-bbcbfa0f813d-cert\") pod \"ingress-canary-srpmn\" (UID: \"0992094b-05c3-47cf-977f-bbcbfa0f813d\") " pod="openshift-ingress-canary/ingress-canary-srpmn"
Sep 10 19:54:49.908525 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.908483    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krjtj\" (UniqueName: \"kubernetes.io/projected/c63240bf-c37d-4515-83ce-231154951432-kube-api-access-krjtj\") pod \"dns-default-zln5l\" (UID: \"c63240bf-c37d-4515-83ce-231154951432\") " pod="openshift-dns/dns-default-zln5l"
Sep 10 19:54:49.908662 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.908645    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwfcb\" (UniqueName: \"kubernetes.io/projected/0992094b-05c3-47cf-977f-bbcbfa0f813d-kube-api-access-gwfcb\") pod \"ingress-canary-srpmn\" (UID: \"0992094b-05c3-47cf-977f-bbcbfa0f813d\") " pod="openshift-ingress-canary/ingress-canary-srpmn"
Sep 10 19:54:49.994045 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:49.994003    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-srpmn"
Sep 10 19:54:50.403702 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:50.403664    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c63240bf-c37d-4515-83ce-231154951432-metrics-tls\") pod \"dns-default-zln5l\" (UID: \"c63240bf-c37d-4515-83ce-231154951432\") " pod="openshift-dns/dns-default-zln5l"
Sep 10 19:54:50.403874 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:50.403799    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 19:54:50.403874 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:50.403855    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c63240bf-c37d-4515-83ce-231154951432-metrics-tls podName:c63240bf-c37d-4515-83ce-231154951432 nodeName:}" failed. No retries permitted until 2026-09-10 19:54:51.403842278 +0000 UTC m=+35.068946503 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c63240bf-c37d-4515-83ce-231154951432-metrics-tls") pod "dns-default-zln5l" (UID: "c63240bf-c37d-4515-83ce-231154951432") : secret "dns-default-metrics-tls" not found
Sep 10 19:54:50.844435 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:50.844244    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:54:50.844587 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:50.844302    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:54:50.844644 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:50.844333    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:54:50.847991 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:50.847269    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 19:54:50.847991 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:50.847576    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 19:54:50.848951 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:50.848749    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 19:54:50.848951 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:50.848809    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mcqxm\""
Sep 10 19:54:50.848951 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:50.848827    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 19:54:50.848951 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:50.848827    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mr4n2\""
Sep 10 19:54:50.915711 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:50.915683    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-srpmn"]
Sep 10 19:54:50.948002 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:54:50.947934    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0992094b_05c3_47cf_977f_bbcbfa0f813d.slice/crio-5c8a8dc097deb6d799d6024d60efdb9712e9f3e29122e82014d4a87f8c1f8aca WatchSource:0}: Error finding container 5c8a8dc097deb6d799d6024d60efdb9712e9f3e29122e82014d4a87f8c1f8aca: Status 404 returned error can't find the container with id 5c8a8dc097deb6d799d6024d60efdb9712e9f3e29122e82014d4a87f8c1f8aca
Sep 10 19:54:51.108574 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:51.108543    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-srpmn" event={"ID":"0992094b-05c3-47cf-977f-bbcbfa0f813d","Type":"ContainerStarted","Data":"5c8a8dc097deb6d799d6024d60efdb9712e9f3e29122e82014d4a87f8c1f8aca"}
Sep 10 19:54:51.411158 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:51.411117    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c63240bf-c37d-4515-83ce-231154951432-metrics-tls\") pod \"dns-default-zln5l\" (UID: \"c63240bf-c37d-4515-83ce-231154951432\") " pod="openshift-dns/dns-default-zln5l"
Sep 10 19:54:51.411321 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:51.411231    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 19:54:51.411321 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:51.411282    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c63240bf-c37d-4515-83ce-231154951432-metrics-tls podName:c63240bf-c37d-4515-83ce-231154951432 nodeName:}" failed. No retries permitted until 2026-09-10 19:54:53.411268344 +0000 UTC m=+37.076372569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c63240bf-c37d-4515-83ce-231154951432-metrics-tls") pod "dns-default-zln5l" (UID: "c63240bf-c37d-4515-83ce-231154951432") : secret "dns-default-metrics-tls" not found
Sep 10 19:54:52.114805 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:52.114768    2561 generic.go:356] "Generic (PLEG): container finished" podID="ef619541-b449-44f8-a3c7-228a92fc6904" containerID="10973543a35e29a4a34038e5a14ade4e826ef9e3378672d8cc1ec00ea03422db" exitCode=0
Sep 10 19:54:52.115419 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:52.114826    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2skk" event={"ID":"ef619541-b449-44f8-a3c7-228a92fc6904","Type":"ContainerDied","Data":"10973543a35e29a4a34038e5a14ade4e826ef9e3378672d8cc1ec00ea03422db"}
Sep 10 19:54:53.120983 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:53.120949    2561 generic.go:356] "Generic (PLEG): container finished" podID="ef619541-b449-44f8-a3c7-228a92fc6904" containerID="e4316b4aab3062fdf1def3c467cbee01f2aba4c120448329c1924f91c358d2ba" exitCode=0
Sep 10 19:54:53.121678 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:53.121015    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2skk" event={"ID":"ef619541-b449-44f8-a3c7-228a92fc6904","Type":"ContainerDied","Data":"e4316b4aab3062fdf1def3c467cbee01f2aba4c120448329c1924f91c358d2ba"}
Sep 10 19:54:53.430116 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:53.430029    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c63240bf-c37d-4515-83ce-231154951432-metrics-tls\") pod \"dns-default-zln5l\" (UID: \"c63240bf-c37d-4515-83ce-231154951432\") " pod="openshift-dns/dns-default-zln5l"
Sep 10 19:54:53.430280 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:53.430206    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 19:54:53.430280 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:53.430279    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c63240bf-c37d-4515-83ce-231154951432-metrics-tls podName:c63240bf-c37d-4515-83ce-231154951432 nodeName:}" failed. No retries permitted until 2026-09-10 19:54:57.430259004 +0000 UTC m=+41.095363246 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c63240bf-c37d-4515-83ce-231154951432-metrics-tls") pod "dns-default-zln5l" (UID: "c63240bf-c37d-4515-83ce-231154951432") : secret "dns-default-metrics-tls" not found
Sep 10 19:54:54.126229 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:54.126025    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2skk" event={"ID":"ef619541-b449-44f8-a3c7-228a92fc6904","Type":"ContainerStarted","Data":"cf9df5fe6ca2ea6eecf0fc21e396b981d51487431384ef16a3d9ff68ef18177f"}
Sep 10 19:54:54.127478 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:54.127450    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-srpmn" event={"ID":"0992094b-05c3-47cf-977f-bbcbfa0f813d","Type":"ContainerStarted","Data":"00157642a7a33240331d9e1d2c18b994805a6f4ebf7d00d454327eef414da22a"}
Sep 10 19:54:54.149973 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:54.149932    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-d2skk" podStartSLOduration=7.778942625 podStartE2EDuration="38.149920112s" totalImagesPullingTime="30.370977487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:54:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:54:54.1489341 +0000 UTC m=+37.814038347" watchObservedRunningTime="2026-09-10 19:54:54.149920112 +0000 UTC m=+37.815024359"
Sep 10 19:54:54.169778 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:54.169742    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-srpmn" podStartSLOduration=2.495638149 podStartE2EDuration="5.169733154s" totalImagesPullingTime="2.674095005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:54:54.169155272 +0000 UTC m=+37.834259520" watchObservedRunningTime="2026-09-10 19:54:54.169733154 +0000 UTC m=+37.834837402"
Sep 10 19:54:57.463999 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:54:57.462055    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c63240bf-c37d-4515-83ce-231154951432-metrics-tls\") pod \"dns-default-zln5l\" (UID: \"c63240bf-c37d-4515-83ce-231154951432\") " pod="openshift-dns/dns-default-zln5l"
Sep 10 19:54:57.463999 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:57.462203    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 19:54:57.463999 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:54:57.462270    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c63240bf-c37d-4515-83ce-231154951432-metrics-tls podName:c63240bf-c37d-4515-83ce-231154951432 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:05.462250709 +0000 UTC m=+49.127354936 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c63240bf-c37d-4515-83ce-231154951432-metrics-tls") pod "dns-default-zln5l" (UID: "c63240bf-c37d-4515-83ce-231154951432") : secret "dns-default-metrics-tls" not found
Sep 10 19:55:05.514321 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:05.514279    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c63240bf-c37d-4515-83ce-231154951432-metrics-tls\") pod \"dns-default-zln5l\" (UID: \"c63240bf-c37d-4515-83ce-231154951432\") " pod="openshift-dns/dns-default-zln5l"
Sep 10 19:55:05.514750 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:05.514462    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 19:55:05.514750 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:05.514531    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c63240bf-c37d-4515-83ce-231154951432-metrics-tls podName:c63240bf-c37d-4515-83ce-231154951432 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:21.514517159 +0000 UTC m=+65.179621384 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c63240bf-c37d-4515-83ce-231154951432-metrics-tls") pod "dns-default-zln5l" (UID: "c63240bf-c37d-4515-83ce-231154951432") : secret "dns-default-metrics-tls" not found
Sep 10 19:55:07.152098 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.152065    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bf98q"]
Sep 10 19:55:07.198130 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.198092    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bf98q"]
Sep 10 19:55:07.198275 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.198182    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bf98q"
Sep 10 19:55:07.200823 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.200794    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 10 19:55:07.200823 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.200792    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 10 19:55:07.201021 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.200827    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7wkjq\""
Sep 10 19:55:07.201707 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.201691    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 10 19:55:07.201811 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.201711    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 10 19:55:07.260052 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.260025    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-66dcf9c45b-792j7"]
Sep 10 19:55:07.276969 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.276945    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-66dcf9c45b-792j7"]
Sep 10 19:55:07.277086 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.277055    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:07.279592 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.279565    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 10 19:55:07.279592 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.279590    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 10 19:55:07.279766 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.279597    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 10 19:55:07.279766 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.279704    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 10 19:55:07.279913 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.279887    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 19:55:07.280015 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.279990    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 19:55:07.280075 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.280063    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gmk4g\""
Sep 10 19:55:07.323307 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.323284    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/253acc31-66e4-4ec2-8dc3-445ffc402492-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-bf98q\" (UID: \"253acc31-66e4-4ec2-8dc3-445ffc402492\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bf98q"
Sep 10 19:55:07.323468 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.323319    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx5lb\" (UniqueName: \"kubernetes.io/projected/253acc31-66e4-4ec2-8dc3-445ffc402492-kube-api-access-qx5lb\") pod \"kube-storage-version-migrator-operator-8d7dd4675-bf98q\" (UID: \"253acc31-66e4-4ec2-8dc3-445ffc402492\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bf98q"
Sep 10 19:55:07.323468 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.323411    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/253acc31-66e4-4ec2-8dc3-445ffc402492-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-bf98q\" (UID: \"253acc31-66e4-4ec2-8dc3-445ffc402492\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bf98q"
Sep 10 19:55:07.424140 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.424069    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-stats-auth\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:07.424140 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.424101    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-metrics-certs\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:07.424140 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.424122    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d01e644-3fdb-48d6-91a4-b67b53b1a804-service-ca-bundle\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:07.424341 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.424144    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr8rc\" (UniqueName: \"kubernetes.io/projected/5d01e644-3fdb-48d6-91a4-b67b53b1a804-kube-api-access-jr8rc\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:07.424341 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.424166    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/253acc31-66e4-4ec2-8dc3-445ffc402492-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-bf98q\" (UID: \"253acc31-66e4-4ec2-8dc3-445ffc402492\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bf98q"
Sep 10 19:55:07.424341 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.424185    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx5lb\" (UniqueName: \"kubernetes.io/projected/253acc31-66e4-4ec2-8dc3-445ffc402492-kube-api-access-qx5lb\") pod \"kube-storage-version-migrator-operator-8d7dd4675-bf98q\" (UID: \"253acc31-66e4-4ec2-8dc3-445ffc402492\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bf98q"
Sep 10 19:55:07.424341 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.424223    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/253acc31-66e4-4ec2-8dc3-445ffc402492-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-bf98q\" (UID: \"253acc31-66e4-4ec2-8dc3-445ffc402492\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bf98q"
Sep 10 19:55:07.424341 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.424238    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-default-certificate\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:07.425397 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.425373    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/253acc31-66e4-4ec2-8dc3-445ffc402492-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-bf98q\" (UID: \"253acc31-66e4-4ec2-8dc3-445ffc402492\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bf98q"
Sep 10 19:55:07.427735 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.427712    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/253acc31-66e4-4ec2-8dc3-445ffc402492-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-bf98q\" (UID: \"253acc31-66e4-4ec2-8dc3-445ffc402492\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bf98q"
Sep 10 19:55:07.432907 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.432884    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx5lb\" (UniqueName: \"kubernetes.io/projected/253acc31-66e4-4ec2-8dc3-445ffc402492-kube-api-access-qx5lb\") pod \"kube-storage-version-migrator-operator-8d7dd4675-bf98q\" (UID: \"253acc31-66e4-4ec2-8dc3-445ffc402492\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bf98q"
Sep 10 19:55:07.506916 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.506891    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bf98q"
Sep 10 19:55:07.525403 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.525376    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr8rc\" (UniqueName: \"kubernetes.io/projected/5d01e644-3fdb-48d6-91a4-b67b53b1a804-kube-api-access-jr8rc\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:07.525495 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.525483    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-default-certificate\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:07.525536 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.525524    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-stats-auth\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:07.525577 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.525537    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-metrics-certs\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:07.525577 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.525561    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d01e644-3fdb-48d6-91a4-b67b53b1a804-service-ca-bundle\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:07.525703 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:07.525682    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 19:55:07.525745 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:07.525726    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d01e644-3fdb-48d6-91a4-b67b53b1a804-service-ca-bundle podName:5d01e644-3fdb-48d6-91a4-b67b53b1a804 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:08.025708237 +0000 UTC m=+51.690812463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5d01e644-3fdb-48d6-91a4-b67b53b1a804-service-ca-bundle") pod "router-default-66dcf9c45b-792j7" (UID: "5d01e644-3fdb-48d6-91a4-b67b53b1a804") : configmap references non-existent config key: service-ca.crt
Sep 10 19:55:07.525789 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:07.525755    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-metrics-certs podName:5d01e644-3fdb-48d6-91a4-b67b53b1a804 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:08.025737097 +0000 UTC m=+51.690841323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-metrics-certs") pod "router-default-66dcf9c45b-792j7" (UID: "5d01e644-3fdb-48d6-91a4-b67b53b1a804") : secret "router-metrics-certs-default" not found
Sep 10 19:55:07.527783 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.527763    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-default-certificate\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:07.527893 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.527870    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-stats-auth\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:07.534559 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.534531    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr8rc\" (UniqueName: \"kubernetes.io/projected/5d01e644-3fdb-48d6-91a4-b67b53b1a804-kube-api-access-jr8rc\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:07.788067 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:07.787995    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bf98q"]
Sep 10 19:55:07.791027 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:55:07.790996    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod253acc31_66e4_4ec2_8dc3_445ffc402492.slice/crio-e15f261f14a42fc405619124378f9a66e87609ea8fb31b171e89cfcf2674eb3b WatchSource:0}: Error finding container e15f261f14a42fc405619124378f9a66e87609ea8fb31b171e89cfcf2674eb3b: Status 404 returned error can't find the container with id e15f261f14a42fc405619124378f9a66e87609ea8fb31b171e89cfcf2674eb3b
Sep 10 19:55:08.029198 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:08.029163    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-metrics-certs\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:08.029198 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:08.029201    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d01e644-3fdb-48d6-91a4-b67b53b1a804-service-ca-bundle\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:08.029434 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:08.029321    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 19:55:08.029434 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:08.029350    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d01e644-3fdb-48d6-91a4-b67b53b1a804-service-ca-bundle podName:5d01e644-3fdb-48d6-91a4-b67b53b1a804 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:09.029336549 +0000 UTC m=+52.694440775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5d01e644-3fdb-48d6-91a4-b67b53b1a804-service-ca-bundle") pod "router-default-66dcf9c45b-792j7" (UID: "5d01e644-3fdb-48d6-91a4-b67b53b1a804") : configmap references non-existent config key: service-ca.crt
Sep 10 19:55:08.029434 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:08.029383    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-metrics-certs podName:5d01e644-3fdb-48d6-91a4-b67b53b1a804 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:09.029370877 +0000 UTC m=+52.694475118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-metrics-certs") pod "router-default-66dcf9c45b-792j7" (UID: "5d01e644-3fdb-48d6-91a4-b67b53b1a804") : secret "router-metrics-certs-default" not found
Sep 10 19:55:08.158909 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:08.158874    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bf98q" event={"ID":"253acc31-66e4-4ec2-8dc3-445ffc402492","Type":"ContainerStarted","Data":"e15f261f14a42fc405619124378f9a66e87609ea8fb31b171e89cfcf2674eb3b"}
Sep 10 19:55:09.037137 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:09.037093    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-metrics-certs\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:09.037321 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:09.037149    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d01e644-3fdb-48d6-91a4-b67b53b1a804-service-ca-bundle\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:09.037321 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:09.037252    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 19:55:09.037468 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:09.037327    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-metrics-certs podName:5d01e644-3fdb-48d6-91a4-b67b53b1a804 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:11.037307016 +0000 UTC m=+54.702411259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-metrics-certs") pod "router-default-66dcf9c45b-792j7" (UID: "5d01e644-3fdb-48d6-91a4-b67b53b1a804") : secret "router-metrics-certs-default" not found
Sep 10 19:55:09.037468 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:09.037414    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d01e644-3fdb-48d6-91a4-b67b53b1a804-service-ca-bundle podName:5d01e644-3fdb-48d6-91a4-b67b53b1a804 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:11.037374306 +0000 UTC m=+54.702478543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5d01e644-3fdb-48d6-91a4-b67b53b1a804-service-ca-bundle") pod "router-default-66dcf9c45b-792j7" (UID: "5d01e644-3fdb-48d6-91a4-b67b53b1a804") : configmap references non-existent config key: service-ca.crt
Sep 10 19:55:10.165145 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:10.165106    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bf98q" event={"ID":"253acc31-66e4-4ec2-8dc3-445ffc402492","Type":"ContainerStarted","Data":"8559d01744ad8e8f60e80260c0a9f0b3f7bc13d078c09cd7d434264fe0c167c1"}
Sep 10 19:55:10.183156 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:10.183105    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bf98q" podStartSLOduration=1.353149668 podStartE2EDuration="3.183086381s" totalImagesPullingTime="1.829936713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:55:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:55:10.18207669 +0000 UTC m=+53.847180931" watchObservedRunningTime="2026-09-10 19:55:10.183086381 +0000 UTC m=+53.848190631"
Sep 10 19:55:11.052672 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:11.052639    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-metrics-certs\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:11.052672 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:11.052674    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d01e644-3fdb-48d6-91a4-b67b53b1a804-service-ca-bundle\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:11.052885 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:11.052804    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d01e644-3fdb-48d6-91a4-b67b53b1a804-service-ca-bundle podName:5d01e644-3fdb-48d6-91a4-b67b53b1a804 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:15.052791024 +0000 UTC m=+58.717895249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5d01e644-3fdb-48d6-91a4-b67b53b1a804-service-ca-bundle") pod "router-default-66dcf9c45b-792j7" (UID: "5d01e644-3fdb-48d6-91a4-b67b53b1a804") : configmap references non-existent config key: service-ca.crt
Sep 10 19:55:11.052885 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:11.052815    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 19:55:11.052885 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:11.052866    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-metrics-certs podName:5d01e644-3fdb-48d6-91a4-b67b53b1a804 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:15.052852929 +0000 UTC m=+58.717957159 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-metrics-certs") pod "router-default-66dcf9c45b-792j7" (UID: "5d01e644-3fdb-48d6-91a4-b67b53b1a804") : secret "router-metrics-certs-default" not found
Sep 10 19:55:11.812468 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:11.812437    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nhrt9"]
Sep 10 19:55:11.814320 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:11.814305    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:11.817119 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:11.817097    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qkwps\""
Sep 10 19:55:11.818023 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:11.818005    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 19:55:11.818122 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:11.818050    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 19:55:11.818122 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:11.818116    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 19:55:11.818251 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:11.818238    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 19:55:11.837382 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:11.837359    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nhrt9"]
Sep 10 19:55:11.960349 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:11.960319    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cb38969-93c6-40c9-acea-ba93e00d8485-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:11.960520 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:11.960374    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cb38969-93c6-40c9-acea-ba93e00d8485-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:11.960520 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:11.960406    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzn84\" (UniqueName: \"kubernetes.io/projected/4cb38969-93c6-40c9-acea-ba93e00d8485-kube-api-access-rzn84\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:11.960520 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:11.960499    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cb38969-93c6-40c9-acea-ba93e00d8485-data-volume\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:11.960650 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:11.960533    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cb38969-93c6-40c9-acea-ba93e00d8485-crio-socket\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:12.061955 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:12.061892    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cb38969-93c6-40c9-acea-ba93e00d8485-crio-socket\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:12.062116 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:12.062058    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cb38969-93c6-40c9-acea-ba93e00d8485-crio-socket\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:12.062202 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:12.062185    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cb38969-93c6-40c9-acea-ba93e00d8485-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:12.062304 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:12.062285    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cb38969-93c6-40c9-acea-ba93e00d8485-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:12.062367 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:12.062328    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzn84\" (UniqueName: \"kubernetes.io/projected/4cb38969-93c6-40c9-acea-ba93e00d8485-kube-api-access-rzn84\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:12.062464 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:12.062447    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cb38969-93c6-40c9-acea-ba93e00d8485-data-volume\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:12.062878 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:12.062823    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cb38969-93c6-40c9-acea-ba93e00d8485-data-volume\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:12.062973 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:12.062931    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 19:55:12.063035 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:12.063005    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4cb38969-93c6-40c9-acea-ba93e00d8485-kube-rbac-proxy-cm podName:4cb38969-93c6-40c9-acea-ba93e00d8485 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:12.562984699 +0000 UTC m=+56.228088938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4cb38969-93c6-40c9-acea-ba93e00d8485-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nhrt9" (UID: "4cb38969-93c6-40c9-acea-ba93e00d8485") : configmap "kube-rbac-proxy" not found
Sep 10 19:55:12.063134 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:12.063118    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 19:55:12.063192 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:12.063178    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb38969-93c6-40c9-acea-ba93e00d8485-insights-runtime-extractor-tls podName:4cb38969-93c6-40c9-acea-ba93e00d8485 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:12.563163156 +0000 UTC m=+56.228267386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4cb38969-93c6-40c9-acea-ba93e00d8485-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nhrt9" (UID: "4cb38969-93c6-40c9-acea-ba93e00d8485") : secret "insights-runtime-extractor-tls" not found
Sep 10 19:55:12.071447 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:12.071422    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzn84\" (UniqueName: \"kubernetes.io/projected/4cb38969-93c6-40c9-acea-ba93e00d8485-kube-api-access-rzn84\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:12.567628 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:12.567599    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cb38969-93c6-40c9-acea-ba93e00d8485-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:12.567782 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:12.567648    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cb38969-93c6-40c9-acea-ba93e00d8485-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:12.567782 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:12.567701    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 19:55:12.567782 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:12.567758    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4cb38969-93c6-40c9-acea-ba93e00d8485-kube-rbac-proxy-cm podName:4cb38969-93c6-40c9-acea-ba93e00d8485 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:13.567742814 +0000 UTC m=+57.232847039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4cb38969-93c6-40c9-acea-ba93e00d8485-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nhrt9" (UID: "4cb38969-93c6-40c9-acea-ba93e00d8485") : configmap "kube-rbac-proxy" not found
Sep 10 19:55:12.567782 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:12.567765    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 19:55:12.567954 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:12.567818    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb38969-93c6-40c9-acea-ba93e00d8485-insights-runtime-extractor-tls podName:4cb38969-93c6-40c9-acea-ba93e00d8485 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:13.567803424 +0000 UTC m=+57.232907651 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4cb38969-93c6-40c9-acea-ba93e00d8485-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nhrt9" (UID: "4cb38969-93c6-40c9-acea-ba93e00d8485") : secret "insights-runtime-extractor-tls" not found
Sep 10 19:55:13.574967 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:13.574931    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cb38969-93c6-40c9-acea-ba93e00d8485-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:13.575334 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:13.575032    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cb38969-93c6-40c9-acea-ba93e00d8485-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:13.575334 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:13.575095    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 19:55:13.575334 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:13.575108    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 19:55:13.575334 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:13.575161    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4cb38969-93c6-40c9-acea-ba93e00d8485-kube-rbac-proxy-cm podName:4cb38969-93c6-40c9-acea-ba93e00d8485 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:15.575147044 +0000 UTC m=+59.240251269 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4cb38969-93c6-40c9-acea-ba93e00d8485-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nhrt9" (UID: "4cb38969-93c6-40c9-acea-ba93e00d8485") : configmap "kube-rbac-proxy" not found
Sep 10 19:55:13.575334 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:13.575175    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb38969-93c6-40c9-acea-ba93e00d8485-insights-runtime-extractor-tls podName:4cb38969-93c6-40c9-acea-ba93e00d8485 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:15.575169191 +0000 UTC m=+59.240273415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4cb38969-93c6-40c9-acea-ba93e00d8485-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nhrt9" (UID: "4cb38969-93c6-40c9-acea-ba93e00d8485") : secret "insights-runtime-extractor-tls" not found
Sep 10 19:55:14.364202 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:14.364175    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lqn7b_b1686c34-4f9d-424e-9b3b-9daf34983519/dns-node-resolver/0.log"
Sep 10 19:55:14.498320 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:14.498292    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-899kg"]
Sep 10 19:55:14.529218 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:14.529197    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-899kg"]
Sep 10 19:55:14.529341 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:14.529279    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-899kg"
Sep 10 19:55:14.532218 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:14.532191    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 10 19:55:14.532218 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:14.532212    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 10 19:55:14.532405 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:14.532232    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 10 19:55:14.533323 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:14.533304    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 10 19:55:14.533323 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:14.533317    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-w557z\""
Sep 10 19:55:14.583605 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:14.583579    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9de32b55-4ac0-45b2-88dc-ced0e7a4f66d-signing-key\") pod \"service-ca-75d99c484-899kg\" (UID: \"9de32b55-4ac0-45b2-88dc-ced0e7a4f66d\") " pod="openshift-service-ca/service-ca-75d99c484-899kg"
Sep 10 19:55:14.583927 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:14.583667    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9de32b55-4ac0-45b2-88dc-ced0e7a4f66d-signing-cabundle\") pod \"service-ca-75d99c484-899kg\" (UID: \"9de32b55-4ac0-45b2-88dc-ced0e7a4f66d\") " pod="openshift-service-ca/service-ca-75d99c484-899kg"
Sep 10 19:55:14.583927 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:14.583735    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfjjn\" (UniqueName: \"kubernetes.io/projected/9de32b55-4ac0-45b2-88dc-ced0e7a4f66d-kube-api-access-nfjjn\") pod \"service-ca-75d99c484-899kg\" (UID: \"9de32b55-4ac0-45b2-88dc-ced0e7a4f66d\") " pod="openshift-service-ca/service-ca-75d99c484-899kg"
Sep 10 19:55:14.684175 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:14.684120    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfjjn\" (UniqueName: \"kubernetes.io/projected/9de32b55-4ac0-45b2-88dc-ced0e7a4f66d-kube-api-access-nfjjn\") pod \"service-ca-75d99c484-899kg\" (UID: \"9de32b55-4ac0-45b2-88dc-ced0e7a4f66d\") " pod="openshift-service-ca/service-ca-75d99c484-899kg"
Sep 10 19:55:14.684175 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:14.684165    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9de32b55-4ac0-45b2-88dc-ced0e7a4f66d-signing-key\") pod \"service-ca-75d99c484-899kg\" (UID: \"9de32b55-4ac0-45b2-88dc-ced0e7a4f66d\") " pod="openshift-service-ca/service-ca-75d99c484-899kg"
Sep 10 19:55:14.684329 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:14.684244    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9de32b55-4ac0-45b2-88dc-ced0e7a4f66d-signing-cabundle\") pod \"service-ca-75d99c484-899kg\" (UID: \"9de32b55-4ac0-45b2-88dc-ced0e7a4f66d\") " pod="openshift-service-ca/service-ca-75d99c484-899kg"
Sep 10 19:55:14.684822 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:14.684804    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9de32b55-4ac0-45b2-88dc-ced0e7a4f66d-signing-cabundle\") pod \"service-ca-75d99c484-899kg\" (UID: \"9de32b55-4ac0-45b2-88dc-ced0e7a4f66d\") " pod="openshift-service-ca/service-ca-75d99c484-899kg"
Sep 10 19:55:14.686539 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:14.686521    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9de32b55-4ac0-45b2-88dc-ced0e7a4f66d-signing-key\") pod \"service-ca-75d99c484-899kg\" (UID: \"9de32b55-4ac0-45b2-88dc-ced0e7a4f66d\") " pod="openshift-service-ca/service-ca-75d99c484-899kg"
Sep 10 19:55:14.691568 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:14.691548    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfjjn\" (UniqueName: \"kubernetes.io/projected/9de32b55-4ac0-45b2-88dc-ced0e7a4f66d-kube-api-access-nfjjn\") pod \"service-ca-75d99c484-899kg\" (UID: \"9de32b55-4ac0-45b2-88dc-ced0e7a4f66d\") " pod="openshift-service-ca/service-ca-75d99c484-899kg"
Sep 10 19:55:14.838283 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:14.838257    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-899kg"
Sep 10 19:55:15.087243 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:15.087212    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-metrics-certs\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:15.087472 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:15.087252    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d01e644-3fdb-48d6-91a4-b67b53b1a804-service-ca-bundle\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:15.087472 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:15.087381    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 19:55:15.087472 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:15.087410    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d01e644-3fdb-48d6-91a4-b67b53b1a804-service-ca-bundle podName:5d01e644-3fdb-48d6-91a4-b67b53b1a804 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:23.087373014 +0000 UTC m=+66.752477259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5d01e644-3fdb-48d6-91a4-b67b53b1a804-service-ca-bundle") pod "router-default-66dcf9c45b-792j7" (UID: "5d01e644-3fdb-48d6-91a4-b67b53b1a804") : configmap references non-existent config key: service-ca.crt
Sep 10 19:55:15.087581 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:15.087478    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-metrics-certs podName:5d01e644-3fdb-48d6-91a4-b67b53b1a804 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:23.087463753 +0000 UTC m=+66.752567995 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-metrics-certs") pod "router-default-66dcf9c45b-792j7" (UID: "5d01e644-3fdb-48d6-91a4-b67b53b1a804") : secret "router-metrics-certs-default" not found
Sep 10 19:55:15.122907 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:15.122880    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-899kg"]
Sep 10 19:55:15.125515 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:55:15.125487    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9de32b55_4ac0_45b2_88dc_ced0e7a4f66d.slice/crio-6c13c28867160ce05aceb8bfc05982f670d3164c3bc0b6424962de4748bcb39b WatchSource:0}: Error finding container 6c13c28867160ce05aceb8bfc05982f670d3164c3bc0b6424962de4748bcb39b: Status 404 returned error can't find the container with id 6c13c28867160ce05aceb8bfc05982f670d3164c3bc0b6424962de4748bcb39b
Sep 10 19:55:15.177296 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:15.177268    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-899kg" event={"ID":"9de32b55-4ac0-45b2-88dc-ced0e7a4f66d","Type":"ContainerStarted","Data":"6c13c28867160ce05aceb8bfc05982f670d3164c3bc0b6424962de4748bcb39b"}
Sep 10 19:55:15.589484 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:15.589455    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cb38969-93c6-40c9-acea-ba93e00d8485-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:15.589898 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:15.589507    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cb38969-93c6-40c9-acea-ba93e00d8485-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:15.589898 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:15.589594    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 19:55:15.589898 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:15.589685    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4cb38969-93c6-40c9-acea-ba93e00d8485-kube-rbac-proxy-cm podName:4cb38969-93c6-40c9-acea-ba93e00d8485 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:19.589662926 +0000 UTC m=+63.254767160 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4cb38969-93c6-40c9-acea-ba93e00d8485-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nhrt9" (UID: "4cb38969-93c6-40c9-acea-ba93e00d8485") : configmap "kube-rbac-proxy" not found
Sep 10 19:55:15.589898 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:15.589598    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 19:55:15.589898 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:15.589728    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb38969-93c6-40c9-acea-ba93e00d8485-insights-runtime-extractor-tls podName:4cb38969-93c6-40c9-acea-ba93e00d8485 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:19.589717138 +0000 UTC m=+63.254821391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4cb38969-93c6-40c9-acea-ba93e00d8485-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nhrt9" (UID: "4cb38969-93c6-40c9-acea-ba93e00d8485") : secret "insights-runtime-extractor-tls" not found
Sep 10 19:55:15.764591 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:15.764562    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vrgkq_ee70731d-0545-406f-bc04-c0589d986e18/node-ca/0.log"
Sep 10 19:55:16.364922 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:16.364889    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-srpmn_0992094b-05c3-47cf-977f-bbcbfa0f813d/serve-healthcheck-canary/0.log"
Sep 10 19:55:17.109137 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:17.109113    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76gvf"
Sep 10 19:55:17.164756 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:17.164705    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-bf98q_253acc31-66e4-4ec2-8dc3-445ffc402492/kube-storage-version-migrator-operator/0.log"
Sep 10 19:55:17.183041 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:17.183008    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-899kg" event={"ID":"9de32b55-4ac0-45b2-88dc-ced0e7a4f66d","Type":"ContainerStarted","Data":"89290b83f747498ece7c80be9dbab3e2e854c5bb56761c49d8b36abc52e8bd8c"}
Sep 10 19:55:17.201281 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:17.201235    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-899kg" podStartSLOduration=1.309958703 podStartE2EDuration="3.201220797s" totalImagesPullingTime="1.891262094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:55:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:55:17.2007245 +0000 UTC m=+60.865828747" watchObservedRunningTime="2026-09-10 19:55:17.201220797 +0000 UTC m=+60.866325043"
Sep 10 19:55:19.629319 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:19.629282    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cb38969-93c6-40c9-acea-ba93e00d8485-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:19.629859 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:19.629410    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cb38969-93c6-40c9-acea-ba93e00d8485-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:19.629859 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:19.629461    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 19:55:19.629859 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:19.629513    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 19:55:19.629859 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:19.629538    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb38969-93c6-40c9-acea-ba93e00d8485-insights-runtime-extractor-tls podName:4cb38969-93c6-40c9-acea-ba93e00d8485 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:27.629519883 +0000 UTC m=+71.294624109 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4cb38969-93c6-40c9-acea-ba93e00d8485-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nhrt9" (UID: "4cb38969-93c6-40c9-acea-ba93e00d8485") : secret "insights-runtime-extractor-tls" not found
Sep 10 19:55:19.629859 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:19.629565    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4cb38969-93c6-40c9-acea-ba93e00d8485-kube-rbac-proxy-cm podName:4cb38969-93c6-40c9-acea-ba93e00d8485 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:27.629548181 +0000 UTC m=+71.294652423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4cb38969-93c6-40c9-acea-ba93e00d8485-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nhrt9" (UID: "4cb38969-93c6-40c9-acea-ba93e00d8485") : configmap "kube-rbac-proxy" not found
Sep 10 19:55:21.546530 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:21.546500    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c63240bf-c37d-4515-83ce-231154951432-metrics-tls\") pod \"dns-default-zln5l\" (UID: \"c63240bf-c37d-4515-83ce-231154951432\") " pod="openshift-dns/dns-default-zln5l"
Sep 10 19:55:21.546916 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:21.546563    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs\") pod \"network-metrics-daemon-mxnhw\" (UID: \"26ab4b64-59b6-42cb-b55d-ce41cecd0e85\") " pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:55:21.548779 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:21.548756    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c63240bf-c37d-4515-83ce-231154951432-metrics-tls\") pod \"dns-default-zln5l\" (UID: \"c63240bf-c37d-4515-83ce-231154951432\") " pod="openshift-dns/dns-default-zln5l"
Sep 10 19:55:21.549142 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:21.549126    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 19:55:21.557205 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:21.557186    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 10 19:55:21.557290 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:21.557241    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs podName:26ab4b64-59b6-42cb-b55d-ce41cecd0e85 nodeName:}" failed. No retries permitted until 2026-09-10 19:56:25.557228076 +0000 UTC m=+129.222332301 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs") pod "network-metrics-daemon-mxnhw" (UID: "26ab4b64-59b6-42cb-b55d-ce41cecd0e85") : secret "metrics-daemon-secret" not found
Sep 10 19:55:21.646859 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:21.646838    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret\") pod \"global-pull-secret-syncer-klxsb\" (UID: \"91e2acc4-0716-4fcb-95ee-32d1668449e7\") " pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:55:21.646966 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:21.646929    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blxj7\" (UniqueName: \"kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7\") pod \"network-check-target-9j5tj\" (UID: \"b27c6a7e-d576-44de-9d2b-ac8b51b69bc7\") " pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:55:21.649321 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:21.649291    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 19:55:21.649407 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:21.649364    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 19:55:21.659501 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:21.659476    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91e2acc4-0716-4fcb-95ee-32d1668449e7-original-pull-secret\") pod \"global-pull-secret-syncer-klxsb\" (UID: \"91e2acc4-0716-4fcb-95ee-32d1668449e7\") " pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:55:21.659611 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:21.659597    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 19:55:21.669510 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:21.669494    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blxj7\" (UniqueName: \"kubernetes.io/projected/b27c6a7e-d576-44de-9d2b-ac8b51b69bc7-kube-api-access-blxj7\") pod \"network-check-target-9j5tj\" (UID: \"b27c6a7e-d576-44de-9d2b-ac8b51b69bc7\") " pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:55:21.760343 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:21.760316    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mcqxm\""
Sep 10 19:55:21.767319 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:21.767295    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klxsb"
Sep 10 19:55:21.768679 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:21.768662    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:55:21.786512 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:21.786487    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ngfwp\""
Sep 10 19:55:21.794465 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:21.794444    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zln5l"
Sep 10 19:55:22.069252 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:22.069227    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-klxsb"]
Sep 10 19:55:22.071594 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:55:22.071565    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e2acc4_0716_4fcb_95ee_32d1668449e7.slice/crio-d6efb16dad7f1cdcbacc80787a12f4ffee421e9d6d9a7846fc7ee085ec15e718 WatchSource:0}: Error finding container d6efb16dad7f1cdcbacc80787a12f4ffee421e9d6d9a7846fc7ee085ec15e718: Status 404 returned error can't find the container with id d6efb16dad7f1cdcbacc80787a12f4ffee421e9d6d9a7846fc7ee085ec15e718
Sep 10 19:55:22.093314 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:22.093291    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9j5tj"]
Sep 10 19:55:22.096174 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:55:22.096148    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb27c6a7e_d576_44de_9d2b_ac8b51b69bc7.slice/crio-29846913630d015c23fa9622f71f081f2520af23f9c503bd6668ad87046795c3 WatchSource:0}: Error finding container 29846913630d015c23fa9622f71f081f2520af23f9c503bd6668ad87046795c3: Status 404 returned error can't find the container with id 29846913630d015c23fa9622f71f081f2520af23f9c503bd6668ad87046795c3
Sep 10 19:55:22.126294 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:22.126268    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zln5l"]
Sep 10 19:55:22.128860 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:55:22.128833    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc63240bf_c37d_4515_83ce_231154951432.slice/crio-8e541f4d939a524addd571c520a30073b81aa49403cac2591da4338c5c1c8c7d WatchSource:0}: Error finding container 8e541f4d939a524addd571c520a30073b81aa49403cac2591da4338c5c1c8c7d: Status 404 returned error can't find the container with id 8e541f4d939a524addd571c520a30073b81aa49403cac2591da4338c5c1c8c7d
Sep 10 19:55:22.195796 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:22.195766    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-klxsb" event={"ID":"91e2acc4-0716-4fcb-95ee-32d1668449e7","Type":"ContainerStarted","Data":"d6efb16dad7f1cdcbacc80787a12f4ffee421e9d6d9a7846fc7ee085ec15e718"}
Sep 10 19:55:22.196863 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:22.196837    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zln5l" event={"ID":"c63240bf-c37d-4515-83ce-231154951432","Type":"ContainerStarted","Data":"8e541f4d939a524addd571c520a30073b81aa49403cac2591da4338c5c1c8c7d"}
Sep 10 19:55:22.197887 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:22.197866    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9j5tj" event={"ID":"b27c6a7e-d576-44de-9d2b-ac8b51b69bc7","Type":"ContainerStarted","Data":"29846913630d015c23fa9622f71f081f2520af23f9c503bd6668ad87046795c3"}
Sep 10 19:55:23.161718 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:23.161678    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-metrics-certs\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:23.162161 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:23.161734    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d01e644-3fdb-48d6-91a4-b67b53b1a804-service-ca-bundle\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:23.162161 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:23.161964    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d01e644-3fdb-48d6-91a4-b67b53b1a804-service-ca-bundle podName:5d01e644-3fdb-48d6-91a4-b67b53b1a804 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:39.161944772 +0000 UTC m=+82.827049011 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5d01e644-3fdb-48d6-91a4-b67b53b1a804-service-ca-bundle") pod "router-default-66dcf9c45b-792j7" (UID: "5d01e644-3fdb-48d6-91a4-b67b53b1a804") : configmap references non-existent config key: service-ca.crt
Sep 10 19:55:23.164890 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:23.164869    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d01e644-3fdb-48d6-91a4-b67b53b1a804-metrics-certs\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:25.209086 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:25.209052    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zln5l" event={"ID":"c63240bf-c37d-4515-83ce-231154951432","Type":"ContainerStarted","Data":"6897aa64f406b8105bfcf4221d340750f63b71e3b9d798be49d5cf28a0cc1d8e"}
Sep 10 19:55:27.216946 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:27.216908    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zln5l" event={"ID":"c63240bf-c37d-4515-83ce-231154951432","Type":"ContainerStarted","Data":"05fb3f57482a6352ed847df6eef6750822041dbff65f7749b81a19e6c413340d"}
Sep 10 19:55:27.217372 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:27.217135    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zln5l"
Sep 10 19:55:27.218969 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:27.218934    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9j5tj" event={"ID":"b27c6a7e-d576-44de-9d2b-ac8b51b69bc7","Type":"ContainerStarted","Data":"834264902d4092224f793d6cdd96fa13b28cae34462d6edff8d027d2a6e3c232"}
Sep 10 19:55:27.219106 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:27.218993    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:55:27.220712 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:27.220649    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-klxsb" event={"ID":"91e2acc4-0716-4fcb-95ee-32d1668449e7","Type":"ContainerStarted","Data":"cede1482ae442d76ad890ceda8d7ce8d57ba9e314e8d7c421d613a9a59001566"}
Sep 10 19:55:27.235323 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:27.235266    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zln5l" podStartSLOduration=35.981884999 podStartE2EDuration="38.235249655s" totalImagesPullingTime="2.253364656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:55:27.233702832 +0000 UTC m=+70.898807081" watchObservedRunningTime="2026-09-10 19:55:27.235249655 +0000 UTC m=+70.900353904"
Sep 10 19:55:27.250632 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:27.250579    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9j5tj" podStartSLOduration=66.313263427 podStartE2EDuration="1m11.250562448s" totalImagesPullingTime="4.937299021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:55:27.249237702 +0000 UTC m=+70.914341948" watchObservedRunningTime="2026-09-10 19:55:27.250562448 +0000 UTC m=+70.915666695"
Sep 10 19:55:27.266010 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:27.265941    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-klxsb" podStartSLOduration=65.298527262 podStartE2EDuration="1m10.26592749s" totalImagesPullingTime="4.967400228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:54:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:55:27.265483116 +0000 UTC m=+70.930587380" watchObservedRunningTime="2026-09-10 19:55:27.26592749 +0000 UTC m=+70.931031736"
Sep 10 19:55:27.697767 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:27.697733    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cb38969-93c6-40c9-acea-ba93e00d8485-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:27.697944 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:27.697788    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cb38969-93c6-40c9-acea-ba93e00d8485-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:27.697944 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:27.697894    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 19:55:27.698055 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:55:27.697963    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb38969-93c6-40c9-acea-ba93e00d8485-insights-runtime-extractor-tls podName:4cb38969-93c6-40c9-acea-ba93e00d8485 nodeName:}" failed. No retries permitted until 2026-09-10 19:55:43.697942597 +0000 UTC m=+87.363046823 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4cb38969-93c6-40c9-acea-ba93e00d8485-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nhrt9" (UID: "4cb38969-93c6-40c9-acea-ba93e00d8485") : secret "insights-runtime-extractor-tls" not found
Sep 10 19:55:27.698241 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:27.698217    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cb38969-93c6-40c9-acea-ba93e00d8485-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:34.226528 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:34.226499    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zln5l"
Sep 10 19:55:37.652023 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.651993    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h"]
Sep 10 19:55:37.656352 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.656321    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h"
Sep 10 19:55:37.664001 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.663982    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 10 19:55:37.666307 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.666288    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 19:55:37.666431 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.666359    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 19:55:37.666431 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.666423    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 10 19:55:37.667165 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.667152    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 19:55:37.667372 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.667357    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 10 19:55:37.667372 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.667368    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 10 19:55:37.678036 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.678000    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h"]
Sep 10 19:55:37.767639 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.767605    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b108e423-5798-4368-9c06-cef6dff50f04-hub\") pod \"cluster-proxy-proxy-agent-644f6d5d9c-rfh2h\" (UID: \"b108e423-5798-4368-9c06-cef6dff50f04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h"
Sep 10 19:55:37.767639 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.767636    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b108e423-5798-4368-9c06-cef6dff50f04-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-644f6d5d9c-rfh2h\" (UID: \"b108e423-5798-4368-9c06-cef6dff50f04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h"
Sep 10 19:55:37.767836 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.767654    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fflk\" (UniqueName: \"kubernetes.io/projected/b108e423-5798-4368-9c06-cef6dff50f04-kube-api-access-6fflk\") pod \"cluster-proxy-proxy-agent-644f6d5d9c-rfh2h\" (UID: \"b108e423-5798-4368-9c06-cef6dff50f04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h"
Sep 10 19:55:37.767836 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.767683    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b108e423-5798-4368-9c06-cef6dff50f04-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-644f6d5d9c-rfh2h\" (UID: \"b108e423-5798-4368-9c06-cef6dff50f04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h"
Sep 10 19:55:37.767836 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.767742    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b108e423-5798-4368-9c06-cef6dff50f04-ca\") pod \"cluster-proxy-proxy-agent-644f6d5d9c-rfh2h\" (UID: \"b108e423-5798-4368-9c06-cef6dff50f04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h"
Sep 10 19:55:37.767836 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.767802    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b108e423-5798-4368-9c06-cef6dff50f04-additional-service-ca\") pod \"cluster-proxy-proxy-agent-644f6d5d9c-rfh2h\" (UID: \"b108e423-5798-4368-9c06-cef6dff50f04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h"
Sep 10 19:55:37.868574 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.868544    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b108e423-5798-4368-9c06-cef6dff50f04-ca\") pod \"cluster-proxy-proxy-agent-644f6d5d9c-rfh2h\" (UID: \"b108e423-5798-4368-9c06-cef6dff50f04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h"
Sep 10 19:55:37.868730 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.868610    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b108e423-5798-4368-9c06-cef6dff50f04-additional-service-ca\") pod \"cluster-proxy-proxy-agent-644f6d5d9c-rfh2h\" (UID: \"b108e423-5798-4368-9c06-cef6dff50f04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h"
Sep 10 19:55:37.868730 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.868677    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b108e423-5798-4368-9c06-cef6dff50f04-hub\") pod \"cluster-proxy-proxy-agent-644f6d5d9c-rfh2h\" (UID: \"b108e423-5798-4368-9c06-cef6dff50f04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h"
Sep 10 19:55:37.868811 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.868724    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b108e423-5798-4368-9c06-cef6dff50f04-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-644f6d5d9c-rfh2h\" (UID: \"b108e423-5798-4368-9c06-cef6dff50f04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h"
Sep 10 19:55:37.868811 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.868751    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fflk\" (UniqueName: \"kubernetes.io/projected/b108e423-5798-4368-9c06-cef6dff50f04-kube-api-access-6fflk\") pod \"cluster-proxy-proxy-agent-644f6d5d9c-rfh2h\" (UID: \"b108e423-5798-4368-9c06-cef6dff50f04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h"
Sep 10 19:55:37.868811 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.868780    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b108e423-5798-4368-9c06-cef6dff50f04-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-644f6d5d9c-rfh2h\" (UID: \"b108e423-5798-4368-9c06-cef6dff50f04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h"
Sep 10 19:55:37.869507 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.869483    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b108e423-5798-4368-9c06-cef6dff50f04-additional-service-ca\") pod \"cluster-proxy-proxy-agent-644f6d5d9c-rfh2h\" (UID: \"b108e423-5798-4368-9c06-cef6dff50f04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h"
Sep 10 19:55:37.871094 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.871070    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b108e423-5798-4368-9c06-cef6dff50f04-ca\") pod \"cluster-proxy-proxy-agent-644f6d5d9c-rfh2h\" (UID: \"b108e423-5798-4368-9c06-cef6dff50f04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h"
Sep 10 19:55:37.871185 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.871108    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b108e423-5798-4368-9c06-cef6dff50f04-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-644f6d5d9c-rfh2h\" (UID: \"b108e423-5798-4368-9c06-cef6dff50f04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h"
Sep 10 19:55:37.871371 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.871355    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b108e423-5798-4368-9c06-cef6dff50f04-hub\") pod \"cluster-proxy-proxy-agent-644f6d5d9c-rfh2h\" (UID: \"b108e423-5798-4368-9c06-cef6dff50f04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h"
Sep 10 19:55:37.871491 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.871476    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b108e423-5798-4368-9c06-cef6dff50f04-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-644f6d5d9c-rfh2h\" (UID: \"b108e423-5798-4368-9c06-cef6dff50f04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h"
Sep 10 19:55:37.878109 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.878089    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fflk\" (UniqueName: \"kubernetes.io/projected/b108e423-5798-4368-9c06-cef6dff50f04-kube-api-access-6fflk\") pod \"cluster-proxy-proxy-agent-644f6d5d9c-rfh2h\" (UID: \"b108e423-5798-4368-9c06-cef6dff50f04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h"
Sep 10 19:55:37.973834 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:37.973765    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h"
Sep 10 19:55:38.253623 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:38.253553    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h"]
Sep 10 19:55:38.256508 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:55:38.256484    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb108e423_5798_4368_9c06_cef6dff50f04.slice/crio-8b8ec7eb1c994c2a4774e42e9300fee1cecf9329bbdc6adea2e0f999d11f39cc WatchSource:0}: Error finding container 8b8ec7eb1c994c2a4774e42e9300fee1cecf9329bbdc6adea2e0f999d11f39cc: Status 404 returned error can't find the container with id 8b8ec7eb1c994c2a4774e42e9300fee1cecf9329bbdc6adea2e0f999d11f39cc
Sep 10 19:55:39.180137 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:39.180091    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d01e644-3fdb-48d6-91a4-b67b53b1a804-service-ca-bundle\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:39.180953 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:39.180928    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d01e644-3fdb-48d6-91a4-b67b53b1a804-service-ca-bundle\") pod \"router-default-66dcf9c45b-792j7\" (UID: \"5d01e644-3fdb-48d6-91a4-b67b53b1a804\") " pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:39.259381 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:39.259345    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h" event={"ID":"b108e423-5798-4368-9c06-cef6dff50f04","Type":"ContainerStarted","Data":"8b8ec7eb1c994c2a4774e42e9300fee1cecf9329bbdc6adea2e0f999d11f39cc"}
Sep 10 19:55:39.390274 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:39.390138    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gmk4g\""
Sep 10 19:55:39.396880 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:39.396832    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:39.684561 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:39.684496    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-66dcf9c45b-792j7"]
Sep 10 19:55:39.688529 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:55:39.688474    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d01e644_3fdb_48d6_91a4_b67b53b1a804.slice/crio-8b9f772662bb65be075835490af575bcb445336c8000123306659e679345e772 WatchSource:0}: Error finding container 8b9f772662bb65be075835490af575bcb445336c8000123306659e679345e772: Status 404 returned error can't find the container with id 8b9f772662bb65be075835490af575bcb445336c8000123306659e679345e772
Sep 10 19:55:40.265516 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:40.265417    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-66dcf9c45b-792j7" event={"ID":"5d01e644-3fdb-48d6-91a4-b67b53b1a804","Type":"ContainerStarted","Data":"086b392b03d3925884c6340413bf7e3d1382b7a54114898d87346b8cb2c70403"}
Sep 10 19:55:40.265516 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:40.265477    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-66dcf9c45b-792j7" event={"ID":"5d01e644-3fdb-48d6-91a4-b67b53b1a804","Type":"ContainerStarted","Data":"8b9f772662bb65be075835490af575bcb445336c8000123306659e679345e772"}
Sep 10 19:55:40.290088 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:40.290037    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-66dcf9c45b-792j7" podStartSLOduration=33.290016711 podStartE2EDuration="33.290016711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:55:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:55:40.289089164 +0000 UTC m=+83.954193412" watchObservedRunningTime="2026-09-10 19:55:40.290016711 +0000 UTC m=+83.955120960"
Sep 10 19:55:40.397768 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:40.397703    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:40.400537 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:40.400512    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:41.268569 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:41.268538    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:41.269866 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:41.269844    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-66dcf9c45b-792j7"
Sep 10 19:55:42.276315 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:42.276265    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h" event={"ID":"b108e423-5798-4368-9c06-cef6dff50f04","Type":"ContainerStarted","Data":"6f87f4cf1651082f8023816f152be02b7e48d32905f0bf1c84a223ed9a45e0e0"}
Sep 10 19:55:42.276693 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:42.276348    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h" event={"ID":"b108e423-5798-4368-9c06-cef6dff50f04","Type":"ContainerStarted","Data":"f349d0466db9a4a587afa2e0817e0ba4f6d5fe6660bd21e4c838b593b38caad3"}
Sep 10 19:55:43.281088 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:43.281050    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h" event={"ID":"b108e423-5798-4368-9c06-cef6dff50f04","Type":"ContainerStarted","Data":"122ff9478ef8446751fbd83a054096a639099ee4a057572b02d438b6d27be3ad"}
Sep 10 19:55:43.302894 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:43.302844    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644f6d5d9c-rfh2h" podStartSLOduration=2.434424179 podStartE2EDuration="6.302830565s" totalImagesPullingTime="3.868406386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:55:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:55:43.301447221 +0000 UTC m=+86.966551470" watchObservedRunningTime="2026-09-10 19:55:43.302830565 +0000 UTC m=+86.967934811"
Sep 10 19:55:43.717866 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:43.717825    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cb38969-93c6-40c9-acea-ba93e00d8485-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:43.720079 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:43.720055    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cb38969-93c6-40c9-acea-ba93e00d8485-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhrt9\" (UID: \"4cb38969-93c6-40c9-acea-ba93e00d8485\") " pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:43.925341 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:43.925309    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qkwps\""
Sep 10 19:55:43.933349 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:43.933325    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nhrt9"
Sep 10 19:55:44.204344 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:44.204310    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nhrt9"]
Sep 10 19:55:44.207203 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:55:44.207182    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cb38969_93c6_40c9_acea_ba93e00d8485.slice/crio-87e65d29436d33f2a13537f60078ab348f5e52222d01c1ff9b3d9ba65bd9a8cb WatchSource:0}: Error finding container 87e65d29436d33f2a13537f60078ab348f5e52222d01c1ff9b3d9ba65bd9a8cb: Status 404 returned error can't find the container with id 87e65d29436d33f2a13537f60078ab348f5e52222d01c1ff9b3d9ba65bd9a8cb
Sep 10 19:55:44.285133 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:44.285105    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nhrt9" event={"ID":"4cb38969-93c6-40c9-acea-ba93e00d8485","Type":"ContainerStarted","Data":"99fc17961269f4caa90f1c251e2256b9124d247ad0a3a2f569afb0ae580c63c6"}
Sep 10 19:55:44.285423 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:44.285169    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nhrt9" event={"ID":"4cb38969-93c6-40c9-acea-ba93e00d8485","Type":"ContainerStarted","Data":"87e65d29436d33f2a13537f60078ab348f5e52222d01c1ff9b3d9ba65bd9a8cb"}
Sep 10 19:55:45.290617 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:45.290536    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nhrt9" event={"ID":"4cb38969-93c6-40c9-acea-ba93e00d8485","Type":"ContainerStarted","Data":"11be1c6d2fefa4c6cd41f27b8789c2953e6624a712b6e6f376b8f543253fb524"}
Sep 10 19:55:46.296220 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:46.296178    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nhrt9" event={"ID":"4cb38969-93c6-40c9-acea-ba93e00d8485","Type":"ContainerStarted","Data":"6a05c459317733fa49fcbcc8cfb27ae2808d583a1a11b22639ef6330063740b6"}
Sep 10 19:55:46.315151 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:46.315110    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nhrt9" podStartSLOduration=33.538548849 podStartE2EDuration="35.315095865s" totalImagesPullingTime="1.776547016s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:55:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:55:46.314099744 +0000 UTC m=+89.979204010" watchObservedRunningTime="2026-09-10 19:55:46.315095865 +0000 UTC m=+89.980200111"
Sep 10 19:55:51.352574 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.352541    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-q5blr"]
Sep 10 19:55:51.357846 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.357815    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.360980 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.360955    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 19:55:51.361144 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.361055    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 19:55:51.361232 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.361170    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-d8qrq\""
Sep 10 19:55:51.362010 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.361993    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 19:55:51.362131 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.362115    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 19:55:51.362407 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.362376    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 19:55:51.362471 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.362462    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 19:55:51.472716 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.472680    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ac5e386-7d56-4201-8f44-6e605d6ba083-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.472716 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.472721    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ac5e386-7d56-4201-8f44-6e605d6ba083-node-exporter-tls\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.472908 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.472741    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ac5e386-7d56-4201-8f44-6e605d6ba083-node-exporter-textfile\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.472908 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.472758    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ac5e386-7d56-4201-8f44-6e605d6ba083-node-exporter-wtmp\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.472908 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.472844    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ac5e386-7d56-4201-8f44-6e605d6ba083-sys\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.472908 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.472859    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ac5e386-7d56-4201-8f44-6e605d6ba083-node-exporter-accelerators-collector-config\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.472908 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.472886    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ac5e386-7d56-4201-8f44-6e605d6ba083-root\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.472908 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.472902    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt5hp\" (UniqueName: \"kubernetes.io/projected/7ac5e386-7d56-4201-8f44-6e605d6ba083-kube-api-access-wt5hp\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.473109 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.472927    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ac5e386-7d56-4201-8f44-6e605d6ba083-metrics-client-ca\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.573456 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.573430    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ac5e386-7d56-4201-8f44-6e605d6ba083-sys\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.573627 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.573463    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ac5e386-7d56-4201-8f44-6e605d6ba083-node-exporter-accelerators-collector-config\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.573627 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.573508    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ac5e386-7d56-4201-8f44-6e605d6ba083-root\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.573627 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.573536    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt5hp\" (UniqueName: \"kubernetes.io/projected/7ac5e386-7d56-4201-8f44-6e605d6ba083-kube-api-access-wt5hp\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.573627 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.573560    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ac5e386-7d56-4201-8f44-6e605d6ba083-sys\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.573627 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.573579    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ac5e386-7d56-4201-8f44-6e605d6ba083-metrics-client-ca\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.573884 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.573645    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ac5e386-7d56-4201-8f44-6e605d6ba083-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.573884 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.573681    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ac5e386-7d56-4201-8f44-6e605d6ba083-node-exporter-tls\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.573884 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.573712    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ac5e386-7d56-4201-8f44-6e605d6ba083-node-exporter-textfile\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.573884 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.573737    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ac5e386-7d56-4201-8f44-6e605d6ba083-node-exporter-wtmp\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.574066 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.573937    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ac5e386-7d56-4201-8f44-6e605d6ba083-node-exporter-wtmp\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.574177 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.574154    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ac5e386-7d56-4201-8f44-6e605d6ba083-metrics-client-ca\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.574260 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.574154    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ac5e386-7d56-4201-8f44-6e605d6ba083-node-exporter-accelerators-collector-config\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.574260 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.574236    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ac5e386-7d56-4201-8f44-6e605d6ba083-root\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.574538 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.574513    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ac5e386-7d56-4201-8f44-6e605d6ba083-node-exporter-textfile\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.576730 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.576706    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ac5e386-7d56-4201-8f44-6e605d6ba083-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.576836 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.576816    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ac5e386-7d56-4201-8f44-6e605d6ba083-node-exporter-tls\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.585097 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.585075    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt5hp\" (UniqueName: \"kubernetes.io/projected/7ac5e386-7d56-4201-8f44-6e605d6ba083-kube-api-access-wt5hp\") pod \"node-exporter-q5blr\" (UID: \"7ac5e386-7d56-4201-8f44-6e605d6ba083\") " pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.614269 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.614215    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-964665f95-2r9x6"]
Sep 10 19:55:51.618519 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.618501    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:55:51.620749 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.620731    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-t4bpf\""
Sep 10 19:55:51.620856 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.620833    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 19:55:51.621193 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.621048    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 19:55:51.621193 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.621111    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 19:55:51.621193 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.621112    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 19:55:51.621420 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.621204    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 19:55:51.621472 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.621459    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 19:55:51.621576 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.621560    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 19:55:51.627173 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.627149    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 19:55:51.628060 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.628041    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-964665f95-2r9x6"]
Sep 10 19:55:51.670513 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.670490    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q5blr"
Sep 10 19:55:51.681421 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:55:51.681375    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ac5e386_7d56_4201_8f44_6e605d6ba083.slice/crio-c48e0172190542ddfe0311edce18e7bb558dc7a98cfa28d8a481c7fe23eaf410 WatchSource:0}: Error finding container c48e0172190542ddfe0311edce18e7bb558dc7a98cfa28d8a481c7fe23eaf410: Status 404 returned error can't find the container with id c48e0172190542ddfe0311edce18e7bb558dc7a98cfa28d8a481c7fe23eaf410
Sep 10 19:55:51.775787 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.775760    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-console-config\") pod \"console-964665f95-2r9x6\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") " pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:55:51.775983 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.775794    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlptm\" (UniqueName: \"kubernetes.io/projected/7457045c-86f2-4918-a5db-b8fdc7053dc8-kube-api-access-vlptm\") pod \"console-964665f95-2r9x6\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") " pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:55:51.775983 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.775811    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7457045c-86f2-4918-a5db-b8fdc7053dc8-console-serving-cert\") pod \"console-964665f95-2r9x6\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") " pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:55:51.775983 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.775875    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-oauth-serving-cert\") pod \"console-964665f95-2r9x6\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") " pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:55:51.775983 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.775968    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-service-ca\") pod \"console-964665f95-2r9x6\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") " pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:55:51.776140 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.776012    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7457045c-86f2-4918-a5db-b8fdc7053dc8-console-oauth-config\") pod \"console-964665f95-2r9x6\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") " pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:55:51.776140 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.776045    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-trusted-ca-bundle\") pod \"console-964665f95-2r9x6\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") " pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:55:51.877228 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.877131    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-console-config\") pod \"console-964665f95-2r9x6\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") " pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:55:51.877228 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.877175    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlptm\" (UniqueName: \"kubernetes.io/projected/7457045c-86f2-4918-a5db-b8fdc7053dc8-kube-api-access-vlptm\") pod \"console-964665f95-2r9x6\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") " pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:55:51.877228 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.877194    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7457045c-86f2-4918-a5db-b8fdc7053dc8-console-serving-cert\") pod \"console-964665f95-2r9x6\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") " pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:55:51.877228 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.877220    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-oauth-serving-cert\") pod \"console-964665f95-2r9x6\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") " pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:55:51.877599 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.877266    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-service-ca\") pod \"console-964665f95-2r9x6\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") " pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:55:51.877599 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.877294    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7457045c-86f2-4918-a5db-b8fdc7053dc8-console-oauth-config\") pod \"console-964665f95-2r9x6\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") " pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:55:51.877599 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.877323    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-trusted-ca-bundle\") pod \"console-964665f95-2r9x6\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") " pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:55:51.878069 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.877985    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-console-config\") pod \"console-964665f95-2r9x6\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") " pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:55:51.878162 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.878102    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-service-ca\") pod \"console-964665f95-2r9x6\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") " pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:55:51.878162 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.878112    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-oauth-serving-cert\") pod \"console-964665f95-2r9x6\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") " pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:55:51.878270 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.878183    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-trusted-ca-bundle\") pod \"console-964665f95-2r9x6\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") " pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:55:51.879891 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.879868    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7457045c-86f2-4918-a5db-b8fdc7053dc8-console-oauth-config\") pod \"console-964665f95-2r9x6\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") " pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:55:51.879999 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.879984    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7457045c-86f2-4918-a5db-b8fdc7053dc8-console-serving-cert\") pod \"console-964665f95-2r9x6\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") " pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:55:51.888490 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.888468    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlptm\" (UniqueName: \"kubernetes.io/projected/7457045c-86f2-4918-a5db-b8fdc7053dc8-kube-api-access-vlptm\") pod \"console-964665f95-2r9x6\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") " pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:55:51.930229 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:51.930202    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:55:52.200966 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:52.200891    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-964665f95-2r9x6"]
Sep 10 19:55:52.203718 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:55:52.203691    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7457045c_86f2_4918_a5db_b8fdc7053dc8.slice/crio-f3ef609123d86abbf19f241c3aa568011bee432055b564ede071dc87751765a7 WatchSource:0}: Error finding container f3ef609123d86abbf19f241c3aa568011bee432055b564ede071dc87751765a7: Status 404 returned error can't find the container with id f3ef609123d86abbf19f241c3aa568011bee432055b564ede071dc87751765a7
Sep 10 19:55:52.318558 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:52.318527    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-964665f95-2r9x6" event={"ID":"7457045c-86f2-4918-a5db-b8fdc7053dc8","Type":"ContainerStarted","Data":"f3ef609123d86abbf19f241c3aa568011bee432055b564ede071dc87751765a7"}
Sep 10 19:55:52.320038 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:52.320007    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q5blr" event={"ID":"7ac5e386-7d56-4201-8f44-6e605d6ba083","Type":"ContainerStarted","Data":"c48e0172190542ddfe0311edce18e7bb558dc7a98cfa28d8a481c7fe23eaf410"}
Sep 10 19:55:53.325679 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:53.325646    2561 generic.go:356] "Generic (PLEG): container finished" podID="7ac5e386-7d56-4201-8f44-6e605d6ba083" containerID="9a0df9861538827232b2e4b83dbf0a9814fb967cffcd9ed45a4e861f90bdcfa4" exitCode=0
Sep 10 19:55:53.326109 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:53.325701    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q5blr" event={"ID":"7ac5e386-7d56-4201-8f44-6e605d6ba083","Type":"ContainerDied","Data":"9a0df9861538827232b2e4b83dbf0a9814fb967cffcd9ed45a4e861f90bdcfa4"}
Sep 10 19:55:54.332551 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:54.332515    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q5blr" event={"ID":"7ac5e386-7d56-4201-8f44-6e605d6ba083","Type":"ContainerStarted","Data":"e54be1882f1c9ee0b17b1e8b6ea30b8f366813c0c4aa9ddd61df4fabb3f1a095"}
Sep 10 19:55:54.332986 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:54.332616    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q5blr" event={"ID":"7ac5e386-7d56-4201-8f44-6e605d6ba083","Type":"ContainerStarted","Data":"ce65383360fc3a9648e99c5a0e9142f982066c0490c74a651790b31e1e91d036"}
Sep 10 19:55:54.355357 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:54.355304    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-q5blr" podStartSLOduration=2.1834503180000002 podStartE2EDuration="3.355286666s" totalImagesPullingTime="1.106235425s" totalInitContainerRuntime="65.600923ms" isStatefulPod=true podCreationTimestamp="2026-09-10 19:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:55:54.354320007 +0000 UTC m=+98.019424257" watchObservedRunningTime="2026-09-10 19:55:54.355286666 +0000 UTC m=+98.020390930"
Sep 10 19:55:55.337593 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.337561    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-964665f95-2r9x6" event={"ID":"7457045c-86f2-4918-a5db-b8fdc7053dc8","Type":"ContainerStarted","Data":"a817bdc311ffa2019cf11bf27412318e861f84b27ee4fc8c1ac294cddba8f476"}
Sep 10 19:55:55.359778 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.359689    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-964665f95-2r9x6" podStartSLOduration=1.460735402 podStartE2EDuration="4.359670648s" totalImagesPullingTime="2.898935246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:55:55.3592389 +0000 UTC m=+99.024343147" watchObservedRunningTime="2026-09-10 19:55:55.359670648 +0000 UTC m=+99.024774897"
Sep 10 19:55:55.646686 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.646613    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"]
Sep 10 19:55:55.649263 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.649248    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:55:55.653052 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.653030    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 10 19:55:55.653223 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.653208    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-4sz4q\""
Sep 10 19:55:55.654547 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.654528    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 10 19:55:55.654695 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.654604    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 10 19:55:55.654695 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.654648    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 10 19:55:55.654821 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.654604    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8jn8grrsvkvna\""
Sep 10 19:55:55.669177 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.669156    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"]
Sep 10 19:55:55.811654 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.811624    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d1e2e487-7073-411c-9994-b7de15777c99-secret-metrics-server-client-certs\") pod \"metrics-server-78bd9bbf89-2dwq6\" (UID: \"d1e2e487-7073-411c-9994-b7de15777c99\") " pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:55:55.811805 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.811670    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d1e2e487-7073-411c-9994-b7de15777c99-secret-metrics-server-tls\") pod \"metrics-server-78bd9bbf89-2dwq6\" (UID: \"d1e2e487-7073-411c-9994-b7de15777c99\") " pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:55:55.811805 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.811699    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p55fr\" (UniqueName: \"kubernetes.io/projected/d1e2e487-7073-411c-9994-b7de15777c99-kube-api-access-p55fr\") pod \"metrics-server-78bd9bbf89-2dwq6\" (UID: \"d1e2e487-7073-411c-9994-b7de15777c99\") " pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:55:55.811805 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.811718    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d1e2e487-7073-411c-9994-b7de15777c99-audit-log\") pod \"metrics-server-78bd9bbf89-2dwq6\" (UID: \"d1e2e487-7073-411c-9994-b7de15777c99\") " pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:55:55.811805 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.811788    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1e2e487-7073-411c-9994-b7de15777c99-client-ca-bundle\") pod \"metrics-server-78bd9bbf89-2dwq6\" (UID: \"d1e2e487-7073-411c-9994-b7de15777c99\") " pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:55:55.811954 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.811848    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1e2e487-7073-411c-9994-b7de15777c99-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78bd9bbf89-2dwq6\" (UID: \"d1e2e487-7073-411c-9994-b7de15777c99\") " pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:55:55.811954 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.811873    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d1e2e487-7073-411c-9994-b7de15777c99-metrics-server-audit-profiles\") pod \"metrics-server-78bd9bbf89-2dwq6\" (UID: \"d1e2e487-7073-411c-9994-b7de15777c99\") " pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:55:55.912799 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.912730    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d1e2e487-7073-411c-9994-b7de15777c99-secret-metrics-server-tls\") pod \"metrics-server-78bd9bbf89-2dwq6\" (UID: \"d1e2e487-7073-411c-9994-b7de15777c99\") " pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:55:55.912799 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.912770    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p55fr\" (UniqueName: \"kubernetes.io/projected/d1e2e487-7073-411c-9994-b7de15777c99-kube-api-access-p55fr\") pod \"metrics-server-78bd9bbf89-2dwq6\" (UID: \"d1e2e487-7073-411c-9994-b7de15777c99\") " pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:55:55.912799 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.912796    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d1e2e487-7073-411c-9994-b7de15777c99-audit-log\") pod \"metrics-server-78bd9bbf89-2dwq6\" (UID: \"d1e2e487-7073-411c-9994-b7de15777c99\") " pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:55:55.913014 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.912833    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1e2e487-7073-411c-9994-b7de15777c99-client-ca-bundle\") pod \"metrics-server-78bd9bbf89-2dwq6\" (UID: \"d1e2e487-7073-411c-9994-b7de15777c99\") " pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:55:55.913014 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.912858    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1e2e487-7073-411c-9994-b7de15777c99-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78bd9bbf89-2dwq6\" (UID: \"d1e2e487-7073-411c-9994-b7de15777c99\") " pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:55:55.913014 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.912883    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d1e2e487-7073-411c-9994-b7de15777c99-metrics-server-audit-profiles\") pod \"metrics-server-78bd9bbf89-2dwq6\" (UID: \"d1e2e487-7073-411c-9994-b7de15777c99\") " pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:55:55.913014 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.912925    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d1e2e487-7073-411c-9994-b7de15777c99-secret-metrics-server-client-certs\") pod \"metrics-server-78bd9bbf89-2dwq6\" (UID: \"d1e2e487-7073-411c-9994-b7de15777c99\") " pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:55:55.913317 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.913293    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d1e2e487-7073-411c-9994-b7de15777c99-audit-log\") pod \"metrics-server-78bd9bbf89-2dwq6\" (UID: \"d1e2e487-7073-411c-9994-b7de15777c99\") " pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:55:55.913606 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.913583    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1e2e487-7073-411c-9994-b7de15777c99-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78bd9bbf89-2dwq6\" (UID: \"d1e2e487-7073-411c-9994-b7de15777c99\") " pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:55:55.913855 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.913832    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d1e2e487-7073-411c-9994-b7de15777c99-metrics-server-audit-profiles\") pod \"metrics-server-78bd9bbf89-2dwq6\" (UID: \"d1e2e487-7073-411c-9994-b7de15777c99\") " pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:55:55.915313 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.915286    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d1e2e487-7073-411c-9994-b7de15777c99-secret-metrics-server-tls\") pod \"metrics-server-78bd9bbf89-2dwq6\" (UID: \"d1e2e487-7073-411c-9994-b7de15777c99\") " pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:55:55.915606 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.915589    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1e2e487-7073-411c-9994-b7de15777c99-client-ca-bundle\") pod \"metrics-server-78bd9bbf89-2dwq6\" (UID: \"d1e2e487-7073-411c-9994-b7de15777c99\") " pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:55:55.915657 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.915641    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d1e2e487-7073-411c-9994-b7de15777c99-secret-metrics-server-client-certs\") pod \"metrics-server-78bd9bbf89-2dwq6\" (UID: \"d1e2e487-7073-411c-9994-b7de15777c99\") " pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:55:55.921128 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.921103    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p55fr\" (UniqueName: \"kubernetes.io/projected/d1e2e487-7073-411c-9994-b7de15777c99-kube-api-access-p55fr\") pod \"metrics-server-78bd9bbf89-2dwq6\" (UID: \"d1e2e487-7073-411c-9994-b7de15777c99\") " pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:55:55.958862 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:55.958841    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:55:56.228591 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:56.228513    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"]
Sep 10 19:55:56.231706 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:55:56.231681    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e2e487_7073_411c_9994_b7de15777c99.slice/crio-b6efff2b5250f2376a609d85b17ef1deaefdb11af0106f9f71248310b7b3ace3 WatchSource:0}: Error finding container b6efff2b5250f2376a609d85b17ef1deaefdb11af0106f9f71248310b7b3ace3: Status 404 returned error can't find the container with id b6efff2b5250f2376a609d85b17ef1deaefdb11af0106f9f71248310b7b3ace3
Sep 10 19:55:56.342574 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:56.342540    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6" event={"ID":"d1e2e487-7073-411c-9994-b7de15777c99","Type":"ContainerStarted","Data":"b6efff2b5250f2376a609d85b17ef1deaefdb11af0106f9f71248310b7b3ace3"}
Sep 10 19:55:58.227529 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:58.227501    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9j5tj"
Sep 10 19:55:58.351174 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:58.351145    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6" event={"ID":"d1e2e487-7073-411c-9994-b7de15777c99","Type":"ContainerStarted","Data":"cc9df428bdae8fe71edf697feaac702022e9d74e6cd2aac57815e8e23d3f111d"}
Sep 10 19:55:58.369213 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:55:58.369172    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6" podStartSLOduration=1.8641271860000002 podStartE2EDuration="3.369158168s" totalImagesPullingTime="1.505030982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:55:58.368479179 +0000 UTC m=+102.033583426" watchObservedRunningTime="2026-09-10 19:55:58.369158168 +0000 UTC m=+102.034262415"
Sep 10 19:56:01.638608 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.638576    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-964665f95-2r9x6"]
Sep 10 19:56:01.712323 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.712296    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d4cbf578d-j2rf2"]
Sep 10 19:56:01.740844 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.740820    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d4cbf578d-j2rf2"]
Sep 10 19:56:01.740961 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.740904    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:01.765145 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.765124    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsj4f\" (UniqueName: \"kubernetes.io/projected/6037102e-d850-4671-9a86-859a9ba1f2d3-kube-api-access-wsj4f\") pod \"console-7d4cbf578d-j2rf2\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") " pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:01.765254 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.765155    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-oauth-serving-cert\") pod \"console-7d4cbf578d-j2rf2\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") " pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:01.765254 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.765176    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-console-config\") pod \"console-7d4cbf578d-j2rf2\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") " pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:01.765332 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.765256    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-trusted-ca-bundle\") pod \"console-7d4cbf578d-j2rf2\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") " pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:01.765332 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.765298    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6037102e-d850-4671-9a86-859a9ba1f2d3-console-serving-cert\") pod \"console-7d4cbf578d-j2rf2\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") " pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:01.765439 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.765334    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-service-ca\") pod \"console-7d4cbf578d-j2rf2\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") " pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:01.765439 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.765404    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6037102e-d850-4671-9a86-859a9ba1f2d3-console-oauth-config\") pod \"console-7d4cbf578d-j2rf2\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") " pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:01.866504 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.866480    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-oauth-serving-cert\") pod \"console-7d4cbf578d-j2rf2\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") " pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:01.866607 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.866515    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-console-config\") pod \"console-7d4cbf578d-j2rf2\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") " pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:01.866748 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.866729    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-trusted-ca-bundle\") pod \"console-7d4cbf578d-j2rf2\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") " pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:01.866796 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.866777    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6037102e-d850-4671-9a86-859a9ba1f2d3-console-serving-cert\") pod \"console-7d4cbf578d-j2rf2\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") " pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:01.866846 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.866808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-service-ca\") pod \"console-7d4cbf578d-j2rf2\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") " pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:01.867000 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.866975    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6037102e-d850-4671-9a86-859a9ba1f2d3-console-oauth-config\") pod \"console-7d4cbf578d-j2rf2\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") " pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:01.867091 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.867021    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsj4f\" (UniqueName: \"kubernetes.io/projected/6037102e-d850-4671-9a86-859a9ba1f2d3-kube-api-access-wsj4f\") pod \"console-7d4cbf578d-j2rf2\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") " pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:01.867275 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.867251    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-oauth-serving-cert\") pod \"console-7d4cbf578d-j2rf2\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") " pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:01.867372 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.867251    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-console-config\") pod \"console-7d4cbf578d-j2rf2\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") " pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:01.867509 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.867482    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-service-ca\") pod \"console-7d4cbf578d-j2rf2\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") " pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:01.867676 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.867656    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-trusted-ca-bundle\") pod \"console-7d4cbf578d-j2rf2\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") " pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:01.869300 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.869270    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6037102e-d850-4671-9a86-859a9ba1f2d3-console-serving-cert\") pod \"console-7d4cbf578d-j2rf2\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") " pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:01.869616 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.869592    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6037102e-d850-4671-9a86-859a9ba1f2d3-console-oauth-config\") pod \"console-7d4cbf578d-j2rf2\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") " pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:01.878163 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.878144    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsj4f\" (UniqueName: \"kubernetes.io/projected/6037102e-d850-4671-9a86-859a9ba1f2d3-kube-api-access-wsj4f\") pod \"console-7d4cbf578d-j2rf2\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") " pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:01.930977 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:01.930915    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:56:02.049084 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:02.049050    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:02.348203 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:02.348036    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d4cbf578d-j2rf2"]
Sep 10 19:56:02.350563 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:56:02.350539    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6037102e_d850_4671_9a86_859a9ba1f2d3.slice/crio-c6c42a3193ccb583b0bfe413ef1e65a5c3ab7d6c0d3cf165e78389243801f4cb WatchSource:0}: Error finding container c6c42a3193ccb583b0bfe413ef1e65a5c3ab7d6c0d3cf165e78389243801f4cb: Status 404 returned error can't find the container with id c6c42a3193ccb583b0bfe413ef1e65a5c3ab7d6c0d3cf165e78389243801f4cb
Sep 10 19:56:02.364550 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:02.364527    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d4cbf578d-j2rf2" event={"ID":"6037102e-d850-4671-9a86-859a9ba1f2d3","Type":"ContainerStarted","Data":"c6c42a3193ccb583b0bfe413ef1e65a5c3ab7d6c0d3cf165e78389243801f4cb"}
Sep 10 19:56:03.368876 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:03.368847    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d4cbf578d-j2rf2" event={"ID":"6037102e-d850-4671-9a86-859a9ba1f2d3","Type":"ContainerStarted","Data":"800ed1a849e7819d8052f825896b3adbe091d2bd17b35e87ab4c36e5cce52a81"}
Sep 10 19:56:03.388082 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:03.388034    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d4cbf578d-j2rf2" podStartSLOduration=2.3880173559999998 podStartE2EDuration="2.388017356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:56:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:56:03.38649834 +0000 UTC m=+107.051602588" watchObservedRunningTime="2026-09-10 19:56:03.388017356 +0000 UTC m=+107.053121603"
Sep 10 19:56:12.049550 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:12.049517    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:12.050003 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:12.049578    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:12.054199 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:12.054177    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:12.407344 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:12.407318    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:56:15.959754 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:15.959722    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:56:15.960107 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:15.959791    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:56:25.648178 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:25.648140    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs\") pod \"network-metrics-daemon-mxnhw\" (UID: \"26ab4b64-59b6-42cb-b55d-ce41cecd0e85\") " pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:56:25.650325 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:25.650305    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26ab4b64-59b6-42cb-b55d-ce41cecd0e85-metrics-certs\") pod \"network-metrics-daemon-mxnhw\" (UID: \"26ab4b64-59b6-42cb-b55d-ce41cecd0e85\") " pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:56:25.666130 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:25.666108    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mr4n2\""
Sep 10 19:56:25.674384 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:25.674366    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxnhw"
Sep 10 19:56:25.943906 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:25.943831    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mxnhw"]
Sep 10 19:56:25.947365 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:56:25.947337    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ab4b64_59b6_42cb_b55d_ce41cecd0e85.slice/crio-881cd648c959360f0dcfecf9c4c222a447193491f415f4a7eca758d641a0c2aa WatchSource:0}: Error finding container 881cd648c959360f0dcfecf9c4c222a447193491f415f4a7eca758d641a0c2aa: Status 404 returned error can't find the container with id 881cd648c959360f0dcfecf9c4c222a447193491f415f4a7eca758d641a0c2aa
Sep 10 19:56:26.454774 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:26.454731    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mxnhw" event={"ID":"26ab4b64-59b6-42cb-b55d-ce41cecd0e85","Type":"ContainerStarted","Data":"881cd648c959360f0dcfecf9c4c222a447193491f415f4a7eca758d641a0c2aa"}
Sep 10 19:56:26.657739 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:26.657680    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-964665f95-2r9x6" podUID="7457045c-86f2-4918-a5db-b8fdc7053dc8" containerName="console" containerID="cri-o://a817bdc311ffa2019cf11bf27412318e861f84b27ee4fc8c1ac294cddba8f476" gracePeriod=15
Sep 10 19:56:27.367888 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.367868    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:56:27.458767 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.458741    2561 generic.go:356] "Generic (PLEG): container finished" podID="7457045c-86f2-4918-a5db-b8fdc7053dc8" containerID="a817bdc311ffa2019cf11bf27412318e861f84b27ee4fc8c1ac294cddba8f476" exitCode=0
Sep 10 19:56:27.458885 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.458786    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-964665f95-2r9x6"
Sep 10 19:56:27.458885 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.458789    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-964665f95-2r9x6" event={"ID":"7457045c-86f2-4918-a5db-b8fdc7053dc8","Type":"ContainerDied","Data":"a817bdc311ffa2019cf11bf27412318e861f84b27ee4fc8c1ac294cddba8f476"}
Sep 10 19:56:27.458885 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.458844    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-964665f95-2r9x6" event={"ID":"7457045c-86f2-4918-a5db-b8fdc7053dc8","Type":"ContainerDied","Data":"f3ef609123d86abbf19f241c3aa568011bee432055b564ede071dc87751765a7"}
Sep 10 19:56:27.458885 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.458877    2561 scope.go:117] "RemoveContainer" containerID="a817bdc311ffa2019cf11bf27412318e861f84b27ee4fc8c1ac294cddba8f476"
Sep 10 19:56:27.462050 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.462032    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-trusted-ca-bundle\") pod \"7457045c-86f2-4918-a5db-b8fdc7053dc8\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") "
Sep 10 19:56:27.462171 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.462083    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7457045c-86f2-4918-a5db-b8fdc7053dc8-console-oauth-config\") pod \"7457045c-86f2-4918-a5db-b8fdc7053dc8\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") "
Sep 10 19:56:27.462171 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.462150    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7457045c-86f2-4918-a5db-b8fdc7053dc8-console-serving-cert\") pod \"7457045c-86f2-4918-a5db-b8fdc7053dc8\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") "
Sep 10 19:56:27.462287 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.462177    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlptm\" (UniqueName: \"kubernetes.io/projected/7457045c-86f2-4918-a5db-b8fdc7053dc8-kube-api-access-vlptm\") pod \"7457045c-86f2-4918-a5db-b8fdc7053dc8\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") "
Sep 10 19:56:27.462287 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.462205    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-console-config\") pod \"7457045c-86f2-4918-a5db-b8fdc7053dc8\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") "
Sep 10 19:56:27.462287 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.462234    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-service-ca\") pod \"7457045c-86f2-4918-a5db-b8fdc7053dc8\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") "
Sep 10 19:56:27.462287 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.462274    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-oauth-serving-cert\") pod \"7457045c-86f2-4918-a5db-b8fdc7053dc8\" (UID: \"7457045c-86f2-4918-a5db-b8fdc7053dc8\") "
Sep 10 19:56:27.462486 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.462434    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7457045c-86f2-4918-a5db-b8fdc7053dc8" (UID: "7457045c-86f2-4918-a5db-b8fdc7053dc8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:56:27.463200 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.462611    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-trusted-ca-bundle\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 19:56:27.464180 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.464106    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-console-config" (OuterVolumeSpecName: "console-config") pod "7457045c-86f2-4918-a5db-b8fdc7053dc8" (UID: "7457045c-86f2-4918-a5db-b8fdc7053dc8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:56:27.464583 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.464553    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-service-ca" (OuterVolumeSpecName: "service-ca") pod "7457045c-86f2-4918-a5db-b8fdc7053dc8" (UID: "7457045c-86f2-4918-a5db-b8fdc7053dc8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:56:27.464676 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.464585    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7457045c-86f2-4918-a5db-b8fdc7053dc8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7457045c-86f2-4918-a5db-b8fdc7053dc8" (UID: "7457045c-86f2-4918-a5db-b8fdc7053dc8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:56:27.464743 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.463844    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7457045c-86f2-4918-a5db-b8fdc7053dc8" (UID: "7457045c-86f2-4918-a5db-b8fdc7053dc8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:56:27.464884 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.464860    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7457045c-86f2-4918-a5db-b8fdc7053dc8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7457045c-86f2-4918-a5db-b8fdc7053dc8" (UID: "7457045c-86f2-4918-a5db-b8fdc7053dc8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:56:27.468818 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.468794    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7457045c-86f2-4918-a5db-b8fdc7053dc8-kube-api-access-vlptm" (OuterVolumeSpecName: "kube-api-access-vlptm") pod "7457045c-86f2-4918-a5db-b8fdc7053dc8" (UID: "7457045c-86f2-4918-a5db-b8fdc7053dc8"). InnerVolumeSpecName "kube-api-access-vlptm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:56:27.471958 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.471938    2561 scope.go:117] "RemoveContainer" containerID="a817bdc311ffa2019cf11bf27412318e861f84b27ee4fc8c1ac294cddba8f476"
Sep 10 19:56:27.472196 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:56:27.472178    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a817bdc311ffa2019cf11bf27412318e861f84b27ee4fc8c1ac294cddba8f476\": container with ID starting with a817bdc311ffa2019cf11bf27412318e861f84b27ee4fc8c1ac294cddba8f476 not found: ID does not exist" containerID="a817bdc311ffa2019cf11bf27412318e861f84b27ee4fc8c1ac294cddba8f476"
Sep 10 19:56:27.472253 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.472203    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a817bdc311ffa2019cf11bf27412318e861f84b27ee4fc8c1ac294cddba8f476"} err="failed to get container status \"a817bdc311ffa2019cf11bf27412318e861f84b27ee4fc8c1ac294cddba8f476\": rpc error: code = NotFound desc = could not find container \"a817bdc311ffa2019cf11bf27412318e861f84b27ee4fc8c1ac294cddba8f476\": container with ID starting with a817bdc311ffa2019cf11bf27412318e861f84b27ee4fc8c1ac294cddba8f476 not found: ID does not exist"
Sep 10 19:56:27.563982 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.563958    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-oauth-serving-cert\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 19:56:27.563982 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.563982    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7457045c-86f2-4918-a5db-b8fdc7053dc8-console-oauth-config\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 19:56:27.564118 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.563991    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7457045c-86f2-4918-a5db-b8fdc7053dc8-console-serving-cert\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 19:56:27.564118 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.564000    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlptm\" (UniqueName: \"kubernetes.io/projected/7457045c-86f2-4918-a5db-b8fdc7053dc8-kube-api-access-vlptm\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 19:56:27.564118 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.564014    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-console-config\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 19:56:27.564118 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.564024    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7457045c-86f2-4918-a5db-b8fdc7053dc8-service-ca\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 19:56:27.781381 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.781344    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-964665f95-2r9x6"]
Sep 10 19:56:27.785380 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:27.785357    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-964665f95-2r9x6"]
Sep 10 19:56:28.464595 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:28.464565    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mxnhw" event={"ID":"26ab4b64-59b6-42cb-b55d-ce41cecd0e85","Type":"ContainerStarted","Data":"82f384f081929be4a14501b8ebf7375e84ff85c47a9abd8e77813bf0e6d4b9d6"}
Sep 10 19:56:28.464764 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:28.464640    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mxnhw" event={"ID":"26ab4b64-59b6-42cb-b55d-ce41cecd0e85","Type":"ContainerStarted","Data":"f05b104d6025066187bb25880fe2f50c44ca4cbe92ee64998a9238b592b8e6ff"}
Sep 10 19:56:28.481849 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:28.481804    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mxnhw" podStartSLOduration=131.071874635 podStartE2EDuration="2m12.481789718s" totalImagesPullingTime="1.409915083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:56:28.48026965 +0000 UTC m=+132.145373898" watchObservedRunningTime="2026-09-10 19:56:28.481789718 +0000 UTC m=+132.146894010"
Sep 10 19:56:28.848070 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:28.848040    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7457045c-86f2-4918-a5db-b8fdc7053dc8" path="/var/lib/kubelet/pods/7457045c-86f2-4918-a5db-b8fdc7053dc8/volumes"
Sep 10 19:56:35.964344 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:35.964305    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:56:35.968317 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:35.968292    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-78bd9bbf89-2dwq6"
Sep 10 19:56:45.524259 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:45.524181    2561 generic.go:356] "Generic (PLEG): container finished" podID="253acc31-66e4-4ec2-8dc3-445ffc402492" containerID="8559d01744ad8e8f60e80260c0a9f0b3f7bc13d078c09cd7d434264fe0c167c1" exitCode=0
Sep 10 19:56:45.524259 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:45.524248    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bf98q" event={"ID":"253acc31-66e4-4ec2-8dc3-445ffc402492","Type":"ContainerDied","Data":"8559d01744ad8e8f60e80260c0a9f0b3f7bc13d078c09cd7d434264fe0c167c1"}
Sep 10 19:56:45.524677 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:45.524549    2561 scope.go:117] "RemoveContainer" containerID="8559d01744ad8e8f60e80260c0a9f0b3f7bc13d078c09cd7d434264fe0c167c1"
Sep 10 19:56:46.529415 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:56:46.529374    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bf98q" event={"ID":"253acc31-66e4-4ec2-8dc3-445ffc402492","Type":"ContainerStarted","Data":"a65a348845829db6c9b32f6d116172be055185148d5fd12d9870a9cbd6a6d1f6"}
Sep 10 19:57:18.863969 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:18.863936    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-759867796f-wn9sr"]
Sep 10 19:57:18.864566 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:18.864188    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7457045c-86f2-4918-a5db-b8fdc7053dc8" containerName="console"
Sep 10 19:57:18.864566 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:18.864201    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7457045c-86f2-4918-a5db-b8fdc7053dc8" containerName="console"
Sep 10 19:57:18.864566 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:18.864243    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7457045c-86f2-4918-a5db-b8fdc7053dc8" containerName="console"
Sep 10 19:57:18.868583 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:18.868565    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:18.892453 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:18.892422    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-759867796f-wn9sr"]
Sep 10 19:57:18.948626 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:18.948582    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2430adbb-bbde-49ce-89ef-e42ca032d532-console-oauth-config\") pod \"console-759867796f-wn9sr\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") " pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:18.948626 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:18.948627    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2430adbb-bbde-49ce-89ef-e42ca032d532-console-serving-cert\") pod \"console-759867796f-wn9sr\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") " pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:18.948826 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:18.948657    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-console-config\") pod \"console-759867796f-wn9sr\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") " pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:18.948826 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:18.948696    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-trusted-ca-bundle\") pod \"console-759867796f-wn9sr\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") " pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:18.948826 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:18.948714    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x52k\" (UniqueName: \"kubernetes.io/projected/2430adbb-bbde-49ce-89ef-e42ca032d532-kube-api-access-6x52k\") pod \"console-759867796f-wn9sr\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") " pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:18.948826 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:18.948755    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-oauth-serving-cert\") pod \"console-759867796f-wn9sr\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") " pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:18.948826 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:18.948799    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-service-ca\") pod \"console-759867796f-wn9sr\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") " pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:19.049660 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:19.049619    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-console-config\") pod \"console-759867796f-wn9sr\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") " pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:19.049660 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:19.049662    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-trusted-ca-bundle\") pod \"console-759867796f-wn9sr\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") " pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:19.049857 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:19.049787    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x52k\" (UniqueName: \"kubernetes.io/projected/2430adbb-bbde-49ce-89ef-e42ca032d532-kube-api-access-6x52k\") pod \"console-759867796f-wn9sr\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") " pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:19.049857 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:19.049826    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-oauth-serving-cert\") pod \"console-759867796f-wn9sr\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") " pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:19.049920 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:19.049860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-service-ca\") pod \"console-759867796f-wn9sr\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") " pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:19.049920 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:19.049884    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2430adbb-bbde-49ce-89ef-e42ca032d532-console-oauth-config\") pod \"console-759867796f-wn9sr\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") " pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:19.049920 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:19.049910    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2430adbb-bbde-49ce-89ef-e42ca032d532-console-serving-cert\") pod \"console-759867796f-wn9sr\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") " pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:19.050598 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:19.050567    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-console-config\") pod \"console-759867796f-wn9sr\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") " pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:19.050716 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:19.050601    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-oauth-serving-cert\") pod \"console-759867796f-wn9sr\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") " pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:19.050716 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:19.050636    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-service-ca\") pod \"console-759867796f-wn9sr\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") " pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:19.050833 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:19.050728    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-trusted-ca-bundle\") pod \"console-759867796f-wn9sr\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") " pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:19.052337 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:19.052308    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2430adbb-bbde-49ce-89ef-e42ca032d532-console-serving-cert\") pod \"console-759867796f-wn9sr\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") " pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:19.052465 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:19.052445    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2430adbb-bbde-49ce-89ef-e42ca032d532-console-oauth-config\") pod \"console-759867796f-wn9sr\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") " pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:19.059996 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:19.059969    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x52k\" (UniqueName: \"kubernetes.io/projected/2430adbb-bbde-49ce-89ef-e42ca032d532-kube-api-access-6x52k\") pod \"console-759867796f-wn9sr\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") " pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:19.176930 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:19.176838    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:19.448540 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:19.448427    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-759867796f-wn9sr"]
Sep 10 19:57:19.451031 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:57:19.451006    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2430adbb_bbde_49ce_89ef_e42ca032d532.slice/crio-4cb8fdf6861cfa5ea15baffb000f195dc70b8b0b42fbb3d9e7cff3e8c2d10c91 WatchSource:0}: Error finding container 4cb8fdf6861cfa5ea15baffb000f195dc70b8b0b42fbb3d9e7cff3e8c2d10c91: Status 404 returned error can't find the container with id 4cb8fdf6861cfa5ea15baffb000f195dc70b8b0b42fbb3d9e7cff3e8c2d10c91
Sep 10 19:57:19.645820 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:19.645785    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759867796f-wn9sr" event={"ID":"2430adbb-bbde-49ce-89ef-e42ca032d532","Type":"ContainerStarted","Data":"fa5665c58a18a19f062c9fd5289d7bac299690f98ff50cb1eacf96dc2a335e89"}
Sep 10 19:57:19.645983 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:19.645839    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759867796f-wn9sr" event={"ID":"2430adbb-bbde-49ce-89ef-e42ca032d532","Type":"ContainerStarted","Data":"4cb8fdf6861cfa5ea15baffb000f195dc70b8b0b42fbb3d9e7cff3e8c2d10c91"}
Sep 10 19:57:19.666217 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:19.666162    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-759867796f-wn9sr" podStartSLOduration=1.666143978 podStartE2EDuration="1.666143978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:57:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:57:19.66542643 +0000 UTC m=+183.330530700" watchObservedRunningTime="2026-09-10 19:57:19.666143978 +0000 UTC m=+183.331248225"
Sep 10 19:57:26.014582 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.014551    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-759867796f-wn9sr"]
Sep 10 19:57:26.048034 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.048007    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c84965b98-wjnkq"]
Sep 10 19:57:26.051329 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.051310    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:26.066595 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.066576    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c84965b98-wjnkq"]
Sep 10 19:57:26.102366 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.102336    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-oauth-serving-cert\") pod \"console-c84965b98-wjnkq\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") " pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:26.102485 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.102380    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-trusted-ca-bundle\") pod \"console-c84965b98-wjnkq\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") " pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:26.102485 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.102441    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-console-config\") pod \"console-c84965b98-wjnkq\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") " pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:26.102554 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.102484    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2b32dab-5037-4172-89fe-de86488eb7cb-console-oauth-config\") pod \"console-c84965b98-wjnkq\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") " pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:26.102554 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.102505    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6f6j\" (UniqueName: \"kubernetes.io/projected/e2b32dab-5037-4172-89fe-de86488eb7cb-kube-api-access-k6f6j\") pod \"console-c84965b98-wjnkq\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") " pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:26.102554 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.102525    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-service-ca\") pod \"console-c84965b98-wjnkq\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") " pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:26.102554 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.102540    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2b32dab-5037-4172-89fe-de86488eb7cb-console-serving-cert\") pod \"console-c84965b98-wjnkq\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") " pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:26.203514 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.203485    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-trusted-ca-bundle\") pod \"console-c84965b98-wjnkq\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") " pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:26.203514 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.203518    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-console-config\") pod \"console-c84965b98-wjnkq\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") " pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:26.203702 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.203545    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2b32dab-5037-4172-89fe-de86488eb7cb-console-oauth-config\") pod \"console-c84965b98-wjnkq\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") " pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:26.203702 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.203563    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6f6j\" (UniqueName: \"kubernetes.io/projected/e2b32dab-5037-4172-89fe-de86488eb7cb-kube-api-access-k6f6j\") pod \"console-c84965b98-wjnkq\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") " pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:26.203800 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.203701    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-service-ca\") pod \"console-c84965b98-wjnkq\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") " pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:26.203800 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.203741    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2b32dab-5037-4172-89fe-de86488eb7cb-console-serving-cert\") pod \"console-c84965b98-wjnkq\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") " pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:26.203800 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.203771    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-oauth-serving-cert\") pod \"console-c84965b98-wjnkq\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") " pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:26.204288 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.204265    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-console-config\") pod \"console-c84965b98-wjnkq\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") " pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:26.204445 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.204425    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-trusted-ca-bundle\") pod \"console-c84965b98-wjnkq\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") " pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:26.204531 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.204430    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-service-ca\") pod \"console-c84965b98-wjnkq\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") " pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:26.204531 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.204485    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-oauth-serving-cert\") pod \"console-c84965b98-wjnkq\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") " pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:26.206002 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.205979    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2b32dab-5037-4172-89fe-de86488eb7cb-console-oauth-config\") pod \"console-c84965b98-wjnkq\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") " pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:26.206207 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.206186    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2b32dab-5037-4172-89fe-de86488eb7cb-console-serving-cert\") pod \"console-c84965b98-wjnkq\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") " pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:26.211646 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.211624    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6f6j\" (UniqueName: \"kubernetes.io/projected/e2b32dab-5037-4172-89fe-de86488eb7cb-kube-api-access-k6f6j\") pod \"console-c84965b98-wjnkq\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") " pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:26.360154 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.360124    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:26.632122 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.631977    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c84965b98-wjnkq"]
Sep 10 19:57:26.636014 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:57:26.635985    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2b32dab_5037_4172_89fe_de86488eb7cb.slice/crio-58d7afeddef19d6ab7b5a08b30680bf410ae5724ca82041459262b03bd62e245 WatchSource:0}: Error finding container 58d7afeddef19d6ab7b5a08b30680bf410ae5724ca82041459262b03bd62e245: Status 404 returned error can't find the container with id 58d7afeddef19d6ab7b5a08b30680bf410ae5724ca82041459262b03bd62e245
Sep 10 19:57:26.672404 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:26.672366    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c84965b98-wjnkq" event={"ID":"e2b32dab-5037-4172-89fe-de86488eb7cb","Type":"ContainerStarted","Data":"58d7afeddef19d6ab7b5a08b30680bf410ae5724ca82041459262b03bd62e245"}
Sep 10 19:57:27.677541 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:27.677499    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c84965b98-wjnkq" event={"ID":"e2b32dab-5037-4172-89fe-de86488eb7cb","Type":"ContainerStarted","Data":"eb6c320fefe28761efa7a5385f724b44eb7fc9b9062fe5ad12804fc7d38265a9"}
Sep 10 19:57:27.704347 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:27.704302    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c84965b98-wjnkq" podStartSLOduration=1.704283947 podStartE2EDuration="1.704283947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:57:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:57:27.704053771 +0000 UTC m=+191.369158018" watchObservedRunningTime="2026-09-10 19:57:27.704283947 +0000 UTC m=+191.369388206"
Sep 10 19:57:29.177563 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:29.177520    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:36.361155 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:36.361130    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:36.361588 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:36.361202    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:36.368578 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:36.368552    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:36.712436 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:36.712336    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 19:57:36.812316 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:36.812284    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d4cbf578d-j2rf2"]
Sep 10 19:57:51.033490 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.033433    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-759867796f-wn9sr" podUID="2430adbb-bbde-49ce-89ef-e42ca032d532" containerName="console" containerID="cri-o://fa5665c58a18a19f062c9fd5289d7bac299690f98ff50cb1eacf96dc2a335e89" gracePeriod=15
Sep 10 19:57:51.492559 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.492534    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:51.599483 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.599450    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2430adbb-bbde-49ce-89ef-e42ca032d532-console-oauth-config\") pod \"2430adbb-bbde-49ce-89ef-e42ca032d532\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") "
Sep 10 19:57:51.599646 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.599508    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6x52k\" (UniqueName: \"kubernetes.io/projected/2430adbb-bbde-49ce-89ef-e42ca032d532-kube-api-access-6x52k\") pod \"2430adbb-bbde-49ce-89ef-e42ca032d532\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") "
Sep 10 19:57:51.599646 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.599537    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-service-ca\") pod \"2430adbb-bbde-49ce-89ef-e42ca032d532\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") "
Sep 10 19:57:51.599646 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.599570    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2430adbb-bbde-49ce-89ef-e42ca032d532-console-serving-cert\") pod \"2430adbb-bbde-49ce-89ef-e42ca032d532\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") "
Sep 10 19:57:51.599646 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.599618    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-oauth-serving-cert\") pod \"2430adbb-bbde-49ce-89ef-e42ca032d532\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") "
Sep 10 19:57:51.599832 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.599646    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-trusted-ca-bundle\") pod \"2430adbb-bbde-49ce-89ef-e42ca032d532\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") "
Sep 10 19:57:51.599832 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.599669    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-console-config\") pod \"2430adbb-bbde-49ce-89ef-e42ca032d532\" (UID: \"2430adbb-bbde-49ce-89ef-e42ca032d532\") "
Sep 10 19:57:51.600007 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.599976    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-service-ca" (OuterVolumeSpecName: "service-ca") pod "2430adbb-bbde-49ce-89ef-e42ca032d532" (UID: "2430adbb-bbde-49ce-89ef-e42ca032d532"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:57:51.600121 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.600097    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2430adbb-bbde-49ce-89ef-e42ca032d532" (UID: "2430adbb-bbde-49ce-89ef-e42ca032d532"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:57:51.600179 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.600117    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2430adbb-bbde-49ce-89ef-e42ca032d532" (UID: "2430adbb-bbde-49ce-89ef-e42ca032d532"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:57:51.600179 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.600157    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-console-config" (OuterVolumeSpecName: "console-config") pod "2430adbb-bbde-49ce-89ef-e42ca032d532" (UID: "2430adbb-bbde-49ce-89ef-e42ca032d532"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:57:51.601721 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.601699    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2430adbb-bbde-49ce-89ef-e42ca032d532-kube-api-access-6x52k" (OuterVolumeSpecName: "kube-api-access-6x52k") pod "2430adbb-bbde-49ce-89ef-e42ca032d532" (UID: "2430adbb-bbde-49ce-89ef-e42ca032d532"). InnerVolumeSpecName "kube-api-access-6x52k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:57:51.602108 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.602091    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2430adbb-bbde-49ce-89ef-e42ca032d532-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2430adbb-bbde-49ce-89ef-e42ca032d532" (UID: "2430adbb-bbde-49ce-89ef-e42ca032d532"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:57:51.602182 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.602110    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2430adbb-bbde-49ce-89ef-e42ca032d532-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2430adbb-bbde-49ce-89ef-e42ca032d532" (UID: "2430adbb-bbde-49ce-89ef-e42ca032d532"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:57:51.701006 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.700983    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2430adbb-bbde-49ce-89ef-e42ca032d532-console-oauth-config\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 19:57:51.701006 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.701006    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6x52k\" (UniqueName: \"kubernetes.io/projected/2430adbb-bbde-49ce-89ef-e42ca032d532-kube-api-access-6x52k\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 19:57:51.701131 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.701017    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-service-ca\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 19:57:51.701131 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.701025    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2430adbb-bbde-49ce-89ef-e42ca032d532-console-serving-cert\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 19:57:51.701131 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.701033    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-oauth-serving-cert\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 19:57:51.701131 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.701041    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-trusted-ca-bundle\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 19:57:51.701131 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.701049    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2430adbb-bbde-49ce-89ef-e42ca032d532-console-config\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 19:57:51.763186 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.763130    2561 generic.go:356] "Generic (PLEG): container finished" podID="2430adbb-bbde-49ce-89ef-e42ca032d532" containerID="fa5665c58a18a19f062c9fd5289d7bac299690f98ff50cb1eacf96dc2a335e89" exitCode=0
Sep 10 19:57:51.763186 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.763177    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759867796f-wn9sr"
Sep 10 19:57:51.763295 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.763208    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759867796f-wn9sr" event={"ID":"2430adbb-bbde-49ce-89ef-e42ca032d532","Type":"ContainerDied","Data":"fa5665c58a18a19f062c9fd5289d7bac299690f98ff50cb1eacf96dc2a335e89"}
Sep 10 19:57:51.763295 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.763259    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759867796f-wn9sr" event={"ID":"2430adbb-bbde-49ce-89ef-e42ca032d532","Type":"ContainerDied","Data":"4cb8fdf6861cfa5ea15baffb000f195dc70b8b0b42fbb3d9e7cff3e8c2d10c91"}
Sep 10 19:57:51.763295 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.763278    2561 scope.go:117] "RemoveContainer" containerID="fa5665c58a18a19f062c9fd5289d7bac299690f98ff50cb1eacf96dc2a335e89"
Sep 10 19:57:51.772690 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.772671    2561 scope.go:117] "RemoveContainer" containerID="fa5665c58a18a19f062c9fd5289d7bac299690f98ff50cb1eacf96dc2a335e89"
Sep 10 19:57:51.772978 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:57:51.772958    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa5665c58a18a19f062c9fd5289d7bac299690f98ff50cb1eacf96dc2a335e89\": container with ID starting with fa5665c58a18a19f062c9fd5289d7bac299690f98ff50cb1eacf96dc2a335e89 not found: ID does not exist" containerID="fa5665c58a18a19f062c9fd5289d7bac299690f98ff50cb1eacf96dc2a335e89"
Sep 10 19:57:51.773044 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.772990    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa5665c58a18a19f062c9fd5289d7bac299690f98ff50cb1eacf96dc2a335e89"} err="failed to get container status \"fa5665c58a18a19f062c9fd5289d7bac299690f98ff50cb1eacf96dc2a335e89\": rpc error: code = NotFound desc = could not find container \"fa5665c58a18a19f062c9fd5289d7bac299690f98ff50cb1eacf96dc2a335e89\": container with ID starting with fa5665c58a18a19f062c9fd5289d7bac299690f98ff50cb1eacf96dc2a335e89 not found: ID does not exist"
Sep 10 19:57:51.790571 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.790547    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-759867796f-wn9sr"]
Sep 10 19:57:51.796899 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:51.796879    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-759867796f-wn9sr"]
Sep 10 19:57:52.848619 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:57:52.848586    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2430adbb-bbde-49ce-89ef-e42ca032d532" path="/var/lib/kubelet/pods/2430adbb-bbde-49ce-89ef-e42ca032d532/volumes"
Sep 10 19:58:01.831532 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:01.831479    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d4cbf578d-j2rf2" podUID="6037102e-d850-4671-9a86-859a9ba1f2d3" containerName="console" containerID="cri-o://800ed1a849e7819d8052f825896b3adbe091d2bd17b35e87ab4c36e5cce52a81" gracePeriod=15
Sep 10 19:58:02.255287 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.255265    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:58:02.388597 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.388570    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-service-ca\") pod \"6037102e-d850-4671-9a86-859a9ba1f2d3\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") "
Sep 10 19:58:02.388597 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.388610    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-oauth-serving-cert\") pod \"6037102e-d850-4671-9a86-859a9ba1f2d3\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") "
Sep 10 19:58:02.388896 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.388637    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6037102e-d850-4671-9a86-859a9ba1f2d3-console-serving-cert\") pod \"6037102e-d850-4671-9a86-859a9ba1f2d3\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") "
Sep 10 19:58:02.388896 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.388665    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsj4f\" (UniqueName: \"kubernetes.io/projected/6037102e-d850-4671-9a86-859a9ba1f2d3-kube-api-access-wsj4f\") pod \"6037102e-d850-4671-9a86-859a9ba1f2d3\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") "
Sep 10 19:58:02.388896 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.388745    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-trusted-ca-bundle\") pod \"6037102e-d850-4671-9a86-859a9ba1f2d3\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") "
Sep 10 19:58:02.388896 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.388810    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6037102e-d850-4671-9a86-859a9ba1f2d3-console-oauth-config\") pod \"6037102e-d850-4671-9a86-859a9ba1f2d3\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") "
Sep 10 19:58:02.388896 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.388864    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-console-config\") pod \"6037102e-d850-4671-9a86-859a9ba1f2d3\" (UID: \"6037102e-d850-4671-9a86-859a9ba1f2d3\") "
Sep 10 19:58:02.389138 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.389046    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6037102e-d850-4671-9a86-859a9ba1f2d3" (UID: "6037102e-d850-4671-9a86-859a9ba1f2d3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:58:02.389138 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.389062    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-service-ca" (OuterVolumeSpecName: "service-ca") pod "6037102e-d850-4671-9a86-859a9ba1f2d3" (UID: "6037102e-d850-4671-9a86-859a9ba1f2d3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:58:02.389240 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.389163    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6037102e-d850-4671-9a86-859a9ba1f2d3" (UID: "6037102e-d850-4671-9a86-859a9ba1f2d3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:58:02.389407 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.389358    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-console-config" (OuterVolumeSpecName: "console-config") pod "6037102e-d850-4671-9a86-859a9ba1f2d3" (UID: "6037102e-d850-4671-9a86-859a9ba1f2d3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:58:02.390828 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.390803    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6037102e-d850-4671-9a86-859a9ba1f2d3-kube-api-access-wsj4f" (OuterVolumeSpecName: "kube-api-access-wsj4f") pod "6037102e-d850-4671-9a86-859a9ba1f2d3" (UID: "6037102e-d850-4671-9a86-859a9ba1f2d3"). InnerVolumeSpecName "kube-api-access-wsj4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:58:02.390828 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.390791    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6037102e-d850-4671-9a86-859a9ba1f2d3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6037102e-d850-4671-9a86-859a9ba1f2d3" (UID: "6037102e-d850-4671-9a86-859a9ba1f2d3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:58:02.390949 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.390873    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6037102e-d850-4671-9a86-859a9ba1f2d3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6037102e-d850-4671-9a86-859a9ba1f2d3" (UID: "6037102e-d850-4671-9a86-859a9ba1f2d3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:58:02.490123 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.490057    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-service-ca\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 19:58:02.490123 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.490080    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-oauth-serving-cert\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 19:58:02.490123 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.490089    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6037102e-d850-4671-9a86-859a9ba1f2d3-console-serving-cert\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 19:58:02.490123 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.490099    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsj4f\" (UniqueName: \"kubernetes.io/projected/6037102e-d850-4671-9a86-859a9ba1f2d3-kube-api-access-wsj4f\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 19:58:02.490123 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.490108    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-trusted-ca-bundle\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 19:58:02.490123 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.490115    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6037102e-d850-4671-9a86-859a9ba1f2d3-console-oauth-config\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 19:58:02.490123 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.490124    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6037102e-d850-4671-9a86-859a9ba1f2d3-console-config\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 19:58:02.805755 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.805673    2561 generic.go:356] "Generic (PLEG): container finished" podID="6037102e-d850-4671-9a86-859a9ba1f2d3" containerID="800ed1a849e7819d8052f825896b3adbe091d2bd17b35e87ab4c36e5cce52a81" exitCode=0
Sep 10 19:58:02.805755 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.805716    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d4cbf578d-j2rf2"
Sep 10 19:58:02.805755 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.805734    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d4cbf578d-j2rf2" event={"ID":"6037102e-d850-4671-9a86-859a9ba1f2d3","Type":"ContainerDied","Data":"800ed1a849e7819d8052f825896b3adbe091d2bd17b35e87ab4c36e5cce52a81"}
Sep 10 19:58:02.805957 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.805774    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d4cbf578d-j2rf2" event={"ID":"6037102e-d850-4671-9a86-859a9ba1f2d3","Type":"ContainerDied","Data":"c6c42a3193ccb583b0bfe413ef1e65a5c3ab7d6c0d3cf165e78389243801f4cb"}
Sep 10 19:58:02.805957 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.805793    2561 scope.go:117] "RemoveContainer" containerID="800ed1a849e7819d8052f825896b3adbe091d2bd17b35e87ab4c36e5cce52a81"
Sep 10 19:58:02.814197 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.814178    2561 scope.go:117] "RemoveContainer" containerID="800ed1a849e7819d8052f825896b3adbe091d2bd17b35e87ab4c36e5cce52a81"
Sep 10 19:58:02.814476 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:58:02.814458    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"800ed1a849e7819d8052f825896b3adbe091d2bd17b35e87ab4c36e5cce52a81\": container with ID starting with 800ed1a849e7819d8052f825896b3adbe091d2bd17b35e87ab4c36e5cce52a81 not found: ID does not exist" containerID="800ed1a849e7819d8052f825896b3adbe091d2bd17b35e87ab4c36e5cce52a81"
Sep 10 19:58:02.814535 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.814484    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"800ed1a849e7819d8052f825896b3adbe091d2bd17b35e87ab4c36e5cce52a81"} err="failed to get container status \"800ed1a849e7819d8052f825896b3adbe091d2bd17b35e87ab4c36e5cce52a81\": rpc error: code = NotFound desc = could not find container \"800ed1a849e7819d8052f825896b3adbe091d2bd17b35e87ab4c36e5cce52a81\": container with ID starting with 800ed1a849e7819d8052f825896b3adbe091d2bd17b35e87ab4c36e5cce52a81 not found: ID does not exist"
Sep 10 19:58:02.831534 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.831511    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d4cbf578d-j2rf2"]
Sep 10 19:58:02.839474 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.839455    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d4cbf578d-j2rf2"]
Sep 10 19:58:02.847791 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:02.847769    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6037102e-d850-4671-9a86-859a9ba1f2d3" path="/var/lib/kubelet/pods/6037102e-d850-4671-9a86-859a9ba1f2d3/volumes"
Sep 10 19:58:43.410415 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:43.410318    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ttrts"]
Sep 10 19:58:43.410841 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:43.410569    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2430adbb-bbde-49ce-89ef-e42ca032d532" containerName="console"
Sep 10 19:58:43.410841 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:43.410580    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2430adbb-bbde-49ce-89ef-e42ca032d532" containerName="console"
Sep 10 19:58:43.410841 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:43.410600    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6037102e-d850-4671-9a86-859a9ba1f2d3" containerName="console"
Sep 10 19:58:43.410841 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:43.410606    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6037102e-d850-4671-9a86-859a9ba1f2d3" containerName="console"
Sep 10 19:58:43.410841 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:43.410644    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2430adbb-bbde-49ce-89ef-e42ca032d532" containerName="console"
Sep 10 19:58:43.410841 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:43.410653    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6037102e-d850-4671-9a86-859a9ba1f2d3" containerName="console"
Sep 10 19:58:43.413372 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:43.413356    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ttrts"
Sep 10 19:58:43.416869 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:43.416850    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-665vz\""
Sep 10 19:58:43.417004 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:43.416991    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 19:58:43.417075 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:43.417024    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 19:58:43.424245 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:43.424223    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ttrts"]
Sep 10 19:58:43.482314 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:43.482293    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01e26a28-a7fa-4a56-af03-7e40178a7f7c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ttrts\" (UID: \"01e26a28-a7fa-4a56-af03-7e40178a7f7c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ttrts"
Sep 10 19:58:43.482427 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:43.482361    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76kk2\" (UniqueName: \"kubernetes.io/projected/01e26a28-a7fa-4a56-af03-7e40178a7f7c-kube-api-access-76kk2\") pod \"cert-manager-cainjector-559cdd8c87-ttrts\" (UID: \"01e26a28-a7fa-4a56-af03-7e40178a7f7c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ttrts"
Sep 10 19:58:43.583236 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:43.583203    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76kk2\" (UniqueName: \"kubernetes.io/projected/01e26a28-a7fa-4a56-af03-7e40178a7f7c-kube-api-access-76kk2\") pod \"cert-manager-cainjector-559cdd8c87-ttrts\" (UID: \"01e26a28-a7fa-4a56-af03-7e40178a7f7c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ttrts"
Sep 10 19:58:43.583409 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:43.583243    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01e26a28-a7fa-4a56-af03-7e40178a7f7c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ttrts\" (UID: \"01e26a28-a7fa-4a56-af03-7e40178a7f7c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ttrts"
Sep 10 19:58:43.593477 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:43.593448    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01e26a28-a7fa-4a56-af03-7e40178a7f7c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ttrts\" (UID: \"01e26a28-a7fa-4a56-af03-7e40178a7f7c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ttrts"
Sep 10 19:58:43.593826 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:43.593808    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76kk2\" (UniqueName: \"kubernetes.io/projected/01e26a28-a7fa-4a56-af03-7e40178a7f7c-kube-api-access-76kk2\") pod \"cert-manager-cainjector-559cdd8c87-ttrts\" (UID: \"01e26a28-a7fa-4a56-af03-7e40178a7f7c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ttrts"
Sep 10 19:58:43.722083 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:43.722008    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ttrts"
Sep 10 19:58:44.010043 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:44.009968    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ttrts"]
Sep 10 19:58:44.012838 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:58:44.012803    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01e26a28_a7fa_4a56_af03_7e40178a7f7c.slice/crio-0042ff1e01c71c6f0dc216e57a0ac084c9392ac88d1ef2060f152c193041cdb8 WatchSource:0}: Error finding container 0042ff1e01c71c6f0dc216e57a0ac084c9392ac88d1ef2060f152c193041cdb8: Status 404 returned error can't find the container with id 0042ff1e01c71c6f0dc216e57a0ac084c9392ac88d1ef2060f152c193041cdb8
Sep 10 19:58:44.949280 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:44.949234    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ttrts" event={"ID":"01e26a28-a7fa-4a56-af03-7e40178a7f7c","Type":"ContainerStarted","Data":"0042ff1e01c71c6f0dc216e57a0ac084c9392ac88d1ef2060f152c193041cdb8"}
Sep 10 19:58:47.961936 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:47.961902    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ttrts" event={"ID":"01e26a28-a7fa-4a56-af03-7e40178a7f7c","Type":"ContainerStarted","Data":"d77209b91f8d9b27783acbf042ad49bcb0176bfd43eb15f5275b020c37971f63"}
Sep 10 19:58:47.982044 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:58:47.981994    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ttrts" podStartSLOduration=1.691452724 podStartE2EDuration="4.98197994s" totalImagesPullingTime="3.290527216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:58:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:58:47.981735029 +0000 UTC m=+271.646839276" watchObservedRunningTime="2026-09-10 19:58:47.98197994 +0000 UTC m=+271.647084179"
Sep 10 19:59:16.755309 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:16.755283    2561 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 19:59:17.107412 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.107371    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd"]
Sep 10 19:59:17.109688 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.109667    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd"
Sep 10 19:59:17.116264 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.116200    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 19:59:17.116370 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.116290    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 19:59:17.116370 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.116317    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 19:59:17.116514 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.116431    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gxjbr\""
Sep 10 19:59:17.116514 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.116482    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 19:59:17.136768 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.136742    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd"]
Sep 10 19:59:17.232046 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.231994    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78c874eb-d8ad-47be-81df-b50bf33f11ca-tmp\") pod \"opendatahub-operator-controller-manager-5678c4c4c5-qn2wd\" (UID: \"78c874eb-d8ad-47be-81df-b50bf33f11ca\") " pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd"
Sep 10 19:59:17.232228 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.232053    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjk9z\" (UniqueName: \"kubernetes.io/projected/78c874eb-d8ad-47be-81df-b50bf33f11ca-kube-api-access-wjk9z\") pod \"opendatahub-operator-controller-manager-5678c4c4c5-qn2wd\" (UID: \"78c874eb-d8ad-47be-81df-b50bf33f11ca\") " pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd"
Sep 10 19:59:17.232228 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.232123    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/78c874eb-d8ad-47be-81df-b50bf33f11ca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5678c4c4c5-qn2wd\" (UID: \"78c874eb-d8ad-47be-81df-b50bf33f11ca\") " pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd"
Sep 10 19:59:17.232228 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.232191    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/78c874eb-d8ad-47be-81df-b50bf33f11ca-manifests\") pod \"opendatahub-operator-controller-manager-5678c4c4c5-qn2wd\" (UID: \"78c874eb-d8ad-47be-81df-b50bf33f11ca\") " pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd"
Sep 10 19:59:17.232365 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.232244    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78c874eb-d8ad-47be-81df-b50bf33f11ca-webhook-cert\") pod \"opendatahub-operator-controller-manager-5678c4c4c5-qn2wd\" (UID: \"78c874eb-d8ad-47be-81df-b50bf33f11ca\") " pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd"
Sep 10 19:59:17.333624 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.333593    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78c874eb-d8ad-47be-81df-b50bf33f11ca-tmp\") pod \"opendatahub-operator-controller-manager-5678c4c4c5-qn2wd\" (UID: \"78c874eb-d8ad-47be-81df-b50bf33f11ca\") " pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd"
Sep 10 19:59:17.333783 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.333634    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjk9z\" (UniqueName: \"kubernetes.io/projected/78c874eb-d8ad-47be-81df-b50bf33f11ca-kube-api-access-wjk9z\") pod \"opendatahub-operator-controller-manager-5678c4c4c5-qn2wd\" (UID: \"78c874eb-d8ad-47be-81df-b50bf33f11ca\") " pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd"
Sep 10 19:59:17.333783 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.333664    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/78c874eb-d8ad-47be-81df-b50bf33f11ca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5678c4c4c5-qn2wd\" (UID: \"78c874eb-d8ad-47be-81df-b50bf33f11ca\") " pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd"
Sep 10 19:59:17.333783 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.333708    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/78c874eb-d8ad-47be-81df-b50bf33f11ca-manifests\") pod \"opendatahub-operator-controller-manager-5678c4c4c5-qn2wd\" (UID: \"78c874eb-d8ad-47be-81df-b50bf33f11ca\") " pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd"
Sep 10 19:59:17.333783 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.333756    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78c874eb-d8ad-47be-81df-b50bf33f11ca-webhook-cert\") pod \"opendatahub-operator-controller-manager-5678c4c4c5-qn2wd\" (UID: \"78c874eb-d8ad-47be-81df-b50bf33f11ca\") " pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd"
Sep 10 19:59:17.334186 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.334166    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/78c874eb-d8ad-47be-81df-b50bf33f11ca-manifests\") pod \"opendatahub-operator-controller-manager-5678c4c4c5-qn2wd\" (UID: \"78c874eb-d8ad-47be-81df-b50bf33f11ca\") " pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd"
Sep 10 19:59:17.335882 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.335860    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78c874eb-d8ad-47be-81df-b50bf33f11ca-tmp\") pod \"opendatahub-operator-controller-manager-5678c4c4c5-qn2wd\" (UID: \"78c874eb-d8ad-47be-81df-b50bf33f11ca\") " pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd"
Sep 10 19:59:17.336103 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.336086    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78c874eb-d8ad-47be-81df-b50bf33f11ca-webhook-cert\") pod \"opendatahub-operator-controller-manager-5678c4c4c5-qn2wd\" (UID: \"78c874eb-d8ad-47be-81df-b50bf33f11ca\") " pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd"
Sep 10 19:59:17.336244 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.336222    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/78c874eb-d8ad-47be-81df-b50bf33f11ca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5678c4c4c5-qn2wd\" (UID: \"78c874eb-d8ad-47be-81df-b50bf33f11ca\") " pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd"
Sep 10 19:59:17.346379 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.346360    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjk9z\" (UniqueName: \"kubernetes.io/projected/78c874eb-d8ad-47be-81df-b50bf33f11ca-kube-api-access-wjk9z\") pod \"opendatahub-operator-controller-manager-5678c4c4c5-qn2wd\" (UID: \"78c874eb-d8ad-47be-81df-b50bf33f11ca\") " pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd"
Sep 10 19:59:17.420019 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.419960    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd"
Sep 10 19:59:17.724413 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:17.724085    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd"]
Sep 10 19:59:17.730077 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:59:17.730048    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78c874eb_d8ad_47be_81df_b50bf33f11ca.slice/crio-392ae8ab1e528bf4a354da3c82696f7035d43a7f8a908ce15f83b2f791c134d5 WatchSource:0}: Error finding container 392ae8ab1e528bf4a354da3c82696f7035d43a7f8a908ce15f83b2f791c134d5: Status 404 returned error can't find the container with id 392ae8ab1e528bf4a354da3c82696f7035d43a7f8a908ce15f83b2f791c134d5
Sep 10 19:59:18.064684 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:18.064605    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd" event={"ID":"78c874eb-d8ad-47be-81df-b50bf33f11ca","Type":"ContainerStarted","Data":"392ae8ab1e528bf4a354da3c82696f7035d43a7f8a908ce15f83b2f791c134d5"}
Sep 10 19:59:21.078952 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:21.078910    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd" event={"ID":"78c874eb-d8ad-47be-81df-b50bf33f11ca","Type":"ContainerStarted","Data":"b824e0c3b3277743c2318223abcf4c1caeea61c7101e2760789f9febe45db58b"}
Sep 10 19:59:22.083930 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:22.083899    2561 generic.go:356] "Generic (PLEG): container finished" podID="78c874eb-d8ad-47be-81df-b50bf33f11ca" containerID="b824e0c3b3277743c2318223abcf4c1caeea61c7101e2760789f9febe45db58b" exitCode=0
Sep 10 19:59:22.084288 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:22.083970    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd" event={"ID":"78c874eb-d8ad-47be-81df-b50bf33f11ca","Type":"ContainerDied","Data":"b824e0c3b3277743c2318223abcf4c1caeea61c7101e2760789f9febe45db58b"}
Sep 10 19:59:22.084450 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:22.084434    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 19:59:23.095484 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:23.095441    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd" event={"ID":"78c874eb-d8ad-47be-81df-b50bf33f11ca","Type":"ContainerStarted","Data":"b3579be98609fecb89f0e50285a7efaa53714daf7501ee6a01dbfe5fe953fd17"}
Sep 10 19:59:23.095953 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:23.095581    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd"
Sep 10 19:59:23.123981 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:23.123927    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd" podStartSLOduration=1.854978579 podStartE2EDuration="6.123906891s" totalImagesPullingTime="3.25289271s" totalInitContainerRuntime="1.016035602s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:59:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:59:23.122767428 +0000 UTC m=+306.787871675" watchObservedRunningTime="2026-09-10 19:59:23.123906891 +0000 UTC m=+306.789011135"
Sep 10 19:59:34.101275 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:34.101248    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5678c4c4c5-qn2wd"
Sep 10 19:59:42.381001 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:42.380965    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-576c9858ff-jvpgj"]
Sep 10 19:59:42.383100 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:42.383074    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-576c9858ff-jvpgj"
Sep 10 19:59:42.386486 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:42.386459    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 10 19:59:42.386614 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:42.386529    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-srvpp\""
Sep 10 19:59:42.386966 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:42.386952    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 10 19:59:42.401709 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:42.401688    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-576c9858ff-jvpgj"]
Sep 10 19:59:42.538327 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:42.538296    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/267713b8-71c6-4962-a12c-63bca79dc657-tmp\") pod \"kube-auth-proxy-576c9858ff-jvpgj\" (UID: \"267713b8-71c6-4962-a12c-63bca79dc657\") " pod="openshift-ingress/kube-auth-proxy-576c9858ff-jvpgj"
Sep 10 19:59:42.538493 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:42.538344    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2pr8\" (UniqueName: \"kubernetes.io/projected/267713b8-71c6-4962-a12c-63bca79dc657-kube-api-access-p2pr8\") pod \"kube-auth-proxy-576c9858ff-jvpgj\" (UID: \"267713b8-71c6-4962-a12c-63bca79dc657\") " pod="openshift-ingress/kube-auth-proxy-576c9858ff-jvpgj"
Sep 10 19:59:42.538493 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:42.538453    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/267713b8-71c6-4962-a12c-63bca79dc657-tls-certs\") pod \"kube-auth-proxy-576c9858ff-jvpgj\" (UID: \"267713b8-71c6-4962-a12c-63bca79dc657\") " pod="openshift-ingress/kube-auth-proxy-576c9858ff-jvpgj"
Sep 10 19:59:42.639307 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:42.639237    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/267713b8-71c6-4962-a12c-63bca79dc657-tls-certs\") pod \"kube-auth-proxy-576c9858ff-jvpgj\" (UID: \"267713b8-71c6-4962-a12c-63bca79dc657\") " pod="openshift-ingress/kube-auth-proxy-576c9858ff-jvpgj"
Sep 10 19:59:42.639307 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:42.639286    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/267713b8-71c6-4962-a12c-63bca79dc657-tmp\") pod \"kube-auth-proxy-576c9858ff-jvpgj\" (UID: \"267713b8-71c6-4962-a12c-63bca79dc657\") " pod="openshift-ingress/kube-auth-proxy-576c9858ff-jvpgj"
Sep 10 19:59:42.639473 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:42.639313    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2pr8\" (UniqueName: \"kubernetes.io/projected/267713b8-71c6-4962-a12c-63bca79dc657-kube-api-access-p2pr8\") pod \"kube-auth-proxy-576c9858ff-jvpgj\" (UID: \"267713b8-71c6-4962-a12c-63bca79dc657\") " pod="openshift-ingress/kube-auth-proxy-576c9858ff-jvpgj"
Sep 10 19:59:42.639473 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:59:42.639382    2561 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 10 19:59:42.639540 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:59:42.639478    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/267713b8-71c6-4962-a12c-63bca79dc657-tls-certs podName:267713b8-71c6-4962-a12c-63bca79dc657 nodeName:}" failed. No retries permitted until 2026-09-10 19:59:43.139459898 +0000 UTC m=+326.804564133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/267713b8-71c6-4962-a12c-63bca79dc657-tls-certs") pod "kube-auth-proxy-576c9858ff-jvpgj" (UID: "267713b8-71c6-4962-a12c-63bca79dc657") : secret "kube-auth-proxy-tls" not found
Sep 10 19:59:42.641587 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:42.641565    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/267713b8-71c6-4962-a12c-63bca79dc657-tmp\") pod \"kube-auth-proxy-576c9858ff-jvpgj\" (UID: \"267713b8-71c6-4962-a12c-63bca79dc657\") " pod="openshift-ingress/kube-auth-proxy-576c9858ff-jvpgj"
Sep 10 19:59:42.650699 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:42.650673    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2pr8\" (UniqueName: \"kubernetes.io/projected/267713b8-71c6-4962-a12c-63bca79dc657-kube-api-access-p2pr8\") pod \"kube-auth-proxy-576c9858ff-jvpgj\" (UID: \"267713b8-71c6-4962-a12c-63bca79dc657\") " pod="openshift-ingress/kube-auth-proxy-576c9858ff-jvpgj"
Sep 10 19:59:43.143922 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:43.143877    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/267713b8-71c6-4962-a12c-63bca79dc657-tls-certs\") pod \"kube-auth-proxy-576c9858ff-jvpgj\" (UID: \"267713b8-71c6-4962-a12c-63bca79dc657\") " pod="openshift-ingress/kube-auth-proxy-576c9858ff-jvpgj"
Sep 10 19:59:43.146269 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:43.146242    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/267713b8-71c6-4962-a12c-63bca79dc657-tls-certs\") pod \"kube-auth-proxy-576c9858ff-jvpgj\" (UID: \"267713b8-71c6-4962-a12c-63bca79dc657\") " pod="openshift-ingress/kube-auth-proxy-576c9858ff-jvpgj"
Sep 10 19:59:43.293193 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:43.293161    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-576c9858ff-jvpgj"
Sep 10 19:59:43.567792 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:43.567723    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-576c9858ff-jvpgj"]
Sep 10 19:59:43.570821 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:59:43.570789    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod267713b8_71c6_4962_a12c_63bca79dc657.slice/crio-5a20e7d016ef04eeed054eafad9601299c2cf5111fcc17a9d6b8baeed0172381 WatchSource:0}: Error finding container 5a20e7d016ef04eeed054eafad9601299c2cf5111fcc17a9d6b8baeed0172381: Status 404 returned error can't find the container with id 5a20e7d016ef04eeed054eafad9601299c2cf5111fcc17a9d6b8baeed0172381
Sep 10 19:59:43.950326 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:43.950297    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"]
Sep 10 19:59:43.953069 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:43.953046    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:43.955743 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:43.955720    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-hb8rj\""
Sep 10 19:59:43.955858 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:43.955719    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 19:59:43.955858 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:43.955753    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 19:59:43.956022 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:43.956005    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 19:59:43.956096 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:43.956057    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 19:59:43.968920 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:43.968897    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"]
Sep 10 19:59:44.051229 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.051204    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5r65q\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:44.051370 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.051235    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5r65q\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:44.051370 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.051256    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5r65q\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:44.051370 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.051273    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4aca27d2-7f28-4ca2-a280-6a11271c8855-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5r65q\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:44.051370 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.051325    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5r65q\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:44.051370 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.051353    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4z5q\" (UniqueName: \"kubernetes.io/projected/4aca27d2-7f28-4ca2-a280-6a11271c8855-kube-api-access-x4z5q\") pod \"istiod-openshift-gateway-7b7995d5cd-5r65q\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:44.051591 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.051375    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4aca27d2-7f28-4ca2-a280-6a11271c8855-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5r65q\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:44.152042 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.152008    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5r65q\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:44.152242 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.152048    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4aca27d2-7f28-4ca2-a280-6a11271c8855-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5r65q\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:44.152242 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.152063    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5r65q\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:44.152242 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.152078    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4z5q\" (UniqueName: \"kubernetes.io/projected/4aca27d2-7f28-4ca2-a280-6a11271c8855-kube-api-access-x4z5q\") pod \"istiod-openshift-gateway-7b7995d5cd-5r65q\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:44.152242 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.152098    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4aca27d2-7f28-4ca2-a280-6a11271c8855-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5r65q\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:44.152242 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.152179    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5r65q\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:44.152242 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.152207    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5r65q\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:44.152854 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.152828    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5r65q\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:44.154503 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.154484    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5r65q\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:44.154616 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.154516    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5r65q\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:44.154812 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.154791    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4aca27d2-7f28-4ca2-a280-6a11271c8855-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5r65q\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:44.154871 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.154849    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4aca27d2-7f28-4ca2-a280-6a11271c8855-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5r65q\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:44.160900 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.160871    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5r65q\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:44.161033 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.161015    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4z5q\" (UniqueName: \"kubernetes.io/projected/4aca27d2-7f28-4ca2-a280-6a11271c8855-kube-api-access-x4z5q\") pod \"istiod-openshift-gateway-7b7995d5cd-5r65q\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:44.172027 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.172003    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-576c9858ff-jvpgj" event={"ID":"267713b8-71c6-4962-a12c-63bca79dc657","Type":"ContainerStarted","Data":"5a20e7d016ef04eeed054eafad9601299c2cf5111fcc17a9d6b8baeed0172381"}
Sep 10 19:59:44.263824 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.263745    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:44.554523 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:44.554333    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"]
Sep 10 19:59:44.557516 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:59:44.557484    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aca27d2_7f28_4ca2_a280_6a11271c8855.slice/crio-542b67ec0cc5116db80b05ca40afd8cb304d01cfcbedf32a5f0b314d994286e6 WatchSource:0}: Error finding container 542b67ec0cc5116db80b05ca40afd8cb304d01cfcbedf32a5f0b314d994286e6: Status 404 returned error can't find the container with id 542b67ec0cc5116db80b05ca40afd8cb304d01cfcbedf32a5f0b314d994286e6
Sep 10 19:59:45.177993 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:45.177961    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q" event={"ID":"4aca27d2-7f28-4ca2-a280-6a11271c8855","Type":"ContainerStarted","Data":"542b67ec0cc5116db80b05ca40afd8cb304d01cfcbedf32a5f0b314d994286e6"}
Sep 10 19:59:47.188450 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:47.188416    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-576c9858ff-jvpgj" event={"ID":"267713b8-71c6-4962-a12c-63bca79dc657","Type":"ContainerStarted","Data":"3113c86cceeaeb0079feb1e4cbeb2428d0659989c79ba1d8d4d247ccb004886b"}
Sep 10 19:59:47.209592 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:47.209532    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-576c9858ff-jvpgj" podStartSLOduration=2.5137254909999998 podStartE2EDuration="5.209510848s" totalImagesPullingTime="2.695785357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:59:47.208038344 +0000 UTC m=+330.873142626" watchObservedRunningTime="2026-09-10 19:59:47.209510848 +0000 UTC m=+330.874615096"
Sep 10 19:59:48.106576 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:48.106533    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:59:48.106682 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:48.106611    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:59:48.195693 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:48.195658    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q" event={"ID":"4aca27d2-7f28-4ca2-a280-6a11271c8855","Type":"ContainerStarted","Data":"b37b4fbaf86e94b1a06e193a7b343bbb5edd8d14458738f597cc6b1ed31f7a90"}
Sep 10 19:59:48.229035 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:48.228976    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q" podStartSLOduration=1.683054322 podStartE2EDuration="5.228958933s" totalImagesPullingTime="3.545904611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:59:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:59:48.225735375 +0000 UTC m=+331.890839624" watchObservedRunningTime="2026-09-10 19:59:48.228958933 +0000 UTC m=+331.894063180"
Sep 10 19:59:49.202809 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:49.202780    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:49.203906 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:49.203880    2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-5r65q container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 19:59:49.204144 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:49.204117    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q" podUID="4aca27d2-7f28-4ca2-a280-6a11271c8855" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 19:59:50.205811 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:50.205783    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 19:59:58.403912 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:58.403876    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wgrsm"]
Sep 10 19:59:58.406792 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:58.406770    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wgrsm"
Sep 10 19:59:58.411510 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:58.411487    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 10 19:59:58.424861 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:58.424841    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-285fh\""
Sep 10 19:59:58.477653 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:58.477615    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wgrsm"]
Sep 10 19:59:58.478985 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:58.478958    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9wxh9"]
Sep 10 19:59:58.481070 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:58.481049    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9wxh9"
Sep 10 19:59:58.487335 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:58.487311    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/750ad70e-5da8-416f-aa61-2f6f6f3e7ddc-cert\") pod \"kserve-controller-manager-d6f4b65b8-wgrsm\" (UID: \"750ad70e-5da8-416f-aa61-2f6f6f3e7ddc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wgrsm"
Sep 10 19:59:58.487472 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:58.487351    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxsv6\" (UniqueName: \"kubernetes.io/projected/750ad70e-5da8-416f-aa61-2f6f6f3e7ddc-kube-api-access-lxsv6\") pod \"kserve-controller-manager-d6f4b65b8-wgrsm\" (UID: \"750ad70e-5da8-416f-aa61-2f6f6f3e7ddc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wgrsm"
Sep 10 19:59:58.491931 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:58.491907    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 10 19:59:58.492018 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:58.491915    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-v6hqq\""
Sep 10 19:59:58.549866 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:58.549841    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9wxh9"]
Sep 10 19:59:58.588615 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:58.588586    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f7d4043-c58c-462f-a9a1-a0471d473dac-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9wxh9\" (UID: \"8f7d4043-c58c-462f-a9a1-a0471d473dac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9wxh9"
Sep 10 19:59:58.588751 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:58.588653    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/750ad70e-5da8-416f-aa61-2f6f6f3e7ddc-cert\") pod \"kserve-controller-manager-d6f4b65b8-wgrsm\" (UID: \"750ad70e-5da8-416f-aa61-2f6f6f3e7ddc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wgrsm"
Sep 10 19:59:58.588751 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:58.588683    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxsv6\" (UniqueName: \"kubernetes.io/projected/750ad70e-5da8-416f-aa61-2f6f6f3e7ddc-kube-api-access-lxsv6\") pod \"kserve-controller-manager-d6f4b65b8-wgrsm\" (UID: \"750ad70e-5da8-416f-aa61-2f6f6f3e7ddc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wgrsm"
Sep 10 19:59:58.588887 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:58.588864    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djtx8\" (UniqueName: \"kubernetes.io/projected/8f7d4043-c58c-462f-a9a1-a0471d473dac-kube-api-access-djtx8\") pod \"llmisvc-controller-manager-777c6bd7d5-9wxh9\" (UID: \"8f7d4043-c58c-462f-a9a1-a0471d473dac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9wxh9"
Sep 10 19:59:58.591081 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:58.591058    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/750ad70e-5da8-416f-aa61-2f6f6f3e7ddc-cert\") pod \"kserve-controller-manager-d6f4b65b8-wgrsm\" (UID: \"750ad70e-5da8-416f-aa61-2f6f6f3e7ddc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wgrsm"
Sep 10 19:59:58.624424 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:58.624384    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxsv6\" (UniqueName: \"kubernetes.io/projected/750ad70e-5da8-416f-aa61-2f6f6f3e7ddc-kube-api-access-lxsv6\") pod \"kserve-controller-manager-d6f4b65b8-wgrsm\" (UID: \"750ad70e-5da8-416f-aa61-2f6f6f3e7ddc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wgrsm"
Sep 10 19:59:58.690439 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:58.690371    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djtx8\" (UniqueName: \"kubernetes.io/projected/8f7d4043-c58c-462f-a9a1-a0471d473dac-kube-api-access-djtx8\") pod \"llmisvc-controller-manager-777c6bd7d5-9wxh9\" (UID: \"8f7d4043-c58c-462f-a9a1-a0471d473dac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9wxh9"
Sep 10 19:59:58.690551 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:58.690442    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f7d4043-c58c-462f-a9a1-a0471d473dac-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9wxh9\" (UID: \"8f7d4043-c58c-462f-a9a1-a0471d473dac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9wxh9"
Sep 10 19:59:58.690603 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:59:58.690559    2561 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 10 19:59:58.690657 ip-10-0-133-162 kubenswrapper[2561]: E0910 19:59:58.690610    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f7d4043-c58c-462f-a9a1-a0471d473dac-cert podName:8f7d4043-c58c-462f-a9a1-a0471d473dac nodeName:}" failed. No retries permitted until 2026-09-10 19:59:59.190595814 +0000 UTC m=+342.855700039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f7d4043-c58c-462f-a9a1-a0471d473dac-cert") pod "llmisvc-controller-manager-777c6bd7d5-9wxh9" (UID: "8f7d4043-c58c-462f-a9a1-a0471d473dac") : secret "llmisvc-webhook-server-cert" not found
Sep 10 19:59:58.709987 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:58.707419    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djtx8\" (UniqueName: \"kubernetes.io/projected/8f7d4043-c58c-462f-a9a1-a0471d473dac-kube-api-access-djtx8\") pod \"llmisvc-controller-manager-777c6bd7d5-9wxh9\" (UID: \"8f7d4043-c58c-462f-a9a1-a0471d473dac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9wxh9"
Sep 10 19:59:58.717493 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:58.717475    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wgrsm"
Sep 10 19:59:59.031096 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:59.030994    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wgrsm"]
Sep 10 19:59:59.033675 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:59:59.033646    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod750ad70e_5da8_416f_aa61_2f6f6f3e7ddc.slice/crio-d0ecadd6e709ccfbd522d8abaa191f7d79b9a20e9f992123aaf89941df2cf917 WatchSource:0}: Error finding container d0ecadd6e709ccfbd522d8abaa191f7d79b9a20e9f992123aaf89941df2cf917: Status 404 returned error can't find the container with id d0ecadd6e709ccfbd522d8abaa191f7d79b9a20e9f992123aaf89941df2cf917
Sep 10 19:59:59.193753 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:59.193713    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f7d4043-c58c-462f-a9a1-a0471d473dac-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9wxh9\" (UID: \"8f7d4043-c58c-462f-a9a1-a0471d473dac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9wxh9"
Sep 10 19:59:59.196556 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:59.196532    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f7d4043-c58c-462f-a9a1-a0471d473dac-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9wxh9\" (UID: \"8f7d4043-c58c-462f-a9a1-a0471d473dac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9wxh9"
Sep 10 19:59:59.243785 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:59.243754    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wgrsm" event={"ID":"750ad70e-5da8-416f-aa61-2f6f6f3e7ddc","Type":"ContainerStarted","Data":"d0ecadd6e709ccfbd522d8abaa191f7d79b9a20e9f992123aaf89941df2cf917"}
Sep 10 19:59:59.392675 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:59.392640    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9wxh9"
Sep 10 19:59:59.685912 ip-10-0-133-162 kubenswrapper[2561]: I0910 19:59:59.685886    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9wxh9"]
Sep 10 19:59:59.687699 ip-10-0-133-162 kubenswrapper[2561]: W0910 19:59:59.687659    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8f7d4043_c58c_462f_a9a1_a0471d473dac.slice/crio-c40b2413c0bf282c465ca833a7ad20bd6ccaa42efdf9efb4e62c309aeb767f24 WatchSource:0}: Error finding container c40b2413c0bf282c465ca833a7ad20bd6ccaa42efdf9efb4e62c309aeb767f24: Status 404 returned error can't find the container with id c40b2413c0bf282c465ca833a7ad20bd6ccaa42efdf9efb4e62c309aeb767f24
Sep 10 20:00:00.249216 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:00.249184    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9wxh9" event={"ID":"8f7d4043-c58c-462f-a9a1-a0471d473dac","Type":"ContainerStarted","Data":"c40b2413c0bf282c465ca833a7ad20bd6ccaa42efdf9efb4e62c309aeb767f24"}
Sep 10 20:00:02.258922 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:02.258888    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wgrsm" event={"ID":"750ad70e-5da8-416f-aa61-2f6f6f3e7ddc","Type":"ContainerStarted","Data":"21d4ed12f4a040bea60df486e12c805d3ae2807735ea00ae2e9c6640c3986aa1"}
Sep 10 20:00:02.259271 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:02.259003    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wgrsm"
Sep 10 20:00:02.282830 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:02.282785    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wgrsm" podStartSLOduration=2.209641124 podStartE2EDuration="4.282770144s" totalImagesPullingTime="2.07312902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:59:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:00:02.279721999 +0000 UTC m=+345.944826247" watchObservedRunningTime="2026-09-10 20:00:02.282770144 +0000 UTC m=+345.947874391"
Sep 10 20:00:02.479856 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:02.479819    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"]
Sep 10 20:00:02.480050 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:02.480027    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q" podUID="4aca27d2-7f28-4ca2-a280-6a11271c8855" containerName="discovery" containerID="cri-o://b37b4fbaf86e94b1a06e193a7b343bbb5edd8d14458738f597cc6b1ed31f7a90" gracePeriod=30
Sep 10 20:00:03.242586 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.242560    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 20:00:03.265571 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.265539    2561 generic.go:356] "Generic (PLEG): container finished" podID="4aca27d2-7f28-4ca2-a280-6a11271c8855" containerID="b37b4fbaf86e94b1a06e193a7b343bbb5edd8d14458738f597cc6b1ed31f7a90" exitCode=0
Sep 10 20:00:03.265960 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.265584    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"
Sep 10 20:00:03.265960 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.265624    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q" event={"ID":"4aca27d2-7f28-4ca2-a280-6a11271c8855","Type":"ContainerDied","Data":"b37b4fbaf86e94b1a06e193a7b343bbb5edd8d14458738f597cc6b1ed31f7a90"}
Sep 10 20:00:03.265960 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.265685    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q" event={"ID":"4aca27d2-7f28-4ca2-a280-6a11271c8855","Type":"ContainerDied","Data":"542b67ec0cc5116db80b05ca40afd8cb304d01cfcbedf32a5f0b314d994286e6"}
Sep 10 20:00:03.265960 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.265714    2561 scope.go:117] "RemoveContainer" containerID="b37b4fbaf86e94b1a06e193a7b343bbb5edd8d14458738f597cc6b1ed31f7a90"
Sep 10 20:00:03.278567 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.278530    2561 scope.go:117] "RemoveContainer" containerID="b37b4fbaf86e94b1a06e193a7b343bbb5edd8d14458738f597cc6b1ed31f7a90"
Sep 10 20:00:03.278896 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:00:03.278873    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b37b4fbaf86e94b1a06e193a7b343bbb5edd8d14458738f597cc6b1ed31f7a90\": container with ID starting with b37b4fbaf86e94b1a06e193a7b343bbb5edd8d14458738f597cc6b1ed31f7a90 not found: ID does not exist" containerID="b37b4fbaf86e94b1a06e193a7b343bbb5edd8d14458738f597cc6b1ed31f7a90"
Sep 10 20:00:03.278985 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.278909    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b37b4fbaf86e94b1a06e193a7b343bbb5edd8d14458738f597cc6b1ed31f7a90"} err="failed to get container status \"b37b4fbaf86e94b1a06e193a7b343bbb5edd8d14458738f597cc6b1ed31f7a90\": rpc error: code = NotFound desc = could not find container \"b37b4fbaf86e94b1a06e193a7b343bbb5edd8d14458738f597cc6b1ed31f7a90\": container with ID starting with b37b4fbaf86e94b1a06e193a7b343bbb5edd8d14458738f597cc6b1ed31f7a90 not found: ID does not exist"
Sep 10 20:00:03.334548 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.334520    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4aca27d2-7f28-4ca2-a280-6a11271c8855-local-certs\") pod \"4aca27d2-7f28-4ca2-a280-6a11271c8855\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") "
Sep 10 20:00:03.334662 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.334569    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-csr-dns-cert\") pod \"4aca27d2-7f28-4ca2-a280-6a11271c8855\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") "
Sep 10 20:00:03.334662 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.334613    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-kubeconfig\") pod \"4aca27d2-7f28-4ca2-a280-6a11271c8855\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") "
Sep 10 20:00:03.334662 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.334654    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4aca27d2-7f28-4ca2-a280-6a11271c8855-cacerts\") pod \"4aca27d2-7f28-4ca2-a280-6a11271c8855\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") "
Sep 10 20:00:03.334820 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.334688    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-csr-ca-configmap\") pod \"4aca27d2-7f28-4ca2-a280-6a11271c8855\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") "
Sep 10 20:00:03.334820 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.334717    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-token\") pod \"4aca27d2-7f28-4ca2-a280-6a11271c8855\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") "
Sep 10 20:00:03.334820 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.334767    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4z5q\" (UniqueName: \"kubernetes.io/projected/4aca27d2-7f28-4ca2-a280-6a11271c8855-kube-api-access-x4z5q\") pod \"4aca27d2-7f28-4ca2-a280-6a11271c8855\" (UID: \"4aca27d2-7f28-4ca2-a280-6a11271c8855\") "
Sep 10 20:00:03.335520 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.335180    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "4aca27d2-7f28-4ca2-a280-6a11271c8855" (UID: "4aca27d2-7f28-4ca2-a280-6a11271c8855"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:00:03.337721 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.337694    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "4aca27d2-7f28-4ca2-a280-6a11271c8855" (UID: "4aca27d2-7f28-4ca2-a280-6a11271c8855"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:00:03.337721 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.337711    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4aca27d2-7f28-4ca2-a280-6a11271c8855-kube-api-access-x4z5q" (OuterVolumeSpecName: "kube-api-access-x4z5q") pod "4aca27d2-7f28-4ca2-a280-6a11271c8855" (UID: "4aca27d2-7f28-4ca2-a280-6a11271c8855"). InnerVolumeSpecName "kube-api-access-x4z5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:00:03.338088 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.337757    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4aca27d2-7f28-4ca2-a280-6a11271c8855-local-certs" (OuterVolumeSpecName: "local-certs") pod "4aca27d2-7f28-4ca2-a280-6a11271c8855" (UID: "4aca27d2-7f28-4ca2-a280-6a11271c8855"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:00:03.338088 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.337846    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aca27d2-7f28-4ca2-a280-6a11271c8855-cacerts" (OuterVolumeSpecName: "cacerts") pod "4aca27d2-7f28-4ca2-a280-6a11271c8855" (UID: "4aca27d2-7f28-4ca2-a280-6a11271c8855"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:00:03.338178 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.338094    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "4aca27d2-7f28-4ca2-a280-6a11271c8855" (UID: "4aca27d2-7f28-4ca2-a280-6a11271c8855"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:00:03.338178 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.338122    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-token" (OuterVolumeSpecName: "istio-token") pod "4aca27d2-7f28-4ca2-a280-6a11271c8855" (UID: "4aca27d2-7f28-4ca2-a280-6a11271c8855"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:00:03.435637 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.435607    2561 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4aca27d2-7f28-4ca2-a280-6a11271c8855-local-certs\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:00:03.435637 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.435636    2561 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-csr-dns-cert\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:00:03.435637 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.435647    2561 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-kubeconfig\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:00:03.435885 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.435656    2561 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4aca27d2-7f28-4ca2-a280-6a11271c8855-cacerts\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:00:03.435885 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.435665    2561 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-csr-ca-configmap\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:00:03.435885 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.435675    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4aca27d2-7f28-4ca2-a280-6a11271c8855-istio-token\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:00:03.435885 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.435683    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4z5q\" (UniqueName: \"kubernetes.io/projected/4aca27d2-7f28-4ca2-a280-6a11271c8855-kube-api-access-x4z5q\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:00:03.593892 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.593852    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"]
Sep 10 20:00:03.595182 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:03.595154    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5r65q"]
Sep 10 20:00:04.272476 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:04.272438    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9wxh9" event={"ID":"8f7d4043-c58c-462f-a9a1-a0471d473dac","Type":"ContainerStarted","Data":"b8235f5742c1759b4d9261a3e98781dc302dba194643e6d304974075137d6da5"}
Sep 10 20:00:04.272872 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:04.272587    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9wxh9"
Sep 10 20:00:04.299097 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:04.299055    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9wxh9" podStartSLOduration=2.698866442 podStartE2EDuration="6.29904176s" totalImagesPullingTime="3.600175318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:59:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:00:04.298276196 +0000 UTC m=+347.963380444" watchObservedRunningTime="2026-09-10 20:00:04.29904176 +0000 UTC m=+347.964146007"
Sep 10 20:00:04.849332 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:04.849301    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4aca27d2-7f28-4ca2-a280-6a11271c8855" path="/var/lib/kubelet/pods/4aca27d2-7f28-4ca2-a280-6a11271c8855/volumes"
Sep 10 20:00:33.271709 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:33.271676    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wgrsm"
Sep 10 20:00:35.278674 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:00:35.278648    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9wxh9"
Sep 10 20:01:06.256763 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.256727    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-784bf5967-mtz67"]
Sep 10 20:01:06.257736 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.257708    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aca27d2-7f28-4ca2-a280-6a11271c8855" containerName="discovery"
Sep 10 20:01:06.257736 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.257737    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aca27d2-7f28-4ca2-a280-6a11271c8855" containerName="discovery"
Sep 10 20:01:06.257888 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.257829    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4aca27d2-7f28-4ca2-a280-6a11271c8855" containerName="discovery"
Sep 10 20:01:06.259811 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.259794    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:06.275964 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.275941    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-784bf5967-mtz67"]
Sep 10 20:01:06.341441 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.341417    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b74c81d3-ad49-4af8-a2e2-d597541b6d1a-console-config\") pod \"console-784bf5967-mtz67\" (UID: \"b74c81d3-ad49-4af8-a2e2-d597541b6d1a\") " pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:06.341555 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.341457    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b74c81d3-ad49-4af8-a2e2-d597541b6d1a-console-oauth-config\") pod \"console-784bf5967-mtz67\" (UID: \"b74c81d3-ad49-4af8-a2e2-d597541b6d1a\") " pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:06.341555 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.341478    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b74c81d3-ad49-4af8-a2e2-d597541b6d1a-console-serving-cert\") pod \"console-784bf5967-mtz67\" (UID: \"b74c81d3-ad49-4af8-a2e2-d597541b6d1a\") " pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:06.341555 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.341493    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b74c81d3-ad49-4af8-a2e2-d597541b6d1a-oauth-serving-cert\") pod \"console-784bf5967-mtz67\" (UID: \"b74c81d3-ad49-4af8-a2e2-d597541b6d1a\") " pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:06.341555 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.341513    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b74c81d3-ad49-4af8-a2e2-d597541b6d1a-service-ca\") pod \"console-784bf5967-mtz67\" (UID: \"b74c81d3-ad49-4af8-a2e2-d597541b6d1a\") " pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:06.341555 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.341528    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b74c81d3-ad49-4af8-a2e2-d597541b6d1a-trusted-ca-bundle\") pod \"console-784bf5967-mtz67\" (UID: \"b74c81d3-ad49-4af8-a2e2-d597541b6d1a\") " pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:06.341715 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.341591    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jd88\" (UniqueName: \"kubernetes.io/projected/b74c81d3-ad49-4af8-a2e2-d597541b6d1a-kube-api-access-4jd88\") pod \"console-784bf5967-mtz67\" (UID: \"b74c81d3-ad49-4af8-a2e2-d597541b6d1a\") " pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:06.442444 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.442414    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b74c81d3-ad49-4af8-a2e2-d597541b6d1a-console-config\") pod \"console-784bf5967-mtz67\" (UID: \"b74c81d3-ad49-4af8-a2e2-d597541b6d1a\") " pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:06.442588 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.442455    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b74c81d3-ad49-4af8-a2e2-d597541b6d1a-console-oauth-config\") pod \"console-784bf5967-mtz67\" (UID: \"b74c81d3-ad49-4af8-a2e2-d597541b6d1a\") " pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:06.442588 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.442567    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b74c81d3-ad49-4af8-a2e2-d597541b6d1a-console-serving-cert\") pod \"console-784bf5967-mtz67\" (UID: \"b74c81d3-ad49-4af8-a2e2-d597541b6d1a\") " pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:06.442668 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.442605    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b74c81d3-ad49-4af8-a2e2-d597541b6d1a-oauth-serving-cert\") pod \"console-784bf5967-mtz67\" (UID: \"b74c81d3-ad49-4af8-a2e2-d597541b6d1a\") " pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:06.442668 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.442637    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b74c81d3-ad49-4af8-a2e2-d597541b6d1a-service-ca\") pod \"console-784bf5967-mtz67\" (UID: \"b74c81d3-ad49-4af8-a2e2-d597541b6d1a\") " pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:06.442668 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.442659    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b74c81d3-ad49-4af8-a2e2-d597541b6d1a-trusted-ca-bundle\") pod \"console-784bf5967-mtz67\" (UID: \"b74c81d3-ad49-4af8-a2e2-d597541b6d1a\") " pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:06.442807 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.442693    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jd88\" (UniqueName: \"kubernetes.io/projected/b74c81d3-ad49-4af8-a2e2-d597541b6d1a-kube-api-access-4jd88\") pod \"console-784bf5967-mtz67\" (UID: \"b74c81d3-ad49-4af8-a2e2-d597541b6d1a\") " pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:06.443222 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.443198    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b74c81d3-ad49-4af8-a2e2-d597541b6d1a-console-config\") pod \"console-784bf5967-mtz67\" (UID: \"b74c81d3-ad49-4af8-a2e2-d597541b6d1a\") " pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:06.443369 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.443347    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b74c81d3-ad49-4af8-a2e2-d597541b6d1a-service-ca\") pod \"console-784bf5967-mtz67\" (UID: \"b74c81d3-ad49-4af8-a2e2-d597541b6d1a\") " pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:06.443450 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.443440    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b74c81d3-ad49-4af8-a2e2-d597541b6d1a-oauth-serving-cert\") pod \"console-784bf5967-mtz67\" (UID: \"b74c81d3-ad49-4af8-a2e2-d597541b6d1a\") " pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:06.443602 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.443576    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b74c81d3-ad49-4af8-a2e2-d597541b6d1a-trusted-ca-bundle\") pod \"console-784bf5967-mtz67\" (UID: \"b74c81d3-ad49-4af8-a2e2-d597541b6d1a\") " pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:06.445026 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.445006    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b74c81d3-ad49-4af8-a2e2-d597541b6d1a-console-oauth-config\") pod \"console-784bf5967-mtz67\" (UID: \"b74c81d3-ad49-4af8-a2e2-d597541b6d1a\") " pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:06.445110 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.445036    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b74c81d3-ad49-4af8-a2e2-d597541b6d1a-console-serving-cert\") pod \"console-784bf5967-mtz67\" (UID: \"b74c81d3-ad49-4af8-a2e2-d597541b6d1a\") " pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:06.459128 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.459107    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jd88\" (UniqueName: \"kubernetes.io/projected/b74c81d3-ad49-4af8-a2e2-d597541b6d1a-kube-api-access-4jd88\") pod \"console-784bf5967-mtz67\" (UID: \"b74c81d3-ad49-4af8-a2e2-d597541b6d1a\") " pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:06.569016 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.568951    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:06.846885 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:01:06.846854    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb74c81d3_ad49_4af8_a2e2_d597541b6d1a.slice/crio-f060a89b66403a5f89072321474016b7d1c41b8da2fc581ce407448bde64cb68 WatchSource:0}: Error finding container f060a89b66403a5f89072321474016b7d1c41b8da2fc581ce407448bde64cb68: Status 404 returned error can't find the container with id f060a89b66403a5f89072321474016b7d1c41b8da2fc581ce407448bde64cb68
Sep 10 20:01:06.849659 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:06.849638    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-784bf5967-mtz67"]
Sep 10 20:01:07.231566 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:07.231487    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t562c"]
Sep 10 20:01:07.233688 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:07.233667    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t562c"
Sep 10 20:01:07.236373 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:07.236354    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 10 20:01:07.236497 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:07.236473    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 20:01:07.236579 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:07.236519    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-98wzx\""
Sep 10 20:01:07.237377 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:07.237360    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 20:01:07.247897 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:07.247875    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t562c"]
Sep 10 20:01:07.350709 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:07.350675    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4fqd\" (UniqueName: \"kubernetes.io/projected/f4fe97cb-8360-4fcb-b584-f5b1ced2c755-kube-api-access-r4fqd\") pod \"dns-operator-controller-manager-7b84cd7c9c-t562c\" (UID: \"f4fe97cb-8360-4fcb-b584-f5b1ced2c755\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t562c"
Sep 10 20:01:07.451152 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:07.451116    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4fqd\" (UniqueName: \"kubernetes.io/projected/f4fe97cb-8360-4fcb-b584-f5b1ced2c755-kube-api-access-r4fqd\") pod \"dns-operator-controller-manager-7b84cd7c9c-t562c\" (UID: \"f4fe97cb-8360-4fcb-b584-f5b1ced2c755\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t562c"
Sep 10 20:01:07.468223 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:07.468196    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4fqd\" (UniqueName: \"kubernetes.io/projected/f4fe97cb-8360-4fcb-b584-f5b1ced2c755-kube-api-access-r4fqd\") pod \"dns-operator-controller-manager-7b84cd7c9c-t562c\" (UID: \"f4fe97cb-8360-4fcb-b584-f5b1ced2c755\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t562c"
Sep 10 20:01:07.526241 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:07.526169    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784bf5967-mtz67" event={"ID":"b74c81d3-ad49-4af8-a2e2-d597541b6d1a","Type":"ContainerStarted","Data":"cc286349858737f725ed61bd62ee3e88a5296ea266a12d4c485c3f7f5ba9c147"}
Sep 10 20:01:07.526241 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:07.526238    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784bf5967-mtz67" event={"ID":"b74c81d3-ad49-4af8-a2e2-d597541b6d1a","Type":"ContainerStarted","Data":"f060a89b66403a5f89072321474016b7d1c41b8da2fc581ce407448bde64cb68"}
Sep 10 20:01:07.543791 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:07.543765    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t562c"
Sep 10 20:01:07.552653 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:07.552601    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-784bf5967-mtz67" podStartSLOduration=1.552582148 podStartE2EDuration="1.552582148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:01:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:01:07.551183768 +0000 UTC m=+411.216288015" watchObservedRunningTime="2026-09-10 20:01:07.552582148 +0000 UTC m=+411.217686396"
Sep 10 20:01:07.841939 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:07.841913    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t562c"]
Sep 10 20:01:07.844344 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:01:07.844311    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4fe97cb_8360_4fcb_b584_f5b1ced2c755.slice/crio-39dae8aea1b7c44a6e2031c2f6637473b34d4ee4819179aca5ea77a1ee89eb59 WatchSource:0}: Error finding container 39dae8aea1b7c44a6e2031c2f6637473b34d4ee4819179aca5ea77a1ee89eb59: Status 404 returned error can't find the container with id 39dae8aea1b7c44a6e2031c2f6637473b34d4ee4819179aca5ea77a1ee89eb59
Sep 10 20:01:08.531449 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:08.531409    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t562c" event={"ID":"f4fe97cb-8360-4fcb-b584-f5b1ced2c755","Type":"ContainerStarted","Data":"39dae8aea1b7c44a6e2031c2f6637473b34d4ee4819179aca5ea77a1ee89eb59"}
Sep 10 20:01:11.547282 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:11.547249    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t562c" event={"ID":"f4fe97cb-8360-4fcb-b584-f5b1ced2c755","Type":"ContainerStarted","Data":"1853d535fd60ba2ebe18a74f60ef18fdf359c4357eecb33c363bff3c064e64c5"}
Sep 10 20:01:11.547685 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:11.547348    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t562c"
Sep 10 20:01:11.590317 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:11.590276    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t562c" podStartSLOduration=1.9163130659999998 podStartE2EDuration="4.590262439s" totalImagesPullingTime="2.673949373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:01:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:01:11.587635019 +0000 UTC m=+415.252739266" watchObservedRunningTime="2026-09-10 20:01:11.590262439 +0000 UTC m=+415.255366685"
Sep 10 20:01:12.137887 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:12.137856    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz"]
Sep 10 20:01:12.140292 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:12.140273    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz"
Sep 10 20:01:12.144357 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:12.144339    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fnjn8\""
Sep 10 20:01:12.160195 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:12.160174    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz"]
Sep 10 20:01:12.291790 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:12.291755    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ed866be-c56e-4620-833b-609d7a06f0ef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nnskz\" (UID: \"5ed866be-c56e-4620-833b-609d7a06f0ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz"
Sep 10 20:01:12.291960 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:12.291804    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2d5f\" (UniqueName: \"kubernetes.io/projected/5ed866be-c56e-4620-833b-609d7a06f0ef-kube-api-access-p2d5f\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nnskz\" (UID: \"5ed866be-c56e-4620-833b-609d7a06f0ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz"
Sep 10 20:01:12.392898 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:12.392823    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ed866be-c56e-4620-833b-609d7a06f0ef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nnskz\" (UID: \"5ed866be-c56e-4620-833b-609d7a06f0ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz"
Sep 10 20:01:12.392898 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:12.392867    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2d5f\" (UniqueName: \"kubernetes.io/projected/5ed866be-c56e-4620-833b-609d7a06f0ef-kube-api-access-p2d5f\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nnskz\" (UID: \"5ed866be-c56e-4620-833b-609d7a06f0ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz"
Sep 10 20:01:12.393200 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:12.393177    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ed866be-c56e-4620-833b-609d7a06f0ef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nnskz\" (UID: \"5ed866be-c56e-4620-833b-609d7a06f0ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz"
Sep 10 20:01:12.416578 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:12.416553    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2d5f\" (UniqueName: \"kubernetes.io/projected/5ed866be-c56e-4620-833b-609d7a06f0ef-kube-api-access-p2d5f\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nnskz\" (UID: \"5ed866be-c56e-4620-833b-609d7a06f0ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz"
Sep 10 20:01:12.450484 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:12.450457    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz"
Sep 10 20:01:12.737307 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:12.737227    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz"]
Sep 10 20:01:12.740341 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:01:12.740315    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed866be_c56e_4620_833b_609d7a06f0ef.slice/crio-fd75ff3d0dbb64a9b55338ba4d36ddf77187f0bd84747fc0d20e8029443460d2 WatchSource:0}: Error finding container fd75ff3d0dbb64a9b55338ba4d36ddf77187f0bd84747fc0d20e8029443460d2: Status 404 returned error can't find the container with id fd75ff3d0dbb64a9b55338ba4d36ddf77187f0bd84747fc0d20e8029443460d2
Sep 10 20:01:13.557698 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:13.557661    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz" event={"ID":"5ed866be-c56e-4620-833b-609d7a06f0ef","Type":"ContainerStarted","Data":"fd75ff3d0dbb64a9b55338ba4d36ddf77187f0bd84747fc0d20e8029443460d2"}
Sep 10 20:01:14.665315 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:14.665280    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-85k6c"]
Sep 10 20:01:14.667983 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:14.667966    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-85k6c"
Sep 10 20:01:14.671225 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:14.671207    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-9q6fk\""
Sep 10 20:01:14.695875 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:14.695856    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-85k6c"]
Sep 10 20:01:14.813215 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:14.813183    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tpgk\" (UniqueName: \"kubernetes.io/projected/358c0815-6d65-410c-91ab-94835fb83e36-kube-api-access-4tpgk\") pod \"authorino-operator-76b478bd78-85k6c\" (UID: \"358c0815-6d65-410c-91ab-94835fb83e36\") " pod="kuadrant-system/authorino-operator-76b478bd78-85k6c"
Sep 10 20:01:14.914493 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:14.914445    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tpgk\" (UniqueName: \"kubernetes.io/projected/358c0815-6d65-410c-91ab-94835fb83e36-kube-api-access-4tpgk\") pod \"authorino-operator-76b478bd78-85k6c\" (UID: \"358c0815-6d65-410c-91ab-94835fb83e36\") " pod="kuadrant-system/authorino-operator-76b478bd78-85k6c"
Sep 10 20:01:14.929643 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:14.929583    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tpgk\" (UniqueName: \"kubernetes.io/projected/358c0815-6d65-410c-91ab-94835fb83e36-kube-api-access-4tpgk\") pod \"authorino-operator-76b478bd78-85k6c\" (UID: \"358c0815-6d65-410c-91ab-94835fb83e36\") " pod="kuadrant-system/authorino-operator-76b478bd78-85k6c"
Sep 10 20:01:14.978295 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:14.978264    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-85k6c"
Sep 10 20:01:15.255560 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:15.255426    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-85k6c"]
Sep 10 20:01:15.258157 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:01:15.258125    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod358c0815_6d65_410c_91ab_94835fb83e36.slice/crio-64a4c416823db0a042106158a05c7b841f3ef2d4330f12a54fc5836398ac52d4 WatchSource:0}: Error finding container 64a4c416823db0a042106158a05c7b841f3ef2d4330f12a54fc5836398ac52d4: Status 404 returned error can't find the container with id 64a4c416823db0a042106158a05c7b841f3ef2d4330f12a54fc5836398ac52d4
Sep 10 20:01:15.567071 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:15.566999    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-85k6c" event={"ID":"358c0815-6d65-410c-91ab-94835fb83e36","Type":"ContainerStarted","Data":"64a4c416823db0a042106158a05c7b841f3ef2d4330f12a54fc5836398ac52d4"}
Sep 10 20:01:16.569384 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:16.569223    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:16.569384 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:16.569289    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:16.576112 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:16.576077    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:16.733140 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:16.733061    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhcfc"]
Sep 10 20:01:16.735667 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:16.735643    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhcfc"
Sep 10 20:01:16.739226 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:16.739201    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-wllh5\""
Sep 10 20:01:16.751634 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:16.751611    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhcfc"]
Sep 10 20:01:16.830535 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:16.830504    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6str\" (UniqueName: \"kubernetes.io/projected/6b9d8123-2689-46d9-a24b-479bc368c83a-kube-api-access-k6str\") pod \"limitador-operator-controller-manager-74495c69f8-xhcfc\" (UID: \"6b9d8123-2689-46d9-a24b-479bc368c83a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhcfc"
Sep 10 20:01:16.930978 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:16.930937    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6str\" (UniqueName: \"kubernetes.io/projected/6b9d8123-2689-46d9-a24b-479bc368c83a-kube-api-access-k6str\") pod \"limitador-operator-controller-manager-74495c69f8-xhcfc\" (UID: \"6b9d8123-2689-46d9-a24b-479bc368c83a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhcfc"
Sep 10 20:01:16.944062 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:16.944031    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6str\" (UniqueName: \"kubernetes.io/projected/6b9d8123-2689-46d9-a24b-479bc368c83a-kube-api-access-k6str\") pod \"limitador-operator-controller-manager-74495c69f8-xhcfc\" (UID: \"6b9d8123-2689-46d9-a24b-479bc368c83a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhcfc"
Sep 10 20:01:17.053262 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:17.053235    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhcfc"
Sep 10 20:01:17.341808 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:17.341774    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhcfc"]
Sep 10 20:01:17.344487 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:01:17.344449    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b9d8123_2689_46d9_a24b_479bc368c83a.slice/crio-4862a1758808b97b2862e80623abe58f8a495db4bc841df27fbc6c3b77066e27 WatchSource:0}: Error finding container 4862a1758808b97b2862e80623abe58f8a495db4bc841df27fbc6c3b77066e27: Status 404 returned error can't find the container with id 4862a1758808b97b2862e80623abe58f8a495db4bc841df27fbc6c3b77066e27
Sep 10 20:01:17.579553 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:17.579520    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhcfc" event={"ID":"6b9d8123-2689-46d9-a24b-479bc368c83a","Type":"ContainerStarted","Data":"4862a1758808b97b2862e80623abe58f8a495db4bc841df27fbc6c3b77066e27"}
Sep 10 20:01:17.581405 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:17.581351    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-85k6c" event={"ID":"358c0815-6d65-410c-91ab-94835fb83e36","Type":"ContainerStarted","Data":"97a753209643e103ce46aa6a1913d976ee4b778b44ac88bae8db3805403aedc8"}
Sep 10 20:01:17.581532 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:17.581440    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-85k6c"
Sep 10 20:01:17.586701 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:17.586675    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-784bf5967-mtz67"
Sep 10 20:01:17.607202 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:17.607150    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-85k6c" podStartSLOduration=1.886314464 podStartE2EDuration="3.607134385s" totalImagesPullingTime="1.720819921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:01:17.604241044 +0000 UTC m=+421.269345290" watchObservedRunningTime="2026-09-10 20:01:17.607134385 +0000 UTC m=+421.272238631"
Sep 10 20:01:17.682014 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:17.681978    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c84965b98-wjnkq"]
Sep 10 20:01:20.598213 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:20.598180    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz" event={"ID":"5ed866be-c56e-4620-833b-609d7a06f0ef","Type":"ContainerStarted","Data":"dcb9404fe012b19549bbb4bad64a58a52790e54280aa663e2bee35a36b622ba4"}
Sep 10 20:01:20.598673 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:20.598284    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz"
Sep 10 20:01:20.600025 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:20.600005    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhcfc" event={"ID":"6b9d8123-2689-46d9-a24b-479bc368c83a","Type":"ContainerStarted","Data":"85ff913e8e4f5c5e2fc5f8f4c93d213ec8e2191f367e5de8c5e2f0645a4bd411"}
Sep 10 20:01:20.600131 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:20.600109    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhcfc"
Sep 10 20:01:20.636664 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:20.636608    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz" podStartSLOduration=1.400837792 podStartE2EDuration="8.636593172s" totalImagesPullingTime="7.23575538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:01:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:01:20.634917043 +0000 UTC m=+424.300021302" watchObservedRunningTime="2026-09-10 20:01:20.636593172 +0000 UTC m=+424.301697419"
Sep 10 20:01:20.676188 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:20.676136    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhcfc" podStartSLOduration=2.051027931 podStartE2EDuration="4.676118229s" totalImagesPullingTime="2.625090298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:01:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:01:20.675556374 +0000 UTC m=+424.340660624" watchObservedRunningTime="2026-09-10 20:01:20.676118229 +0000 UTC m=+424.341222475"
Sep 10 20:01:22.555555 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:22.555521    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t562c"
Sep 10 20:01:22.705526 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:22.705492    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-45rrs"]
Sep 10 20:01:22.709355 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:22.709331    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-45rrs"
Sep 10 20:01:22.712429 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:22.712378    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 10 20:01:22.712981 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:22.712961    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fnn7r\""
Sep 10 20:01:22.712981 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:22.712977    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 10 20:01:22.721589 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:22.721560    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-45rrs"]
Sep 10 20:01:22.780688 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:22.780655    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/30f0e8a7-c487-4887-9e39-6484080fd3be-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-45rrs\" (UID: \"30f0e8a7-c487-4887-9e39-6484080fd3be\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-45rrs"
Sep 10 20:01:22.780858 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:22.780699    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/30f0e8a7-c487-4887-9e39-6484080fd3be-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-45rrs\" (UID: \"30f0e8a7-c487-4887-9e39-6484080fd3be\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-45rrs"
Sep 10 20:01:22.780858 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:22.780723    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf5bt\" (UniqueName: \"kubernetes.io/projected/30f0e8a7-c487-4887-9e39-6484080fd3be-kube-api-access-vf5bt\") pod \"kuadrant-console-plugin-fbdd4f445-45rrs\" (UID: \"30f0e8a7-c487-4887-9e39-6484080fd3be\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-45rrs"
Sep 10 20:01:22.882183 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:22.882145    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf5bt\" (UniqueName: \"kubernetes.io/projected/30f0e8a7-c487-4887-9e39-6484080fd3be-kube-api-access-vf5bt\") pod \"kuadrant-console-plugin-fbdd4f445-45rrs\" (UID: \"30f0e8a7-c487-4887-9e39-6484080fd3be\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-45rrs"
Sep 10 20:01:22.882330 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:22.882224    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/30f0e8a7-c487-4887-9e39-6484080fd3be-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-45rrs\" (UID: \"30f0e8a7-c487-4887-9e39-6484080fd3be\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-45rrs"
Sep 10 20:01:22.882330 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:22.882252    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/30f0e8a7-c487-4887-9e39-6484080fd3be-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-45rrs\" (UID: \"30f0e8a7-c487-4887-9e39-6484080fd3be\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-45rrs"
Sep 10 20:01:22.882405 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:01:22.882342    2561 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 10 20:01:22.882461 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:01:22.882421    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30f0e8a7-c487-4887-9e39-6484080fd3be-plugin-serving-cert podName:30f0e8a7-c487-4887-9e39-6484080fd3be nodeName:}" failed. No retries permitted until 2026-09-10 20:01:23.382403665 +0000 UTC m=+427.047507908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/30f0e8a7-c487-4887-9e39-6484080fd3be-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-45rrs" (UID: "30f0e8a7-c487-4887-9e39-6484080fd3be") : secret "plugin-serving-cert" not found
Sep 10 20:01:22.882929 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:22.882908    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/30f0e8a7-c487-4887-9e39-6484080fd3be-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-45rrs\" (UID: \"30f0e8a7-c487-4887-9e39-6484080fd3be\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-45rrs"
Sep 10 20:01:22.897536 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:22.897496    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf5bt\" (UniqueName: \"kubernetes.io/projected/30f0e8a7-c487-4887-9e39-6484080fd3be-kube-api-access-vf5bt\") pod \"kuadrant-console-plugin-fbdd4f445-45rrs\" (UID: \"30f0e8a7-c487-4887-9e39-6484080fd3be\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-45rrs"
Sep 10 20:01:23.386636 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:23.386601    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/30f0e8a7-c487-4887-9e39-6484080fd3be-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-45rrs\" (UID: \"30f0e8a7-c487-4887-9e39-6484080fd3be\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-45rrs"
Sep 10 20:01:23.389042 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:23.389018    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/30f0e8a7-c487-4887-9e39-6484080fd3be-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-45rrs\" (UID: \"30f0e8a7-c487-4887-9e39-6484080fd3be\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-45rrs"
Sep 10 20:01:23.618794 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:23.618757    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-45rrs"
Sep 10 20:01:23.894847 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:23.894812    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-45rrs"]
Sep 10 20:01:23.897757 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:01:23.897725    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30f0e8a7_c487_4887_9e39_6484080fd3be.slice/crio-54e62fdf295aaa58570e118ba6e45d145ae9e69c3bde2b0ebcd180fc4bd9c062 WatchSource:0}: Error finding container 54e62fdf295aaa58570e118ba6e45d145ae9e69c3bde2b0ebcd180fc4bd9c062: Status 404 returned error can't find the container with id 54e62fdf295aaa58570e118ba6e45d145ae9e69c3bde2b0ebcd180fc4bd9c062
Sep 10 20:01:24.621352 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:24.621315    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-45rrs" event={"ID":"30f0e8a7-c487-4887-9e39-6484080fd3be","Type":"ContainerStarted","Data":"54e62fdf295aaa58570e118ba6e45d145ae9e69c3bde2b0ebcd180fc4bd9c062"}
Sep 10 20:01:28.588587 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:28.588546    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-85k6c"
Sep 10 20:01:29.648836 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:29.648801    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-45rrs" event={"ID":"30f0e8a7-c487-4887-9e39-6484080fd3be","Type":"ContainerStarted","Data":"9fb3575656f8c4cc1506fe155bebac1fc7393c99aa1842a5d22e45b297777372"}
Sep 10 20:01:29.676266 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:29.676218    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-45rrs" podStartSLOduration=2.976996044 podStartE2EDuration="7.676201041s" totalImagesPullingTime="4.699204997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:01:29.676126396 +0000 UTC m=+433.341230643" watchObservedRunningTime="2026-09-10 20:01:29.676201041 +0000 UTC m=+433.341305287"
Sep 10 20:01:31.606946 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:31.606916    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz"
Sep 10 20:01:31.607385 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:31.607060    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhcfc"
Sep 10 20:01:33.943921 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:33.943883    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz"]
Sep 10 20:01:33.944316 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:33.944095    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz" podUID="5ed866be-c56e-4620-833b-609d7a06f0ef" containerName="manager" containerID="cri-o://dcb9404fe012b19549bbb4bad64a58a52790e54280aa663e2bee35a36b622ba4" gracePeriod=2
Sep 10 20:01:33.956715 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:33.956691    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz"]
Sep 10 20:01:33.983351 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:33.983321    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhcfc"]
Sep 10 20:01:33.983597 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:33.983569    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhcfc" podUID="6b9d8123-2689-46d9-a24b-479bc368c83a" containerName="manager" containerID="cri-o://85ff913e8e4f5c5e2fc5f8f4c93d213ec8e2191f367e5de8c5e2f0645a4bd411" gracePeriod=2
Sep 10 20:01:33.986150 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:01:33.986110    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-nnskz\" is forbidden: User \"system:node:ip-10-0-133-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-162.ec2.internal' and this object" podUID="5ed866be-c56e-4620-833b-609d7a06f0ef" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz"
Sep 10 20:01:33.991783 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:33.991758    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v"]
Sep 10 20:01:33.992150 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:33.992131    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ed866be-c56e-4620-833b-609d7a06f0ef" containerName="manager"
Sep 10 20:01:33.992234 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:33.992152    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ed866be-c56e-4620-833b-609d7a06f0ef" containerName="manager"
Sep 10 20:01:33.992234 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:33.992228    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ed866be-c56e-4620-833b-609d7a06f0ef" containerName="manager"
Sep 10 20:01:34.084720 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.084579    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhcfc"]
Sep 10 20:01:34.084720 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.084635    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v"]
Sep 10 20:01:34.084720 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.084667    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-b7hvp"]
Sep 10 20:01:34.085444 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.085058    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v"
Sep 10 20:01:34.085444 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.085088    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b9d8123-2689-46d9-a24b-479bc368c83a" containerName="manager"
Sep 10 20:01:34.085444 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.085107    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b9d8123-2689-46d9-a24b-479bc368c83a" containerName="manager"
Sep 10 20:01:34.085444 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.085222    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b9d8123-2689-46d9-a24b-479bc368c83a" containerName="manager"
Sep 10 20:01:34.088043 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:01:34.088009    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xhcfc\" is forbidden: User \"system:node:ip-10-0-133-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-162.ec2.internal' and this object" podUID="6b9d8123-2689-46d9-a24b-479bc368c83a" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhcfc"
Sep 10 20:01:34.090677 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:01:34.090641    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-nnskz\" is forbidden: User \"system:node:ip-10-0-133-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-162.ec2.internal' and this object" podUID="5ed866be-c56e-4620-833b-609d7a06f0ef" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz"
Sep 10 20:01:34.100625 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.100602    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-b7hvp"]
Sep 10 20:01:34.100931 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.100719    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b7hvp"
Sep 10 20:01:34.125491 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:01:34.125454    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xhcfc\" is forbidden: User \"system:node:ip-10-0-133-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-162.ec2.internal' and this object" podUID="6b9d8123-2689-46d9-a24b-479bc368c83a" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhcfc"
Sep 10 20:01:34.129034 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:01:34.128987    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-nnskz\" is forbidden: User \"system:node:ip-10-0-133-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-162.ec2.internal' and this object" podUID="5ed866be-c56e-4620-833b-609d7a06f0ef" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz"
Sep 10 20:01:34.281932 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.281897    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lff9d\" (UniqueName: \"kubernetes.io/projected/ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24-kube-api-access-lff9d\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lzb7v\" (UID: \"ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v"
Sep 10 20:01:34.282087 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.281960    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5hvz\" (UniqueName: \"kubernetes.io/projected/cc8fae29-e3c1-4b1f-95d8-e24f8288fc4c-kube-api-access-d5hvz\") pod \"limitador-operator-controller-manager-74495c69f8-b7hvp\" (UID: \"cc8fae29-e3c1-4b1f-95d8-e24f8288fc4c\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b7hvp"
Sep 10 20:01:34.282087 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.282045    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lzb7v\" (UID: \"ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v"
Sep 10 20:01:34.383042 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.382998    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lff9d\" (UniqueName: \"kubernetes.io/projected/ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24-kube-api-access-lff9d\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lzb7v\" (UID: \"ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v"
Sep 10 20:01:34.383210 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.383078    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5hvz\" (UniqueName: \"kubernetes.io/projected/cc8fae29-e3c1-4b1f-95d8-e24f8288fc4c-kube-api-access-d5hvz\") pod \"limitador-operator-controller-manager-74495c69f8-b7hvp\" (UID: \"cc8fae29-e3c1-4b1f-95d8-e24f8288fc4c\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b7hvp"
Sep 10 20:01:34.383210 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.383103    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lzb7v\" (UID: \"ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v"
Sep 10 20:01:34.383473 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.383457    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lzb7v\" (UID: \"ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v"
Sep 10 20:01:34.391590 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.391567    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lff9d\" (UniqueName: \"kubernetes.io/projected/ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24-kube-api-access-lff9d\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lzb7v\" (UID: \"ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v"
Sep 10 20:01:34.392539 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.392518    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5hvz\" (UniqueName: \"kubernetes.io/projected/cc8fae29-e3c1-4b1f-95d8-e24f8288fc4c-kube-api-access-d5hvz\") pod \"limitador-operator-controller-manager-74495c69f8-b7hvp\" (UID: \"cc8fae29-e3c1-4b1f-95d8-e24f8288fc4c\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b7hvp"
Sep 10 20:01:34.537798 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.537708    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v"
Sep 10 20:01:34.544861 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.544826    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b7hvp"
Sep 10 20:01:34.623431 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.623379    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhcfc"
Sep 10 20:01:34.626649 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:01:34.626605    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xhcfc\" is forbidden: User \"system:node:ip-10-0-133-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-162.ec2.internal' and this object" podUID="6b9d8123-2689-46d9-a24b-479bc368c83a" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhcfc"
Sep 10 20:01:34.628571 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:01:34.628518    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-nnskz\" is forbidden: User \"system:node:ip-10-0-133-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-162.ec2.internal' and this object" podUID="5ed866be-c56e-4620-833b-609d7a06f0ef" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz"
Sep 10 20:01:34.672758 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.672719    2561 generic.go:356] "Generic (PLEG): container finished" podID="5ed866be-c56e-4620-833b-609d7a06f0ef" containerID="dcb9404fe012b19549bbb4bad64a58a52790e54280aa663e2bee35a36b622ba4" exitCode=0
Sep 10 20:01:34.674336 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.674310    2561 generic.go:356] "Generic (PLEG): container finished" podID="6b9d8123-2689-46d9-a24b-479bc368c83a" containerID="85ff913e8e4f5c5e2fc5f8f4c93d213ec8e2191f367e5de8c5e2f0645a4bd411" exitCode=0
Sep 10 20:01:34.674472 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.674366    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhcfc"
Sep 10 20:01:34.674472 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.674378    2561 scope.go:117] "RemoveContainer" containerID="85ff913e8e4f5c5e2fc5f8f4c93d213ec8e2191f367e5de8c5e2f0645a4bd411"
Sep 10 20:01:34.677614 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:01:34.677587    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xhcfc\" is forbidden: User \"system:node:ip-10-0-133-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-162.ec2.internal' and this object" podUID="6b9d8123-2689-46d9-a24b-479bc368c83a" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhcfc"
Sep 10 20:01:34.679559 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:01:34.679536    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-nnskz\" is forbidden: User \"system:node:ip-10-0-133-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-162.ec2.internal' and this object" podUID="5ed866be-c56e-4620-833b-609d7a06f0ef" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz"
Sep 10 20:01:34.682349 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.682332    2561 scope.go:117] "RemoveContainer" containerID="85ff913e8e4f5c5e2fc5f8f4c93d213ec8e2191f367e5de8c5e2f0645a4bd411"
Sep 10 20:01:34.682646 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:01:34.682627    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85ff913e8e4f5c5e2fc5f8f4c93d213ec8e2191f367e5de8c5e2f0645a4bd411\": container with ID starting with 85ff913e8e4f5c5e2fc5f8f4c93d213ec8e2191f367e5de8c5e2f0645a4bd411 not found: ID does not exist" containerID="85ff913e8e4f5c5e2fc5f8f4c93d213ec8e2191f367e5de8c5e2f0645a4bd411"
Sep 10 20:01:34.682710 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.682654    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85ff913e8e4f5c5e2fc5f8f4c93d213ec8e2191f367e5de8c5e2f0645a4bd411"} err="failed to get container status \"85ff913e8e4f5c5e2fc5f8f4c93d213ec8e2191f367e5de8c5e2f0645a4bd411\": rpc error: code = NotFound desc = could not find container \"85ff913e8e4f5c5e2fc5f8f4c93d213ec8e2191f367e5de8c5e2f0645a4bd411\": container with ID starting with 85ff913e8e4f5c5e2fc5f8f4c93d213ec8e2191f367e5de8c5e2f0645a4bd411 not found: ID does not exist"
Sep 10 20:01:34.686003 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.685987    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6str\" (UniqueName: \"kubernetes.io/projected/6b9d8123-2689-46d9-a24b-479bc368c83a-kube-api-access-k6str\") pod \"6b9d8123-2689-46d9-a24b-479bc368c83a\" (UID: \"6b9d8123-2689-46d9-a24b-479bc368c83a\") "
Sep 10 20:01:34.688292 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.688269    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b9d8123-2689-46d9-a24b-479bc368c83a-kube-api-access-k6str" (OuterVolumeSpecName: "kube-api-access-k6str") pod "6b9d8123-2689-46d9-a24b-479bc368c83a" (UID: "6b9d8123-2689-46d9-a24b-479bc368c83a"). InnerVolumeSpecName "kube-api-access-k6str". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:01:34.786747 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.786721    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6str\" (UniqueName: \"kubernetes.io/projected/6b9d8123-2689-46d9-a24b-479bc368c83a-kube-api-access-k6str\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:01:34.849844 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.849812    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b9d8123-2689-46d9-a24b-479bc368c83a" path="/var/lib/kubelet/pods/6b9d8123-2689-46d9-a24b-479bc368c83a/volumes"
Sep 10 20:01:34.863314 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:34.863291    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v"]
Sep 10 20:01:34.865638 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:01:34.865608    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac54efe9_8df4_4f6a_b6d2_99a44b3fdc24.slice/crio-2c187d411053d8f88f01a23405dfa3215754a205e30e060d3b5ae3cf32a3785d WatchSource:0}: Error finding container 2c187d411053d8f88f01a23405dfa3215754a205e30e060d3b5ae3cf32a3785d: Status 404 returned error can't find the container with id 2c187d411053d8f88f01a23405dfa3215754a205e30e060d3b5ae3cf32a3785d
Sep 10 20:01:35.082108 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:35.082049    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-b7hvp"]
Sep 10 20:01:35.086320 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:01:35.086293    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8fae29_e3c1_4b1f_95d8_e24f8288fc4c.slice/crio-16ce6b8bccad7390f56220ace9b15e4569be6ea0723ff773ae28ae21a18c67fc WatchSource:0}: Error finding container 16ce6b8bccad7390f56220ace9b15e4569be6ea0723ff773ae28ae21a18c67fc: Status 404 returned error can't find the container with id 16ce6b8bccad7390f56220ace9b15e4569be6ea0723ff773ae28ae21a18c67fc
Sep 10 20:01:35.191702 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:35.191680    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz"
Sep 10 20:01:35.290457 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:35.290426    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2d5f\" (UniqueName: \"kubernetes.io/projected/5ed866be-c56e-4620-833b-609d7a06f0ef-kube-api-access-p2d5f\") pod \"5ed866be-c56e-4620-833b-609d7a06f0ef\" (UID: \"5ed866be-c56e-4620-833b-609d7a06f0ef\") "
Sep 10 20:01:35.290457 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:35.290464    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ed866be-c56e-4620-833b-609d7a06f0ef-extensions-socket-volume\") pod \"5ed866be-c56e-4620-833b-609d7a06f0ef\" (UID: \"5ed866be-c56e-4620-833b-609d7a06f0ef\") "
Sep 10 20:01:35.291132 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:35.291103    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ed866be-c56e-4620-833b-609d7a06f0ef-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5ed866be-c56e-4620-833b-609d7a06f0ef" (UID: "5ed866be-c56e-4620-833b-609d7a06f0ef"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:01:35.292659 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:35.292620    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ed866be-c56e-4620-833b-609d7a06f0ef-kube-api-access-p2d5f" (OuterVolumeSpecName: "kube-api-access-p2d5f") pod "5ed866be-c56e-4620-833b-609d7a06f0ef" (UID: "5ed866be-c56e-4620-833b-609d7a06f0ef"). InnerVolumeSpecName "kube-api-access-p2d5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:01:35.391648 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:35.391532    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2d5f\" (UniqueName: \"kubernetes.io/projected/5ed866be-c56e-4620-833b-609d7a06f0ef-kube-api-access-p2d5f\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:01:35.391648 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:35.391569    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ed866be-c56e-4620-833b-609d7a06f0ef-extensions-socket-volume\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:01:35.680455 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:35.680364    2561 scope.go:117] "RemoveContainer" containerID="dcb9404fe012b19549bbb4bad64a58a52790e54280aa663e2bee35a36b622ba4"
Sep 10 20:01:35.680455 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:35.680362    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nnskz"
Sep 10 20:01:35.683166 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:35.683136    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v" event={"ID":"ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24","Type":"ContainerStarted","Data":"1410b92c434431f6199ffd3c6fdaeb4cbfc4369bca30c848f4f15d639f69cd3c"}
Sep 10 20:01:35.683283 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:35.683191    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v" event={"ID":"ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24","Type":"ContainerStarted","Data":"2c187d411053d8f88f01a23405dfa3215754a205e30e060d3b5ae3cf32a3785d"}
Sep 10 20:01:35.683352 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:35.683313    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v"
Sep 10 20:01:35.686220 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:35.686184    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b7hvp" event={"ID":"cc8fae29-e3c1-4b1f-95d8-e24f8288fc4c","Type":"ContainerStarted","Data":"df2b426bc8cec7b1d4c1f9f62d9f1ebb1c740cc9a82539bf36631bc78aa3ffee"}
Sep 10 20:01:35.686367 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:35.686294    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b7hvp" event={"ID":"cc8fae29-e3c1-4b1f-95d8-e24f8288fc4c","Type":"ContainerStarted","Data":"16ce6b8bccad7390f56220ace9b15e4569be6ea0723ff773ae28ae21a18c67fc"}
Sep 10 20:01:35.686632 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:35.686611    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b7hvp"
Sep 10 20:01:35.793891 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:35.793827    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v" podStartSLOduration=2.793803234 podStartE2EDuration="2.793803234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:01:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:01:35.731204652 +0000 UTC m=+439.396308899" watchObservedRunningTime="2026-09-10 20:01:35.793803234 +0000 UTC m=+439.458907496"
Sep 10 20:01:36.849473 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:36.849438    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ed866be-c56e-4620-833b-609d7a06f0ef" path="/var/lib/kubelet/pods/5ed866be-c56e-4620-833b-609d7a06f0ef/volumes"
Sep 10 20:01:42.714532 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:42.714432    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c84965b98-wjnkq" podUID="e2b32dab-5037-4172-89fe-de86488eb7cb" containerName="console" containerID="cri-o://eb6c320fefe28761efa7a5385f724b44eb7fc9b9062fe5ad12804fc7d38265a9" gracePeriod=15
Sep 10 20:01:43.362110 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.362083    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 20:01:43.385975 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.385905    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b7hvp" podStartSLOduration=9.385885735 podStartE2EDuration="9.385885735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:01:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:01:35.793085301 +0000 UTC m=+439.458189548" watchObservedRunningTime="2026-09-10 20:01:43.385885735 +0000 UTC m=+447.050989984"
Sep 10 20:01:43.460232 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.460195    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-oauth-serving-cert\") pod \"e2b32dab-5037-4172-89fe-de86488eb7cb\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") "
Sep 10 20:01:43.460232 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.460234    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-trusted-ca-bundle\") pod \"e2b32dab-5037-4172-89fe-de86488eb7cb\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") "
Sep 10 20:01:43.460486 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.460258    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2b32dab-5037-4172-89fe-de86488eb7cb-console-serving-cert\") pod \"e2b32dab-5037-4172-89fe-de86488eb7cb\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") "
Sep 10 20:01:43.460486 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.460294    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6f6j\" (UniqueName: \"kubernetes.io/projected/e2b32dab-5037-4172-89fe-de86488eb7cb-kube-api-access-k6f6j\") pod \"e2b32dab-5037-4172-89fe-de86488eb7cb\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") "
Sep 10 20:01:43.460486 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.460384    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-console-config\") pod \"e2b32dab-5037-4172-89fe-de86488eb7cb\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") "
Sep 10 20:01:43.460486 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.460434    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-service-ca\") pod \"e2b32dab-5037-4172-89fe-de86488eb7cb\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") "
Sep 10 20:01:43.460486 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.460465    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2b32dab-5037-4172-89fe-de86488eb7cb-console-oauth-config\") pod \"e2b32dab-5037-4172-89fe-de86488eb7cb\" (UID: \"e2b32dab-5037-4172-89fe-de86488eb7cb\") "
Sep 10 20:01:43.460754 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.460618    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e2b32dab-5037-4172-89fe-de86488eb7cb" (UID: "e2b32dab-5037-4172-89fe-de86488eb7cb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:01:43.460754 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.460717    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-trusted-ca-bundle\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:01:43.460872 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.460764    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e2b32dab-5037-4172-89fe-de86488eb7cb" (UID: "e2b32dab-5037-4172-89fe-de86488eb7cb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:01:43.460970 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.460858    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-service-ca" (OuterVolumeSpecName: "service-ca") pod "e2b32dab-5037-4172-89fe-de86488eb7cb" (UID: "e2b32dab-5037-4172-89fe-de86488eb7cb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:01:43.461031 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.461011    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-console-config" (OuterVolumeSpecName: "console-config") pod "e2b32dab-5037-4172-89fe-de86488eb7cb" (UID: "e2b32dab-5037-4172-89fe-de86488eb7cb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:01:43.462572 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.462545    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2b32dab-5037-4172-89fe-de86488eb7cb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e2b32dab-5037-4172-89fe-de86488eb7cb" (UID: "e2b32dab-5037-4172-89fe-de86488eb7cb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:01:43.462685 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.462623    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2b32dab-5037-4172-89fe-de86488eb7cb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e2b32dab-5037-4172-89fe-de86488eb7cb" (UID: "e2b32dab-5037-4172-89fe-de86488eb7cb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:01:43.462816 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.462798    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2b32dab-5037-4172-89fe-de86488eb7cb-kube-api-access-k6f6j" (OuterVolumeSpecName: "kube-api-access-k6f6j") pod "e2b32dab-5037-4172-89fe-de86488eb7cb" (UID: "e2b32dab-5037-4172-89fe-de86488eb7cb"). InnerVolumeSpecName "kube-api-access-k6f6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:01:43.561415 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.561363    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-console-config\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:01:43.561415 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.561387    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-service-ca\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:01:43.561619 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.561427    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2b32dab-5037-4172-89fe-de86488eb7cb-console-oauth-config\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:01:43.561619 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.561437    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2b32dab-5037-4172-89fe-de86488eb7cb-oauth-serving-cert\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:01:43.561619 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.561446    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2b32dab-5037-4172-89fe-de86488eb7cb-console-serving-cert\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:01:43.561619 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.561454    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6f6j\" (UniqueName: \"kubernetes.io/projected/e2b32dab-5037-4172-89fe-de86488eb7cb-kube-api-access-k6f6j\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:01:43.723606 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.723522    2561 generic.go:356] "Generic (PLEG): container finished" podID="e2b32dab-5037-4172-89fe-de86488eb7cb" containerID="eb6c320fefe28761efa7a5385f724b44eb7fc9b9062fe5ad12804fc7d38265a9" exitCode=0
Sep 10 20:01:43.723606 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.723567    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c84965b98-wjnkq"
Sep 10 20:01:43.724089 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.723566    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c84965b98-wjnkq" event={"ID":"e2b32dab-5037-4172-89fe-de86488eb7cb","Type":"ContainerDied","Data":"eb6c320fefe28761efa7a5385f724b44eb7fc9b9062fe5ad12804fc7d38265a9"}
Sep 10 20:01:43.724089 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.723702    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c84965b98-wjnkq" event={"ID":"e2b32dab-5037-4172-89fe-de86488eb7cb","Type":"ContainerDied","Data":"58d7afeddef19d6ab7b5a08b30680bf410ae5724ca82041459262b03bd62e245"}
Sep 10 20:01:43.724089 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.723744    2561 scope.go:117] "RemoveContainer" containerID="eb6c320fefe28761efa7a5385f724b44eb7fc9b9062fe5ad12804fc7d38265a9"
Sep 10 20:01:43.731946 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.731929    2561 scope.go:117] "RemoveContainer" containerID="eb6c320fefe28761efa7a5385f724b44eb7fc9b9062fe5ad12804fc7d38265a9"
Sep 10 20:01:43.732211 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:01:43.732194    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb6c320fefe28761efa7a5385f724b44eb7fc9b9062fe5ad12804fc7d38265a9\": container with ID starting with eb6c320fefe28761efa7a5385f724b44eb7fc9b9062fe5ad12804fc7d38265a9 not found: ID does not exist" containerID="eb6c320fefe28761efa7a5385f724b44eb7fc9b9062fe5ad12804fc7d38265a9"
Sep 10 20:01:43.732254 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.732220    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb6c320fefe28761efa7a5385f724b44eb7fc9b9062fe5ad12804fc7d38265a9"} err="failed to get container status \"eb6c320fefe28761efa7a5385f724b44eb7fc9b9062fe5ad12804fc7d38265a9\": rpc error: code = NotFound desc = could not find container \"eb6c320fefe28761efa7a5385f724b44eb7fc9b9062fe5ad12804fc7d38265a9\": container with ID starting with eb6c320fefe28761efa7a5385f724b44eb7fc9b9062fe5ad12804fc7d38265a9 not found: ID does not exist"
Sep 10 20:01:43.747955 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.747930    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c84965b98-wjnkq"]
Sep 10 20:01:43.756290 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:43.756267    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c84965b98-wjnkq"]
Sep 10 20:01:44.850030 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:44.849989    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2b32dab-5037-4172-89fe-de86488eb7cb" path="/var/lib/kubelet/pods/e2b32dab-5037-4172-89fe-de86488eb7cb/volumes"
Sep 10 20:01:46.693510 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:46.693481    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v"
Sep 10 20:01:46.693935 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:46.693544    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-b7hvp"
Sep 10 20:01:49.947952 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:49.947925    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v"]
Sep 10 20:01:49.948367 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:49.948083    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v" podUID="ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24" containerName="manager" containerID="cri-o://1410b92c434431f6199ffd3c6fdaeb4cbfc4369bca30c848f4f15d639f69cd3c" gracePeriod=10
Sep 10 20:01:50.608071 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:50.608048    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v"
Sep 10 20:01:50.717988 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:50.717958    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24-extensions-socket-volume\") pod \"ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24\" (UID: \"ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24\") "
Sep 10 20:01:50.718134 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:50.718077    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lff9d\" (UniqueName: \"kubernetes.io/projected/ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24-kube-api-access-lff9d\") pod \"ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24\" (UID: \"ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24\") "
Sep 10 20:01:50.718301 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:50.718282    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24" (UID: "ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:01:50.720051 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:50.720025    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24-kube-api-access-lff9d" (OuterVolumeSpecName: "kube-api-access-lff9d") pod "ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24" (UID: "ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24"). InnerVolumeSpecName "kube-api-access-lff9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:01:50.757252 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:50.757225    2561 generic.go:356] "Generic (PLEG): container finished" podID="ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24" containerID="1410b92c434431f6199ffd3c6fdaeb4cbfc4369bca30c848f4f15d639f69cd3c" exitCode=0
Sep 10 20:01:50.757346 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:50.757266    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v" event={"ID":"ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24","Type":"ContainerDied","Data":"1410b92c434431f6199ffd3c6fdaeb4cbfc4369bca30c848f4f15d639f69cd3c"}
Sep 10 20:01:50.757346 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:50.757276    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v"
Sep 10 20:01:50.757346 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:50.757315    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v" event={"ID":"ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24","Type":"ContainerDied","Data":"2c187d411053d8f88f01a23405dfa3215754a205e30e060d3b5ae3cf32a3785d"}
Sep 10 20:01:50.757482 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:50.757345    2561 scope.go:117] "RemoveContainer" containerID="1410b92c434431f6199ffd3c6fdaeb4cbfc4369bca30c848f4f15d639f69cd3c"
Sep 10 20:01:50.766338 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:50.766308    2561 scope.go:117] "RemoveContainer" containerID="1410b92c434431f6199ffd3c6fdaeb4cbfc4369bca30c848f4f15d639f69cd3c"
Sep 10 20:01:50.766620 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:01:50.766603    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1410b92c434431f6199ffd3c6fdaeb4cbfc4369bca30c848f4f15d639f69cd3c\": container with ID starting with 1410b92c434431f6199ffd3c6fdaeb4cbfc4369bca30c848f4f15d639f69cd3c not found: ID does not exist" containerID="1410b92c434431f6199ffd3c6fdaeb4cbfc4369bca30c848f4f15d639f69cd3c"
Sep 10 20:01:50.766669 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:50.766629    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1410b92c434431f6199ffd3c6fdaeb4cbfc4369bca30c848f4f15d639f69cd3c"} err="failed to get container status \"1410b92c434431f6199ffd3c6fdaeb4cbfc4369bca30c848f4f15d639f69cd3c\": rpc error: code = NotFound desc = could not find container \"1410b92c434431f6199ffd3c6fdaeb4cbfc4369bca30c848f4f15d639f69cd3c\": container with ID starting with 1410b92c434431f6199ffd3c6fdaeb4cbfc4369bca30c848f4f15d639f69cd3c not found: ID does not exist"
Sep 10 20:01:50.785037 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:50.785015    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v"]
Sep 10 20:01:50.791695 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:50.791670    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lzb7v"]
Sep 10 20:01:50.819633 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:50.819605    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24-extensions-socket-volume\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:01:50.819633 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:50.819627    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lff9d\" (UniqueName: \"kubernetes.io/projected/ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24-kube-api-access-lff9d\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:01:50.849664 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:01:50.849604    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24" path="/var/lib/kubelet/pods/ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24/volumes"
Sep 10 20:02:06.461278 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.461235    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"]
Sep 10 20:02:06.462000 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.461546    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24" containerName="manager"
Sep 10 20:02:06.462000 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.461559    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24" containerName="manager"
Sep 10 20:02:06.462000 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.461570    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2b32dab-5037-4172-89fe-de86488eb7cb" containerName="console"
Sep 10 20:02:06.462000 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.461575    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2b32dab-5037-4172-89fe-de86488eb7cb" containerName="console"
Sep 10 20:02:06.462000 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.461629    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2b32dab-5037-4172-89fe-de86488eb7cb" containerName="console"
Sep 10 20:02:06.462000 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.461638    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac54efe9-8df4-4f6a-b6d2-99a44b3fdc24" containerName="manager"
Sep 10 20:02:06.471527 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.471499    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.475422 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.475384    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-7jl46\""
Sep 10 20:02:06.475555 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.475405    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 20:02:06.487798 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.487769    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"]
Sep 10 20:02:06.551139 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.551111    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.551309 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.551156    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r58mh\" (UniqueName: \"kubernetes.io/projected/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-kube-api-access-r58mh\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.551309 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.551235    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.551309 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.551267    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.551309 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.551294    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.551479 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.551329    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.551479 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.551345    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.551479 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.551361    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.551479 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.551381    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.652149 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.652120    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.652149 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.652152    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.652432 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.652178    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.652432 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.652306    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.652432 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.652357    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.652432 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.652423    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r58mh\" (UniqueName: \"kubernetes.io/projected/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-kube-api-access-r58mh\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.652698 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.652484    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.652698 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.652515    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.652698 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.652634    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.652698 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.652681    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.652882 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.652772    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.652882 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.652789    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.653174 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.653152    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.653292 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.653155    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.654835 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.654812    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.654930 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.654909    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.662383 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.662358    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.663024 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.663004    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r58mh\" (UniqueName: \"kubernetes.io/projected/608dc0a9-91cf-4679-a99d-6b2e04d7cbef-kube-api-access-r58mh\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2d2hl\" (UID: \"608dc0a9-91cf-4679-a99d-6b2e04d7cbef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:06.781769 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:06.781682    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:07.063326 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:07.063257    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"]
Sep 10 20:02:07.067002 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:02:07.066973    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod608dc0a9_91cf_4679_a99d_6b2e04d7cbef.slice/crio-c5cea2614388893caa48d22e5ef6039fe30ea43837cb37d45434d5c63ca38056 WatchSource:0}: Error finding container c5cea2614388893caa48d22e5ef6039fe30ea43837cb37d45434d5c63ca38056: Status 404 returned error can't find the container with id c5cea2614388893caa48d22e5ef6039fe30ea43837cb37d45434d5c63ca38056
Sep 10 20:02:07.834226 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:07.834193    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl" event={"ID":"608dc0a9-91cf-4679-a99d-6b2e04d7cbef","Type":"ContainerStarted","Data":"c5cea2614388893caa48d22e5ef6039fe30ea43837cb37d45434d5c63ca38056"}
Sep 10 20:02:09.565542 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:09.565505    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:02:09.565802 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:09.565576    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:02:09.565802 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:09.565607    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:02:09.849279 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:09.849248    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl" event={"ID":"608dc0a9-91cf-4679-a99d-6b2e04d7cbef","Type":"ContainerStarted","Data":"f23113b1b12d1b39968cd975c2491ab4b8e12ba159070367d257b913c3f02060"}
Sep 10 20:02:09.879404 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:09.879351    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl" podStartSLOduration=1.383073826 podStartE2EDuration="3.879333559s" totalImagesPullingTime="2.496259733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:02:09.879278436 +0000 UTC m=+473.544382682" watchObservedRunningTime="2026-09-10 20:02:09.879333559 +0000 UTC m=+473.544437809"
Sep 10 20:02:10.782341 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:10.782308    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:10.787105 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:10.787080    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:10.853348 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:10.853317    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:10.854197 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:10.854165    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:02:10.992115 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:10.992082    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-q26tt"]
Sep 10 20:02:10.995347 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:10.995327    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-q26tt"
Sep 10 20:02:10.997862 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:10.997842    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 20:02:11.006654 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:11.006632    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-q26tt"]
Sep 10 20:02:11.086671 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:11.086638    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-q26tt"]
Sep 10 20:02:11.093368 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:11.093338    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/96286a94-8916-4c2e-a5c5-d7eba1040624-config-file\") pod \"limitador-limitador-8588749977-q26tt\" (UID: \"96286a94-8916-4c2e-a5c5-d7eba1040624\") " pod="kuadrant-system/limitador-limitador-8588749977-q26tt"
Sep 10 20:02:11.093536 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:11.093424    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk6bv\" (UniqueName: \"kubernetes.io/projected/96286a94-8916-4c2e-a5c5-d7eba1040624-kube-api-access-pk6bv\") pod \"limitador-limitador-8588749977-q26tt\" (UID: \"96286a94-8916-4c2e-a5c5-d7eba1040624\") " pod="kuadrant-system/limitador-limitador-8588749977-q26tt"
Sep 10 20:02:11.194204 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:11.194172    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/96286a94-8916-4c2e-a5c5-d7eba1040624-config-file\") pod \"limitador-limitador-8588749977-q26tt\" (UID: \"96286a94-8916-4c2e-a5c5-d7eba1040624\") " pod="kuadrant-system/limitador-limitador-8588749977-q26tt"
Sep 10 20:02:11.194204 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:11.194209    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk6bv\" (UniqueName: \"kubernetes.io/projected/96286a94-8916-4c2e-a5c5-d7eba1040624-kube-api-access-pk6bv\") pod \"limitador-limitador-8588749977-q26tt\" (UID: \"96286a94-8916-4c2e-a5c5-d7eba1040624\") " pod="kuadrant-system/limitador-limitador-8588749977-q26tt"
Sep 10 20:02:11.194807 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:11.194787    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/96286a94-8916-4c2e-a5c5-d7eba1040624-config-file\") pod \"limitador-limitador-8588749977-q26tt\" (UID: \"96286a94-8916-4c2e-a5c5-d7eba1040624\") " pod="kuadrant-system/limitador-limitador-8588749977-q26tt"
Sep 10 20:02:11.202769 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:11.202748    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk6bv\" (UniqueName: \"kubernetes.io/projected/96286a94-8916-4c2e-a5c5-d7eba1040624-kube-api-access-pk6bv\") pod \"limitador-limitador-8588749977-q26tt\" (UID: \"96286a94-8916-4c2e-a5c5-d7eba1040624\") " pod="kuadrant-system/limitador-limitador-8588749977-q26tt"
Sep 10 20:02:11.305223 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:11.305193    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-q26tt"
Sep 10 20:02:11.305923 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:11.305900    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:02:11.309028 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:11.309008    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"
Sep 10 20:02:11.323537 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:11.323512    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:02:11.364008 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:11.363981    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:02:11.396449 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:11.396415    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1f8f5ee0-0be9-4379-934c-8067bfa6315c-config-file\") pod \"limitador-limitador-84994f7ffc-6kjgx\" (UID: \"1f8f5ee0-0be9-4379-934c-8067bfa6315c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"
Sep 10 20:02:11.396633 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:11.396495    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dftv\" (UniqueName: \"kubernetes.io/projected/1f8f5ee0-0be9-4379-934c-8067bfa6315c-kube-api-access-6dftv\") pod \"limitador-limitador-84994f7ffc-6kjgx\" (UID: \"1f8f5ee0-0be9-4379-934c-8067bfa6315c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"
Sep 10 20:02:11.497999 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:11.497953    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1f8f5ee0-0be9-4379-934c-8067bfa6315c-config-file\") pod \"limitador-limitador-84994f7ffc-6kjgx\" (UID: \"1f8f5ee0-0be9-4379-934c-8067bfa6315c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"
Sep 10 20:02:11.498223 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:11.498027    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dftv\" (UniqueName: \"kubernetes.io/projected/1f8f5ee0-0be9-4379-934c-8067bfa6315c-kube-api-access-6dftv\") pod \"limitador-limitador-84994f7ffc-6kjgx\" (UID: \"1f8f5ee0-0be9-4379-934c-8067bfa6315c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"
Sep 10 20:02:11.498918 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:11.498894    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1f8f5ee0-0be9-4379-934c-8067bfa6315c-config-file\") pod \"limitador-limitador-84994f7ffc-6kjgx\" (UID: \"1f8f5ee0-0be9-4379-934c-8067bfa6315c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"
Sep 10 20:02:11.506532 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:11.506508    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dftv\" (UniqueName: \"kubernetes.io/projected/1f8f5ee0-0be9-4379-934c-8067bfa6315c-kube-api-access-6dftv\") pod \"limitador-limitador-84994f7ffc-6kjgx\" (UID: \"1f8f5ee0-0be9-4379-934c-8067bfa6315c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"
Sep 10 20:02:11.582764 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:11.582741    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-q26tt"]
Sep 10 20:02:11.585382 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:02:11.585349    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96286a94_8916_4c2e_a5c5_d7eba1040624.slice/crio-f6ecf5e0bcb1a71c9db65185a8e69578070d2479a17f1dd4c7c74a9c25783d17 WatchSource:0}: Error finding container f6ecf5e0bcb1a71c9db65185a8e69578070d2479a17f1dd4c7c74a9c25783d17: Status 404 returned error can't find the container with id f6ecf5e0bcb1a71c9db65185a8e69578070d2479a17f1dd4c7c74a9c25783d17
Sep 10 20:02:11.635406 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:11.635310    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"
Sep 10 20:02:11.859138 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:11.859095    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-q26tt" event={"ID":"96286a94-8916-4c2e-a5c5-d7eba1040624","Type":"ContainerStarted","Data":"f6ecf5e0bcb1a71c9db65185a8e69578070d2479a17f1dd4c7c74a9c25783d17"}
Sep 10 20:02:11.932174 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:11.932094    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:02:11.934968 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:02:11.934946    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f8f5ee0_0be9_4379_934c_8067bfa6315c.slice/crio-a84e4d6979e443f3f332594123e3092a943a0a3b11406f34796f1453f6abc837 WatchSource:0}: Error finding container a84e4d6979e443f3f332594123e3092a943a0a3b11406f34796f1453f6abc837: Status 404 returned error can't find the container with id a84e4d6979e443f3f332594123e3092a943a0a3b11406f34796f1453f6abc837
Sep 10 20:02:12.131780 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:12.131749    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-tjmks"]
Sep 10 20:02:12.136085 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:12.136064    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-tjmks"
Sep 10 20:02:12.139047 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:12.139022    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6n2dz\""
Sep 10 20:02:12.147041 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:12.147017    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-tjmks"]
Sep 10 20:02:12.205568 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:12.205490    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s7jz\" (UniqueName: \"kubernetes.io/projected/93b6488a-0a6f-4017-9849-5f58d69da907-kube-api-access-6s7jz\") pod \"authorino-59c974bd48-tjmks\" (UID: \"93b6488a-0a6f-4017-9849-5f58d69da907\") " pod="kuadrant-system/authorino-59c974bd48-tjmks"
Sep 10 20:02:12.306636 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:12.306604    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s7jz\" (UniqueName: \"kubernetes.io/projected/93b6488a-0a6f-4017-9849-5f58d69da907-kube-api-access-6s7jz\") pod \"authorino-59c974bd48-tjmks\" (UID: \"93b6488a-0a6f-4017-9849-5f58d69da907\") " pod="kuadrant-system/authorino-59c974bd48-tjmks"
Sep 10 20:02:12.316595 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:12.316569    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s7jz\" (UniqueName: \"kubernetes.io/projected/93b6488a-0a6f-4017-9849-5f58d69da907-kube-api-access-6s7jz\") pod \"authorino-59c974bd48-tjmks\" (UID: \"93b6488a-0a6f-4017-9849-5f58d69da907\") " pod="kuadrant-system/authorino-59c974bd48-tjmks"
Sep 10 20:02:12.445245 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:12.445208    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-tjmks"
Sep 10 20:02:12.729759 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:12.729571    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-tjmks"]
Sep 10 20:02:12.798304 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:02:12.798269    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93b6488a_0a6f_4017_9849_5f58d69da907.slice/crio-30565b85a61a8a43371d4655313273251d24d24e395c4b03cfa50f3d64d560f7 WatchSource:0}: Error finding container 30565b85a61a8a43371d4655313273251d24d24e395c4b03cfa50f3d64d560f7: Status 404 returned error can't find the container with id 30565b85a61a8a43371d4655313273251d24d24e395c4b03cfa50f3d64d560f7
Sep 10 20:02:12.871809 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:12.871780    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-tjmks" event={"ID":"93b6488a-0a6f-4017-9849-5f58d69da907","Type":"ContainerStarted","Data":"30565b85a61a8a43371d4655313273251d24d24e395c4b03cfa50f3d64d560f7"}
Sep 10 20:02:12.873112 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:12.873083    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-6kjgx" event={"ID":"1f8f5ee0-0be9-4379-934c-8067bfa6315c","Type":"ContainerStarted","Data":"a84e4d6979e443f3f332594123e3092a943a0a3b11406f34796f1453f6abc837"}
Sep 10 20:02:13.879456 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:13.879425    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-6kjgx" event={"ID":"1f8f5ee0-0be9-4379-934c-8067bfa6315c","Type":"ContainerStarted","Data":"bc42c0e2ede1e400490ac0b5afe0305e7554d1fa6b82fc7c492d2418558cc1b8"}
Sep 10 20:02:13.879835 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:13.879525    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"
Sep 10 20:02:13.900100 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:13.900049    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-6kjgx" podStartSLOduration=1.984007161 podStartE2EDuration="2.900033296s" totalImagesPullingTime="916.026135ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:02:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:02:13.898818025 +0000 UTC m=+477.563922294" watchObservedRunningTime="2026-09-10 20:02:13.900033296 +0000 UTC m=+477.565137533"
Sep 10 20:02:14.886647 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:14.886564    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-q26tt" event={"ID":"96286a94-8916-4c2e-a5c5-d7eba1040624","Type":"ContainerStarted","Data":"3abe90c0999bd1d5c9c7952c51b3d6764e7f4022732e98d5b2e6f23caf300fb2"}
Sep 10 20:02:14.887073 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:14.886887    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-q26tt"
Sep 10 20:02:14.908899 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:14.908843    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-q26tt" podStartSLOduration=1.892346266 podStartE2EDuration="4.908823587s" totalImagesPullingTime="3.016477321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:02:14.908202861 +0000 UTC m=+478.573307111" watchObservedRunningTime="2026-09-10 20:02:14.908823587 +0000 UTC m=+478.573927837"
Sep 10 20:02:15.893030 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:15.892993    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-tjmks" event={"ID":"93b6488a-0a6f-4017-9849-5f58d69da907","Type":"ContainerStarted","Data":"41c5bf1d415ff0077114d60b3d02931e2141490d8e58ce9964d56e4e750ea240"}
Sep 10 20:02:15.909566 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:15.909515    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-tjmks" podStartSLOduration=1.1550824419999999 podStartE2EDuration="3.90949795s" totalImagesPullingTime="2.754415508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:02:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:02:15.908029352 +0000 UTC m=+479.573133616" watchObservedRunningTime="2026-09-10 20:02:15.90949795 +0000 UTC m=+479.574602198"
Sep 10 20:02:24.887661 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:24.887634    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"
Sep 10 20:02:24.937696 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:24.937664    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-q26tt"]
Sep 10 20:02:24.937859 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:24.937835    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-q26tt" podUID="96286a94-8916-4c2e-a5c5-d7eba1040624" containerName="limitador" containerID="cri-o://3abe90c0999bd1d5c9c7952c51b3d6764e7f4022732e98d5b2e6f23caf300fb2" gracePeriod=30
Sep 10 20:02:24.938611 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:24.938522    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-q26tt"
Sep 10 20:02:25.888828 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:25.888805    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-q26tt"
Sep 10 20:02:25.941136 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:25.941108    2561 generic.go:356] "Generic (PLEG): container finished" podID="96286a94-8916-4c2e-a5c5-d7eba1040624" containerID="3abe90c0999bd1d5c9c7952c51b3d6764e7f4022732e98d5b2e6f23caf300fb2" exitCode=0
Sep 10 20:02:25.941299 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:25.941148    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-q26tt"
Sep 10 20:02:25.941299 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:25.941191    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-q26tt" event={"ID":"96286a94-8916-4c2e-a5c5-d7eba1040624","Type":"ContainerDied","Data":"3abe90c0999bd1d5c9c7952c51b3d6764e7f4022732e98d5b2e6f23caf300fb2"}
Sep 10 20:02:25.941299 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:25.941238    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-q26tt" event={"ID":"96286a94-8916-4c2e-a5c5-d7eba1040624","Type":"ContainerDied","Data":"f6ecf5e0bcb1a71c9db65185a8e69578070d2479a17f1dd4c7c74a9c25783d17"}
Sep 10 20:02:25.941299 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:25.941260    2561 scope.go:117] "RemoveContainer" containerID="3abe90c0999bd1d5c9c7952c51b3d6764e7f4022732e98d5b2e6f23caf300fb2"
Sep 10 20:02:25.949367 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:25.949355    2561 scope.go:117] "RemoveContainer" containerID="3abe90c0999bd1d5c9c7952c51b3d6764e7f4022732e98d5b2e6f23caf300fb2"
Sep 10 20:02:25.949651 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:02:25.949633    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3abe90c0999bd1d5c9c7952c51b3d6764e7f4022732e98d5b2e6f23caf300fb2\": container with ID starting with 3abe90c0999bd1d5c9c7952c51b3d6764e7f4022732e98d5b2e6f23caf300fb2 not found: ID does not exist" containerID="3abe90c0999bd1d5c9c7952c51b3d6764e7f4022732e98d5b2e6f23caf300fb2"
Sep 10 20:02:25.949718 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:25.949665    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3abe90c0999bd1d5c9c7952c51b3d6764e7f4022732e98d5b2e6f23caf300fb2"} err="failed to get container status \"3abe90c0999bd1d5c9c7952c51b3d6764e7f4022732e98d5b2e6f23caf300fb2\": rpc error: code = NotFound desc = could not find container \"3abe90c0999bd1d5c9c7952c51b3d6764e7f4022732e98d5b2e6f23caf300fb2\": container with ID starting with 3abe90c0999bd1d5c9c7952c51b3d6764e7f4022732e98d5b2e6f23caf300fb2 not found: ID does not exist"
Sep 10 20:02:26.022162 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:26.022133    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pk6bv\" (UniqueName: \"kubernetes.io/projected/96286a94-8916-4c2e-a5c5-d7eba1040624-kube-api-access-pk6bv\") pod \"96286a94-8916-4c2e-a5c5-d7eba1040624\" (UID: \"96286a94-8916-4c2e-a5c5-d7eba1040624\") "
Sep 10 20:02:26.022314 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:26.022207    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/96286a94-8916-4c2e-a5c5-d7eba1040624-config-file\") pod \"96286a94-8916-4c2e-a5c5-d7eba1040624\" (UID: \"96286a94-8916-4c2e-a5c5-d7eba1040624\") "
Sep 10 20:02:26.022621 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:26.022590    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96286a94-8916-4c2e-a5c5-d7eba1040624-config-file" (OuterVolumeSpecName: "config-file") pod "96286a94-8916-4c2e-a5c5-d7eba1040624" (UID: "96286a94-8916-4c2e-a5c5-d7eba1040624"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:02:26.024195 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:26.024173    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96286a94-8916-4c2e-a5c5-d7eba1040624-kube-api-access-pk6bv" (OuterVolumeSpecName: "kube-api-access-pk6bv") pod "96286a94-8916-4c2e-a5c5-d7eba1040624" (UID: "96286a94-8916-4c2e-a5c5-d7eba1040624"). InnerVolumeSpecName "kube-api-access-pk6bv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:02:26.123026 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:26.122953    2561 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/96286a94-8916-4c2e-a5c5-d7eba1040624-config-file\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:02:26.123026 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:26.122982    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pk6bv\" (UniqueName: \"kubernetes.io/projected/96286a94-8916-4c2e-a5c5-d7eba1040624-kube-api-access-pk6bv\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:02:26.269811 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:26.269783    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-q26tt"]
Sep 10 20:02:26.274785 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:26.274758    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-q26tt"]
Sep 10 20:02:26.849591 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:26.849561    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96286a94-8916-4c2e-a5c5-d7eba1040624" path="/var/lib/kubelet/pods/96286a94-8916-4c2e-a5c5-d7eba1040624/volumes"
Sep 10 20:02:27.612861 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:27.612833    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dkw5x"]
Sep 10 20:02:27.613255 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:27.613151    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96286a94-8916-4c2e-a5c5-d7eba1040624" containerName="limitador"
Sep 10 20:02:27.613255 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:27.613168    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="96286a94-8916-4c2e-a5c5-d7eba1040624" containerName="limitador"
Sep 10 20:02:27.613255 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:27.613231    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="96286a94-8916-4c2e-a5c5-d7eba1040624" containerName="limitador"
Sep 10 20:02:27.616223 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:27.616206    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkw5x"
Sep 10 20:02:27.618801 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:27.618777    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 10 20:02:27.619375 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:27.619348    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 20:02:27.619535 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:27.619472    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-5mhp6\""
Sep 10 20:02:27.619690 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:27.619675    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 20:02:27.629719 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:27.629697    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dkw5x"]
Sep 10 20:02:27.737640 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:27.737606    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b3346029-ff0f-486e-8bcb-110eefd6a7ed-data\") pod \"postgres-69fb4594cf-dkw5x\" (UID: \"b3346029-ff0f-486e-8bcb-110eefd6a7ed\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkw5x"
Sep 10 20:02:27.737813 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:27.737649    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wqnq\" (UniqueName: \"kubernetes.io/projected/b3346029-ff0f-486e-8bcb-110eefd6a7ed-kube-api-access-6wqnq\") pod \"postgres-69fb4594cf-dkw5x\" (UID: \"b3346029-ff0f-486e-8bcb-110eefd6a7ed\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkw5x"
Sep 10 20:02:27.838709 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:27.838675    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b3346029-ff0f-486e-8bcb-110eefd6a7ed-data\") pod \"postgres-69fb4594cf-dkw5x\" (UID: \"b3346029-ff0f-486e-8bcb-110eefd6a7ed\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkw5x"
Sep 10 20:02:27.838955 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:27.838722    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wqnq\" (UniqueName: \"kubernetes.io/projected/b3346029-ff0f-486e-8bcb-110eefd6a7ed-kube-api-access-6wqnq\") pod \"postgres-69fb4594cf-dkw5x\" (UID: \"b3346029-ff0f-486e-8bcb-110eefd6a7ed\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkw5x"
Sep 10 20:02:27.839066 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:27.839044    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b3346029-ff0f-486e-8bcb-110eefd6a7ed-data\") pod \"postgres-69fb4594cf-dkw5x\" (UID: \"b3346029-ff0f-486e-8bcb-110eefd6a7ed\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkw5x"
Sep 10 20:02:27.851659 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:27.849144    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wqnq\" (UniqueName: \"kubernetes.io/projected/b3346029-ff0f-486e-8bcb-110eefd6a7ed-kube-api-access-6wqnq\") pod \"postgres-69fb4594cf-dkw5x\" (UID: \"b3346029-ff0f-486e-8bcb-110eefd6a7ed\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkw5x"
Sep 10 20:02:27.926146 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:27.926074    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkw5x"
Sep 10 20:02:28.200535 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:28.200462    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dkw5x"]
Sep 10 20:02:28.205658 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:02:28.205630    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3346029_ff0f_486e_8bcb_110eefd6a7ed.slice/crio-5c7c53176bd7809878b18670688d9624b7bd7f7a1f000d42428d4d474b07c873 WatchSource:0}: Error finding container 5c7c53176bd7809878b18670688d9624b7bd7f7a1f000d42428d4d474b07c873: Status 404 returned error can't find the container with id 5c7c53176bd7809878b18670688d9624b7bd7f7a1f000d42428d4d474b07c873
Sep 10 20:02:28.957135 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:28.957102    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkw5x" event={"ID":"b3346029-ff0f-486e-8bcb-110eefd6a7ed","Type":"ContainerStarted","Data":"5c7c53176bd7809878b18670688d9624b7bd7f7a1f000d42428d4d474b07c873"}
Sep 10 20:02:30.967870 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:30.967834    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkw5x" event={"ID":"b3346029-ff0f-486e-8bcb-110eefd6a7ed","Type":"ContainerStarted","Data":"6faab52aae084aab2b6c6bd3b1f508a97f80639a39a042766b00b1eb32d90b5f"}
Sep 10 20:02:30.968292 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:30.967939    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkw5x"
Sep 10 20:02:30.985052 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:30.985005    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkw5x" podStartSLOduration=1.6846185870000001 podStartE2EDuration="3.98499106s" totalImagesPullingTime="2.300372473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:02:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:02:30.983928334 +0000 UTC m=+494.649032582" watchObservedRunningTime="2026-09-10 20:02:30.98499106 +0000 UTC m=+494.650095307"
Sep 10 20:02:37.002048 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:37.002020    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkw5x"
Sep 10 20:02:37.828934 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:37.828901    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-j6sgc"]
Sep 10 20:02:37.832983 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:37.832965    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-j6sgc"
Sep 10 20:02:37.835369 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:37.835349    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 10 20:02:37.843742 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:37.843721    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-j6sgc"]
Sep 10 20:02:37.920630 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:37.920602    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kddt\" (UniqueName: \"kubernetes.io/projected/dc41c398-9b4e-41e9-b108-aa11104e1588-kube-api-access-5kddt\") pod \"authorino-6d4dfc649f-j6sgc\" (UID: \"dc41c398-9b4e-41e9-b108-aa11104e1588\") " pod="kuadrant-system/authorino-6d4dfc649f-j6sgc"
Sep 10 20:02:37.920746 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:37.920674    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dc41c398-9b4e-41e9-b108-aa11104e1588-tls-cert\") pod \"authorino-6d4dfc649f-j6sgc\" (UID: \"dc41c398-9b4e-41e9-b108-aa11104e1588\") " pod="kuadrant-system/authorino-6d4dfc649f-j6sgc"
Sep 10 20:02:37.922432 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:37.922412    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-j6sgc"]
Sep 10 20:02:37.922620 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:02:37.922600    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-5kddt tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-j6sgc" podUID="dc41c398-9b4e-41e9-b108-aa11104e1588"
Sep 10 20:02:37.998370 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:37.998338    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-j6sgc"
Sep 10 20:02:38.004706 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:38.004680    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-j6sgc"
Sep 10 20:02:38.021071 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:38.021046    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dc41c398-9b4e-41e9-b108-aa11104e1588-tls-cert\") pod \"authorino-6d4dfc649f-j6sgc\" (UID: \"dc41c398-9b4e-41e9-b108-aa11104e1588\") " pod="kuadrant-system/authorino-6d4dfc649f-j6sgc"
Sep 10 20:02:38.021219 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:38.021094    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kddt\" (UniqueName: \"kubernetes.io/projected/dc41c398-9b4e-41e9-b108-aa11104e1588-kube-api-access-5kddt\") pod \"authorino-6d4dfc649f-j6sgc\" (UID: \"dc41c398-9b4e-41e9-b108-aa11104e1588\") " pod="kuadrant-system/authorino-6d4dfc649f-j6sgc"
Sep 10 20:02:38.023584 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:38.023553    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dc41c398-9b4e-41e9-b108-aa11104e1588-tls-cert\") pod \"authorino-6d4dfc649f-j6sgc\" (UID: \"dc41c398-9b4e-41e9-b108-aa11104e1588\") " pod="kuadrant-system/authorino-6d4dfc649f-j6sgc"
Sep 10 20:02:38.032895 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:38.032873    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kddt\" (UniqueName: \"kubernetes.io/projected/dc41c398-9b4e-41e9-b108-aa11104e1588-kube-api-access-5kddt\") pod \"authorino-6d4dfc649f-j6sgc\" (UID: \"dc41c398-9b4e-41e9-b108-aa11104e1588\") " pod="kuadrant-system/authorino-6d4dfc649f-j6sgc"
Sep 10 20:02:38.121657 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:38.121554    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dc41c398-9b4e-41e9-b108-aa11104e1588-tls-cert\") pod \"dc41c398-9b4e-41e9-b108-aa11104e1588\" (UID: \"dc41c398-9b4e-41e9-b108-aa11104e1588\") "
Sep 10 20:02:38.121657 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:38.121615    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kddt\" (UniqueName: \"kubernetes.io/projected/dc41c398-9b4e-41e9-b108-aa11104e1588-kube-api-access-5kddt\") pod \"dc41c398-9b4e-41e9-b108-aa11104e1588\" (UID: \"dc41c398-9b4e-41e9-b108-aa11104e1588\") "
Sep 10 20:02:38.123734 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:38.123707    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc41c398-9b4e-41e9-b108-aa11104e1588-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "dc41c398-9b4e-41e9-b108-aa11104e1588" (UID: "dc41c398-9b4e-41e9-b108-aa11104e1588"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:02:38.123845 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:38.123767    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc41c398-9b4e-41e9-b108-aa11104e1588-kube-api-access-5kddt" (OuterVolumeSpecName: "kube-api-access-5kddt") pod "dc41c398-9b4e-41e9-b108-aa11104e1588" (UID: "dc41c398-9b4e-41e9-b108-aa11104e1588"). InnerVolumeSpecName "kube-api-access-5kddt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:02:38.222837 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:38.222805    2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dc41c398-9b4e-41e9-b108-aa11104e1588-tls-cert\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:02:38.222837 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:38.222833    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kddt\" (UniqueName: \"kubernetes.io/projected/dc41c398-9b4e-41e9-b108-aa11104e1588-kube-api-access-5kddt\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:02:39.002796 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:39.002766    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-j6sgc"
Sep 10 20:02:39.041797 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:39.041770    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-j6sgc"]
Sep 10 20:02:39.048245 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:39.048223    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-j6sgc"]
Sep 10 20:02:39.940895 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:39.940860    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-tjmks"]
Sep 10 20:02:39.941086 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:39.941062    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-tjmks" podUID="93b6488a-0a6f-4017-9849-5f58d69da907" containerName="authorino" containerID="cri-o://41c5bf1d415ff0077114d60b3d02931e2141490d8e58ce9964d56e4e750ea240" gracePeriod=30
Sep 10 20:02:40.514456 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:40.514428    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-tjmks"
Sep 10 20:02:40.539642 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:40.539614    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6s7jz\" (UniqueName: \"kubernetes.io/projected/93b6488a-0a6f-4017-9849-5f58d69da907-kube-api-access-6s7jz\") pod \"93b6488a-0a6f-4017-9849-5f58d69da907\" (UID: \"93b6488a-0a6f-4017-9849-5f58d69da907\") "
Sep 10 20:02:40.541660 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:40.541631    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93b6488a-0a6f-4017-9849-5f58d69da907-kube-api-access-6s7jz" (OuterVolumeSpecName: "kube-api-access-6s7jz") pod "93b6488a-0a6f-4017-9849-5f58d69da907" (UID: "93b6488a-0a6f-4017-9849-5f58d69da907"). InnerVolumeSpecName "kube-api-access-6s7jz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:02:40.641165 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:40.641135    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6s7jz\" (UniqueName: \"kubernetes.io/projected/93b6488a-0a6f-4017-9849-5f58d69da907-kube-api-access-6s7jz\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:02:40.850004 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:40.849975    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc41c398-9b4e-41e9-b108-aa11104e1588" path="/var/lib/kubelet/pods/dc41c398-9b4e-41e9-b108-aa11104e1588/volumes"
Sep 10 20:02:41.012978 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:41.012946    2561 generic.go:356] "Generic (PLEG): container finished" podID="93b6488a-0a6f-4017-9849-5f58d69da907" containerID="41c5bf1d415ff0077114d60b3d02931e2141490d8e58ce9964d56e4e750ea240" exitCode=0
Sep 10 20:02:41.013124 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:41.012987    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-tjmks"
Sep 10 20:02:41.013124 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:41.013023    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-tjmks" event={"ID":"93b6488a-0a6f-4017-9849-5f58d69da907","Type":"ContainerDied","Data":"41c5bf1d415ff0077114d60b3d02931e2141490d8e58ce9964d56e4e750ea240"}
Sep 10 20:02:41.013124 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:41.013061    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-tjmks" event={"ID":"93b6488a-0a6f-4017-9849-5f58d69da907","Type":"ContainerDied","Data":"30565b85a61a8a43371d4655313273251d24d24e395c4b03cfa50f3d64d560f7"}
Sep 10 20:02:41.013124 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:41.013077    2561 scope.go:117] "RemoveContainer" containerID="41c5bf1d415ff0077114d60b3d02931e2141490d8e58ce9964d56e4e750ea240"
Sep 10 20:02:41.021435 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:41.021417    2561 scope.go:117] "RemoveContainer" containerID="41c5bf1d415ff0077114d60b3d02931e2141490d8e58ce9964d56e4e750ea240"
Sep 10 20:02:41.021710 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:02:41.021689    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41c5bf1d415ff0077114d60b3d02931e2141490d8e58ce9964d56e4e750ea240\": container with ID starting with 41c5bf1d415ff0077114d60b3d02931e2141490d8e58ce9964d56e4e750ea240 not found: ID does not exist" containerID="41c5bf1d415ff0077114d60b3d02931e2141490d8e58ce9964d56e4e750ea240"
Sep 10 20:02:41.021756 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:41.021718    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41c5bf1d415ff0077114d60b3d02931e2141490d8e58ce9964d56e4e750ea240"} err="failed to get container status \"41c5bf1d415ff0077114d60b3d02931e2141490d8e58ce9964d56e4e750ea240\": rpc error: code = NotFound desc = could not find container \"41c5bf1d415ff0077114d60b3d02931e2141490d8e58ce9964d56e4e750ea240\": container with ID starting with 41c5bf1d415ff0077114d60b3d02931e2141490d8e58ce9964d56e4e750ea240 not found: ID does not exist"
Sep 10 20:02:41.028476 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:41.028451    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-tjmks"]
Sep 10 20:02:41.031258 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:41.031239    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-tjmks"]
Sep 10 20:02:42.850118 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:02:42.850088    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93b6488a-0a6f-4017-9849-5f58d69da907" path="/var/lib/kubelet/pods/93b6488a-0a6f-4017-9849-5f58d69da907/volumes"
Sep 10 20:03:24.516237 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:24.516202    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-285zb"]
Sep 10 20:03:24.516681 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:24.516537    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93b6488a-0a6f-4017-9849-5f58d69da907" containerName="authorino"
Sep 10 20:03:24.516681 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:24.516550    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="93b6488a-0a6f-4017-9849-5f58d69da907" containerName="authorino"
Sep 10 20:03:24.516681 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:24.516622    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="93b6488a-0a6f-4017-9849-5f58d69da907" containerName="authorino"
Sep 10 20:03:24.521005 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:24.520986    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-285zb"
Sep 10 20:03:24.523826 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:24.523803    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 10 20:03:24.531794 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:24.531770    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-285zb"]
Sep 10 20:03:24.554292 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:24.554268    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:03:24.712433 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:24.712405    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/610beaf4-64cc-4802-9ad3-3bb86b55f884-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-285zb\" (UID: \"610beaf4-64cc-4802-9ad3-3bb86b55f884\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-285zb"
Sep 10 20:03:24.712593 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:24.712512    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbh48\" (UniqueName: \"kubernetes.io/projected/610beaf4-64cc-4802-9ad3-3bb86b55f884-kube-api-access-kbh48\") pod \"payload-pre-processing-59fbc47bf8-285zb\" (UID: \"610beaf4-64cc-4802-9ad3-3bb86b55f884\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-285zb"
Sep 10 20:03:24.813001 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:24.812911    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/610beaf4-64cc-4802-9ad3-3bb86b55f884-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-285zb\" (UID: \"610beaf4-64cc-4802-9ad3-3bb86b55f884\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-285zb"
Sep 10 20:03:24.813141 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:24.813005    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbh48\" (UniqueName: \"kubernetes.io/projected/610beaf4-64cc-4802-9ad3-3bb86b55f884-kube-api-access-kbh48\") pod \"payload-pre-processing-59fbc47bf8-285zb\" (UID: \"610beaf4-64cc-4802-9ad3-3bb86b55f884\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-285zb"
Sep 10 20:03:24.813636 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:24.813614    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/610beaf4-64cc-4802-9ad3-3bb86b55f884-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-285zb\" (UID: \"610beaf4-64cc-4802-9ad3-3bb86b55f884\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-285zb"
Sep 10 20:03:24.820581 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:24.820550    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbh48\" (UniqueName: \"kubernetes.io/projected/610beaf4-64cc-4802-9ad3-3bb86b55f884-kube-api-access-kbh48\") pod \"payload-pre-processing-59fbc47bf8-285zb\" (UID: \"610beaf4-64cc-4802-9ad3-3bb86b55f884\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-285zb"
Sep 10 20:03:24.831382 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:24.831353    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-285zb"
Sep 10 20:03:25.107309 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:25.107287    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-285zb"]
Sep 10 20:03:25.109336 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:03:25.109301    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod610beaf4_64cc_4802_9ad3_3bb86b55f884.slice/crio-c4b2502486a4ca35d27ec4ddad279275c02e1fbe0e2080a90ff6ff113d57d6f5 WatchSource:0}: Error finding container c4b2502486a4ca35d27ec4ddad279275c02e1fbe0e2080a90ff6ff113d57d6f5: Status 404 returned error can't find the container with id c4b2502486a4ca35d27ec4ddad279275c02e1fbe0e2080a90ff6ff113d57d6f5
Sep 10 20:03:25.218997 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:25.218953    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-285zb" event={"ID":"610beaf4-64cc-4802-9ad3-3bb86b55f884","Type":"ContainerStarted","Data":"c4b2502486a4ca35d27ec4ddad279275c02e1fbe0e2080a90ff6ff113d57d6f5"}
Sep 10 20:03:28.236545 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:28.236499    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-285zb" event={"ID":"610beaf4-64cc-4802-9ad3-3bb86b55f884","Type":"ContainerStarted","Data":"f5842f3f7a7ae1e64f77da2685fe67d273e462f4382981a04f505b2be7bb4748"}
Sep 10 20:03:28.236992 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:28.236614    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-285zb"
Sep 10 20:03:28.254763 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:28.254715    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-285zb" podStartSLOduration=2.08498121 podStartE2EDuration="4.254700377s" totalImagesPullingTime="2.169719167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:03:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:03:28.254016691 +0000 UTC m=+551.919120939" watchObservedRunningTime="2026-09-10 20:03:28.254700377 +0000 UTC m=+551.919804635"
Sep 10 20:03:34.264629 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:34.264584    2561 generic.go:356] "Generic (PLEG): container finished" podID="608dc0a9-91cf-4679-a99d-6b2e04d7cbef" containerID="f23113b1b12d1b39968cd975c2491ab4b8e12ba159070367d257b913c3f02060" exitCode=0
Sep 10 20:03:34.264629 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:34.264620    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl" event={"ID":"608dc0a9-91cf-4679-a99d-6b2e04d7cbef","Type":"ContainerDied","Data":"f23113b1b12d1b39968cd975c2491ab4b8e12ba159070367d257b913c3f02060"}
Sep 10 20:03:34.265095 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:34.264991    2561 scope.go:117] "RemoveContainer" containerID="f23113b1b12d1b39968cd975c2491ab4b8e12ba159070367d257b913c3f02060"
Sep 10 20:03:34.265986 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:34.265947    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:03:34.266088 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:34.266045    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:03:34.266151 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:34.266094    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:03:35.271436 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:35.271379    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl" event={"ID":"608dc0a9-91cf-4679-a99d-6b2e04d7cbef","Type":"ContainerStarted","Data":"8961ae927db88c801b830e1c0e099224a1ea4406a7636d3e64f9688aa4b87346"}
Sep 10 20:03:35.782700 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:35.782658    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:03:35.782888 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:35.782857    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-2d2hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Sep 10 20:03:35.782952 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:35.782932    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl" podUID="608dc0a9-91cf-4679-a99d-6b2e04d7cbef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Sep 10 20:03:36.782213 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:36.782181    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-2d2hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Sep 10 20:03:36.782593 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:36.782232    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl" podUID="608dc0a9-91cf-4679-a99d-6b2e04d7cbef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Sep 10 20:03:37.782522 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:37.782486    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-2d2hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Sep 10 20:03:37.782862 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:37.782545    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl" podUID="608dc0a9-91cf-4679-a99d-6b2e04d7cbef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Sep 10 20:03:38.782176 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:38.782144    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-2d2hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Sep 10 20:03:38.782348 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:38.782199    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl" podUID="608dc0a9-91cf-4679-a99d-6b2e04d7cbef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Sep 10 20:03:39.243525 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:39.243493    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-285zb"
Sep 10 20:03:39.782545 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:39.782512    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-2d2hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Sep 10 20:03:39.782721 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:39.782602    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl" podUID="608dc0a9-91cf-4679-a99d-6b2e04d7cbef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Sep 10 20:03:40.786591 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:40.786561    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:03:40.786953 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:40.786826    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:03:40.787434 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:40.787416    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2d2hl"
Sep 10 20:03:43.298942 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:43.298905    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:03:56.447354 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.447324    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"]
Sep 10 20:03:56.449599 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.449583    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:03:56.453269 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.453246    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 20:03:56.455564 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.455532    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j5zgl\""
Sep 10 20:03:56.455666 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.455625    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 20:03:56.455743 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.455548    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 10 20:03:56.460816 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.460794    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"]
Sep 10 20:03:56.583020 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.582989    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/943c089a-e449-4431-8b07-88877d567dec-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v9f9x\" (UID: \"943c089a-e449-4431-8b07-88877d567dec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:03:56.583173 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.583051    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/943c089a-e449-4431-8b07-88877d567dec-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v9f9x\" (UID: \"943c089a-e449-4431-8b07-88877d567dec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:03:56.583173 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.583067    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/943c089a-e449-4431-8b07-88877d567dec-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v9f9x\" (UID: \"943c089a-e449-4431-8b07-88877d567dec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:03:56.583173 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.583113    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnwhl\" (UniqueName: \"kubernetes.io/projected/943c089a-e449-4431-8b07-88877d567dec-kube-api-access-lnwhl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v9f9x\" (UID: \"943c089a-e449-4431-8b07-88877d567dec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:03:56.583173 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.583156    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/943c089a-e449-4431-8b07-88877d567dec-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v9f9x\" (UID: \"943c089a-e449-4431-8b07-88877d567dec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:03:56.583303 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.583179    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/943c089a-e449-4431-8b07-88877d567dec-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v9f9x\" (UID: \"943c089a-e449-4431-8b07-88877d567dec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:03:56.684183 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.684147    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/943c089a-e449-4431-8b07-88877d567dec-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v9f9x\" (UID: \"943c089a-e449-4431-8b07-88877d567dec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:03:56.684364 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.684191    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/943c089a-e449-4431-8b07-88877d567dec-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v9f9x\" (UID: \"943c089a-e449-4431-8b07-88877d567dec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:03:56.684364 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.684255    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/943c089a-e449-4431-8b07-88877d567dec-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v9f9x\" (UID: \"943c089a-e449-4431-8b07-88877d567dec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:03:56.684364 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.684277    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/943c089a-e449-4431-8b07-88877d567dec-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v9f9x\" (UID: \"943c089a-e449-4431-8b07-88877d567dec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:03:56.684364 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.684308    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnwhl\" (UniqueName: \"kubernetes.io/projected/943c089a-e449-4431-8b07-88877d567dec-kube-api-access-lnwhl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v9f9x\" (UID: \"943c089a-e449-4431-8b07-88877d567dec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:03:56.684364 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.684348    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/943c089a-e449-4431-8b07-88877d567dec-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v9f9x\" (UID: \"943c089a-e449-4431-8b07-88877d567dec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:03:56.684664 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.684593    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/943c089a-e449-4431-8b07-88877d567dec-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v9f9x\" (UID: \"943c089a-e449-4431-8b07-88877d567dec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:03:56.684745 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.684724    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/943c089a-e449-4431-8b07-88877d567dec-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v9f9x\" (UID: \"943c089a-e449-4431-8b07-88877d567dec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:03:56.684745 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.684736    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/943c089a-e449-4431-8b07-88877d567dec-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v9f9x\" (UID: \"943c089a-e449-4431-8b07-88877d567dec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:03:56.686488 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.686460    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/943c089a-e449-4431-8b07-88877d567dec-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v9f9x\" (UID: \"943c089a-e449-4431-8b07-88877d567dec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:03:56.686738 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.686718    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/943c089a-e449-4431-8b07-88877d567dec-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v9f9x\" (UID: \"943c089a-e449-4431-8b07-88877d567dec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:03:56.695372 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.695347    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnwhl\" (UniqueName: \"kubernetes.io/projected/943c089a-e449-4431-8b07-88877d567dec-kube-api-access-lnwhl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v9f9x\" (UID: \"943c089a-e449-4431-8b07-88877d567dec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:03:56.760248 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:56.760187    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:03:57.027039 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:57.027012    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"]
Sep 10 20:03:57.028532 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:03:57.028506    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod943c089a_e449_4431_8b07_88877d567dec.slice/crio-ad7f09672338b317d8647da21dbbf4753659aa75632446cddc90353b0f4633b5 WatchSource:0}: Error finding container ad7f09672338b317d8647da21dbbf4753659aa75632446cddc90353b0f4633b5: Status 404 returned error can't find the container with id ad7f09672338b317d8647da21dbbf4753659aa75632446cddc90353b0f4633b5
Sep 10 20:03:57.184257 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:57.184220    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:03:57.379486 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:57.379453    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x" event={"ID":"943c089a-e449-4431-8b07-88877d567dec","Type":"ContainerStarted","Data":"ad7f09672338b317d8647da21dbbf4753659aa75632446cddc90353b0f4633b5"}
Sep 10 20:03:58.386046 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:58.386017    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x" event={"ID":"943c089a-e449-4431-8b07-88877d567dec","Type":"ContainerStarted","Data":"8371cdb7a0e9355b0abd90da8982b89247311e19c7a7b1c10f18797609c92a20"}
Sep 10 20:03:58.405855 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:03:58.405791    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x" podStartSLOduration=1.237909968 podStartE2EDuration="2.405775089s" totalImagesPullingTime="1.167865121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:03:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:03:58.403937596 +0000 UTC m=+582.069041867" watchObservedRunningTime="2026-09-10 20:03:58.405775089 +0000 UTC m=+582.070879335"
Sep 10 20:04:06.496775 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:06.496741    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:04:06.760641 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:06.760541    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:04:06.760641 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:06.760618    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:04:06.773109 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:06.773086    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:04:07.437296 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:07.437269    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v9f9x"
Sep 10 20:04:15.349447 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.349411    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"]
Sep 10 20:04:15.352038 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.352015    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:15.354491 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.354468    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 10 20:04:15.363078 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.363059    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"]
Sep 10 20:04:15.452909 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.452868    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4272939-57da-468e-9896-f07e2617b5ec-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vbczg\" (UID: \"a4272939-57da-468e-9896-f07e2617b5ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:15.452909 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.452911    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4272939-57da-468e-9896-f07e2617b5ec-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vbczg\" (UID: \"a4272939-57da-468e-9896-f07e2617b5ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:15.453118 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.452965    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4272939-57da-468e-9896-f07e2617b5ec-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vbczg\" (UID: \"a4272939-57da-468e-9896-f07e2617b5ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:15.453118 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.453056    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4272939-57da-468e-9896-f07e2617b5ec-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vbczg\" (UID: \"a4272939-57da-468e-9896-f07e2617b5ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:15.453192 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.453115    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv5xn\" (UniqueName: \"kubernetes.io/projected/a4272939-57da-468e-9896-f07e2617b5ec-kube-api-access-rv5xn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vbczg\" (UID: \"a4272939-57da-468e-9896-f07e2617b5ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:15.453192 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.453145    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4272939-57da-468e-9896-f07e2617b5ec-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vbczg\" (UID: \"a4272939-57da-468e-9896-f07e2617b5ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:15.553804 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.553773    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4272939-57da-468e-9896-f07e2617b5ec-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vbczg\" (UID: \"a4272939-57da-468e-9896-f07e2617b5ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:15.553983 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.553811    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4272939-57da-468e-9896-f07e2617b5ec-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vbczg\" (UID: \"a4272939-57da-468e-9896-f07e2617b5ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:15.553983 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.553830    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4272939-57da-468e-9896-f07e2617b5ec-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vbczg\" (UID: \"a4272939-57da-468e-9896-f07e2617b5ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:15.553983 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.553854    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4272939-57da-468e-9896-f07e2617b5ec-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vbczg\" (UID: \"a4272939-57da-468e-9896-f07e2617b5ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:15.553983 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.553886    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv5xn\" (UniqueName: \"kubernetes.io/projected/a4272939-57da-468e-9896-f07e2617b5ec-kube-api-access-rv5xn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vbczg\" (UID: \"a4272939-57da-468e-9896-f07e2617b5ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:15.553983 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.553917    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4272939-57da-468e-9896-f07e2617b5ec-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vbczg\" (UID: \"a4272939-57da-468e-9896-f07e2617b5ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:15.554328 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.554294    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4272939-57da-468e-9896-f07e2617b5ec-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vbczg\" (UID: \"a4272939-57da-468e-9896-f07e2617b5ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:15.554407 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.554328    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4272939-57da-468e-9896-f07e2617b5ec-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vbczg\" (UID: \"a4272939-57da-468e-9896-f07e2617b5ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:15.554407 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.554341    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4272939-57da-468e-9896-f07e2617b5ec-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vbczg\" (UID: \"a4272939-57da-468e-9896-f07e2617b5ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:15.556199 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.556175    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4272939-57da-468e-9896-f07e2617b5ec-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vbczg\" (UID: \"a4272939-57da-468e-9896-f07e2617b5ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:15.556512 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.556494    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4272939-57da-468e-9896-f07e2617b5ec-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vbczg\" (UID: \"a4272939-57da-468e-9896-f07e2617b5ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:15.562276 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.562253    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv5xn\" (UniqueName: \"kubernetes.io/projected/a4272939-57da-468e-9896-f07e2617b5ec-kube-api-access-rv5xn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vbczg\" (UID: \"a4272939-57da-468e-9896-f07e2617b5ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:15.663772 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.663703    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:15.934581 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:15.934530    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"]
Sep 10 20:04:15.936782 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:04:15.936754    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4272939_57da_468e_9896_f07e2617b5ec.slice/crio-52b29330fd12801bb8c9b028e920ebef7a5892850c83d03cb5c74f7b6383b031 WatchSource:0}: Error finding container 52b29330fd12801bb8c9b028e920ebef7a5892850c83d03cb5c74f7b6383b031: Status 404 returned error can't find the container with id 52b29330fd12801bb8c9b028e920ebef7a5892850c83d03cb5c74f7b6383b031
Sep 10 20:04:16.468110 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:16.468027    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg" event={"ID":"a4272939-57da-468e-9896-f07e2617b5ec","Type":"ContainerStarted","Data":"6f5336aad885eb26dd2efb4f3c2d8ce633b945765439deb38daff15b97587190"}
Sep 10 20:04:16.468461 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:16.468126    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg" event={"ID":"a4272939-57da-468e-9896-f07e2617b5ec","Type":"ContainerStarted","Data":"52b29330fd12801bb8c9b028e920ebef7a5892850c83d03cb5c74f7b6383b031"}
Sep 10 20:04:16.489078 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:16.489028    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg" podStartSLOduration=1.284474651 podStartE2EDuration="1.489014118s" totalImagesPullingTime="204.539467ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:04:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:04:16.487362296 +0000 UTC m=+600.152466544" watchObservedRunningTime="2026-09-10 20:04:16.489014118 +0000 UTC m=+600.154118400"
Sep 10 20:04:16.590406 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:16.590364    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:04:25.664292 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:25.664254    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:25.664718 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:25.664315    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:25.676550 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:25.676527    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:26.524883 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:26.524851    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vbczg"
Sep 10 20:04:46.593283 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:46.593202    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:04:52.930430 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:52.930383    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"]
Sep 10 20:04:52.932922 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:52.932896    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:04:52.935539 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:52.935521    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 10 20:04:52.946514 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:52.946495    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"]
Sep 10 20:04:53.061033 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:53.061003    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9d36a2b-7fdb-49f1-ad3f-859a95377cb6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gd9lh\" (UID: \"a9d36a2b-7fdb-49f1-ad3f-859a95377cb6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:04:53.061191 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:53.061058    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9d36a2b-7fdb-49f1-ad3f-859a95377cb6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gd9lh\" (UID: \"a9d36a2b-7fdb-49f1-ad3f-859a95377cb6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:04:53.061191 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:53.061107    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxhg9\" (UniqueName: \"kubernetes.io/projected/a9d36a2b-7fdb-49f1-ad3f-859a95377cb6-kube-api-access-nxhg9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gd9lh\" (UID: \"a9d36a2b-7fdb-49f1-ad3f-859a95377cb6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:04:53.061191 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:53.061125    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9d36a2b-7fdb-49f1-ad3f-859a95377cb6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gd9lh\" (UID: \"a9d36a2b-7fdb-49f1-ad3f-859a95377cb6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:04:53.061191 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:53.061144    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9d36a2b-7fdb-49f1-ad3f-859a95377cb6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gd9lh\" (UID: \"a9d36a2b-7fdb-49f1-ad3f-859a95377cb6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:04:53.061191 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:53.061162    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9d36a2b-7fdb-49f1-ad3f-859a95377cb6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gd9lh\" (UID: \"a9d36a2b-7fdb-49f1-ad3f-859a95377cb6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:04:53.162404 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:53.162366    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9d36a2b-7fdb-49f1-ad3f-859a95377cb6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gd9lh\" (UID: \"a9d36a2b-7fdb-49f1-ad3f-859a95377cb6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:04:53.162558 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:53.162438    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxhg9\" (UniqueName: \"kubernetes.io/projected/a9d36a2b-7fdb-49f1-ad3f-859a95377cb6-kube-api-access-nxhg9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gd9lh\" (UID: \"a9d36a2b-7fdb-49f1-ad3f-859a95377cb6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:04:53.162558 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:53.162461    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9d36a2b-7fdb-49f1-ad3f-859a95377cb6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gd9lh\" (UID: \"a9d36a2b-7fdb-49f1-ad3f-859a95377cb6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:04:53.162558 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:53.162481    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9d36a2b-7fdb-49f1-ad3f-859a95377cb6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gd9lh\" (UID: \"a9d36a2b-7fdb-49f1-ad3f-859a95377cb6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:04:53.162558 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:53.162499    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9d36a2b-7fdb-49f1-ad3f-859a95377cb6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gd9lh\" (UID: \"a9d36a2b-7fdb-49f1-ad3f-859a95377cb6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:04:53.162558 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:53.162540    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9d36a2b-7fdb-49f1-ad3f-859a95377cb6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gd9lh\" (UID: \"a9d36a2b-7fdb-49f1-ad3f-859a95377cb6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:04:53.162833 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:53.162813    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9d36a2b-7fdb-49f1-ad3f-859a95377cb6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gd9lh\" (UID: \"a9d36a2b-7fdb-49f1-ad3f-859a95377cb6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:04:53.162887 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:53.162849    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9d36a2b-7fdb-49f1-ad3f-859a95377cb6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gd9lh\" (UID: \"a9d36a2b-7fdb-49f1-ad3f-859a95377cb6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:04:53.162944 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:53.162924    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9d36a2b-7fdb-49f1-ad3f-859a95377cb6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gd9lh\" (UID: \"a9d36a2b-7fdb-49f1-ad3f-859a95377cb6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:04:53.164702 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:53.164680    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9d36a2b-7fdb-49f1-ad3f-859a95377cb6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gd9lh\" (UID: \"a9d36a2b-7fdb-49f1-ad3f-859a95377cb6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:04:53.165045 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:53.165027    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9d36a2b-7fdb-49f1-ad3f-859a95377cb6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gd9lh\" (UID: \"a9d36a2b-7fdb-49f1-ad3f-859a95377cb6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:04:53.176009 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:53.175984    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxhg9\" (UniqueName: \"kubernetes.io/projected/a9d36a2b-7fdb-49f1-ad3f-859a95377cb6-kube-api-access-nxhg9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gd9lh\" (UID: \"a9d36a2b-7fdb-49f1-ad3f-859a95377cb6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:04:53.243241 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:53.243175    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:04:53.512446 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:53.512357    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"]
Sep 10 20:04:53.515351 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:04:53.515327    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9d36a2b_7fdb_49f1_ad3f_859a95377cb6.slice/crio-d89d0c5500b02a260e6e376a364e418dbb83ccd8b2835d1e91c89402c991b5d6 WatchSource:0}: Error finding container d89d0c5500b02a260e6e376a364e418dbb83ccd8b2835d1e91c89402c991b5d6: Status 404 returned error can't find the container with id d89d0c5500b02a260e6e376a364e418dbb83ccd8b2835d1e91c89402c991b5d6
Sep 10 20:04:53.516822 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:53.516802    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 20:04:53.642159 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:53.642130    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh" event={"ID":"a9d36a2b-7fdb-49f1-ad3f-859a95377cb6","Type":"ContainerStarted","Data":"d89d0c5500b02a260e6e376a364e418dbb83ccd8b2835d1e91c89402c991b5d6"}
Sep 10 20:04:54.647770 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:54.647740    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh" event={"ID":"a9d36a2b-7fdb-49f1-ad3f-859a95377cb6","Type":"ContainerStarted","Data":"56323dd3ce1c02c5ed8d2e9def46839f1510925a33369c6d83d3cfbbe4f8f37d"}
Sep 10 20:04:54.668690 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:54.668640    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh" podStartSLOduration=2.484448333 podStartE2EDuration="2.66862467s" totalImagesPullingTime="184.176337ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:04:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:04:54.667826901 +0000 UTC m=+638.332931150" watchObservedRunningTime="2026-09-10 20:04:54.66862467 +0000 UTC m=+638.333728967"
Sep 10 20:04:54.691934 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:04:54.691907    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:05:03.243471 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:05:03.243425    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:05:03.243884 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:05:03.243499    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:05:03.255661 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:05:03.255639    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:05:03.401413 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:05:03.397011    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:05:03.701333 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:05:03.701303    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gd9lh"
Sep 10 20:06:25.677795 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:25.677761    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68bf5ff85c-mpfk9"]
Sep 10 20:06:25.680102 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:25.680080    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68bf5ff85c-mpfk9"
Sep 10 20:06:25.683438 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:25.683414    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6n2dz\""
Sep 10 20:06:25.683536 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:25.683447    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 10 20:06:25.690362 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:25.690340    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68bf5ff85c-mpfk9"]
Sep 10 20:06:25.775289 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:25.775266    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/43842a1c-65cd-460c-bf44-320746fd2662-tls-cert\") pod \"authorino-68bf5ff85c-mpfk9\" (UID: \"43842a1c-65cd-460c-bf44-320746fd2662\") " pod="kuadrant-system/authorino-68bf5ff85c-mpfk9"
Sep 10 20:06:25.775419 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:25.775305    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv6z8\" (UniqueName: \"kubernetes.io/projected/43842a1c-65cd-460c-bf44-320746fd2662-kube-api-access-pv6z8\") pod \"authorino-68bf5ff85c-mpfk9\" (UID: \"43842a1c-65cd-460c-bf44-320746fd2662\") " pod="kuadrant-system/authorino-68bf5ff85c-mpfk9"
Sep 10 20:06:25.876711 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:25.876683    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/43842a1c-65cd-460c-bf44-320746fd2662-tls-cert\") pod \"authorino-68bf5ff85c-mpfk9\" (UID: \"43842a1c-65cd-460c-bf44-320746fd2662\") " pod="kuadrant-system/authorino-68bf5ff85c-mpfk9"
Sep 10 20:06:25.876843 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:25.876724    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv6z8\" (UniqueName: \"kubernetes.io/projected/43842a1c-65cd-460c-bf44-320746fd2662-kube-api-access-pv6z8\") pod \"authorino-68bf5ff85c-mpfk9\" (UID: \"43842a1c-65cd-460c-bf44-320746fd2662\") " pod="kuadrant-system/authorino-68bf5ff85c-mpfk9"
Sep 10 20:06:25.879119 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:25.879096    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/43842a1c-65cd-460c-bf44-320746fd2662-tls-cert\") pod \"authorino-68bf5ff85c-mpfk9\" (UID: \"43842a1c-65cd-460c-bf44-320746fd2662\") " pod="kuadrant-system/authorino-68bf5ff85c-mpfk9"
Sep 10 20:06:25.886848 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:25.886827    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv6z8\" (UniqueName: \"kubernetes.io/projected/43842a1c-65cd-460c-bf44-320746fd2662-kube-api-access-pv6z8\") pod \"authorino-68bf5ff85c-mpfk9\" (UID: \"43842a1c-65cd-460c-bf44-320746fd2662\") " pod="kuadrant-system/authorino-68bf5ff85c-mpfk9"
Sep 10 20:06:25.988547 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:25.988470    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68bf5ff85c-mpfk9"
Sep 10 20:06:26.255654 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:26.255632    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68bf5ff85c-mpfk9"]
Sep 10 20:06:26.257731 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:06:26.257706    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43842a1c_65cd_460c_bf44_320746fd2662.slice/crio-c5c394e52a86fb7b66fd97a1358ee1178adf2d0a620ec8e2b3ab44862f2c8f57 WatchSource:0}: Error finding container c5c394e52a86fb7b66fd97a1358ee1178adf2d0a620ec8e2b3ab44862f2c8f57: Status 404 returned error can't find the container with id c5c394e52a86fb7b66fd97a1358ee1178adf2d0a620ec8e2b3ab44862f2c8f57
Sep 10 20:06:27.074141 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:27.074103    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68bf5ff85c-mpfk9" event={"ID":"43842a1c-65cd-460c-bf44-320746fd2662","Type":"ContainerStarted","Data":"c5c394e52a86fb7b66fd97a1358ee1178adf2d0a620ec8e2b3ab44862f2c8f57"}
Sep 10 20:06:28.081425 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:28.081375    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68bf5ff85c-mpfk9" event={"ID":"43842a1c-65cd-460c-bf44-320746fd2662","Type":"ContainerStarted","Data":"c5aaa1c88f94103bab38f6e276d8c7ba626bc1ac3c54baaae87ac19808ea8ca0"}
Sep 10 20:06:28.099439 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:28.099353    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-68bf5ff85c-mpfk9" podStartSLOduration=2.085445316 podStartE2EDuration="3.099329856s" totalImagesPullingTime="1.01388454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:06:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:06:28.097899476 +0000 UTC m=+731.763003737" watchObservedRunningTime="2026-09-10 20:06:28.099329856 +0000 UTC m=+731.764434105"
Sep 10 20:06:49.803058 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:49.803019    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:06:51.323925 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:51.323885    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt"]
Sep 10 20:06:51.327477 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:51.327454    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt"
Sep 10 20:06:51.330195 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:51.330170    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-6d8d62-dockercfg-zs99b\""
Sep 10 20:06:51.330471 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:51.330449    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-6d8d62\""
Sep 10 20:06:51.341188 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:51.341160    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt"]
Sep 10 20:06:51.382910 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:51.382876    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knx2p\" (UniqueName: \"kubernetes.io/projected/7c5f175d-7257-41b8-a949-11100f289fe7-kube-api-access-knx2p\") pod \"payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt\" (UID: \"7c5f175d-7257-41b8-a949-11100f289fe7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt"
Sep 10 20:06:51.383070 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:51.382920    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c5f175d-7257-41b8-a949-11100f289fe7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt\" (UID: \"7c5f175d-7257-41b8-a949-11100f289fe7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt"
Sep 10 20:06:51.484028 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:51.483997    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c5f175d-7257-41b8-a949-11100f289fe7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt\" (UID: \"7c5f175d-7257-41b8-a949-11100f289fe7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt"
Sep 10 20:06:51.484188 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:51.484095    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knx2p\" (UniqueName: \"kubernetes.io/projected/7c5f175d-7257-41b8-a949-11100f289fe7-kube-api-access-knx2p\") pod \"payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt\" (UID: \"7c5f175d-7257-41b8-a949-11100f289fe7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt"
Sep 10 20:06:51.484820 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:51.484801    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c5f175d-7257-41b8-a949-11100f289fe7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt\" (UID: \"7c5f175d-7257-41b8-a949-11100f289fe7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt"
Sep 10 20:06:51.493033 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:51.493008    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knx2p\" (UniqueName: \"kubernetes.io/projected/7c5f175d-7257-41b8-a949-11100f289fe7-kube-api-access-knx2p\") pod \"payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt\" (UID: \"7c5f175d-7257-41b8-a949-11100f289fe7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt"
Sep 10 20:06:51.638244 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:51.638152    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt"
Sep 10 20:06:51.911515 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:51.911491    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt"]
Sep 10 20:06:51.914055 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:06:51.914031    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c5f175d_7257_41b8_a949_11100f289fe7.slice/crio-c6e655985404608c8ed95021aecc55d724b5ae29e32e59e6e608452b0ad45ca8 WatchSource:0}: Error finding container c6e655985404608c8ed95021aecc55d724b5ae29e32e59e6e608452b0ad45ca8: Status 404 returned error can't find the container with id c6e655985404608c8ed95021aecc55d724b5ae29e32e59e6e608452b0ad45ca8
Sep 10 20:06:52.199810 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:52.199723    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt" event={"ID":"7c5f175d-7257-41b8-a949-11100f289fe7","Type":"ContainerStarted","Data":"d961795172344741bb040357913ccb97e9c87f2b1a1ed33853ee276ae3e761d8"}
Sep 10 20:06:52.199810 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:52.199785    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt" event={"ID":"7c5f175d-7257-41b8-a949-11100f289fe7","Type":"ContainerStarted","Data":"c6e655985404608c8ed95021aecc55d724b5ae29e32e59e6e608452b0ad45ca8"}
Sep 10 20:06:52.199985 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:52.199813    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt"
Sep 10 20:06:52.223174 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:52.223111    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt" podStartSLOduration=1.223088899 podStartE2EDuration="1.223088899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:06:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:06:52.21397431 +0000 UTC m=+755.879078559" watchObservedRunningTime="2026-09-10 20:06:52.223088899 +0000 UTC m=+755.888193148"
Sep 10 20:06:54.356179 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.356140    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"]
Sep 10 20:06:54.359905 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.359885    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.363378 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.363356    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-cde8cba8-openshift-default-dockercfg-ppxlj\""
Sep 10 20:06:54.379756 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.379732    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"]
Sep 10 20:06:54.408136 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.408111    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-envoy\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.408273 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.408151    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-workload-certs\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.408273 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.408174    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-token\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.408273 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.408230    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-credential-socket\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.408430 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.408298    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-workload-socket\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.408430 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.408325    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-data\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.408430 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.408354    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hb2b\" (UniqueName: \"kubernetes.io/projected/96ad37b1-0022-4b1c-9373-a3cef31b8564-kube-api-access-4hb2b\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.408430 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.408380    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-podinfo\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.408599 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.408448    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96ad37b1-0022-4b1c-9373-a3cef31b8564-istiod-ca-cert\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.509163 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.509137    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-workload-certs\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.509264 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.509178    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-token\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.509264 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.509212    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-credential-socket\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.509264 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.509258    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-workload-socket\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.509405 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.509368    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-data\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.509466 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.509428    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hb2b\" (UniqueName: \"kubernetes.io/projected/96ad37b1-0022-4b1c-9373-a3cef31b8564-kube-api-access-4hb2b\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.509520 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.509465    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-podinfo\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.509577 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.509538    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96ad37b1-0022-4b1c-9373-a3cef31b8564-istiod-ca-cert\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.509577 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.509568    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-envoy\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.509670 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.509610    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-workload-certs\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.509670 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.509648    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-workload-socket\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.509777 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.509696    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-credential-socket\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.509834 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.509774    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-data\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.510259 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.510233    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96ad37b1-0022-4b1c-9373-a3cef31b8564-istiod-ca-cert\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.511699 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.511681    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-envoy\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.511909 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.511892    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-podinfo\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.518162 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.518142    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-token\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.518407 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.518371    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hb2b\" (UniqueName: \"kubernetes.io/projected/96ad37b1-0022-4b1c-9373-a3cef31b8564-kube-api-access-4hb2b\") pod \"e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") " pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.671619 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.671536    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:54.951591 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.951560    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"]
Sep 10 20:06:54.953420 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:06:54.953375    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ad37b1_0022_4b1c_9373_a3cef31b8564.slice/crio-4d27a47f4aac75f37601d2a438bf2b2f70bb724187acee5a4e40b768e0893f7d WatchSource:0}: Error finding container 4d27a47f4aac75f37601d2a438bf2b2f70bb724187acee5a4e40b768e0893f7d: Status 404 returned error can't find the container with id 4d27a47f4aac75f37601d2a438bf2b2f70bb724187acee5a4e40b768e0893f7d
Sep 10 20:06:54.955701 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.955663    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:06:54.955766 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.955751    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:06:54.955808 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:54.955794    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:06:55.217064 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:55.216972    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn" event={"ID":"96ad37b1-0022-4b1c-9373-a3cef31b8564","Type":"ContainerStarted","Data":"6f877debf124aea98fe92aac883b8b193bfebfd7f3cfec905821e92cd2899333"}
Sep 10 20:06:55.217064 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:55.217033    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn" event={"ID":"96ad37b1-0022-4b1c-9373-a3cef31b8564","Type":"ContainerStarted","Data":"4d27a47f4aac75f37601d2a438bf2b2f70bb724187acee5a4e40b768e0893f7d"}
Sep 10 20:06:55.248642 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:55.248596    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn" podStartSLOduration=1.248580469 podStartE2EDuration="1.248580469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:06:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:06:55.246480291 +0000 UTC m=+758.911584533" watchObservedRunningTime="2026-09-10 20:06:55.248580469 +0000 UTC m=+758.913684715"
Sep 10 20:06:55.672289 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:55.672259    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:56.678211 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:56.678181    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:57.229668 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:57.229635    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:57.231053 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:57.231000    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:06:57.360022 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:57.359986    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx"]
Sep 10 20:06:57.363530 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:57.363509    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx"
Sep 10 20:06:57.367924 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:57.367902    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-28a5f0-dockercfg-kwh29\""
Sep 10 20:06:57.368276 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:57.368253    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-28a5f0\""
Sep 10 20:06:57.376647 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:57.376625    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx"]
Sep 10 20:06:57.438704 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:57.438675    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e28b2a19-96f1-41fe-b3d4-60c764272735-plugins-config-volume\") pod \"payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx\" (UID: \"e28b2a19-96f1-41fe-b3d4-60c764272735\") " pod="openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx"
Sep 10 20:06:57.438704 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:57.438707    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkhch\" (UniqueName: \"kubernetes.io/projected/e28b2a19-96f1-41fe-b3d4-60c764272735-kube-api-access-fkhch\") pod \"payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx\" (UID: \"e28b2a19-96f1-41fe-b3d4-60c764272735\") " pod="openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx"
Sep 10 20:06:57.540100 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:57.540012    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e28b2a19-96f1-41fe-b3d4-60c764272735-plugins-config-volume\") pod \"payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx\" (UID: \"e28b2a19-96f1-41fe-b3d4-60c764272735\") " pod="openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx"
Sep 10 20:06:57.540100 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:57.540068    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkhch\" (UniqueName: \"kubernetes.io/projected/e28b2a19-96f1-41fe-b3d4-60c764272735-kube-api-access-fkhch\") pod \"payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx\" (UID: \"e28b2a19-96f1-41fe-b3d4-60c764272735\") " pod="openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx"
Sep 10 20:06:57.541023 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:57.540998    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e28b2a19-96f1-41fe-b3d4-60c764272735-plugins-config-volume\") pod \"payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx\" (UID: \"e28b2a19-96f1-41fe-b3d4-60c764272735\") " pod="openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx"
Sep 10 20:06:57.548233 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:57.548205    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkhch\" (UniqueName: \"kubernetes.io/projected/e28b2a19-96f1-41fe-b3d4-60c764272735-kube-api-access-fkhch\") pod \"payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx\" (UID: \"e28b2a19-96f1-41fe-b3d4-60c764272735\") " pod="openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx"
Sep 10 20:06:57.675900 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:57.675869    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx"
Sep 10 20:06:57.955992 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:57.955962    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx"]
Sep 10 20:06:57.957716 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:06:57.957688    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode28b2a19_96f1_41fe_b3d4_60c764272735.slice/crio-ef2067948a13a80f5185a7cf8ce58a716cee9c23d24fa934eacf5c47109e0d32 WatchSource:0}: Error finding container ef2067948a13a80f5185a7cf8ce58a716cee9c23d24fa934eacf5c47109e0d32: Status 404 returned error can't find the container with id ef2067948a13a80f5185a7cf8ce58a716cee9c23d24fa934eacf5c47109e0d32
Sep 10 20:06:58.238064 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:58.237977    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx" event={"ID":"e28b2a19-96f1-41fe-b3d4-60c764272735","Type":"ContainerStarted","Data":"d9c59818d78ae9889175c8a3f198cc0a6e9f0d377d6ce4ff1be3598fe4ed10ce"}
Sep 10 20:06:58.238064 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:58.238029    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx" event={"ID":"e28b2a19-96f1-41fe-b3d4-60c764272735","Type":"ContainerStarted","Data":"ef2067948a13a80f5185a7cf8ce58a716cee9c23d24fa934eacf5c47109e0d32"}
Sep 10 20:06:58.254992 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:58.254941    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx" podStartSLOduration=1.254923651 podStartE2EDuration="1.254923651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:06:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:06:58.254553721 +0000 UTC m=+761.919657969" watchObservedRunningTime="2026-09-10 20:06:58.254923651 +0000 UTC m=+761.920027898"
Sep 10 20:06:59.232546 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:59.232517    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4"]
Sep 10 20:06:59.236147 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:59.236126    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4"
Sep 10 20:06:59.239075 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:59.239055    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-cde8cba8\""
Sep 10 20:06:59.239199 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:59.239055    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-cde8cba8-dockercfg-njpw7\""
Sep 10 20:06:59.250142 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:59.250118    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx"
Sep 10 20:06:59.254513 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:59.254339    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89c5d3f3-5f2e-4e08-b605-58ccb6255757-plugins-config-volume\") pod \"payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4\" (UID: \"89c5d3f3-5f2e-4e08-b605-58ccb6255757\") " pod="openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4"
Sep 10 20:06:59.254513 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:59.254493    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b9qw\" (UniqueName: \"kubernetes.io/projected/89c5d3f3-5f2e-4e08-b605-58ccb6255757-kube-api-access-6b9qw\") pod \"payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4\" (UID: \"89c5d3f3-5f2e-4e08-b605-58ccb6255757\") " pod="openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4"
Sep 10 20:06:59.256904 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:59.256882    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4"]
Sep 10 20:06:59.355826 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:59.355792    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89c5d3f3-5f2e-4e08-b605-58ccb6255757-plugins-config-volume\") pod \"payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4\" (UID: \"89c5d3f3-5f2e-4e08-b605-58ccb6255757\") " pod="openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4"
Sep 10 20:06:59.356004 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:59.355889    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b9qw\" (UniqueName: \"kubernetes.io/projected/89c5d3f3-5f2e-4e08-b605-58ccb6255757-kube-api-access-6b9qw\") pod \"payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4\" (UID: \"89c5d3f3-5f2e-4e08-b605-58ccb6255757\") " pod="openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4"
Sep 10 20:06:59.356840 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:59.356813    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89c5d3f3-5f2e-4e08-b605-58ccb6255757-plugins-config-volume\") pod \"payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4\" (UID: \"89c5d3f3-5f2e-4e08-b605-58ccb6255757\") " pod="openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4"
Sep 10 20:06:59.364309 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:59.364285    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b9qw\" (UniqueName: \"kubernetes.io/projected/89c5d3f3-5f2e-4e08-b605-58ccb6255757-kube-api-access-6b9qw\") pod \"payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4\" (UID: \"89c5d3f3-5f2e-4e08-b605-58ccb6255757\") " pod="openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4"
Sep 10 20:06:59.555209 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:59.555128    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4"
Sep 10 20:06:59.825078 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:06:59.824942    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4"]
Sep 10 20:06:59.827295 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:06:59.827265    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89c5d3f3_5f2e_4e08_b605_58ccb6255757.slice/crio-681af49a8e79953eb1aee51ec8dc8db13d49044aa75713d6dfab25afce67aeda WatchSource:0}: Error finding container 681af49a8e79953eb1aee51ec8dc8db13d49044aa75713d6dfab25afce67aeda: Status 404 returned error can't find the container with id 681af49a8e79953eb1aee51ec8dc8db13d49044aa75713d6dfab25afce67aeda
Sep 10 20:07:00.254703 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:00.254615    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4" event={"ID":"89c5d3f3-5f2e-4e08-b605-58ccb6255757","Type":"ContainerStarted","Data":"b4b615cdb0acaa6d90404428b03ec04fdbce4b4706fe5b9ffec652761d805696"}
Sep 10 20:07:00.254703 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:00.254674    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4" event={"ID":"89c5d3f3-5f2e-4e08-b605-58ccb6255757","Type":"ContainerStarted","Data":"681af49a8e79953eb1aee51ec8dc8db13d49044aa75713d6dfab25afce67aeda"}
Sep 10 20:07:00.255192 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:00.255177    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4"
Sep 10 20:07:00.272473 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:00.272423    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4" podStartSLOduration=1.272404781 podStartE2EDuration="1.272404781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:06:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:07:00.27160464 +0000 UTC m=+763.936708913" watchObservedRunningTime="2026-09-10 20:07:00.272404781 +0000 UTC m=+763.937509039"
Sep 10 20:07:03.206905 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:03.206871    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt"
Sep 10 20:07:05.334162 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:05.334125    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:07:10.256983 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:10.256952    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx"
Sep 10 20:07:12.266570 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:12.266539    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4"
Sep 10 20:07:16.354764 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:16.354729    2561 generic.go:356] "Generic (PLEG): container finished" podID="96ad37b1-0022-4b1c-9373-a3cef31b8564" containerID="6f877debf124aea98fe92aac883b8b193bfebfd7f3cfec905821e92cd2899333" exitCode=0
Sep 10 20:07:16.355259 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:16.354799    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn" event={"ID":"96ad37b1-0022-4b1c-9373-a3cef31b8564","Type":"ContainerDied","Data":"6f877debf124aea98fe92aac883b8b193bfebfd7f3cfec905821e92cd2899333"}
Sep 10 20:07:16.355356 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:16.355338    2561 scope.go:117] "RemoveContainer" containerID="6f877debf124aea98fe92aac883b8b193bfebfd7f3cfec905821e92cd2899333"
Sep 10 20:07:16.356433 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:16.356381    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:07:16.356529 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:16.356492    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:07:16.356604 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:16.356586    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:07:17.362805 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:17.362769    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn" event={"ID":"96ad37b1-0022-4b1c-9373-a3cef31b8564","Type":"ContainerStarted","Data":"5cc9b9e56f66f59db8935a8bcdb3e42f9f362e06da89e6f967ba3dd0da1a5918"}
Sep 10 20:07:17.672097 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:17.672022    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:07:17.672318 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:17.672288    2561 patch_prober.go:28] interesting pod/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 10 20:07:17.672474 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:17.672404    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn" podUID="96ad37b1-0022-4b1c-9373-a3cef31b8564" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 10 20:07:18.671887 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:18.671855    2561 patch_prober.go:28] interesting pod/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 10 20:07:18.672284 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:18.671919    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn" podUID="96ad37b1-0022-4b1c-9373-a3cef31b8564" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 10 20:07:19.672458 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:19.672420    2561 patch_prober.go:28] interesting pod/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 10 20:07:19.672937 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:19.672498    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn" podUID="96ad37b1-0022-4b1c-9373-a3cef31b8564" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 10 20:07:20.672066 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:20.672034    2561 patch_prober.go:28] interesting pod/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 10 20:07:20.672235 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:20.672090    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn" podUID="96ad37b1-0022-4b1c-9373-a3cef31b8564" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 10 20:07:21.575642 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:21.575591    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs"]
Sep 10 20:07:21.579308 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:21.579259    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs"
Sep 10 20:07:21.582216 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:21.582191    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-39487c\""
Sep 10 20:07:21.582481 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:21.582465    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-39487c-dockercfg-z57sw\""
Sep 10 20:07:21.588633 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:21.588611    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs"]
Sep 10 20:07:21.663984 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:21.663954    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r54hp\" (UniqueName: \"kubernetes.io/projected/97e7e829-3377-414e-9b66-1f9e135b6a5e-kube-api-access-r54hp\") pod \"payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs\" (UID: \"97e7e829-3377-414e-9b66-1f9e135b6a5e\") " pod="openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs"
Sep 10 20:07:21.664191 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:21.664176    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97e7e829-3377-414e-9b66-1f9e135b6a5e-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs\" (UID: \"97e7e829-3377-414e-9b66-1f9e135b6a5e\") " pod="openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs"
Sep 10 20:07:21.672065 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:21.672028    2561 patch_prober.go:28] interesting pod/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 10 20:07:21.672240 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:21.672094    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn" podUID="96ad37b1-0022-4b1c-9373-a3cef31b8564" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 10 20:07:21.765017 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:21.764982    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97e7e829-3377-414e-9b66-1f9e135b6a5e-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs\" (UID: \"97e7e829-3377-414e-9b66-1f9e135b6a5e\") " pod="openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs"
Sep 10 20:07:21.765305 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:21.765291    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r54hp\" (UniqueName: \"kubernetes.io/projected/97e7e829-3377-414e-9b66-1f9e135b6a5e-kube-api-access-r54hp\") pod \"payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs\" (UID: \"97e7e829-3377-414e-9b66-1f9e135b6a5e\") " pod="openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs"
Sep 10 20:07:21.765810 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:21.765791    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97e7e829-3377-414e-9b66-1f9e135b6a5e-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs\" (UID: \"97e7e829-3377-414e-9b66-1f9e135b6a5e\") " pod="openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs"
Sep 10 20:07:21.774542 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:21.774463    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r54hp\" (UniqueName: \"kubernetes.io/projected/97e7e829-3377-414e-9b66-1f9e135b6a5e-kube-api-access-r54hp\") pod \"payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs\" (UID: \"97e7e829-3377-414e-9b66-1f9e135b6a5e\") " pod="openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs"
Sep 10 20:07:21.892479 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:21.892334    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs"
Sep 10 20:07:22.186434 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:22.186242    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs"]
Sep 10 20:07:22.389443 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:22.389385    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs" event={"ID":"97e7e829-3377-414e-9b66-1f9e135b6a5e","Type":"ContainerStarted","Data":"14ad03ead95682834768feb123ecf0019669440236ada8a9470a0d336cad82e0"}
Sep 10 20:07:22.389628 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:22.389469    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs" event={"ID":"97e7e829-3377-414e-9b66-1f9e135b6a5e","Type":"ContainerStarted","Data":"20ccdb470804a79a65696a43fe5f788c06068c0ed06d5f53dec0155c27e0b850"}
Sep 10 20:07:22.389752 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:22.389726    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs"
Sep 10 20:07:22.407362 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:22.407301    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs" podStartSLOduration=1.40728187 podStartE2EDuration="1.40728187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:07:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:07:22.406983877 +0000 UTC m=+786.072088151" watchObservedRunningTime="2026-09-10 20:07:22.40728187 +0000 UTC m=+786.072386116"
Sep 10 20:07:22.850931 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:22.850896    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:07:22.851444 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:22.851426    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:07:22.852834 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:22.852801    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:07:25.594765 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:25.594724    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:07:33.397472 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:33.397440    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs"
Sep 10 20:07:38.539464 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:38.539428    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4"]
Sep 10 20:07:38.539926 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:38.539657    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4" podUID="89c5d3f3-5f2e-4e08-b605-58ccb6255757" containerName="payload-processing" containerID="cri-o://b4b615cdb0acaa6d90404428b03ec04fdbce4b4706fe5b9ffec652761d805696" gracePeriod=30
Sep 10 20:07:38.828471 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:38.828433    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"]
Sep 10 20:07:38.829261 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:38.828826    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn" podUID="96ad37b1-0022-4b1c-9373-a3cef31b8564" containerName="istio-proxy" containerID="cri-o://5cc9b9e56f66f59db8935a8bcdb3e42f9f362e06da89e6f967ba3dd0da1a5918" gracePeriod=30
Sep 10 20:07:39.200776 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.200747    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4"
Sep 10 20:07:39.332319 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.332276    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89c5d3f3-5f2e-4e08-b605-58ccb6255757-plugins-config-volume\") pod \"89c5d3f3-5f2e-4e08-b605-58ccb6255757\" (UID: \"89c5d3f3-5f2e-4e08-b605-58ccb6255757\") "
Sep 10 20:07:39.332518 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.332405    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6b9qw\" (UniqueName: \"kubernetes.io/projected/89c5d3f3-5f2e-4e08-b605-58ccb6255757-kube-api-access-6b9qw\") pod \"89c5d3f3-5f2e-4e08-b605-58ccb6255757\" (UID: \"89c5d3f3-5f2e-4e08-b605-58ccb6255757\") "
Sep 10 20:07:39.332749 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.332710    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89c5d3f3-5f2e-4e08-b605-58ccb6255757-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "89c5d3f3-5f2e-4e08-b605-58ccb6255757" (UID: "89c5d3f3-5f2e-4e08-b605-58ccb6255757"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:07:39.345455 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.341518    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89c5d3f3-5f2e-4e08-b605-58ccb6255757-kube-api-access-6b9qw" (OuterVolumeSpecName: "kube-api-access-6b9qw") pod "89c5d3f3-5f2e-4e08-b605-58ccb6255757" (UID: "89c5d3f3-5f2e-4e08-b605-58ccb6255757"). InnerVolumeSpecName "kube-api-access-6b9qw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:07:39.433488 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.433378    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b9qw\" (UniqueName: \"kubernetes.io/projected/89c5d3f3-5f2e-4e08-b605-58ccb6255757-kube-api-access-6b9qw\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:07:39.433488 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.433436    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89c5d3f3-5f2e-4e08-b605-58ccb6255757-plugins-config-volume\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:07:39.478525 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.478494    2561 generic.go:356] "Generic (PLEG): container finished" podID="89c5d3f3-5f2e-4e08-b605-58ccb6255757" containerID="b4b615cdb0acaa6d90404428b03ec04fdbce4b4706fe5b9ffec652761d805696" exitCode=0
Sep 10 20:07:39.478705 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.478529    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4" event={"ID":"89c5d3f3-5f2e-4e08-b605-58ccb6255757","Type":"ContainerDied","Data":"b4b615cdb0acaa6d90404428b03ec04fdbce4b4706fe5b9ffec652761d805696"}
Sep 10 20:07:39.478705 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.478554    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4"
Sep 10 20:07:39.478705 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.478600    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4" event={"ID":"89c5d3f3-5f2e-4e08-b605-58ccb6255757","Type":"ContainerDied","Data":"681af49a8e79953eb1aee51ec8dc8db13d49044aa75713d6dfab25afce67aeda"}
Sep 10 20:07:39.478705 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.478632    2561 scope.go:117] "RemoveContainer" containerID="b4b615cdb0acaa6d90404428b03ec04fdbce4b4706fe5b9ffec652761d805696"
Sep 10 20:07:39.487232 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.487212    2561 scope.go:117] "RemoveContainer" containerID="b4b615cdb0acaa6d90404428b03ec04fdbce4b4706fe5b9ffec652761d805696"
Sep 10 20:07:39.487634 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:07:39.487614    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4b615cdb0acaa6d90404428b03ec04fdbce4b4706fe5b9ffec652761d805696\": container with ID starting with b4b615cdb0acaa6d90404428b03ec04fdbce4b4706fe5b9ffec652761d805696 not found: ID does not exist" containerID="b4b615cdb0acaa6d90404428b03ec04fdbce4b4706fe5b9ffec652761d805696"
Sep 10 20:07:39.487715 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.487645    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4b615cdb0acaa6d90404428b03ec04fdbce4b4706fe5b9ffec652761d805696"} err="failed to get container status \"b4b615cdb0acaa6d90404428b03ec04fdbce4b4706fe5b9ffec652761d805696\": rpc error: code = NotFound desc = could not find container \"b4b615cdb0acaa6d90404428b03ec04fdbce4b4706fe5b9ffec652761d805696\": container with ID starting with b4b615cdb0acaa6d90404428b03ec04fdbce4b4706fe5b9ffec652761d805696 not found: ID does not exist"
Sep 10 20:07:39.504101 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.504079    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4"]
Sep 10 20:07:39.510565 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.510541    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-cde8cba8-75569f9cc9-vg7r4"]
Sep 10 20:07:39.763107 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.763029    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"]
Sep 10 20:07:39.763653 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.763602    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89c5d3f3-5f2e-4e08-b605-58ccb6255757" containerName="payload-processing"
Sep 10 20:07:39.763653 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.763624    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="89c5d3f3-5f2e-4e08-b605-58ccb6255757" containerName="payload-processing"
Sep 10 20:07:39.763800 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.763730    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="89c5d3f3-5f2e-4e08-b605-58ccb6255757" containerName="payload-processing"
Sep 10 20:07:39.768177 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.768154    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:39.770690 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.770664    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-f563295c-gw-openshift-default-dockercfg-sxvzb\""
Sep 10 20:07:39.782577 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.782556    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"]
Sep 10 20:07:39.938171 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.938135    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-workload-socket\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:39.938373 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.938182    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-podinfo\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:39.938373 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.938259    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-credential-socket\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:39.938373 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.938299    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istiod-ca-cert\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:39.938373 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.938325    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-envoy\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:39.938561 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.938444    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-workload-certs\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:39.938561 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.938482    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-token\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:39.938561 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.938532    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h4ks\" (UniqueName: \"kubernetes.io/projected/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-kube-api-access-6h4ks\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:39.938667 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:39.938601    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-data\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:40.040087 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.039999    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istiod-ca-cert\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:40.040087 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.040040    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-envoy\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:40.040087 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.040080    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-workload-certs\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:40.040356 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.040104    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-token\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:40.040356 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.040225    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h4ks\" (UniqueName: \"kubernetes.io/projected/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-kube-api-access-6h4ks\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:40.040356 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.040296    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-data\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:40.040536 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.040361    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-workload-socket\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:40.040595 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.040561    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-workload-certs\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:40.040906 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.040705    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-data\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:40.040906 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.040740    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-workload-socket\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:40.040906 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.040819    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-podinfo\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:40.041107 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.040913    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istiod-ca-cert\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:40.041246 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.041220    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-credential-socket\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:40.041489 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.041467    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-credential-socket\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:40.043237 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.043204    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-envoy\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:40.043339 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.043213    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-podinfo\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:40.048593 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.048572    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h4ks\" (UniqueName: \"kubernetes.io/projected/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-kube-api-access-6h4ks\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:40.048760 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.048740    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-token\") pod \"e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") " pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:40.080817 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.080790    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:40.380713 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.380668    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"]
Sep 10 20:07:40.383789 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:07:40.383762    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01d39510_9c9b_4f20_b8dd_ae6e395ef12a.slice/crio-72430317ce02c4919953ef2d68d7c9187bb510472f0ef4876c3b587e19858044 WatchSource:0}: Error finding container 72430317ce02c4919953ef2d68d7c9187bb510472f0ef4876c3b587e19858044: Status 404 returned error can't find the container with id 72430317ce02c4919953ef2d68d7c9187bb510472f0ef4876c3b587e19858044
Sep 10 20:07:40.386139 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.386106    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:07:40.386219 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.386200    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:07:40.386263 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.386247    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:07:40.487014 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.486982    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf" event={"ID":"01d39510-9c9b-4f20-b8dd-ae6e395ef12a","Type":"ContainerStarted","Data":"e7476d07aafed4c2f6cbabe4b2a31534c1e935821d7bf59eec0e2ef5945fd976"}
Sep 10 20:07:40.487174 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.487037    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf" event={"ID":"01d39510-9c9b-4f20-b8dd-ae6e395ef12a","Type":"ContainerStarted","Data":"72430317ce02c4919953ef2d68d7c9187bb510472f0ef4876c3b587e19858044"}
Sep 10 20:07:40.505860 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.505809    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf" podStartSLOduration=1.5057910209999998 podStartE2EDuration="1.505791021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:07:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:07:40.505012514 +0000 UTC m=+804.170116783" watchObservedRunningTime="2026-09-10 20:07:40.505791021 +0000 UTC m=+804.170895270"
Sep 10 20:07:40.850815 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:40.850779    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89c5d3f3-5f2e-4e08-b605-58ccb6255757" path="/var/lib/kubelet/pods/89c5d3f3-5f2e-4e08-b605-58ccb6255757/volumes"
Sep 10 20:07:41.081447 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:41.081386    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:41.086171 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:41.086147    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:41.491936 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:41.491893    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:41.492793 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:41.492768    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:07:44.485507 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.485482    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:07:44.510976 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.510940    2561 generic.go:356] "Generic (PLEG): container finished" podID="96ad37b1-0022-4b1c-9373-a3cef31b8564" containerID="5cc9b9e56f66f59db8935a8bcdb3e42f9f362e06da89e6f967ba3dd0da1a5918" exitCode=0
Sep 10 20:07:44.511121 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.510993    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"
Sep 10 20:07:44.511121 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.511031    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn" event={"ID":"96ad37b1-0022-4b1c-9373-a3cef31b8564","Type":"ContainerDied","Data":"5cc9b9e56f66f59db8935a8bcdb3e42f9f362e06da89e6f967ba3dd0da1a5918"}
Sep 10 20:07:44.511121 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.511090    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn" event={"ID":"96ad37b1-0022-4b1c-9373-a3cef31b8564","Type":"ContainerDied","Data":"4d27a47f4aac75f37601d2a438bf2b2f70bb724187acee5a4e40b768e0893f7d"}
Sep 10 20:07:44.511121 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.511121    2561 scope.go:117] "RemoveContainer" containerID="5cc9b9e56f66f59db8935a8bcdb3e42f9f362e06da89e6f967ba3dd0da1a5918"
Sep 10 20:07:44.522964 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.522944    2561 scope.go:117] "RemoveContainer" containerID="6f877debf124aea98fe92aac883b8b193bfebfd7f3cfec905821e92cd2899333"
Sep 10 20:07:44.531132 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.531112    2561 scope.go:117] "RemoveContainer" containerID="5cc9b9e56f66f59db8935a8bcdb3e42f9f362e06da89e6f967ba3dd0da1a5918"
Sep 10 20:07:44.531448 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:07:44.531426    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cc9b9e56f66f59db8935a8bcdb3e42f9f362e06da89e6f967ba3dd0da1a5918\": container with ID starting with 5cc9b9e56f66f59db8935a8bcdb3e42f9f362e06da89e6f967ba3dd0da1a5918 not found: ID does not exist" containerID="5cc9b9e56f66f59db8935a8bcdb3e42f9f362e06da89e6f967ba3dd0da1a5918"
Sep 10 20:07:44.531448 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.531457    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cc9b9e56f66f59db8935a8bcdb3e42f9f362e06da89e6f967ba3dd0da1a5918"} err="failed to get container status \"5cc9b9e56f66f59db8935a8bcdb3e42f9f362e06da89e6f967ba3dd0da1a5918\": rpc error: code = NotFound desc = could not find container \"5cc9b9e56f66f59db8935a8bcdb3e42f9f362e06da89e6f967ba3dd0da1a5918\": container with ID starting with 5cc9b9e56f66f59db8935a8bcdb3e42f9f362e06da89e6f967ba3dd0da1a5918 not found: ID does not exist"
Sep 10 20:07:44.531448 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.531475    2561 scope.go:117] "RemoveContainer" containerID="6f877debf124aea98fe92aac883b8b193bfebfd7f3cfec905821e92cd2899333"
Sep 10 20:07:44.531776 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:07:44.531755    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f877debf124aea98fe92aac883b8b193bfebfd7f3cfec905821e92cd2899333\": container with ID starting with 6f877debf124aea98fe92aac883b8b193bfebfd7f3cfec905821e92cd2899333 not found: ID does not exist" containerID="6f877debf124aea98fe92aac883b8b193bfebfd7f3cfec905821e92cd2899333"
Sep 10 20:07:44.531847 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.531780    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f877debf124aea98fe92aac883b8b193bfebfd7f3cfec905821e92cd2899333"} err="failed to get container status \"6f877debf124aea98fe92aac883b8b193bfebfd7f3cfec905821e92cd2899333\": rpc error: code = NotFound desc = could not find container \"6f877debf124aea98fe92aac883b8b193bfebfd7f3cfec905821e92cd2899333\": container with ID starting with 6f877debf124aea98fe92aac883b8b193bfebfd7f3cfec905821e92cd2899333 not found: ID does not exist"
Sep 10 20:07:44.589711 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.589678    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96ad37b1-0022-4b1c-9373-a3cef31b8564-istiod-ca-cert\") pod \"96ad37b1-0022-4b1c-9373-a3cef31b8564\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") "
Sep 10 20:07:44.589877 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.589725    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-workload-socket\") pod \"96ad37b1-0022-4b1c-9373-a3cef31b8564\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") "
Sep 10 20:07:44.589877 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.589753    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-envoy\") pod \"96ad37b1-0022-4b1c-9373-a3cef31b8564\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") "
Sep 10 20:07:44.589877 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.589780    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hb2b\" (UniqueName: \"kubernetes.io/projected/96ad37b1-0022-4b1c-9373-a3cef31b8564-kube-api-access-4hb2b\") pod \"96ad37b1-0022-4b1c-9373-a3cef31b8564\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") "
Sep 10 20:07:44.589877 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.589809    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-workload-certs\") pod \"96ad37b1-0022-4b1c-9373-a3cef31b8564\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") "
Sep 10 20:07:44.589877 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.589833    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-token\") pod \"96ad37b1-0022-4b1c-9373-a3cef31b8564\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") "
Sep 10 20:07:44.589877 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.589857    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-credential-socket\") pod \"96ad37b1-0022-4b1c-9373-a3cef31b8564\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") "
Sep 10 20:07:44.590199 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.589885    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-podinfo\") pod \"96ad37b1-0022-4b1c-9373-a3cef31b8564\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") "
Sep 10 20:07:44.590199 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.589940    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-data\") pod \"96ad37b1-0022-4b1c-9373-a3cef31b8564\" (UID: \"96ad37b1-0022-4b1c-9373-a3cef31b8564\") "
Sep 10 20:07:44.590199 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.590001    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "96ad37b1-0022-4b1c-9373-a3cef31b8564" (UID: "96ad37b1-0022-4b1c-9373-a3cef31b8564"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:07:44.590199 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.590174    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "96ad37b1-0022-4b1c-9373-a3cef31b8564" (UID: "96ad37b1-0022-4b1c-9373-a3cef31b8564"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:07:44.590199 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.590191    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96ad37b1-0022-4b1c-9373-a3cef31b8564-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "96ad37b1-0022-4b1c-9373-a3cef31b8564" (UID: "96ad37b1-0022-4b1c-9373-a3cef31b8564"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:07:44.590598 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.590194    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "96ad37b1-0022-4b1c-9373-a3cef31b8564" (UID: "96ad37b1-0022-4b1c-9373-a3cef31b8564"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:07:44.590598 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.590478    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-data" (OuterVolumeSpecName: "istio-data") pod "96ad37b1-0022-4b1c-9373-a3cef31b8564" (UID: "96ad37b1-0022-4b1c-9373-a3cef31b8564"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:07:44.590705 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.590688    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-credential-socket\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:07:44.590763 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.590710    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-data\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:07:44.590763 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.590730    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96ad37b1-0022-4b1c-9373-a3cef31b8564-istiod-ca-cert\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:07:44.590763 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.590745    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-workload-socket\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:07:44.590763 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.590759    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-workload-certs\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:07:44.592482 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.592438    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-token" (OuterVolumeSpecName: "istio-token") pod "96ad37b1-0022-4b1c-9373-a3cef31b8564" (UID: "96ad37b1-0022-4b1c-9373-a3cef31b8564"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:07:44.592630 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.592532    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "96ad37b1-0022-4b1c-9373-a3cef31b8564" (UID: "96ad37b1-0022-4b1c-9373-a3cef31b8564"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:07:44.592630 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.592608    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "96ad37b1-0022-4b1c-9373-a3cef31b8564" (UID: "96ad37b1-0022-4b1c-9373-a3cef31b8564"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 20:07:44.592630 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.592620    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96ad37b1-0022-4b1c-9373-a3cef31b8564-kube-api-access-4hb2b" (OuterVolumeSpecName: "kube-api-access-4hb2b") pod "96ad37b1-0022-4b1c-9373-a3cef31b8564" (UID: "96ad37b1-0022-4b1c-9373-a3cef31b8564"). InnerVolumeSpecName "kube-api-access-4hb2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:07:44.691991 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.691952    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-envoy\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:07:44.691991 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.691993    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hb2b\" (UniqueName: \"kubernetes.io/projected/96ad37b1-0022-4b1c-9373-a3cef31b8564-kube-api-access-4hb2b\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:07:44.692187 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.692010    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-token\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:07:44.692187 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.692024    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96ad37b1-0022-4b1c-9373-a3cef31b8564-istio-podinfo\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:07:44.833380 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.833350    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"]
Sep 10 20:07:44.836810 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.836787    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-cde8cba8-openshift-default-6fdd6c7f96-6jjpn"]
Sep 10 20:07:44.851284 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:44.851258    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96ad37b1-0022-4b1c-9373-a3cef31b8564" path="/var/lib/kubelet/pods/96ad37b1-0022-4b1c-9373-a3cef31b8564/volumes"
Sep 10 20:07:47.698329 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:47.698294    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:07:57.533565 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:57.533517    2561 patch_prober.go:28] interesting pod/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 20:07:57.534048 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:57.533592    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf" podUID="01d39510-9c9b-4f20-b8dd-ae6e395ef12a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 20:07:59.591414 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:59.591367    2561 generic.go:356] "Generic (PLEG): container finished" podID="01d39510-9c9b-4f20-b8dd-ae6e395ef12a" containerID="e7476d07aafed4c2f6cbabe4b2a31534c1e935821d7bf59eec0e2ef5945fd976" exitCode=0
Sep 10 20:07:59.591930 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:59.591432    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf" event={"ID":"01d39510-9c9b-4f20-b8dd-ae6e395ef12a","Type":"ContainerDied","Data":"e7476d07aafed4c2f6cbabe4b2a31534c1e935821d7bf59eec0e2ef5945fd976"}
Sep 10 20:07:59.591930 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:59.591850    2561 scope.go:117] "RemoveContainer" containerID="e7476d07aafed4c2f6cbabe4b2a31534c1e935821d7bf59eec0e2ef5945fd976"
Sep 10 20:07:59.592957 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:59.592923    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:07:59.593059 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:59.592994    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:07:59.593059 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:07:59.593047    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:08:00.601637 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:00.601592    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf" event={"ID":"01d39510-9c9b-4f20-b8dd-ae6e395ef12a","Type":"ContainerStarted","Data":"316244e337007df61d3dfd1edbb4cba7305304a5fc84a4694cbb6df145c7f1a3"}
Sep 10 20:08:01.081659 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:01.081626    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:08:01.081831 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:01.081814    2561 patch_prober.go:28] interesting pod/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 10 20:08:01.081887 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:01.081859    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf" podUID="01d39510-9c9b-4f20-b8dd-ae6e395ef12a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 10 20:08:02.081725 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:02.081689    2561 patch_prober.go:28] interesting pod/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 10 20:08:02.082091 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:02.081761    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf" podUID="01d39510-9c9b-4f20-b8dd-ae6e395ef12a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 10 20:08:03.081646 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:03.081609    2561 patch_prober.go:28] interesting pod/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 10 20:08:03.081819 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:03.081663    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf" podUID="01d39510-9c9b-4f20-b8dd-ae6e395ef12a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 10 20:08:04.081757 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:04.081717    2561 patch_prober.go:28] interesting pod/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 10 20:08:04.082090 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:04.081781    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf" podUID="01d39510-9c9b-4f20-b8dd-ae6e395ef12a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 10 20:08:04.309044 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:04.308989    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:08:05.081991 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:05.081962    2561 patch_prober.go:28] interesting pod/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 10 20:08:05.082165 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:05.082010    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf" podUID="01d39510-9c9b-4f20-b8dd-ae6e395ef12a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 10 20:08:06.084938 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:06.084907    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:08:06.085411 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:06.085188    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:08:06.085829 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:06.085808    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:08:06.931116 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:06.931086    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f563295c-ckj7q"]
Sep 10 20:08:06.931465 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:06.931452    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96ad37b1-0022-4b1c-9373-a3cef31b8564" containerName="istio-proxy"
Sep 10 20:08:06.931566 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:06.931466    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="96ad37b1-0022-4b1c-9373-a3cef31b8564" containerName="istio-proxy"
Sep 10 20:08:06.931566 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:06.931534    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="96ad37b1-0022-4b1c-9373-a3cef31b8564" containerName="istio-proxy"
Sep 10 20:08:06.931566 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:06.931543    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="96ad37b1-0022-4b1c-9373-a3cef31b8564" containerName="istio-proxy"
Sep 10 20:08:06.933916 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:06.933901    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f563295c-ckj7q"
Sep 10 20:08:06.936302 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:06.936283    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zdpml\""
Sep 10 20:08:06.942085 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:06.942065    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f563295c-ckj7q"]
Sep 10 20:08:06.997575 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:06.997533    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5662d84-2c47-4d6c-92d1-539c070e387a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f563295c-ckj7q\" (UID: \"b5662d84-2c47-4d6c-92d1-539c070e387a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f563295c-ckj7q"
Sep 10 20:08:07.098935 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:07.098899    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5662d84-2c47-4d6c-92d1-539c070e387a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f563295c-ckj7q\" (UID: \"b5662d84-2c47-4d6c-92d1-539c070e387a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f563295c-ckj7q"
Sep 10 20:08:07.099508 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:07.099490    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5662d84-2c47-4d6c-92d1-539c070e387a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f563295c-ckj7q\" (UID: \"b5662d84-2c47-4d6c-92d1-539c070e387a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f563295c-ckj7q"
Sep 10 20:08:07.245742 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:07.245654    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f563295c-ckj7q"
Sep 10 20:08:07.516037 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:07.516014    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f563295c-ckj7q"]
Sep 10 20:08:07.518483 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:08:07.518446    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5662d84_2c47_4d6c_92d1_539c070e387a.slice/crio-3858ff8a13f11458cab56ccf07e7ea26b023dd457392814526825f3a90213969 WatchSource:0}: Error finding container 3858ff8a13f11458cab56ccf07e7ea26b023dd457392814526825f3a90213969: Status 404 returned error can't find the container with id 3858ff8a13f11458cab56ccf07e7ea26b023dd457392814526825f3a90213969
Sep 10 20:08:07.645122 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:07.645089    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f563295c-ckj7q" event={"ID":"b5662d84-2c47-4d6c-92d1-539c070e387a","Type":"ContainerStarted","Data":"3858ff8a13f11458cab56ccf07e7ea26b023dd457392814526825f3a90213969"}
Sep 10 20:08:10.665839 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:10.665806    2561 generic.go:356] "Generic (PLEG): container finished" podID="b5662d84-2c47-4d6c-92d1-539c070e387a" containerID="c4056e9034b7143cf6f0dedd84c2a5e4614b1736df06b8138b7d251dce4644c3" exitCode=0
Sep 10 20:08:10.666204 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:10.665855    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f563295c-ckj7q" event={"ID":"b5662d84-2c47-4d6c-92d1-539c070e387a","Type":"ContainerDied","Data":"c4056e9034b7143cf6f0dedd84c2a5e4614b1736df06b8138b7d251dce4644c3"}
Sep 10 20:08:12.132551 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:12.132529    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f563295c-ckj7q"
Sep 10 20:08:12.248782 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:12.248744    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5662d84-2c47-4d6c-92d1-539c070e387a-maas-api-service-ca\") pod \"b5662d84-2c47-4d6c-92d1-539c070e387a\" (UID: \"b5662d84-2c47-4d6c-92d1-539c070e387a\") "
Sep 10 20:08:12.249110 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:12.249087    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5662d84-2c47-4d6c-92d1-539c070e387a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b5662d84-2c47-4d6c-92d1-539c070e387a" (UID: "b5662d84-2c47-4d6c-92d1-539c070e387a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:08:12.349600 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:12.349566    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5662d84-2c47-4d6c-92d1-539c070e387a-maas-api-service-ca\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:08:12.678009 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:12.677969    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f563295c-ckj7q" event={"ID":"b5662d84-2c47-4d6c-92d1-539c070e387a","Type":"ContainerDied","Data":"3858ff8a13f11458cab56ccf07e7ea26b023dd457392814526825f3a90213969"}
Sep 10 20:08:12.678197 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:12.678093    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3858ff8a13f11458cab56ccf07e7ea26b023dd457392814526825f3a90213969"
Sep 10 20:08:12.678197 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:12.677996    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f563295c-ckj7q"
Sep 10 20:08:18.055170 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.055134    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"]
Sep 10 20:08:18.055615 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.055598    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5662d84-2c47-4d6c-92d1-539c070e387a" containerName="revoke-keys"
Sep 10 20:08:18.055655 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.055616    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5662d84-2c47-4d6c-92d1-539c070e387a" containerName="revoke-keys"
Sep 10 20:08:18.055655 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.055637    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96ad37b1-0022-4b1c-9373-a3cef31b8564" containerName="istio-proxy"
Sep 10 20:08:18.055655 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.055643    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="96ad37b1-0022-4b1c-9373-a3cef31b8564" containerName="istio-proxy"
Sep 10 20:08:18.055790 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.055700    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5662d84-2c47-4d6c-92d1-539c070e387a" containerName="revoke-keys"
Sep 10 20:08:18.058772 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.058749    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:18.061822 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.061799    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-28a5f0\"/\"kube-root-ca.crt\""
Sep 10 20:08:18.061822 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.061816    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-28a5f0\"/\"openshift-service-ca.crt\""
Sep 10 20:08:18.062940 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.062916    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-28a5f0\"/\"default-dockercfg-56jbx\""
Sep 10 20:08:18.063070 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.062987    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-28a5f0\"/\"autores-model-28a5f0-kserve-self-signed-certs\""
Sep 10 20:08:18.070613 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.070588    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"]
Sep 10 20:08:18.200648 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.200609    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c5kt\" (UniqueName: \"kubernetes.io/projected/44b1fa6b-83db-4c47-858b-264242cd811a-kube-api-access-4c5kt\") pod \"autores-model-28a5f0-kserve-866c8cff5f-dsdcz\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") " pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:18.200862 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.200661    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-tmp-dir\") pod \"autores-model-28a5f0-kserve-866c8cff5f-dsdcz\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") " pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:18.200862 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.200781    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44b1fa6b-83db-4c47-858b-264242cd811a-tls-certs\") pod \"autores-model-28a5f0-kserve-866c8cff5f-dsdcz\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") " pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:18.200862 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.200818    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-model-cache\") pod \"autores-model-28a5f0-kserve-866c8cff5f-dsdcz\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") " pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:18.200862 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.200852    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-dshm\") pod \"autores-model-28a5f0-kserve-866c8cff5f-dsdcz\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") " pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:18.201075 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.200907    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-home\") pod \"autores-model-28a5f0-kserve-866c8cff5f-dsdcz\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") " pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:18.302204 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.302172    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44b1fa6b-83db-4c47-858b-264242cd811a-tls-certs\") pod \"autores-model-28a5f0-kserve-866c8cff5f-dsdcz\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") " pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:18.302413 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.302217    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-model-cache\") pod \"autores-model-28a5f0-kserve-866c8cff5f-dsdcz\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") " pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:18.302413 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.302273    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-dshm\") pod \"autores-model-28a5f0-kserve-866c8cff5f-dsdcz\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") " pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:18.302413 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.302299    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-home\") pod \"autores-model-28a5f0-kserve-866c8cff5f-dsdcz\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") " pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:18.302578 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.302439    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c5kt\" (UniqueName: \"kubernetes.io/projected/44b1fa6b-83db-4c47-858b-264242cd811a-kube-api-access-4c5kt\") pod \"autores-model-28a5f0-kserve-866c8cff5f-dsdcz\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") " pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:18.302578 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.302476    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-tmp-dir\") pod \"autores-model-28a5f0-kserve-866c8cff5f-dsdcz\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") " pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:18.302758 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.302740    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-home\") pod \"autores-model-28a5f0-kserve-866c8cff5f-dsdcz\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") " pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:18.302824 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.302759    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-model-cache\") pod \"autores-model-28a5f0-kserve-866c8cff5f-dsdcz\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") " pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:18.302873 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.302831    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-tmp-dir\") pod \"autores-model-28a5f0-kserve-866c8cff5f-dsdcz\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") " pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:18.304552 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.304527    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-dshm\") pod \"autores-model-28a5f0-kserve-866c8cff5f-dsdcz\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") " pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:18.304760 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.304742    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44b1fa6b-83db-4c47-858b-264242cd811a-tls-certs\") pod \"autores-model-28a5f0-kserve-866c8cff5f-dsdcz\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") " pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:18.310376 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.310313    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c5kt\" (UniqueName: \"kubernetes.io/projected/44b1fa6b-83db-4c47-858b-264242cd811a-kube-api-access-4c5kt\") pod \"autores-model-28a5f0-kserve-866c8cff5f-dsdcz\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") " pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:18.369549 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.369521    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:18.640003 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.639981    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"]
Sep 10 20:08:18.642238 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:08:18.642211    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44b1fa6b_83db_4c47_858b_264242cd811a.slice/crio-690a758d0a4d3d1a671c9dffeeeb5773c75c8e7ed169410dedf7ddf41097097f WatchSource:0}: Error finding container 690a758d0a4d3d1a671c9dffeeeb5773c75c8e7ed169410dedf7ddf41097097f: Status 404 returned error can't find the container with id 690a758d0a4d3d1a671c9dffeeeb5773c75c8e7ed169410dedf7ddf41097097f
Sep 10 20:08:18.711791 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.711759    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz" event={"ID":"44b1fa6b-83db-4c47-858b-264242cd811a","Type":"ContainerStarted","Data":"bba4721eb67104e8fb81222ae5388837b535560c191ac448f30867833a77c285"}
Sep 10 20:08:18.711904 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.711812    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz" event={"ID":"44b1fa6b-83db-4c47-858b-264242cd811a","Type":"ContainerStarted","Data":"690a758d0a4d3d1a671c9dffeeeb5773c75c8e7ed169410dedf7ddf41097097f"}
Sep 10 20:08:18.730694 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.730644    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz" podStartSLOduration=0.730629125 podStartE2EDuration="730.629125ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:08:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:08:18.729296137 +0000 UTC m=+842.394400384" watchObservedRunningTime="2026-09-10 20:08:18.730629125 +0000 UTC m=+842.395733372"
Sep 10 20:08:18.791112 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:18.791068    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:08:23.833729 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:23.833689    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f563295c-ckj7q"]
Sep 10 20:08:23.841410 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:23.837773    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f563295c-ckj7q"]
Sep 10 20:08:23.956862 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:23.956832    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"]
Sep 10 20:08:23.957086 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:23.957047    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf" podUID="01d39510-9c9b-4f20-b8dd-ae6e395ef12a" containerName="istio-proxy" containerID="cri-o://316244e337007df61d3dfd1edbb4cba7305304a5fc84a4694cbb6df145c7f1a3" gracePeriod=30
Sep 10 20:08:24.855672 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:24.855637    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5662d84-2c47-4d6c-92d1-539c070e387a" path="/var/lib/kubelet/pods/b5662d84-2c47-4d6c-92d1-539c070e387a/volumes"
Sep 10 20:08:28.369882 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:28.369841    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:28.370273 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:28.369900    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:28.382618 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:28.382596    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:28.782210 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:28.782126    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:08:29.566797 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.566774    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:08:29.637736 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.637706    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8"]
Sep 10 20:08:29.638069 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.638057    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01d39510-9c9b-4f20-b8dd-ae6e395ef12a" containerName="istio-proxy"
Sep 10 20:08:29.638117 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.638071    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="01d39510-9c9b-4f20-b8dd-ae6e395ef12a" containerName="istio-proxy"
Sep 10 20:08:29.638158 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.638148    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="01d39510-9c9b-4f20-b8dd-ae6e395ef12a" containerName="istio-proxy"
Sep 10 20:08:29.638198 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.638159    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="01d39510-9c9b-4f20-b8dd-ae6e395ef12a" containerName="istio-proxy"
Sep 10 20:08:29.640075 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.640052    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8"
Sep 10 20:08:29.647121 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.647098    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-468cfd8a-dockercfg-2fbw9\""
Sep 10 20:08:29.647724 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.647701    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-468cfd8a\""
Sep 10 20:08:29.655647 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.655626    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8"]
Sep 10 20:08:29.716691 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.716660    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-credential-socket\") pod \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") "
Sep 10 20:08:29.716691 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.716693    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-data\") pod \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") "
Sep 10 20:08:29.716911 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.716731    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-podinfo\") pod \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") "
Sep 10 20:08:29.716911 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.716759    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-workload-socket\") pod \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") "
Sep 10 20:08:29.716911 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.716821    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istiod-ca-cert\") pod \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") "
Sep 10 20:08:29.716911 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.716850    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6h4ks\" (UniqueName: \"kubernetes.io/projected/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-kube-api-access-6h4ks\") pod \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") "
Sep 10 20:08:29.717103 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.716914    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-token\") pod \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") "
Sep 10 20:08:29.717103 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.716980    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-envoy\") pod \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") "
Sep 10 20:08:29.717103 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.716976    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-data" (OuterVolumeSpecName: "istio-data") pod "01d39510-9c9b-4f20-b8dd-ae6e395ef12a" (UID: "01d39510-9c9b-4f20-b8dd-ae6e395ef12a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:08:29.717103 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.717061    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-workload-certs\") pod \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\" (UID: \"01d39510-9c9b-4f20-b8dd-ae6e395ef12a\") "
Sep 10 20:08:29.717330 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.717305    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "01d39510-9c9b-4f20-b8dd-ae6e395ef12a" (UID: "01d39510-9c9b-4f20-b8dd-ae6e395ef12a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:08:29.717330 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.716989    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "01d39510-9c9b-4f20-b8dd-ae6e395ef12a" (UID: "01d39510-9c9b-4f20-b8dd-ae6e395ef12a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:08:29.717469 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.717420    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "01d39510-9c9b-4f20-b8dd-ae6e395ef12a" (UID: "01d39510-9c9b-4f20-b8dd-ae6e395ef12a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:08:29.717537 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.717516    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-workload-certs\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:08:29.717537 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.717531    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-credential-socket\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:08:29.717651 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.717546    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-data\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:08:29.717651 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.717558    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istiod-ca-cert\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:08:29.717754 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.717650    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "01d39510-9c9b-4f20-b8dd-ae6e395ef12a" (UID: "01d39510-9c9b-4f20-b8dd-ae6e395ef12a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:08:29.719310 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.719287    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "01d39510-9c9b-4f20-b8dd-ae6e395ef12a" (UID: "01d39510-9c9b-4f20-b8dd-ae6e395ef12a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:08:29.719446 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.719358    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-token" (OuterVolumeSpecName: "istio-token") pod "01d39510-9c9b-4f20-b8dd-ae6e395ef12a" (UID: "01d39510-9c9b-4f20-b8dd-ae6e395ef12a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:08:29.719560 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.719529    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-kube-api-access-6h4ks" (OuterVolumeSpecName: "kube-api-access-6h4ks") pod "01d39510-9c9b-4f20-b8dd-ae6e395ef12a" (UID: "01d39510-9c9b-4f20-b8dd-ae6e395ef12a"). InnerVolumeSpecName "kube-api-access-6h4ks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:08:29.719630 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.719614    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "01d39510-9c9b-4f20-b8dd-ae6e395ef12a" (UID: "01d39510-9c9b-4f20-b8dd-ae6e395ef12a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 20:08:29.729003 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.728980    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm"]
Sep 10 20:08:29.729412 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.729381    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01d39510-9c9b-4f20-b8dd-ae6e395ef12a" containerName="istio-proxy"
Sep 10 20:08:29.729498 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.729414    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="01d39510-9c9b-4f20-b8dd-ae6e395ef12a" containerName="istio-proxy"
Sep 10 20:08:29.732364 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.732344    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm"
Sep 10 20:08:29.744405 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.744366    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm"]
Sep 10 20:08:29.773808 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.773776    2561 generic.go:356] "Generic (PLEG): container finished" podID="01d39510-9c9b-4f20-b8dd-ae6e395ef12a" containerID="316244e337007df61d3dfd1edbb4cba7305304a5fc84a4694cbb6df145c7f1a3" exitCode=0
Sep 10 20:08:29.773977 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.773827    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"
Sep 10 20:08:29.773977 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.773891    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf" event={"ID":"01d39510-9c9b-4f20-b8dd-ae6e395ef12a","Type":"ContainerDied","Data":"316244e337007df61d3dfd1edbb4cba7305304a5fc84a4694cbb6df145c7f1a3"}
Sep 10 20:08:29.773977 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.773972    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf" event={"ID":"01d39510-9c9b-4f20-b8dd-ae6e395ef12a","Type":"ContainerDied","Data":"72430317ce02c4919953ef2d68d7c9187bb510472f0ef4876c3b587e19858044"}
Sep 10 20:08:29.774120 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.774019    2561 scope.go:117] "RemoveContainer" containerID="316244e337007df61d3dfd1edbb4cba7305304a5fc84a4694cbb6df145c7f1a3"
Sep 10 20:08:29.784038 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.784021    2561 scope.go:117] "RemoveContainer" containerID="e7476d07aafed4c2f6cbabe4b2a31534c1e935821d7bf59eec0e2ef5945fd976"
Sep 10 20:08:29.792007 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.791988    2561 scope.go:117] "RemoveContainer" containerID="316244e337007df61d3dfd1edbb4cba7305304a5fc84a4694cbb6df145c7f1a3"
Sep 10 20:08:29.792291 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:08:29.792272    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"316244e337007df61d3dfd1edbb4cba7305304a5fc84a4694cbb6df145c7f1a3\": container with ID starting with 316244e337007df61d3dfd1edbb4cba7305304a5fc84a4694cbb6df145c7f1a3 not found: ID does not exist" containerID="316244e337007df61d3dfd1edbb4cba7305304a5fc84a4694cbb6df145c7f1a3"
Sep 10 20:08:29.792364 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.792296    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"316244e337007df61d3dfd1edbb4cba7305304a5fc84a4694cbb6df145c7f1a3"} err="failed to get container status \"316244e337007df61d3dfd1edbb4cba7305304a5fc84a4694cbb6df145c7f1a3\": rpc error: code = NotFound desc = could not find container \"316244e337007df61d3dfd1edbb4cba7305304a5fc84a4694cbb6df145c7f1a3\": container with ID starting with 316244e337007df61d3dfd1edbb4cba7305304a5fc84a4694cbb6df145c7f1a3 not found: ID does not exist"
Sep 10 20:08:29.792364 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.792324    2561 scope.go:117] "RemoveContainer" containerID="e7476d07aafed4c2f6cbabe4b2a31534c1e935821d7bf59eec0e2ef5945fd976"
Sep 10 20:08:29.792734 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:08:29.792691    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7476d07aafed4c2f6cbabe4b2a31534c1e935821d7bf59eec0e2ef5945fd976\": container with ID starting with e7476d07aafed4c2f6cbabe4b2a31534c1e935821d7bf59eec0e2ef5945fd976 not found: ID does not exist" containerID="e7476d07aafed4c2f6cbabe4b2a31534c1e935821d7bf59eec0e2ef5945fd976"
Sep 10 20:08:29.792734 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.792721    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7476d07aafed4c2f6cbabe4b2a31534c1e935821d7bf59eec0e2ef5945fd976"} err="failed to get container status \"e7476d07aafed4c2f6cbabe4b2a31534c1e935821d7bf59eec0e2ef5945fd976\": rpc error: code = NotFound desc = could not find container \"e7476d07aafed4c2f6cbabe4b2a31534c1e935821d7bf59eec0e2ef5945fd976\": container with ID starting with e7476d07aafed4c2f6cbabe4b2a31534c1e935821d7bf59eec0e2ef5945fd976 not found: ID does not exist"
Sep 10 20:08:29.798150 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.798103    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"]
Sep 10 20:08:29.803997 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.803978    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-f563295c-gw-openshift-default-69df77c98d-szrrf"]
Sep 10 20:08:29.818789 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.818763    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a01dbbb-c0b3-420a-980c-0d80b34f23dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8\" (UID: \"7a01dbbb-c0b3-420a-980c-0d80b34f23dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8"
Sep 10 20:08:29.818891 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.818851    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nblzr\" (UniqueName: \"kubernetes.io/projected/7a01dbbb-c0b3-420a-980c-0d80b34f23dd-kube-api-access-nblzr\") pod \"payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8\" (UID: \"7a01dbbb-c0b3-420a-980c-0d80b34f23dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8"
Sep 10 20:08:29.818961 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.818942    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-podinfo\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:08:29.819024 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.818959    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-workload-socket\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:08:29.819024 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.818976    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h4ks\" (UniqueName: \"kubernetes.io/projected/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-kube-api-access-6h4ks\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:08:29.819024 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.818991    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-token\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:08:29.819024 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.819004    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01d39510-9c9b-4f20-b8dd-ae6e395ef12a-istio-envoy\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:08:29.920125 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.920086    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a01dbbb-c0b3-420a-980c-0d80b34f23dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8\" (UID: \"7a01dbbb-c0b3-420a-980c-0d80b34f23dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8"
Sep 10 20:08:29.920315 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.920186    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nblzr\" (UniqueName: \"kubernetes.io/projected/7a01dbbb-c0b3-420a-980c-0d80b34f23dd-kube-api-access-nblzr\") pod \"payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8\" (UID: \"7a01dbbb-c0b3-420a-980c-0d80b34f23dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8"
Sep 10 20:08:29.920315 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.920217    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/764d263d-6af9-4ed3-99fa-68aca739a9f8-plugins-config-volume\") pod \"payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm\" (UID: \"764d263d-6af9-4ed3-99fa-68aca739a9f8\") " pod="openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm"
Sep 10 20:08:29.920315 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.920283    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72ts5\" (UniqueName: \"kubernetes.io/projected/764d263d-6af9-4ed3-99fa-68aca739a9f8-kube-api-access-72ts5\") pod \"payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm\" (UID: \"764d263d-6af9-4ed3-99fa-68aca739a9f8\") " pod="openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm"
Sep 10 20:08:29.920958 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.920936    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a01dbbb-c0b3-420a-980c-0d80b34f23dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8\" (UID: \"7a01dbbb-c0b3-420a-980c-0d80b34f23dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8"
Sep 10 20:08:29.931665 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.931632    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nblzr\" (UniqueName: \"kubernetes.io/projected/7a01dbbb-c0b3-420a-980c-0d80b34f23dd-kube-api-access-nblzr\") pod \"payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8\" (UID: \"7a01dbbb-c0b3-420a-980c-0d80b34f23dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8"
Sep 10 20:08:29.949976 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:29.949950    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8"
Sep 10 20:08:30.022726 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:30.021115    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/764d263d-6af9-4ed3-99fa-68aca739a9f8-plugins-config-volume\") pod \"payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm\" (UID: \"764d263d-6af9-4ed3-99fa-68aca739a9f8\") " pod="openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm"
Sep 10 20:08:30.022726 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:30.021162    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72ts5\" (UniqueName: \"kubernetes.io/projected/764d263d-6af9-4ed3-99fa-68aca739a9f8-kube-api-access-72ts5\") pod \"payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm\" (UID: \"764d263d-6af9-4ed3-99fa-68aca739a9f8\") " pod="openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm"
Sep 10 20:08:30.022726 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:30.022534    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/764d263d-6af9-4ed3-99fa-68aca739a9f8-plugins-config-volume\") pod \"payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm\" (UID: \"764d263d-6af9-4ed3-99fa-68aca739a9f8\") " pod="openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm"
Sep 10 20:08:30.033263 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:30.033220    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72ts5\" (UniqueName: \"kubernetes.io/projected/764d263d-6af9-4ed3-99fa-68aca739a9f8-kube-api-access-72ts5\") pod \"payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm\" (UID: \"764d263d-6af9-4ed3-99fa-68aca739a9f8\") " pod="openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm"
Sep 10 20:08:30.046885 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:30.046860    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm"
Sep 10 20:08:30.233478 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:30.233308    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8"]
Sep 10 20:08:30.525556 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:30.525465    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm"]
Sep 10 20:08:30.528248 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:08:30.528211    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod764d263d_6af9_4ed3_99fa_68aca739a9f8.slice/crio-294bf206d923fbb21a46d2460ada168e8e1d9bc359d26aa97c2948a1b1cca9dd WatchSource:0}: Error finding container 294bf206d923fbb21a46d2460ada168e8e1d9bc359d26aa97c2948a1b1cca9dd: Status 404 returned error can't find the container with id 294bf206d923fbb21a46d2460ada168e8e1d9bc359d26aa97c2948a1b1cca9dd
Sep 10 20:08:30.781245 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:30.781213    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8" event={"ID":"7a01dbbb-c0b3-420a-980c-0d80b34f23dd","Type":"ContainerStarted","Data":"a0e8900da77b22d49504f9256129d5357cda24cb627734e2daacadc9c32da28a"}
Sep 10 20:08:30.781718 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:30.781264    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8" event={"ID":"7a01dbbb-c0b3-420a-980c-0d80b34f23dd","Type":"ContainerStarted","Data":"85b4b16095e3cb09870a078a57522bd465d3e1d88bac9bbee328b33714484722"}
Sep 10 20:08:30.781718 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:30.781295    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8"
Sep 10 20:08:30.783061 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:30.783037    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm" event={"ID":"764d263d-6af9-4ed3-99fa-68aca739a9f8","Type":"ContainerStarted","Data":"578385de6e38d60e9b3eee7d81d30a754d23c3739e796c59b3079fd81ed70b42"}
Sep 10 20:08:30.783197 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:30.783085    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm" event={"ID":"764d263d-6af9-4ed3-99fa-68aca739a9f8","Type":"ContainerStarted","Data":"294bf206d923fbb21a46d2460ada168e8e1d9bc359d26aa97c2948a1b1cca9dd"}
Sep 10 20:08:30.783197 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:30.783115    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm"
Sep 10 20:08:30.800582 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:30.800532    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8" podStartSLOduration=1.800511346 podStartE2EDuration="1.800511346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:08:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:08:30.798759271 +0000 UTC m=+854.463863520" watchObservedRunningTime="2026-09-10 20:08:30.800511346 +0000 UTC m=+854.465615594"
Sep 10 20:08:30.817034 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:30.816957    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm" podStartSLOduration=1.816945306 podStartE2EDuration="1.816945306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:08:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:08:30.815512108 +0000 UTC m=+854.480616355" watchObservedRunningTime="2026-09-10 20:08:30.816945306 +0000 UTC m=+854.482049552"
Sep 10 20:08:30.861221 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:30.861183    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01d39510-9c9b-4f20-b8dd-ae6e395ef12a" path="/var/lib/kubelet/pods/01d39510-9c9b-4f20-b8dd-ae6e395ef12a/volumes"
Sep 10 20:08:39.614748 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:39.614710    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:08:41.793354 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:41.793304    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm"
Sep 10 20:08:41.793835 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:41.793430    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8"
Sep 10 20:08:47.763643 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:47.763608    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"]
Sep 10 20:08:47.902342 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:47.902313    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-28a5f0-vgls8"]
Sep 10 20:08:47.907522 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:47.907502    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-28a5f0-vgls8"
Sep 10 20:08:47.910066 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:47.910046    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zdpml\""
Sep 10 20:08:47.918153 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:47.918129    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-28a5f0-vgls8"]
Sep 10 20:08:47.961002 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:47.960965    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7622bd7-301a-4cfe-8755-bef194ee131c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-28a5f0-vgls8\" (UID: \"d7622bd7-301a-4cfe-8755-bef194ee131c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-28a5f0-vgls8"
Sep 10 20:08:48.061824 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:48.061723    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7622bd7-301a-4cfe-8755-bef194ee131c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-28a5f0-vgls8\" (UID: \"d7622bd7-301a-4cfe-8755-bef194ee131c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-28a5f0-vgls8"
Sep 10 20:08:48.062344 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:48.062324    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7622bd7-301a-4cfe-8755-bef194ee131c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-28a5f0-vgls8\" (UID: \"d7622bd7-301a-4cfe-8755-bef194ee131c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-28a5f0-vgls8"
Sep 10 20:08:48.218912 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:48.218887    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-28a5f0-vgls8"
Sep 10 20:08:48.511630 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:48.511600    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-28a5f0-vgls8"]
Sep 10 20:08:48.514817 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:08:48.514786    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7622bd7_301a_4cfe_8755_bef194ee131c.slice/crio-7d1fc69a621d02caa262dfc526308aaebac1541bbc6256ceb1ce3a7a4cf7b3a7 WatchSource:0}: Error finding container 7d1fc69a621d02caa262dfc526308aaebac1541bbc6256ceb1ce3a7a4cf7b3a7: Status 404 returned error can't find the container with id 7d1fc69a621d02caa262dfc526308aaebac1541bbc6256ceb1ce3a7a4cf7b3a7
Sep 10 20:08:48.885523 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:48.885489    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-28a5f0-vgls8" event={"ID":"d7622bd7-301a-4cfe-8755-bef194ee131c","Type":"ContainerStarted","Data":"10574534d0d8427bf55fc8d8e9fb2ea147b9d4bdaaec21d9930960fade0ccbae"}
Sep 10 20:08:48.885839 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:48.885546    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-28a5f0-vgls8" event={"ID":"d7622bd7-301a-4cfe-8755-bef194ee131c","Type":"ContainerStarted","Data":"7d1fc69a621d02caa262dfc526308aaebac1541bbc6256ceb1ce3a7a4cf7b3a7"}
Sep 10 20:08:48.910777 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:48.910735    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-28a5f0-vgls8" podStartSLOduration=1.910697984 podStartE2EDuration="1.910697984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:08:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:08:48.909912415 +0000 UTC m=+872.575016662" watchObservedRunningTime="2026-09-10 20:08:48.910697984 +0000 UTC m=+872.575802231"
Sep 10 20:08:49.893518 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:49.893481    2561 generic.go:356] "Generic (PLEG): container finished" podID="d7622bd7-301a-4cfe-8755-bef194ee131c" containerID="10574534d0d8427bf55fc8d8e9fb2ea147b9d4bdaaec21d9930960fade0ccbae" exitCode=0
Sep 10 20:08:49.893876 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:49.893548    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-28a5f0-vgls8" event={"ID":"d7622bd7-301a-4cfe-8755-bef194ee131c","Type":"ContainerDied","Data":"10574534d0d8427bf55fc8d8e9fb2ea147b9d4bdaaec21d9930960fade0ccbae"}
Sep 10 20:08:51.333959 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:51.333935    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-28a5f0-vgls8"
Sep 10 20:08:51.388313 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:51.388288    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7622bd7-301a-4cfe-8755-bef194ee131c-maas-api-service-ca\") pod \"d7622bd7-301a-4cfe-8755-bef194ee131c\" (UID: \"d7622bd7-301a-4cfe-8755-bef194ee131c\") "
Sep 10 20:08:51.388621 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:51.388597    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7622bd7-301a-4cfe-8755-bef194ee131c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d7622bd7-301a-4cfe-8755-bef194ee131c" (UID: "d7622bd7-301a-4cfe-8755-bef194ee131c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:08:51.489780 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:51.489750    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7622bd7-301a-4cfe-8755-bef194ee131c-maas-api-service-ca\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:08:51.905692 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:51.905665    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-28a5f0-vgls8"
Sep 10 20:08:51.905847 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:51.905702    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-28a5f0-vgls8" event={"ID":"d7622bd7-301a-4cfe-8755-bef194ee131c","Type":"ContainerDied","Data":"7d1fc69a621d02caa262dfc526308aaebac1541bbc6256ceb1ce3a7a4cf7b3a7"}
Sep 10 20:08:51.905847 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:51.905750    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d1fc69a621d02caa262dfc526308aaebac1541bbc6256ceb1ce3a7a4cf7b3a7"
Sep 10 20:08:53.311738 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:53.311708    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-468cfd8a-tqlwd"]
Sep 10 20:08:53.312110 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:53.312094    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7622bd7-301a-4cfe-8755-bef194ee131c" containerName="revoke-keys"
Sep 10 20:08:53.312110 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:53.312105    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7622bd7-301a-4cfe-8755-bef194ee131c" containerName="revoke-keys"
Sep 10 20:08:53.312182 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:53.312166    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7622bd7-301a-4cfe-8755-bef194ee131c" containerName="revoke-keys"
Sep 10 20:08:53.314204 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:53.314188    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-468cfd8a-tqlwd"
Sep 10 20:08:53.316655 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:53.316634    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zdpml\""
Sep 10 20:08:53.325988 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:53.325963    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-468cfd8a-tqlwd"]
Sep 10 20:08:53.407458 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:53.407427    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf60cec-c377-424a-abc3-fb82f4d92ee2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-468cfd8a-tqlwd\" (UID: \"9cf60cec-c377-424a-abc3-fb82f4d92ee2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-468cfd8a-tqlwd"
Sep 10 20:08:53.508820 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:53.508787    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf60cec-c377-424a-abc3-fb82f4d92ee2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-468cfd8a-tqlwd\" (UID: \"9cf60cec-c377-424a-abc3-fb82f4d92ee2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-468cfd8a-tqlwd"
Sep 10 20:08:53.509416 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:53.509377    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf60cec-c377-424a-abc3-fb82f4d92ee2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-468cfd8a-tqlwd\" (UID: \"9cf60cec-c377-424a-abc3-fb82f4d92ee2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-468cfd8a-tqlwd"
Sep 10 20:08:53.627768 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:53.627739    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-468cfd8a-tqlwd"
Sep 10 20:08:53.900490 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:53.900462    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-468cfd8a-tqlwd"]
Sep 10 20:08:53.902363 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:08:53.902336    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cf60cec_c377_424a_abc3_fb82f4d92ee2.slice/crio-9c26e058fbf1a9f8dbf5ed67b4478781773c93214a374d817b4e7507acad1ba2 WatchSource:0}: Error finding container 9c26e058fbf1a9f8dbf5ed67b4478781773c93214a374d817b4e7507acad1ba2: Status 404 returned error can't find the container with id 9c26e058fbf1a9f8dbf5ed67b4478781773c93214a374d817b4e7507acad1ba2
Sep 10 20:08:53.916986 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:53.916963    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-468cfd8a-tqlwd" event={"ID":"9cf60cec-c377-424a-abc3-fb82f4d92ee2","Type":"ContainerStarted","Data":"9c26e058fbf1a9f8dbf5ed67b4478781773c93214a374d817b4e7507acad1ba2"}
Sep 10 20:08:54.924547 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:54.924513    2561 generic.go:356] "Generic (PLEG): container finished" podID="9cf60cec-c377-424a-abc3-fb82f4d92ee2" containerID="e39fc700b44726b01b2de0ee64423f7af47a507120ae50f0ef5af0e668fa38cb" exitCode=0
Sep 10 20:08:54.924948 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:54.924662    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-468cfd8a-tqlwd" event={"ID":"9cf60cec-c377-424a-abc3-fb82f4d92ee2","Type":"ContainerDied","Data":"e39fc700b44726b01b2de0ee64423f7af47a507120ae50f0ef5af0e668fa38cb"}
Sep 10 20:08:56.369184 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:56.369154    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-468cfd8a-tqlwd"
Sep 10 20:08:56.435524 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:56.435498    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf60cec-c377-424a-abc3-fb82f4d92ee2-maas-api-service-ca\") pod \"9cf60cec-c377-424a-abc3-fb82f4d92ee2\" (UID: \"9cf60cec-c377-424a-abc3-fb82f4d92ee2\") "
Sep 10 20:08:56.435906 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:56.435884    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cf60cec-c377-424a-abc3-fb82f4d92ee2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9cf60cec-c377-424a-abc3-fb82f4d92ee2" (UID: "9cf60cec-c377-424a-abc3-fb82f4d92ee2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:08:56.536209 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:56.536179    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf60cec-c377-424a-abc3-fb82f4d92ee2-maas-api-service-ca\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:08:56.938072 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:56.938044    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-468cfd8a-tqlwd"
Sep 10 20:08:56.938266 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:56.938075    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-468cfd8a-tqlwd" event={"ID":"9cf60cec-c377-424a-abc3-fb82f4d92ee2","Type":"ContainerDied","Data":"9c26e058fbf1a9f8dbf5ed67b4478781773c93214a374d817b4e7507acad1ba2"}
Sep 10 20:08:56.938266 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:56.938125    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c26e058fbf1a9f8dbf5ed67b4478781773c93214a374d817b4e7507acad1ba2"
Sep 10 20:08:59.329159 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:59.329122    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm"]
Sep 10 20:08:59.329649 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:59.329386    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm" podUID="764d263d-6af9-4ed3-99fa-68aca739a9f8" containerName="payload-processing" containerID="cri-o://578385de6e38d60e9b3eee7d81d30a754d23c3739e796c59b3079fd81ed70b42" gracePeriod=30
Sep 10 20:08:59.358283 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:59.358237    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8"]
Sep 10 20:08:59.358551 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:59.358517    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8" podUID="7a01dbbb-c0b3-420a-980c-0d80b34f23dd" containerName="payload-pre-processing" containerID="cri-o://a0e8900da77b22d49504f9256129d5357cda24cb627734e2daacadc9c32da28a" gracePeriod=30
Sep 10 20:08:59.610658 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:59.610569    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx"]
Sep 10 20:08:59.610910 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:59.610864    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx" podUID="e28b2a19-96f1-41fe-b3d4-60c764272735" containerName="payload-processing" containerID="cri-o://d9c59818d78ae9889175c8a3f198cc0a6e9f0d377d6ce4ff1be3598fe4ed10ce" gracePeriod=30
Sep 10 20:08:59.648029 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:59.647985    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-468cfd8a-tqlwd"]
Sep 10 20:08:59.652306 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:59.652277    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-468cfd8a-tqlwd"]
Sep 10 20:08:59.919206 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:59.919107    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-28a5f0-vgls8"]
Sep 10 20:08:59.924676 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:59.924639    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-28a5f0-vgls8"]
Sep 10 20:08:59.956173 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:59.956085    2561 generic.go:356] "Generic (PLEG): container finished" podID="764d263d-6af9-4ed3-99fa-68aca739a9f8" containerID="578385de6e38d60e9b3eee7d81d30a754d23c3739e796c59b3079fd81ed70b42" exitCode=0
Sep 10 20:08:59.956431 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:59.956219    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm" event={"ID":"764d263d-6af9-4ed3-99fa-68aca739a9f8","Type":"ContainerDied","Data":"578385de6e38d60e9b3eee7d81d30a754d23c3739e796c59b3079fd81ed70b42"}
Sep 10 20:08:59.958321 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:59.958177    2561 generic.go:356] "Generic (PLEG): container finished" podID="e28b2a19-96f1-41fe-b3d4-60c764272735" containerID="d9c59818d78ae9889175c8a3f198cc0a6e9f0d377d6ce4ff1be3598fe4ed10ce" exitCode=0
Sep 10 20:08:59.958321 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:59.958266    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx" event={"ID":"e28b2a19-96f1-41fe-b3d4-60c764272735","Type":"ContainerDied","Data":"d9c59818d78ae9889175c8a3f198cc0a6e9f0d377d6ce4ff1be3598fe4ed10ce"}
Sep 10 20:08:59.960773 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:59.960670    2561 generic.go:356] "Generic (PLEG): container finished" podID="7a01dbbb-c0b3-420a-980c-0d80b34f23dd" containerID="a0e8900da77b22d49504f9256129d5357cda24cb627734e2daacadc9c32da28a" exitCode=0
Sep 10 20:08:59.960773 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:08:59.960701    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8" event={"ID":"7a01dbbb-c0b3-420a-980c-0d80b34f23dd","Type":"ContainerDied","Data":"a0e8900da77b22d49504f9256129d5357cda24cb627734e2daacadc9c32da28a"}
Sep 10 20:09:00.222543 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.222513    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm"
Sep 10 20:09:00.269807 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.269428    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72ts5\" (UniqueName: \"kubernetes.io/projected/764d263d-6af9-4ed3-99fa-68aca739a9f8-kube-api-access-72ts5\") pod \"764d263d-6af9-4ed3-99fa-68aca739a9f8\" (UID: \"764d263d-6af9-4ed3-99fa-68aca739a9f8\") "
Sep 10 20:09:00.269807 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.269586    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/764d263d-6af9-4ed3-99fa-68aca739a9f8-plugins-config-volume\") pod \"764d263d-6af9-4ed3-99fa-68aca739a9f8\" (UID: \"764d263d-6af9-4ed3-99fa-68aca739a9f8\") "
Sep 10 20:09:00.270052 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.269988    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/764d263d-6af9-4ed3-99fa-68aca739a9f8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "764d263d-6af9-4ed3-99fa-68aca739a9f8" (UID: "764d263d-6af9-4ed3-99fa-68aca739a9f8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:09:00.271801 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.271777    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/764d263d-6af9-4ed3-99fa-68aca739a9f8-kube-api-access-72ts5" (OuterVolumeSpecName: "kube-api-access-72ts5") pod "764d263d-6af9-4ed3-99fa-68aca739a9f8" (UID: "764d263d-6af9-4ed3-99fa-68aca739a9f8"). InnerVolumeSpecName "kube-api-access-72ts5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:09:00.337728 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.337703    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8"
Sep 10 20:09:00.370843 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.370794    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nblzr\" (UniqueName: \"kubernetes.io/projected/7a01dbbb-c0b3-420a-980c-0d80b34f23dd-kube-api-access-nblzr\") pod \"7a01dbbb-c0b3-420a-980c-0d80b34f23dd\" (UID: \"7a01dbbb-c0b3-420a-980c-0d80b34f23dd\") "
Sep 10 20:09:00.371090 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.371065    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a01dbbb-c0b3-420a-980c-0d80b34f23dd-plugins-config-volume\") pod \"7a01dbbb-c0b3-420a-980c-0d80b34f23dd\" (UID: \"7a01dbbb-c0b3-420a-980c-0d80b34f23dd\") "
Sep 10 20:09:00.371470 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.371442    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a01dbbb-c0b3-420a-980c-0d80b34f23dd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7a01dbbb-c0b3-420a-980c-0d80b34f23dd" (UID: "7a01dbbb-c0b3-420a-980c-0d80b34f23dd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:09:00.371714 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.371693    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72ts5\" (UniqueName: \"kubernetes.io/projected/764d263d-6af9-4ed3-99fa-68aca739a9f8-kube-api-access-72ts5\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:09:00.371836 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.371821    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a01dbbb-c0b3-420a-980c-0d80b34f23dd-plugins-config-volume\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:09:00.371947 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.371921    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/764d263d-6af9-4ed3-99fa-68aca739a9f8-plugins-config-volume\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:09:00.375537 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.375121    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a01dbbb-c0b3-420a-980c-0d80b34f23dd-kube-api-access-nblzr" (OuterVolumeSpecName: "kube-api-access-nblzr") pod "7a01dbbb-c0b3-420a-980c-0d80b34f23dd" (UID: "7a01dbbb-c0b3-420a-980c-0d80b34f23dd"). InnerVolumeSpecName "kube-api-access-nblzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:09:00.473020 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.472909    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nblzr\" (UniqueName: \"kubernetes.io/projected/7a01dbbb-c0b3-420a-980c-0d80b34f23dd-kube-api-access-nblzr\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:09:00.519411 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.518921    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx"
Sep 10 20:09:00.574108 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.574053    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e28b2a19-96f1-41fe-b3d4-60c764272735-plugins-config-volume\") pod \"e28b2a19-96f1-41fe-b3d4-60c764272735\" (UID: \"e28b2a19-96f1-41fe-b3d4-60c764272735\") "
Sep 10 20:09:00.574292 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.574214    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkhch\" (UniqueName: \"kubernetes.io/projected/e28b2a19-96f1-41fe-b3d4-60c764272735-kube-api-access-fkhch\") pod \"e28b2a19-96f1-41fe-b3d4-60c764272735\" (UID: \"e28b2a19-96f1-41fe-b3d4-60c764272735\") "
Sep 10 20:09:00.574471 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.574440    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e28b2a19-96f1-41fe-b3d4-60c764272735-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e28b2a19-96f1-41fe-b3d4-60c764272735" (UID: "e28b2a19-96f1-41fe-b3d4-60c764272735"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:09:00.576357 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.576333    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e28b2a19-96f1-41fe-b3d4-60c764272735-kube-api-access-fkhch" (OuterVolumeSpecName: "kube-api-access-fkhch") pod "e28b2a19-96f1-41fe-b3d4-60c764272735" (UID: "e28b2a19-96f1-41fe-b3d4-60c764272735"). InnerVolumeSpecName "kube-api-access-fkhch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:09:00.675784 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.675750    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e28b2a19-96f1-41fe-b3d4-60c764272735-plugins-config-volume\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:09:00.675784 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.675778    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkhch\" (UniqueName: \"kubernetes.io/projected/e28b2a19-96f1-41fe-b3d4-60c764272735-kube-api-access-fkhch\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:09:00.851893 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.851859    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cf60cec-c377-424a-abc3-fb82f4d92ee2" path="/var/lib/kubelet/pods/9cf60cec-c377-424a-abc3-fb82f4d92ee2/volumes"
Sep 10 20:09:00.852296 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.852275    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7622bd7-301a-4cfe-8755-bef194ee131c" path="/var/lib/kubelet/pods/d7622bd7-301a-4cfe-8755-bef194ee131c/volumes"
Sep 10 20:09:00.968475 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.968446    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm"
Sep 10 20:09:00.968673 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.968438    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm" event={"ID":"764d263d-6af9-4ed3-99fa-68aca739a9f8","Type":"ContainerDied","Data":"294bf206d923fbb21a46d2460ada168e8e1d9bc359d26aa97c2948a1b1cca9dd"}
Sep 10 20:09:00.968673 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.968584    2561 scope.go:117] "RemoveContainer" containerID="578385de6e38d60e9b3eee7d81d30a754d23c3739e796c59b3079fd81ed70b42"
Sep 10 20:09:00.970417 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.969962    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx"
Sep 10 20:09:00.970417 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.970001    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx" event={"ID":"e28b2a19-96f1-41fe-b3d4-60c764272735","Type":"ContainerDied","Data":"ef2067948a13a80f5185a7cf8ce58a716cee9c23d24fa934eacf5c47109e0d32"}
Sep 10 20:09:00.971693 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.971673    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8"
Sep 10 20:09:00.971812 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.971732    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8" event={"ID":"7a01dbbb-c0b3-420a-980c-0d80b34f23dd","Type":"ContainerDied","Data":"85b4b16095e3cb09870a078a57522bd465d3e1d88bac9bbee328b33714484722"}
Sep 10 20:09:00.979211 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.979160    2561 scope.go:117] "RemoveContainer" containerID="d9c59818d78ae9889175c8a3f198cc0a6e9f0d377d6ce4ff1be3598fe4ed10ce"
Sep 10 20:09:00.988610 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.988582    2561 scope.go:117] "RemoveContainer" containerID="a0e8900da77b22d49504f9256129d5357cda24cb627734e2daacadc9c32da28a"
Sep 10 20:09:00.998018 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:00.997985    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8"]
Sep 10 20:09:01.010807 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.010784    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-468cfd8a-7d5d6cd8b-qvrx8"]
Sep 10 20:09:01.035252 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.035224    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm"]
Sep 10 20:09:01.039155 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.039132    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-468cfd8a-57d67c9855-7nsrm"]
Sep 10 20:09:01.067591 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.067562    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx"]
Sep 10 20:09:01.071617 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.071589    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx"]
Sep 10 20:09:01.256790 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.256698    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-autores-28a5f0-55c69f78b9-gnbmx" podUID="e28b2a19-96f1-41fe-b3d4-60c764272735" containerName="payload-processing" probeResult="failure" output="dial tcp 10.133.0.45:9004: i/o timeout"
Sep 10 20:09:01.635413 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.635116    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"]
Sep 10 20:09:01.635863 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.635697    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e28b2a19-96f1-41fe-b3d4-60c764272735" containerName="payload-processing"
Sep 10 20:09:01.635863 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.635715    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e28b2a19-96f1-41fe-b3d4-60c764272735" containerName="payload-processing"
Sep 10 20:09:01.635863 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.635733    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="764d263d-6af9-4ed3-99fa-68aca739a9f8" containerName="payload-processing"
Sep 10 20:09:01.635863 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.635742    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="764d263d-6af9-4ed3-99fa-68aca739a9f8" containerName="payload-processing"
Sep 10 20:09:01.635863 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.635752    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cf60cec-c377-424a-abc3-fb82f4d92ee2" containerName="revoke-keys"
Sep 10 20:09:01.635863 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.635758    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cf60cec-c377-424a-abc3-fb82f4d92ee2" containerName="revoke-keys"
Sep 10 20:09:01.635863 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.635766    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a01dbbb-c0b3-420a-980c-0d80b34f23dd" containerName="payload-pre-processing"
Sep 10 20:09:01.635863 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.635772    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a01dbbb-c0b3-420a-980c-0d80b34f23dd" containerName="payload-pre-processing"
Sep 10 20:09:01.635863 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.635848    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="764d263d-6af9-4ed3-99fa-68aca739a9f8" containerName="payload-processing"
Sep 10 20:09:01.635863 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.635855    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e28b2a19-96f1-41fe-b3d4-60c764272735" containerName="payload-processing"
Sep 10 20:09:01.635863 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.635862    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cf60cec-c377-424a-abc3-fb82f4d92ee2" containerName="revoke-keys"
Sep 10 20:09:01.635863 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.635869    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a01dbbb-c0b3-420a-980c-0d80b34f23dd" containerName="payload-pre-processing"
Sep 10 20:09:01.640687 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.640664    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.643458 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.643437    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-653653a4-openshift-default-dockercfg-tw5jf\""
Sep 10 20:09:01.659786 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.659728    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"]
Sep 10 20:09:01.685462 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.685427    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e810ff69-a54e-4b10-9445-dd98f3ff82af-istiod-ca-cert\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.685705 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.685474    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-envoy\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.685705 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.685566    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-podinfo\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.685705 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.685640    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-data\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.685705 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.685700    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-workload-certs\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.686040 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.685724    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-token\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.686040 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.685775    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-credential-socket\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.686040 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.685806    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgfs2\" (UniqueName: \"kubernetes.io/projected/e810ff69-a54e-4b10-9445-dd98f3ff82af-kube-api-access-tgfs2\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.686040 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.685849    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-workload-socket\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.787087 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.787050    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgfs2\" (UniqueName: \"kubernetes.io/projected/e810ff69-a54e-4b10-9445-dd98f3ff82af-kube-api-access-tgfs2\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.787283 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.787097    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-workload-socket\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.787283 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.787129    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e810ff69-a54e-4b10-9445-dd98f3ff82af-istiod-ca-cert\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.787283 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.787153    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-envoy\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.787283 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.787209    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-podinfo\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.787283 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.787241    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-data\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.787283 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.787273    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-workload-certs\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.787619 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.787304    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-token\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.787619 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.787367    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-credential-socket\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.787619 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.787560    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-workload-socket\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.787917 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.787885    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-workload-certs\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.787917 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.787911    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-data\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.788121 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.788101    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-credential-socket\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.788217 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.788198    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e810ff69-a54e-4b10-9445-dd98f3ff82af-istiod-ca-cert\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.792686 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.792650    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-envoy\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.793150 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.793128    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-podinfo\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.797563 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.797528    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgfs2\" (UniqueName: \"kubernetes.io/projected/e810ff69-a54e-4b10-9445-dd98f3ff82af-kube-api-access-tgfs2\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.797682 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.797560    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-token\") pod \"e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") " pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:01.953882 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:01.953790    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:02.240380 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:02.240350    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"]
Sep 10 20:09:02.242302 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:09:02.242264    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode810ff69_a54e_4b10_9445_dd98f3ff82af.slice/crio-7cf26794996e1d80ece5f502fffb4ae8017f66dbab51760a635f26d1ce31d204 WatchSource:0}: Error finding container 7cf26794996e1d80ece5f502fffb4ae8017f66dbab51760a635f26d1ce31d204: Status 404 returned error can't find the container with id 7cf26794996e1d80ece5f502fffb4ae8017f66dbab51760a635f26d1ce31d204
Sep 10 20:09:02.244574 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:02.244540    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:09:02.244674 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:02.244637    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:09:02.244739 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:02.244682    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:09:02.783537 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:02.783495    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz" podUID="44b1fa6b-83db-4c47-858b-264242cd811a" containerName="main" containerID="cri-o://bba4721eb67104e8fb81222ae5388837b535560c191ac448f30867833a77c285" gracePeriod=45
Sep 10 20:09:02.850580 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:02.850550    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="764d263d-6af9-4ed3-99fa-68aca739a9f8" path="/var/lib/kubelet/pods/764d263d-6af9-4ed3-99fa-68aca739a9f8/volumes"
Sep 10 20:09:02.850919 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:02.850907    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a01dbbb-c0b3-420a-980c-0d80b34f23dd" path="/var/lib/kubelet/pods/7a01dbbb-c0b3-420a-980c-0d80b34f23dd/volumes"
Sep 10 20:09:02.851220 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:02.851209    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e28b2a19-96f1-41fe-b3d4-60c764272735" path="/var/lib/kubelet/pods/e28b2a19-96f1-41fe-b3d4-60c764272735/volumes"
Sep 10 20:09:02.997619 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:02.997585    2561 generic.go:356] "Generic (PLEG): container finished" podID="44b1fa6b-83db-4c47-858b-264242cd811a" containerID="bba4721eb67104e8fb81222ae5388837b535560c191ac448f30867833a77c285" exitCode=0
Sep 10 20:09:02.997807 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:02.997661    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz" event={"ID":"44b1fa6b-83db-4c47-858b-264242cd811a","Type":"ContainerDied","Data":"bba4721eb67104e8fb81222ae5388837b535560c191ac448f30867833a77c285"}
Sep 10 20:09:02.999580 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:02.999551    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t" event={"ID":"e810ff69-a54e-4b10-9445-dd98f3ff82af","Type":"ContainerStarted","Data":"f587875b8d01c22cd07f75a118934402b3d02dc4b95532fd11fc2e289b92971b"}
Sep 10 20:09:02.999741 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:02.999637    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t" event={"ID":"e810ff69-a54e-4b10-9445-dd98f3ff82af","Type":"ContainerStarted","Data":"7cf26794996e1d80ece5f502fffb4ae8017f66dbab51760a635f26d1ce31d204"}
Sep 10 20:09:03.026237 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:03.026180    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t" podStartSLOduration=2.026162419 podStartE2EDuration="2.026162419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:09:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:09:03.023728225 +0000 UTC m=+886.688832473" watchObservedRunningTime="2026-09-10 20:09:03.026162419 +0000 UTC m=+886.691266666"
Sep 10 20:09:03.370850 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:03.370823    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:09:03.503663 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:03.503624    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44b1fa6b-83db-4c47-858b-264242cd811a-tls-certs\") pod \"44b1fa6b-83db-4c47-858b-264242cd811a\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") "
Sep 10 20:09:03.503811 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:03.503733    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-home\") pod \"44b1fa6b-83db-4c47-858b-264242cd811a\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") "
Sep 10 20:09:03.503811 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:03.503771    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4c5kt\" (UniqueName: \"kubernetes.io/projected/44b1fa6b-83db-4c47-858b-264242cd811a-kube-api-access-4c5kt\") pod \"44b1fa6b-83db-4c47-858b-264242cd811a\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") "
Sep 10 20:09:03.503811 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:03.503806    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-dshm\") pod \"44b1fa6b-83db-4c47-858b-264242cd811a\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") "
Sep 10 20:09:03.503965 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:03.503886    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-tmp-dir\") pod \"44b1fa6b-83db-4c47-858b-264242cd811a\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") "
Sep 10 20:09:03.503965 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:03.503909    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-model-cache\") pod \"44b1fa6b-83db-4c47-858b-264242cd811a\" (UID: \"44b1fa6b-83db-4c47-858b-264242cd811a\") "
Sep 10 20:09:03.504082 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:03.503995    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-home" (OuterVolumeSpecName: "home") pod "44b1fa6b-83db-4c47-858b-264242cd811a" (UID: "44b1fa6b-83db-4c47-858b-264242cd811a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:09:03.504143 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:03.504081    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "44b1fa6b-83db-4c47-858b-264242cd811a" (UID: "44b1fa6b-83db-4c47-858b-264242cd811a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:09:03.504203 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:03.504162    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-model-cache" (OuterVolumeSpecName: "model-cache") pod "44b1fa6b-83db-4c47-858b-264242cd811a" (UID: "44b1fa6b-83db-4c47-858b-264242cd811a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:09:03.504263 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:03.504240    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-home\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:09:03.504263 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:03.504259    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-tmp-dir\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:09:03.506101 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:03.506071    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44b1fa6b-83db-4c47-858b-264242cd811a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "44b1fa6b-83db-4c47-858b-264242cd811a" (UID: "44b1fa6b-83db-4c47-858b-264242cd811a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:09:03.506213 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:03.506114    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44b1fa6b-83db-4c47-858b-264242cd811a-kube-api-access-4c5kt" (OuterVolumeSpecName: "kube-api-access-4c5kt") pod "44b1fa6b-83db-4c47-858b-264242cd811a" (UID: "44b1fa6b-83db-4c47-858b-264242cd811a"). InnerVolumeSpecName "kube-api-access-4c5kt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:09:03.506213 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:03.506115    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-dshm" (OuterVolumeSpecName: "dshm") pod "44b1fa6b-83db-4c47-858b-264242cd811a" (UID: "44b1fa6b-83db-4c47-858b-264242cd811a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:09:03.604815 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:03.604729    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-model-cache\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:09:03.604815 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:03.604763    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44b1fa6b-83db-4c47-858b-264242cd811a-tls-certs\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:09:03.604815 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:03.604773    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4c5kt\" (UniqueName: \"kubernetes.io/projected/44b1fa6b-83db-4c47-858b-264242cd811a-kube-api-access-4c5kt\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:09:03.604815 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:03.604784    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44b1fa6b-83db-4c47-858b-264242cd811a-dshm\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:09:03.954703 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:03.954653    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:03.959820 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:03.959793    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:04.006689 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:04.006660    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"
Sep 10 20:09:04.006902 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:04.006693    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz" event={"ID":"44b1fa6b-83db-4c47-858b-264242cd811a","Type":"ContainerDied","Data":"690a758d0a4d3d1a671c9dffeeeb5773c75c8e7ed169410dedf7ddf41097097f"}
Sep 10 20:09:04.006902 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:04.006743    2561 scope.go:117] "RemoveContainer" containerID="bba4721eb67104e8fb81222ae5388837b535560c191ac448f30867833a77c285"
Sep 10 20:09:04.007377 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:04.007354    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:04.008025 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:04.008007    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:04.048342 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:04.048299    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"]
Sep 10 20:09:04.053611 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:04.053580    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-28a5f0/autores-model-28a5f0-kserve-866c8cff5f-dsdcz"]
Sep 10 20:09:04.850807 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:04.850773    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44b1fa6b-83db-4c47-858b-264242cd811a" path="/var/lib/kubelet/pods/44b1fa6b-83db-4c47-858b-264242cd811a/volumes"
Sep 10 20:09:06.237664 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:06.237631    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l"]
Sep 10 20:09:06.238005 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:06.237993    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44b1fa6b-83db-4c47-858b-264242cd811a" containerName="main"
Sep 10 20:09:06.238061 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:06.238008    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="44b1fa6b-83db-4c47-858b-264242cd811a" containerName="main"
Sep 10 20:09:06.238094 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:06.238072    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="44b1fa6b-83db-4c47-858b-264242cd811a" containerName="main"
Sep 10 20:09:06.242376 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:06.242359    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l"
Sep 10 20:09:06.245436 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:06.245420    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-653653a4\""
Sep 10 20:09:06.259179 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:06.259157    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l"]
Sep 10 20:09:06.327777 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:06.327750    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae77195f-875d-4b49-9140-1d0b0de27b3c-plugins-config-volume\") pod \"payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l\" (UID: \"ae77195f-875d-4b49-9140-1d0b0de27b3c\") " pod="openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l"
Sep 10 20:09:06.327954 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:06.327835    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2xfn\" (UniqueName: \"kubernetes.io/projected/ae77195f-875d-4b49-9140-1d0b0de27b3c-kube-api-access-t2xfn\") pod \"payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l\" (UID: \"ae77195f-875d-4b49-9140-1d0b0de27b3c\") " pod="openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l"
Sep 10 20:09:06.414797 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:06.414763    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:09:06.428550 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:06.428524    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2xfn\" (UniqueName: \"kubernetes.io/projected/ae77195f-875d-4b49-9140-1d0b0de27b3c-kube-api-access-t2xfn\") pod \"payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l\" (UID: \"ae77195f-875d-4b49-9140-1d0b0de27b3c\") " pod="openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l"
Sep 10 20:09:06.428705 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:06.428610    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae77195f-875d-4b49-9140-1d0b0de27b3c-plugins-config-volume\") pod \"payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l\" (UID: \"ae77195f-875d-4b49-9140-1d0b0de27b3c\") " pod="openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l"
Sep 10 20:09:06.429291 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:06.429271    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae77195f-875d-4b49-9140-1d0b0de27b3c-plugins-config-volume\") pod \"payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l\" (UID: \"ae77195f-875d-4b49-9140-1d0b0de27b3c\") " pod="openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l"
Sep 10 20:09:06.437776 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:06.437752    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2xfn\" (UniqueName: \"kubernetes.io/projected/ae77195f-875d-4b49-9140-1d0b0de27b3c-kube-api-access-t2xfn\") pod \"payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l\" (UID: \"ae77195f-875d-4b49-9140-1d0b0de27b3c\") " pod="openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l"
Sep 10 20:09:06.552648 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:06.552572    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l"
Sep 10 20:09:06.831148 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:06.831126    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l"]
Sep 10 20:09:06.833917 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:09:06.833889    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae77195f_875d_4b49_9140_1d0b0de27b3c.slice/crio-b32262847f0b37e84b069aa3b28b263e1a6809e0d4a31bd9a9399c1342d97563 WatchSource:0}: Error finding container b32262847f0b37e84b069aa3b28b263e1a6809e0d4a31bd9a9399c1342d97563: Status 404 returned error can't find the container with id b32262847f0b37e84b069aa3b28b263e1a6809e0d4a31bd9a9399c1342d97563
Sep 10 20:09:07.024827 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:07.024795    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l" event={"ID":"ae77195f-875d-4b49-9140-1d0b0de27b3c","Type":"ContainerStarted","Data":"1506504d9c192bd87de4dd14e84499e3ed68a764d651b09d031dc27acc87e461"}
Sep 10 20:09:07.025015 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:07.024845    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l" event={"ID":"ae77195f-875d-4b49-9140-1d0b0de27b3c","Type":"ContainerStarted","Data":"b32262847f0b37e84b069aa3b28b263e1a6809e0d4a31bd9a9399c1342d97563"}
Sep 10 20:09:07.025015 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:07.024954    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l"
Sep 10 20:09:07.050472 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:07.047662    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l" podStartSLOduration=1.047643226 podStartE2EDuration="1.047643226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:09:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:09:07.04329084 +0000 UTC m=+890.708395087" watchObservedRunningTime="2026-09-10 20:09:07.047643226 +0000 UTC m=+890.712747474"
Sep 10 20:09:09.084588 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.084554    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"]
Sep 10 20:09:09.088871 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.088846    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.091527 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.091505    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-589acd-openshift-default-dockercfg-nvvsl\""
Sep 10 20:09:09.099685 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.099663    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"]
Sep 10 20:09:09.154785 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.154754    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-token\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.154967 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.154803    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkp2g\" (UniqueName: \"kubernetes.io/projected/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-kube-api-access-nkp2g\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.154967 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.154877    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istiod-ca-cert\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.154967 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.154933    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-envoy\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.154967 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.154965    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-data\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.155188 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.155035    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-workload-certs\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.155188 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.155063    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-credential-socket\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.155188 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.155088    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-podinfo\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.155188 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.155167    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-workload-socket\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.256522 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.256487    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-data\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.256703 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.256549    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-workload-certs\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.256703 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.256572    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-credential-socket\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.256703 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.256589    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-podinfo\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.256703 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.256626    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-workload-socket\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.256703 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.256660    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-token\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.256963 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.256707    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkp2g\" (UniqueName: \"kubernetes.io/projected/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-kube-api-access-nkp2g\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.256963 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.256743    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istiod-ca-cert\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.256963 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.256787    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-envoy\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.257135 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.257002    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-data\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.257135 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.257015    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-credential-socket\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.257135 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.257117    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-workload-certs\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.257285 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.257127    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-workload-socket\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.257610 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.257590    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istiod-ca-cert\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.259302 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.259280    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-podinfo\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.259543 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.259525    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-envoy\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.269451 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.269380    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-token\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.269700 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.269681    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkp2g\" (UniqueName: \"kubernetes.io/projected/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-kube-api-access-nkp2g\") pod \"e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") " pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.399870 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.399763    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:09.681503 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.681473    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"]
Sep 10 20:09:09.681939 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:09:09.681914    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode57fd98d_fa6f_427b_87cd_c0f8bdaee8b4.slice/crio-66e3bc16a77c22314f41a7e66eec7bbabb7727253a143559b082dbb1d72d5e89 WatchSource:0}: Error finding container 66e3bc16a77c22314f41a7e66eec7bbabb7727253a143559b082dbb1d72d5e89: Status 404 returned error can't find the container with id 66e3bc16a77c22314f41a7e66eec7bbabb7727253a143559b082dbb1d72d5e89
Sep 10 20:09:09.684161 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.684128    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:09:09.684260 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.684203    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:09:09.684260 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:09.684249    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:09:10.041923 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:10.041786    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss" event={"ID":"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4","Type":"ContainerStarted","Data":"ead0f7e717624a5bb85272e8d277e3127c8e4d68d5c89cd7b52ea14e61d6679d"}
Sep 10 20:09:10.041923 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:10.041851    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss" event={"ID":"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4","Type":"ContainerStarted","Data":"66e3bc16a77c22314f41a7e66eec7bbabb7727253a143559b082dbb1d72d5e89"}
Sep 10 20:09:10.066947 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:10.066900    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss" podStartSLOduration=1.066885372 podStartE2EDuration="1.066885372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:09:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:09:10.064457406 +0000 UTC m=+893.729561654" watchObservedRunningTime="2026-09-10 20:09:10.066885372 +0000 UTC m=+893.731989620"
Sep 10 20:09:10.400280 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:10.400244    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:10.401962 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:10.401940    2561 patch_prober.go:28] interesting pod/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 20:09:10.402045 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:10.401988    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss" podUID="e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 20:09:11.404895 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:11.404860    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:12.053306 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:12.053275    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:12.054253 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:12.054225    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:18.033366 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:18.033331    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l"
Sep 10 20:09:22.464692 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:22.464641    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:09:24.127197 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:24.127120    2561 generic.go:356] "Generic (PLEG): container finished" podID="e810ff69-a54e-4b10-9445-dd98f3ff82af" containerID="f587875b8d01c22cd07f75a118934402b3d02dc4b95532fd11fc2e289b92971b" exitCode=0
Sep 10 20:09:24.127613 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:24.127203    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t" event={"ID":"e810ff69-a54e-4b10-9445-dd98f3ff82af","Type":"ContainerDied","Data":"f587875b8d01c22cd07f75a118934402b3d02dc4b95532fd11fc2e289b92971b"}
Sep 10 20:09:24.127613 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:24.127592    2561 scope.go:117] "RemoveContainer" containerID="f587875b8d01c22cd07f75a118934402b3d02dc4b95532fd11fc2e289b92971b"
Sep 10 20:09:24.128609 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:24.128584    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:09:24.128679 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:24.128655    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:09:24.128720 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:24.128689    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:09:25.133885 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:25.133854    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t" event={"ID":"e810ff69-a54e-4b10-9445-dd98f3ff82af","Type":"ContainerStarted","Data":"208f6e062f1b90dbc52598792085f1c28014d7da9d402cd8009283f9807c710e"}
Sep 10 20:09:25.955037 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:25.955001    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:25.955209 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:25.955097    2561 patch_prober.go:28] interesting pod/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 10 20:09:25.955209 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:25.955130    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t" podUID="e810ff69-a54e-4b10-9445-dd98f3ff82af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 10 20:09:26.954608 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:26.954574    2561 patch_prober.go:28] interesting pod/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 10 20:09:26.955134 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:26.954637    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t" podUID="e810ff69-a54e-4b10-9445-dd98f3ff82af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 10 20:09:27.954910 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:27.954879    2561 patch_prober.go:28] interesting pod/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 10 20:09:27.955284 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:27.954933    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t" podUID="e810ff69-a54e-4b10-9445-dd98f3ff82af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 10 20:09:28.954558 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:28.954513    2561 patch_prober.go:28] interesting pod/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 10 20:09:28.954809 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:28.954579    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t" podUID="e810ff69-a54e-4b10-9445-dd98f3ff82af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 10 20:09:29.955179 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:29.955144    2561 patch_prober.go:28] interesting pod/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 10 20:09:29.955597 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:29.955202    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t" podUID="e810ff69-a54e-4b10-9445-dd98f3ff82af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 10 20:09:30.959461 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:30.959430    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:30.959832 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:30.959815    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:30.960428 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:30.960383    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:34.198906 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:34.198810    2561 generic.go:356] "Generic (PLEG): container finished" podID="e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" containerID="ead0f7e717624a5bb85272e8d277e3127c8e4d68d5c89cd7b52ea14e61d6679d" exitCode=0
Sep 10 20:09:34.198906 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:34.198886    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss" event={"ID":"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4","Type":"ContainerDied","Data":"ead0f7e717624a5bb85272e8d277e3127c8e4d68d5c89cd7b52ea14e61d6679d"}
Sep 10 20:09:34.199512 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:34.199383    2561 scope.go:117] "RemoveContainer" containerID="ead0f7e717624a5bb85272e8d277e3127c8e4d68d5c89cd7b52ea14e61d6679d"
Sep 10 20:09:34.200455 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:34.200427    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:09:34.200578 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:34.200509    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:09:34.200578 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:34.200556    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:09:35.209213 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:35.209168    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss" event={"ID":"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4","Type":"ContainerStarted","Data":"748a710ab5b93859fdf18e97b53ae3d03822e3671c7555554492134e8f238687"}
Sep 10 20:09:35.400769 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:35.400728    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:35.400972 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:35.400857    2561 patch_prober.go:28] interesting pod/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 20:09:35.400972 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:35.400899    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss" podUID="e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 20:09:35.778202 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:35.778166    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l"]
Sep 10 20:09:35.778514 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:35.778482    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l" podUID="ae77195f-875d-4b49-9140-1d0b0de27b3c" containerName="payload-processing" containerID="cri-o://1506504d9c192bd87de4dd14e84499e3ed68a764d651b09d031dc27acc87e461" gracePeriod=30
Sep 10 20:09:36.228430 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:36.227482    2561 generic.go:356] "Generic (PLEG): container finished" podID="ae77195f-875d-4b49-9140-1d0b0de27b3c" containerID="1506504d9c192bd87de4dd14e84499e3ed68a764d651b09d031dc27acc87e461" exitCode=0
Sep 10 20:09:36.228430 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:36.228338    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l" event={"ID":"ae77195f-875d-4b49-9140-1d0b0de27b3c","Type":"ContainerDied","Data":"1506504d9c192bd87de4dd14e84499e3ed68a764d651b09d031dc27acc87e461"}
Sep 10 20:09:36.359455 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:36.359420    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"]
Sep 10 20:09:36.359685 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:36.359659    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t" podUID="e810ff69-a54e-4b10-9445-dd98f3ff82af" containerName="istio-proxy" containerID="cri-o://208f6e062f1b90dbc52598792085f1c28014d7da9d402cd8009283f9807c710e" gracePeriod=30
Sep 10 20:09:36.401187 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:36.400778    2561 patch_prober.go:28] interesting pod/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 20:09:36.401187 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:36.400838    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss" podUID="e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 20:09:36.645766 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:36.645741    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l"
Sep 10 20:09:36.737204 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:36.737173    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2xfn\" (UniqueName: \"kubernetes.io/projected/ae77195f-875d-4b49-9140-1d0b0de27b3c-kube-api-access-t2xfn\") pod \"ae77195f-875d-4b49-9140-1d0b0de27b3c\" (UID: \"ae77195f-875d-4b49-9140-1d0b0de27b3c\") "
Sep 10 20:09:36.737360 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:36.737248    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae77195f-875d-4b49-9140-1d0b0de27b3c-plugins-config-volume\") pod \"ae77195f-875d-4b49-9140-1d0b0de27b3c\" (UID: \"ae77195f-875d-4b49-9140-1d0b0de27b3c\") "
Sep 10 20:09:36.737672 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:36.737652    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae77195f-875d-4b49-9140-1d0b0de27b3c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ae77195f-875d-4b49-9140-1d0b0de27b3c" (UID: "ae77195f-875d-4b49-9140-1d0b0de27b3c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:09:36.739644 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:36.739621    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae77195f-875d-4b49-9140-1d0b0de27b3c-kube-api-access-t2xfn" (OuterVolumeSpecName: "kube-api-access-t2xfn") pod "ae77195f-875d-4b49-9140-1d0b0de27b3c" (UID: "ae77195f-875d-4b49-9140-1d0b0de27b3c"). InnerVolumeSpecName "kube-api-access-t2xfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:09:36.838900 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:36.838856    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2xfn\" (UniqueName: \"kubernetes.io/projected/ae77195f-875d-4b49-9140-1d0b0de27b3c-kube-api-access-t2xfn\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:09:36.838900 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:36.838897    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae77195f-875d-4b49-9140-1d0b0de27b3c-plugins-config-volume\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:09:37.234864 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:37.234826    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l" event={"ID":"ae77195f-875d-4b49-9140-1d0b0de27b3c","Type":"ContainerDied","Data":"b32262847f0b37e84b069aa3b28b263e1a6809e0d4a31bd9a9399c1342d97563"}
Sep 10 20:09:37.234864 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:37.234863    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l"
Sep 10 20:09:37.235321 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:37.234885    2561 scope.go:117] "RemoveContainer" containerID="1506504d9c192bd87de4dd14e84499e3ed68a764d651b09d031dc27acc87e461"
Sep 10 20:09:37.267132 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:37.267104    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l"]
Sep 10 20:09:37.273130 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:37.273098    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-653653a4-57f5d75945-8jx2l"]
Sep 10 20:09:37.400709 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:37.400669    2561 patch_prober.go:28] interesting pod/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 20:09:37.400906 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:37.400751    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss" podUID="e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 20:09:38.400703 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:38.400663    2561 patch_prober.go:28] interesting pod/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 20:09:38.401266 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:38.401234    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss" podUID="e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 20:09:38.851951 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:38.851921    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae77195f-875d-4b49-9140-1d0b0de27b3c" path="/var/lib/kubelet/pods/ae77195f-875d-4b49-9140-1d0b0de27b3c/volumes"
Sep 10 20:09:39.401855 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:39.401814    2561 patch_prober.go:28] interesting pod/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 20:09:39.402452 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:39.402417    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss" podUID="e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 20:09:40.400348 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:40.400303    2561 patch_prober.go:28] interesting pod/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 20:09:40.400630 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:40.400370    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss" podUID="e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 20:09:41.404262 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:41.404234    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:41.404622 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:41.404492    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:41.405123 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:41.405105    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:09:41.620243 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:41.620212    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:09:41.976343 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:41.976312    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:42.087013 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.086978    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-token\") pod \"e810ff69-a54e-4b10-9445-dd98f3ff82af\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") "
Sep 10 20:09:42.087202 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.087024    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgfs2\" (UniqueName: \"kubernetes.io/projected/e810ff69-a54e-4b10-9445-dd98f3ff82af-kube-api-access-tgfs2\") pod \"e810ff69-a54e-4b10-9445-dd98f3ff82af\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") "
Sep 10 20:09:42.087202 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.087051    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-envoy\") pod \"e810ff69-a54e-4b10-9445-dd98f3ff82af\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") "
Sep 10 20:09:42.087202 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.087072    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-credential-socket\") pod \"e810ff69-a54e-4b10-9445-dd98f3ff82af\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") "
Sep 10 20:09:42.087202 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.087097    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-podinfo\") pod \"e810ff69-a54e-4b10-9445-dd98f3ff82af\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") "
Sep 10 20:09:42.087202 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.087132    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e810ff69-a54e-4b10-9445-dd98f3ff82af-istiod-ca-cert\") pod \"e810ff69-a54e-4b10-9445-dd98f3ff82af\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") "
Sep 10 20:09:42.087202 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.087164    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-workload-certs\") pod \"e810ff69-a54e-4b10-9445-dd98f3ff82af\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") "
Sep 10 20:09:42.087556 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.087234    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-data\") pod \"e810ff69-a54e-4b10-9445-dd98f3ff82af\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") "
Sep 10 20:09:42.087556 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.087258    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-workload-socket\") pod \"e810ff69-a54e-4b10-9445-dd98f3ff82af\" (UID: \"e810ff69-a54e-4b10-9445-dd98f3ff82af\") "
Sep 10 20:09:42.087556 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.087436    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e810ff69-a54e-4b10-9445-dd98f3ff82af" (UID: "e810ff69-a54e-4b10-9445-dd98f3ff82af"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:09:42.087727 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.087600    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-credential-socket\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:09:42.087727 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.087606    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e810ff69-a54e-4b10-9445-dd98f3ff82af" (UID: "e810ff69-a54e-4b10-9445-dd98f3ff82af"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:09:42.087727 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.087627    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e810ff69-a54e-4b10-9445-dd98f3ff82af" (UID: "e810ff69-a54e-4b10-9445-dd98f3ff82af"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:09:42.087882 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.087760    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-data" (OuterVolumeSpecName: "istio-data") pod "e810ff69-a54e-4b10-9445-dd98f3ff82af" (UID: "e810ff69-a54e-4b10-9445-dd98f3ff82af"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:09:42.087882 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.087762    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e810ff69-a54e-4b10-9445-dd98f3ff82af-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e810ff69-a54e-4b10-9445-dd98f3ff82af" (UID: "e810ff69-a54e-4b10-9445-dd98f3ff82af"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:09:42.089673 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.089648    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e810ff69-a54e-4b10-9445-dd98f3ff82af" (UID: "e810ff69-a54e-4b10-9445-dd98f3ff82af"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:09:42.089784 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.089760    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e810ff69-a54e-4b10-9445-dd98f3ff82af-kube-api-access-tgfs2" (OuterVolumeSpecName: "kube-api-access-tgfs2") pod "e810ff69-a54e-4b10-9445-dd98f3ff82af" (UID: "e810ff69-a54e-4b10-9445-dd98f3ff82af"). InnerVolumeSpecName "kube-api-access-tgfs2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:09:42.089784 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.089773    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-token" (OuterVolumeSpecName: "istio-token") pod "e810ff69-a54e-4b10-9445-dd98f3ff82af" (UID: "e810ff69-a54e-4b10-9445-dd98f3ff82af"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:09:42.089907 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.089861    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e810ff69-a54e-4b10-9445-dd98f3ff82af" (UID: "e810ff69-a54e-4b10-9445-dd98f3ff82af"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 20:09:42.188567 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.188533    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-data\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:09:42.188567 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.188561    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-workload-socket\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:09:42.188567 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.188571    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-token\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:09:42.188798 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.188580    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgfs2\" (UniqueName: \"kubernetes.io/projected/e810ff69-a54e-4b10-9445-dd98f3ff82af-kube-api-access-tgfs2\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:09:42.188798 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.188590    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-envoy\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:09:42.188798 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.188599    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e810ff69-a54e-4b10-9445-dd98f3ff82af-istio-podinfo\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:09:42.188798 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.188606    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e810ff69-a54e-4b10-9445-dd98f3ff82af-istiod-ca-cert\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:09:42.188798 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.188614    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e810ff69-a54e-4b10-9445-dd98f3ff82af-workload-certs\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:09:42.272708 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.272613    2561 generic.go:356] "Generic (PLEG): container finished" podID="e810ff69-a54e-4b10-9445-dd98f3ff82af" containerID="208f6e062f1b90dbc52598792085f1c28014d7da9d402cd8009283f9807c710e" exitCode=0
Sep 10 20:09:42.272708 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.272683    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"
Sep 10 20:09:42.272928 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.272706    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t" event={"ID":"e810ff69-a54e-4b10-9445-dd98f3ff82af","Type":"ContainerDied","Data":"208f6e062f1b90dbc52598792085f1c28014d7da9d402cd8009283f9807c710e"}
Sep 10 20:09:42.272928 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.272810    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t" event={"ID":"e810ff69-a54e-4b10-9445-dd98f3ff82af","Type":"ContainerDied","Data":"7cf26794996e1d80ece5f502fffb4ae8017f66dbab51760a635f26d1ce31d204"}
Sep 10 20:09:42.272928 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.272845    2561 scope.go:117] "RemoveContainer" containerID="208f6e062f1b90dbc52598792085f1c28014d7da9d402cd8009283f9807c710e"
Sep 10 20:09:42.284508 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.284492    2561 scope.go:117] "RemoveContainer" containerID="f587875b8d01c22cd07f75a118934402b3d02dc4b95532fd11fc2e289b92971b"
Sep 10 20:09:42.292510 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.292486    2561 scope.go:117] "RemoveContainer" containerID="208f6e062f1b90dbc52598792085f1c28014d7da9d402cd8009283f9807c710e"
Sep 10 20:09:42.292803 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:09:42.292783    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"208f6e062f1b90dbc52598792085f1c28014d7da9d402cd8009283f9807c710e\": container with ID starting with 208f6e062f1b90dbc52598792085f1c28014d7da9d402cd8009283f9807c710e not found: ID does not exist" containerID="208f6e062f1b90dbc52598792085f1c28014d7da9d402cd8009283f9807c710e"
Sep 10 20:09:42.292877 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.292811    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"208f6e062f1b90dbc52598792085f1c28014d7da9d402cd8009283f9807c710e"} err="failed to get container status \"208f6e062f1b90dbc52598792085f1c28014d7da9d402cd8009283f9807c710e\": rpc error: code = NotFound desc = could not find container \"208f6e062f1b90dbc52598792085f1c28014d7da9d402cd8009283f9807c710e\": container with ID starting with 208f6e062f1b90dbc52598792085f1c28014d7da9d402cd8009283f9807c710e not found: ID does not exist"
Sep 10 20:09:42.292877 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.292828    2561 scope.go:117] "RemoveContainer" containerID="f587875b8d01c22cd07f75a118934402b3d02dc4b95532fd11fc2e289b92971b"
Sep 10 20:09:42.293088 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:09:42.293068    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f587875b8d01c22cd07f75a118934402b3d02dc4b95532fd11fc2e289b92971b\": container with ID starting with f587875b8d01c22cd07f75a118934402b3d02dc4b95532fd11fc2e289b92971b not found: ID does not exist" containerID="f587875b8d01c22cd07f75a118934402b3d02dc4b95532fd11fc2e289b92971b"
Sep 10 20:09:42.293150 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.293098    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f587875b8d01c22cd07f75a118934402b3d02dc4b95532fd11fc2e289b92971b"} err="failed to get container status \"f587875b8d01c22cd07f75a118934402b3d02dc4b95532fd11fc2e289b92971b\": rpc error: code = NotFound desc = could not find container \"f587875b8d01c22cd07f75a118934402b3d02dc4b95532fd11fc2e289b92971b\": container with ID starting with f587875b8d01c22cd07f75a118934402b3d02dc4b95532fd11fc2e289b92971b not found: ID does not exist"
Sep 10 20:09:42.303718 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.303696    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"]
Sep 10 20:09:42.308427 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.308379    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-653653a4-openshift-default-9f6d67dd4-bfk8t"]
Sep 10 20:09:42.852952 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:42.852914    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e810ff69-a54e-4b10-9445-dd98f3ff82af" path="/var/lib/kubelet/pods/e810ff69-a54e-4b10-9445-dd98f3ff82af/volumes"
Sep 10 20:09:56.920036 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:56.920004    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:09:58.684869 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.684826    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"]
Sep 10 20:09:58.685496 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.685474    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae77195f-875d-4b49-9140-1d0b0de27b3c" containerName="payload-processing"
Sep 10 20:09:58.685587 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.685497    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae77195f-875d-4b49-9140-1d0b0de27b3c" containerName="payload-processing"
Sep 10 20:09:58.685587 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.685530    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e810ff69-a54e-4b10-9445-dd98f3ff82af" containerName="istio-proxy"
Sep 10 20:09:58.685587 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.685540    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e810ff69-a54e-4b10-9445-dd98f3ff82af" containerName="istio-proxy"
Sep 10 20:09:58.685587 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.685552    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e810ff69-a54e-4b10-9445-dd98f3ff82af" containerName="istio-proxy"
Sep 10 20:09:58.685587 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.685560    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e810ff69-a54e-4b10-9445-dd98f3ff82af" containerName="istio-proxy"
Sep 10 20:09:58.685850 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.685662    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e810ff69-a54e-4b10-9445-dd98f3ff82af" containerName="istio-proxy"
Sep 10 20:09:58.685850 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.685674    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae77195f-875d-4b49-9140-1d0b0de27b3c" containerName="payload-processing"
Sep 10 20:09:58.685850 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.685682    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e810ff69-a54e-4b10-9445-dd98f3ff82af" containerName="istio-proxy"
Sep 10 20:09:58.687978 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.687958    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:09:58.691437 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.691377    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-589acd\"/\"default-dockercfg-49gvl\""
Sep 10 20:09:58.694439 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.692271    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-589acd\"/\"kube-root-ca.crt\""
Sep 10 20:09:58.694439 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.692805    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-589acd\"/\"openshift-service-ca.crt\""
Sep 10 20:09:58.694439 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.693627    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-589acd\"/\"explicit-model-589acd-kserve-self-signed-certs\""
Sep 10 20:09:58.702876 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.702847    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"]
Sep 10 20:09:58.836115 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.836075    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlqsx\" (UniqueName: \"kubernetes.io/projected/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-kube-api-access-rlqsx\") pod \"explicit-model-589acd-kserve-669b5dbf5c-bnz8g\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") " pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:09:58.836296 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.836133    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-dshm\") pod \"explicit-model-589acd-kserve-669b5dbf5c-bnz8g\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") " pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:09:58.836296 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.836151    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-tmp-dir\") pod \"explicit-model-589acd-kserve-669b5dbf5c-bnz8g\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") " pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:09:58.836296 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.836221    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-tls-certs\") pod \"explicit-model-589acd-kserve-669b5dbf5c-bnz8g\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") " pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:09:58.836296 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.836293    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-model-cache\") pod \"explicit-model-589acd-kserve-669b5dbf5c-bnz8g\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") " pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:09:58.836484 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.836317    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-home\") pod \"explicit-model-589acd-kserve-669b5dbf5c-bnz8g\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") " pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:09:58.937813 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.937725    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-model-cache\") pod \"explicit-model-589acd-kserve-669b5dbf5c-bnz8g\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") " pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:09:58.937813 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.937767    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-home\") pod \"explicit-model-589acd-kserve-669b5dbf5c-bnz8g\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") " pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:09:58.938019 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.937823    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlqsx\" (UniqueName: \"kubernetes.io/projected/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-kube-api-access-rlqsx\") pod \"explicit-model-589acd-kserve-669b5dbf5c-bnz8g\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") " pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:09:58.938019 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.937853    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-dshm\") pod \"explicit-model-589acd-kserve-669b5dbf5c-bnz8g\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") " pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:09:58.938019 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.937869    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-tmp-dir\") pod \"explicit-model-589acd-kserve-669b5dbf5c-bnz8g\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") " pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:09:58.938019 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.937886    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-tls-certs\") pod \"explicit-model-589acd-kserve-669b5dbf5c-bnz8g\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") " pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:09:58.938226 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.938186    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-model-cache\") pod \"explicit-model-589acd-kserve-669b5dbf5c-bnz8g\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") " pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:09:58.938226 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.938198    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-home\") pod \"explicit-model-589acd-kserve-669b5dbf5c-bnz8g\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") " pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:09:58.938319 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.938284    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-tmp-dir\") pod \"explicit-model-589acd-kserve-669b5dbf5c-bnz8g\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") " pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:09:58.940287 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.940261    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-dshm\") pod \"explicit-model-589acd-kserve-669b5dbf5c-bnz8g\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") " pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:09:58.940439 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.940377    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-tls-certs\") pod \"explicit-model-589acd-kserve-669b5dbf5c-bnz8g\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") " pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:09:58.953113 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:58.953080    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlqsx\" (UniqueName: \"kubernetes.io/projected/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-kube-api-access-rlqsx\") pod \"explicit-model-589acd-kserve-669b5dbf5c-bnz8g\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") " pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:09:59.000877 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:59.000841    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:09:59.294254 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:59.294225    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"]
Sep 10 20:09:59.296098 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:09:59.296071    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47908d9a_bf6b_4355_9ad1_f3a76d8f58b3.slice/crio-1d9c5c6374dab0c6769ae91d81d788f09e5890cda040cb4930bd13b136968010 WatchSource:0}: Error finding container 1d9c5c6374dab0c6769ae91d81d788f09e5890cda040cb4930bd13b136968010: Status 404 returned error can't find the container with id 1d9c5c6374dab0c6769ae91d81d788f09e5890cda040cb4930bd13b136968010
Sep 10 20:09:59.360874 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:59.360845    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g" event={"ID":"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3","Type":"ContainerStarted","Data":"ae526eead8d6e7b2b6168492474bd77256c6fc9e739706281e043162c76b900f"}
Sep 10 20:09:59.360989 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:59.360884    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g" event={"ID":"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3","Type":"ContainerStarted","Data":"1d9c5c6374dab0c6769ae91d81d788f09e5890cda040cb4930bd13b136968010"}
Sep 10 20:09:59.388821 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:09:59.388569    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g" podStartSLOduration=1.388550731 podStartE2EDuration="1.388550731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:09:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:09:59.38449179 +0000 UTC m=+943.049596040" watchObservedRunningTime="2026-09-10 20:09:59.388550731 +0000 UTC m=+943.053654980"
Sep 10 20:10:09.001780 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:09.001744    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:10:09.002269 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:09.001808    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:10:09.014601 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:09.014575    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:10:09.429373 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:09.429339    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:10:14.323459 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:14.323426    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:10:18.287731 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:18.287696    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"]
Sep 10 20:10:18.385734 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:18.385690    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-589acd-mvf79"]
Sep 10 20:10:18.391187 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:18.391162    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-589acd-mvf79"
Sep 10 20:10:18.394047 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:18.394018    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zdpml\""
Sep 10 20:10:18.400341 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:18.400313    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-589acd-mvf79"]
Sep 10 20:10:18.424292 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:18.424258    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2373efef-4928-4bbb-97e7-19201acba93f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-589acd-mvf79\" (UID: \"2373efef-4928-4bbb-97e7-19201acba93f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-589acd-mvf79"
Sep 10 20:10:18.525588 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:18.525552    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2373efef-4928-4bbb-97e7-19201acba93f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-589acd-mvf79\" (UID: \"2373efef-4928-4bbb-97e7-19201acba93f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-589acd-mvf79"
Sep 10 20:10:18.526159 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:18.526138    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2373efef-4928-4bbb-97e7-19201acba93f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-589acd-mvf79\" (UID: \"2373efef-4928-4bbb-97e7-19201acba93f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-589acd-mvf79"
Sep 10 20:10:18.706672 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:18.706631    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-589acd-mvf79"
Sep 10 20:10:18.998863 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:18.998839    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-589acd-mvf79"]
Sep 10 20:10:19.000410 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:10:19.000357    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2373efef_4928_4bbb_97e7_19201acba93f.slice/crio-98b819b4f5f60b89a6489ede1125d038a7240777191ef5404a8362d57c7243d7 WatchSource:0}: Error finding container 98b819b4f5f60b89a6489ede1125d038a7240777191ef5404a8362d57c7243d7: Status 404 returned error can't find the container with id 98b819b4f5f60b89a6489ede1125d038a7240777191ef5404a8362d57c7243d7
Sep 10 20:10:19.468855 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:19.468823    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-589acd-mvf79" event={"ID":"2373efef-4928-4bbb-97e7-19201acba93f","Type":"ContainerStarted","Data":"577974dfb748132fd8dcd04dfbdcd9ad7927464d72718ae9d495c155293cafcb"}
Sep 10 20:10:19.469334 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:19.468886    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-589acd-mvf79" event={"ID":"2373efef-4928-4bbb-97e7-19201acba93f","Type":"ContainerStarted","Data":"98b819b4f5f60b89a6489ede1125d038a7240777191ef5404a8362d57c7243d7"}
Sep 10 20:10:20.476772 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:20.476739    2561 generic.go:356] "Generic (PLEG): container finished" podID="2373efef-4928-4bbb-97e7-19201acba93f" containerID="577974dfb748132fd8dcd04dfbdcd9ad7927464d72718ae9d495c155293cafcb" exitCode=0
Sep 10 20:10:20.477166 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:20.476783    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-589acd-mvf79" event={"ID":"2373efef-4928-4bbb-97e7-19201acba93f","Type":"ContainerDied","Data":"577974dfb748132fd8dcd04dfbdcd9ad7927464d72718ae9d495c155293cafcb"}
Sep 10 20:10:21.918674 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:21.918649    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-589acd-mvf79"
Sep 10 20:10:21.958613 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:21.958583    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2373efef-4928-4bbb-97e7-19201acba93f-maas-api-service-ca\") pod \"2373efef-4928-4bbb-97e7-19201acba93f\" (UID: \"2373efef-4928-4bbb-97e7-19201acba93f\") "
Sep 10 20:10:21.958997 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:21.958968    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2373efef-4928-4bbb-97e7-19201acba93f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2373efef-4928-4bbb-97e7-19201acba93f" (UID: "2373efef-4928-4bbb-97e7-19201acba93f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:10:22.060108 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:22.060076    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2373efef-4928-4bbb-97e7-19201acba93f-maas-api-service-ca\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:10:22.494201 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:22.494156    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-589acd-mvf79" event={"ID":"2373efef-4928-4bbb-97e7-19201acba93f","Type":"ContainerDied","Data":"98b819b4f5f60b89a6489ede1125d038a7240777191ef5404a8362d57c7243d7"}
Sep 10 20:10:22.494440 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:22.494256    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98b819b4f5f60b89a6489ede1125d038a7240777191ef5404a8362d57c7243d7"
Sep 10 20:10:22.494440 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:22.494173    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-589acd-mvf79"
Sep 10 20:10:29.769098 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:29.769058    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-589acd-mvf79"]
Sep 10 20:10:29.779004 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:29.778974    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-589acd-mvf79"]
Sep 10 20:10:30.851574 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:30.851530    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2373efef-4928-4bbb-97e7-19201acba93f" path="/var/lib/kubelet/pods/2373efef-4928-4bbb-97e7-19201acba93f/volumes"
Sep 10 20:10:30.852044 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:30.851902    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:10:33.308634 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:33.308595    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g" podUID="47908d9a-bf6b-4355-9ad1-f3a76d8f58b3" containerName="main" containerID="cri-o://ae526eead8d6e7b2b6168492474bd77256c6fc9e739706281e043162c76b900f" gracePeriod=45
Sep 10 20:10:33.552101 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:33.552069    2561 generic.go:356] "Generic (PLEG): container finished" podID="47908d9a-bf6b-4355-9ad1-f3a76d8f58b3" containerID="ae526eead8d6e7b2b6168492474bd77256c6fc9e739706281e043162c76b900f" exitCode=0
Sep 10 20:10:33.552269 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:33.552144    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g" event={"ID":"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3","Type":"ContainerDied","Data":"ae526eead8d6e7b2b6168492474bd77256c6fc9e739706281e043162c76b900f"}
Sep 10 20:10:33.957865 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:33.957839    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:10:34.068821 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.068783    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-tmp-dir\") pod \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") "
Sep 10 20:10:34.068821 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.068824    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-tls-certs\") pod \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") "
Sep 10 20:10:34.069035 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.068903    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlqsx\" (UniqueName: \"kubernetes.io/projected/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-kube-api-access-rlqsx\") pod \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") "
Sep 10 20:10:34.069035 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.068944    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-home\") pod \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") "
Sep 10 20:10:34.069035 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.068977    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-dshm\") pod \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") "
Sep 10 20:10:34.069035 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.069010    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-model-cache\") pod \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\" (UID: \"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3\") "
Sep 10 20:10:34.069230 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.069072    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "47908d9a-bf6b-4355-9ad1-f3a76d8f58b3" (UID: "47908d9a-bf6b-4355-9ad1-f3a76d8f58b3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:10:34.069230 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.069215    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-home" (OuterVolumeSpecName: "home") pod "47908d9a-bf6b-4355-9ad1-f3a76d8f58b3" (UID: "47908d9a-bf6b-4355-9ad1-f3a76d8f58b3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:10:34.069367 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.069326    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-model-cache" (OuterVolumeSpecName: "model-cache") pod "47908d9a-bf6b-4355-9ad1-f3a76d8f58b3" (UID: "47908d9a-bf6b-4355-9ad1-f3a76d8f58b3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:10:34.069367 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.069348    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-tmp-dir\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:10:34.069517 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.069374    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-home\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:10:34.071196 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.071171    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-kube-api-access-rlqsx" (OuterVolumeSpecName: "kube-api-access-rlqsx") pod "47908d9a-bf6b-4355-9ad1-f3a76d8f58b3" (UID: "47908d9a-bf6b-4355-9ad1-f3a76d8f58b3"). InnerVolumeSpecName "kube-api-access-rlqsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:10:34.071301 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.071224    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-dshm" (OuterVolumeSpecName: "dshm") pod "47908d9a-bf6b-4355-9ad1-f3a76d8f58b3" (UID: "47908d9a-bf6b-4355-9ad1-f3a76d8f58b3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:10:34.071301 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.071253    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "47908d9a-bf6b-4355-9ad1-f3a76d8f58b3" (UID: "47908d9a-bf6b-4355-9ad1-f3a76d8f58b3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:10:34.169992 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.169942    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlqsx\" (UniqueName: \"kubernetes.io/projected/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-kube-api-access-rlqsx\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:10:34.169992 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.169989    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-dshm\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:10:34.170212 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.170005    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-model-cache\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:10:34.170212 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.170019    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3-tls-certs\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:10:34.558507 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.558474    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"
Sep 10 20:10:34.558978 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.558514    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g" event={"ID":"47908d9a-bf6b-4355-9ad1-f3a76d8f58b3","Type":"ContainerDied","Data":"1d9c5c6374dab0c6769ae91d81d788f09e5890cda040cb4930bd13b136968010"}
Sep 10 20:10:34.558978 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.558574    2561 scope.go:117] "RemoveContainer" containerID="ae526eead8d6e7b2b6168492474bd77256c6fc9e739706281e043162c76b900f"
Sep 10 20:10:34.600014 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.597031    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"]
Sep 10 20:10:34.603718 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.603685    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-589acd/explicit-model-589acd-kserve-669b5dbf5c-bnz8g"]
Sep 10 20:10:34.850860 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:34.850822    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47908d9a-bf6b-4355-9ad1-f3a76d8f58b3" path="/var/lib/kubelet/pods/47908d9a-bf6b-4355-9ad1-f3a76d8f58b3/volumes"
Sep 10 20:10:36.726940 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:36.726910    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d8d62-g5bgl"]
Sep 10 20:10:36.727417 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:36.727290    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47908d9a-bf6b-4355-9ad1-f3a76d8f58b3" containerName="main"
Sep 10 20:10:36.727417 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:36.727301    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="47908d9a-bf6b-4355-9ad1-f3a76d8f58b3" containerName="main"
Sep 10 20:10:36.727417 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:36.727309    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2373efef-4928-4bbb-97e7-19201acba93f" containerName="revoke-keys"
Sep 10 20:10:36.727417 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:36.727315    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2373efef-4928-4bbb-97e7-19201acba93f" containerName="revoke-keys"
Sep 10 20:10:36.727417 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:36.727369    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="47908d9a-bf6b-4355-9ad1-f3a76d8f58b3" containerName="main"
Sep 10 20:10:36.727417 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:36.727376    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2373efef-4928-4bbb-97e7-19201acba93f" containerName="revoke-keys"
Sep 10 20:10:36.730245 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:36.730226    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d8d62-g5bgl"
Sep 10 20:10:36.733423 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:36.733375    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zdpml\""
Sep 10 20:10:36.748562 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:36.748536    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d8d62-g5bgl"]
Sep 10 20:10:36.796969 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:36.796938    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35eaf382-b923-49d9-9f66-84deeb809bc1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-6d8d62-g5bgl\" (UID: \"35eaf382-b923-49d9-9f66-84deeb809bc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d8d62-g5bgl"
Sep 10 20:10:36.898032 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:36.898000    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35eaf382-b923-49d9-9f66-84deeb809bc1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-6d8d62-g5bgl\" (UID: \"35eaf382-b923-49d9-9f66-84deeb809bc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d8d62-g5bgl"
Sep 10 20:10:36.898899 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:36.898875    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35eaf382-b923-49d9-9f66-84deeb809bc1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-6d8d62-g5bgl\" (UID: \"35eaf382-b923-49d9-9f66-84deeb809bc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d8d62-g5bgl"
Sep 10 20:10:37.039993 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:37.039912    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d8d62-g5bgl"
Sep 10 20:10:37.323668 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:37.323642    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d8d62-g5bgl"]
Sep 10 20:10:37.326483 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:10:37.326457    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35eaf382_b923_49d9_9f66_84deeb809bc1.slice/crio-3eaa7fee1784755a752adb357719519b1f2bdfa271552cb5bb95aa7e0ae0b68b WatchSource:0}: Error finding container 3eaa7fee1784755a752adb357719519b1f2bdfa271552cb5bb95aa7e0ae0b68b: Status 404 returned error can't find the container with id 3eaa7fee1784755a752adb357719519b1f2bdfa271552cb5bb95aa7e0ae0b68b
Sep 10 20:10:37.577679 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:37.577594    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d8d62-g5bgl" event={"ID":"35eaf382-b923-49d9-9f66-84deeb809bc1","Type":"ContainerStarted","Data":"3eaa7fee1784755a752adb357719519b1f2bdfa271552cb5bb95aa7e0ae0b68b"}
Sep 10 20:10:38.584474 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:38.584445    2561 generic.go:356] "Generic (PLEG): container finished" podID="35eaf382-b923-49d9-9f66-84deeb809bc1" containerID="4fe4f9f4e2902bc9472679f1520ef8717e9e33d04cb65053f6fbeab3aa991dfd" exitCode=0
Sep 10 20:10:38.584892 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:38.584537    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d8d62-g5bgl" event={"ID":"35eaf382-b923-49d9-9f66-84deeb809bc1","Type":"ContainerDied","Data":"4fe4f9f4e2902bc9472679f1520ef8717e9e33d04cb65053f6fbeab3aa991dfd"}
Sep 10 20:10:40.044555 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:40.044526    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d8d62-g5bgl"
Sep 10 20:10:40.126999 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:40.126967    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35eaf382-b923-49d9-9f66-84deeb809bc1-maas-api-service-ca\") pod \"35eaf382-b923-49d9-9f66-84deeb809bc1\" (UID: \"35eaf382-b923-49d9-9f66-84deeb809bc1\") "
Sep 10 20:10:40.127288 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:40.127264    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35eaf382-b923-49d9-9f66-84deeb809bc1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "35eaf382-b923-49d9-9f66-84deeb809bc1" (UID: "35eaf382-b923-49d9-9f66-84deeb809bc1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:10:40.228377 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:40.228345    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35eaf382-b923-49d9-9f66-84deeb809bc1-maas-api-service-ca\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:10:40.334582 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:40.330997    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"]
Sep 10 20:10:40.334850 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:40.334812    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss" podUID="e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" containerName="istio-proxy" containerID="cri-o://748a710ab5b93859fdf18e97b53ae3d03822e3671c7555554492134e8f238687" gracePeriod=30
Sep 10 20:10:40.596878 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:40.596801    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d8d62-g5bgl"
Sep 10 20:10:40.596878 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:40.596813    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d8d62-g5bgl" event={"ID":"35eaf382-b923-49d9-9f66-84deeb809bc1","Type":"ContainerDied","Data":"3eaa7fee1784755a752adb357719519b1f2bdfa271552cb5bb95aa7e0ae0b68b"}
Sep 10 20:10:40.596878 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:40.596860    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3eaa7fee1784755a752adb357719519b1f2bdfa271552cb5bb95aa7e0ae0b68b"
Sep 10 20:10:40.673254 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:40.673209    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:10:41.407374 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:41.407327    2561 patch_prober.go:28] interesting pod/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 20:10:41.407846 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:41.407381    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss" podUID="e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 20:10:45.639114 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.639022    2561 generic.go:356] "Generic (PLEG): container finished" podID="e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" containerID="748a710ab5b93859fdf18e97b53ae3d03822e3671c7555554492134e8f238687" exitCode=0
Sep 10 20:10:45.639114 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.639098    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss" event={"ID":"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4","Type":"ContainerDied","Data":"748a710ab5b93859fdf18e97b53ae3d03822e3671c7555554492134e8f238687"}
Sep 10 20:10:45.639619 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.639170    2561 scope.go:117] "RemoveContainer" containerID="ead0f7e717624a5bb85272e8d277e3127c8e4d68d5c89cd7b52ea14e61d6679d"
Sep 10 20:10:45.907528 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.907499    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:10:45.979812 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.979785    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-data\") pod \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") "
Sep 10 20:10:45.979812 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.979816    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-workload-certs\") pod \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") "
Sep 10 20:10:45.980063 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.979835    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-podinfo\") pod \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") "
Sep 10 20:10:45.980063 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.979859    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-token\") pod \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") "
Sep 10 20:10:45.980063 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.980014    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istiod-ca-cert\") pod \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") "
Sep 10 20:10:45.980063 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.980055    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-envoy\") pod \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") "
Sep 10 20:10:45.980278 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.980078    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-credential-socket\") pod \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") "
Sep 10 20:10:45.980278 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.980107    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" (UID: "e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:10:45.980278 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.980127    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-workload-socket\") pod \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") "
Sep 10 20:10:45.980278 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.980132    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-data" (OuterVolumeSpecName: "istio-data") pod "e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" (UID: "e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:10:45.980278 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.980193    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkp2g\" (UniqueName: \"kubernetes.io/projected/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-kube-api-access-nkp2g\") pod \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\" (UID: \"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4\") "
Sep 10 20:10:45.980570 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.980364    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" (UID: "e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:10:45.980570 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.980480    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" (UID: "e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:10:45.980687 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.980579    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" (UID: "e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:10:45.980687 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.980618    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-data\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:10:45.980687 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.980638    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-workload-certs\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:10:45.980687 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.980652    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istiod-ca-cert\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:10:45.980687 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.980664    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-credential-socket\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:10:45.982340 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.982311    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-token" (OuterVolumeSpecName: "istio-token") pod "e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" (UID: "e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:10:45.982642 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.982608    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-kube-api-access-nkp2g" (OuterVolumeSpecName: "kube-api-access-nkp2g") pod "e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" (UID: "e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4"). InnerVolumeSpecName "kube-api-access-nkp2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:10:45.982751 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.982729    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" (UID: "e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 20:10:45.982751 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:45.982733    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" (UID: "e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:10:46.081364 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:46.081331    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-podinfo\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:10:46.081364 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:46.081361    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-token\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:10:46.081583 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:46.081373    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-istio-envoy\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:10:46.081583 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:46.081385    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-workload-socket\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:10:46.081583 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:46.081413    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkp2g\" (UniqueName: \"kubernetes.io/projected/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4-kube-api-access-nkp2g\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:10:46.645847 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:46.645812    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss" event={"ID":"e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4","Type":"ContainerDied","Data":"66e3bc16a77c22314f41a7e66eec7bbabb7727253a143559b082dbb1d72d5e89"}
Sep 10 20:10:46.645847 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:46.645845    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"
Sep 10 20:10:46.646369 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:46.645872    2561 scope.go:117] "RemoveContainer" containerID="748a710ab5b93859fdf18e97b53ae3d03822e3671c7555554492134e8f238687"
Sep 10 20:10:46.726472 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:46.726439    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"]
Sep 10 20:10:46.746099 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:46.746066    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-589acd-openshift-default-6b7bc6468-m7bss"]
Sep 10 20:10:46.850748 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:46.850711    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" path="/var/lib/kubelet/pods/e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4/volumes"
Sep 10 20:10:48.087424 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:48.087366    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt"]
Sep 10 20:10:48.087943 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:48.087628    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt" podUID="7c5f175d-7257-41b8-a949-11100f289fe7" containerName="payload-pre-processing" containerID="cri-o://d961795172344741bb040357913ccb97e9c87f2b1a1ed33853ee276ae3e761d8" gracePeriod=30
Sep 10 20:10:48.541324 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:48.541220    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d8d62-g5bgl"]
Sep 10 20:10:48.551942 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:48.551902    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d8d62-g5bgl"]
Sep 10 20:10:48.659485 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:48.659453    2561 generic.go:356] "Generic (PLEG): container finished" podID="7c5f175d-7257-41b8-a949-11100f289fe7" containerID="d961795172344741bb040357913ccb97e9c87f2b1a1ed33853ee276ae3e761d8" exitCode=0
Sep 10 20:10:48.659692 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:48.659530    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt" event={"ID":"7c5f175d-7257-41b8-a949-11100f289fe7","Type":"ContainerDied","Data":"d961795172344741bb040357913ccb97e9c87f2b1a1ed33853ee276ae3e761d8"}
Sep 10 20:10:48.709741 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:48.709714    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt"
Sep 10 20:10:48.807056 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:48.806969    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knx2p\" (UniqueName: \"kubernetes.io/projected/7c5f175d-7257-41b8-a949-11100f289fe7-kube-api-access-knx2p\") pod \"7c5f175d-7257-41b8-a949-11100f289fe7\" (UID: \"7c5f175d-7257-41b8-a949-11100f289fe7\") "
Sep 10 20:10:48.807056 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:48.807025    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c5f175d-7257-41b8-a949-11100f289fe7-plugins-config-volume\") pod \"7c5f175d-7257-41b8-a949-11100f289fe7\" (UID: \"7c5f175d-7257-41b8-a949-11100f289fe7\") "
Sep 10 20:10:48.807367 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:48.807345    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c5f175d-7257-41b8-a949-11100f289fe7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7c5f175d-7257-41b8-a949-11100f289fe7" (UID: "7c5f175d-7257-41b8-a949-11100f289fe7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:10:48.809246 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:48.809221    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c5f175d-7257-41b8-a949-11100f289fe7-kube-api-access-knx2p" (OuterVolumeSpecName: "kube-api-access-knx2p") pod "7c5f175d-7257-41b8-a949-11100f289fe7" (UID: "7c5f175d-7257-41b8-a949-11100f289fe7"). InnerVolumeSpecName "kube-api-access-knx2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:10:48.851357 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:48.851329    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35eaf382-b923-49d9-9f66-84deeb809bc1" path="/var/lib/kubelet/pods/35eaf382-b923-49d9-9f66-84deeb809bc1/volumes"
Sep 10 20:10:48.908407 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:48.908351    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knx2p\" (UniqueName: \"kubernetes.io/projected/7c5f175d-7257-41b8-a949-11100f289fe7-kube-api-access-knx2p\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:10:48.908407 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:48.908383    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c5f175d-7257-41b8-a949-11100f289fe7-plugins-config-volume\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:10:49.666610 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:49.666583    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt"
Sep 10 20:10:49.667013 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:49.666614    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt" event={"ID":"7c5f175d-7257-41b8-a949-11100f289fe7","Type":"ContainerDied","Data":"c6e655985404608c8ed95021aecc55d724b5ae29e32e59e6e608452b0ad45ca8"}
Sep 10 20:10:49.667013 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:49.666673    2561 scope.go:117] "RemoveContainer" containerID="d961795172344741bb040357913ccb97e9c87f2b1a1ed33853ee276ae3e761d8"
Sep 10 20:10:49.699907 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:49.699875    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt"]
Sep 10 20:10:49.705481 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:49.705368    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6d8d62-7b6f9d75f8-c6lmt"]
Sep 10 20:10:50.850349 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:50.850317    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c5f175d-7257-41b8-a949-11100f289fe7" path="/var/lib/kubelet/pods/7c5f175d-7257-41b8-a949-11100f289fe7/volumes"
Sep 10 20:10:51.345884 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:51.345852    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:10:57.993312 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:57.993273    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-39487c-qfhfl"]
Sep 10 20:10:57.993815 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:57.993706    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" containerName="istio-proxy"
Sep 10 20:10:57.993815 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:57.993721    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" containerName="istio-proxy"
Sep 10 20:10:57.993815 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:57.993736    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c5f175d-7257-41b8-a949-11100f289fe7" containerName="payload-pre-processing"
Sep 10 20:10:57.993815 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:57.993743    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c5f175d-7257-41b8-a949-11100f289fe7" containerName="payload-pre-processing"
Sep 10 20:10:57.993815 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:57.993768    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35eaf382-b923-49d9-9f66-84deeb809bc1" containerName="revoke-keys"
Sep 10 20:10:57.993815 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:57.993776    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="35eaf382-b923-49d9-9f66-84deeb809bc1" containerName="revoke-keys"
Sep 10 20:10:57.994066 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:57.993848    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" containerName="istio-proxy"
Sep 10 20:10:57.994066 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:57.993859    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="35eaf382-b923-49d9-9f66-84deeb809bc1" containerName="revoke-keys"
Sep 10 20:10:57.994066 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:57.993871    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c5f175d-7257-41b8-a949-11100f289fe7" containerName="payload-pre-processing"
Sep 10 20:10:57.998379 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:57.998357    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-39487c-qfhfl"
Sep 10 20:10:58.001827 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:58.001803    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zdpml\""
Sep 10 20:10:58.011800 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:58.011776    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-39487c-qfhfl"]
Sep 10 20:10:58.093216 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:58.093173    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/204f99a8-7694-4b1e-86da-f98b27ded49b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-39487c-qfhfl\" (UID: \"204f99a8-7694-4b1e-86da-f98b27ded49b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-39487c-qfhfl"
Sep 10 20:10:58.194710 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:58.194667    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/204f99a8-7694-4b1e-86da-f98b27ded49b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-39487c-qfhfl\" (UID: \"204f99a8-7694-4b1e-86da-f98b27ded49b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-39487c-qfhfl"
Sep 10 20:10:58.195385 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:58.195362    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/204f99a8-7694-4b1e-86da-f98b27ded49b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-39487c-qfhfl\" (UID: \"204f99a8-7694-4b1e-86da-f98b27ded49b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-39487c-qfhfl"
Sep 10 20:10:58.309145 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:58.309055    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-39487c-qfhfl"
Sep 10 20:10:58.588585 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:58.588561    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-39487c-qfhfl"]
Sep 10 20:10:58.590739 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:10:58.590710    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod204f99a8_7694_4b1e_86da_f98b27ded49b.slice/crio-01ede00e0377f238c4ddfa68c0b6899cd382efa7a7ae142b53a20a8fb31102c7 WatchSource:0}: Error finding container 01ede00e0377f238c4ddfa68c0b6899cd382efa7a7ae142b53a20a8fb31102c7: Status 404 returned error can't find the container with id 01ede00e0377f238c4ddfa68c0b6899cd382efa7a7ae142b53a20a8fb31102c7
Sep 10 20:10:58.713083 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:58.713051    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-39487c-qfhfl" event={"ID":"204f99a8-7694-4b1e-86da-f98b27ded49b","Type":"ContainerStarted","Data":"01ede00e0377f238c4ddfa68c0b6899cd382efa7a7ae142b53a20a8fb31102c7"}
Sep 10 20:10:59.720298 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:59.720263    2561 generic.go:356] "Generic (PLEG): container finished" podID="204f99a8-7694-4b1e-86da-f98b27ded49b" containerID="3e2cf1f20ef2d0d7e89d600904616c42a81023148ae0659489ea0d7c41a8e767" exitCode=0
Sep 10 20:10:59.720722 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:10:59.720306    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-39487c-qfhfl" event={"ID":"204f99a8-7694-4b1e-86da-f98b27ded49b","Type":"ContainerDied","Data":"3e2cf1f20ef2d0d7e89d600904616c42a81023148ae0659489ea0d7c41a8e767"}
Sep 10 20:11:01.171047 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:01.171019    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-39487c-qfhfl"
Sep 10 20:11:01.325342 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:01.325300    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/204f99a8-7694-4b1e-86da-f98b27ded49b-maas-api-service-ca\") pod \"204f99a8-7694-4b1e-86da-f98b27ded49b\" (UID: \"204f99a8-7694-4b1e-86da-f98b27ded49b\") "
Sep 10 20:11:01.325690 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:01.325667    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/204f99a8-7694-4b1e-86da-f98b27ded49b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "204f99a8-7694-4b1e-86da-f98b27ded49b" (UID: "204f99a8-7694-4b1e-86da-f98b27ded49b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:11:01.426985 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:01.426904    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/204f99a8-7694-4b1e-86da-f98b27ded49b-maas-api-service-ca\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:11:01.731257 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:01.731171    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-39487c-qfhfl" event={"ID":"204f99a8-7694-4b1e-86da-f98b27ded49b","Type":"ContainerDied","Data":"01ede00e0377f238c4ddfa68c0b6899cd382efa7a7ae142b53a20a8fb31102c7"}
Sep 10 20:11:01.731257 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:01.731207    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-39487c-qfhfl"
Sep 10 20:11:01.731257 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:01.731217    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01ede00e0377f238c4ddfa68c0b6899cd382efa7a7ae142b53a20a8fb31102c7"
Sep 10 20:11:07.805199 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:07.805164    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:11:08.858144 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:08.858112    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs"]
Sep 10 20:11:08.858967 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:08.858897    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs" podUID="97e7e829-3377-414e-9b66-1f9e135b6a5e" containerName="payload-processing" containerID="cri-o://14ad03ead95682834768feb123ecf0019669440236ada8a9470a0d336cad82e0" gracePeriod=30
Sep 10 20:11:09.158465 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:09.157945    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-39487c-qfhfl"]
Sep 10 20:11:09.162185 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:09.162151    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-39487c-qfhfl"]
Sep 10 20:11:09.536401 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:09.536345    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs"
Sep 10 20:11:09.598153 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:09.598113    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r54hp\" (UniqueName: \"kubernetes.io/projected/97e7e829-3377-414e-9b66-1f9e135b6a5e-kube-api-access-r54hp\") pod \"97e7e829-3377-414e-9b66-1f9e135b6a5e\" (UID: \"97e7e829-3377-414e-9b66-1f9e135b6a5e\") "
Sep 10 20:11:09.598321 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:09.598205    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97e7e829-3377-414e-9b66-1f9e135b6a5e-plugins-config-volume\") pod \"97e7e829-3377-414e-9b66-1f9e135b6a5e\" (UID: \"97e7e829-3377-414e-9b66-1f9e135b6a5e\") "
Sep 10 20:11:09.598943 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:09.598907    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97e7e829-3377-414e-9b66-1f9e135b6a5e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "97e7e829-3377-414e-9b66-1f9e135b6a5e" (UID: "97e7e829-3377-414e-9b66-1f9e135b6a5e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:11:09.613018 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:09.612968    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97e7e829-3377-414e-9b66-1f9e135b6a5e-kube-api-access-r54hp" (OuterVolumeSpecName: "kube-api-access-r54hp") pod "97e7e829-3377-414e-9b66-1f9e135b6a5e" (UID: "97e7e829-3377-414e-9b66-1f9e135b6a5e"). InnerVolumeSpecName "kube-api-access-r54hp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:11:09.699255 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:09.699217    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r54hp\" (UniqueName: \"kubernetes.io/projected/97e7e829-3377-414e-9b66-1f9e135b6a5e-kube-api-access-r54hp\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:11:09.699255 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:09.699250    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97e7e829-3377-414e-9b66-1f9e135b6a5e-plugins-config-volume\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:11:09.774773 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:09.774686    2561 generic.go:356] "Generic (PLEG): container finished" podID="97e7e829-3377-414e-9b66-1f9e135b6a5e" containerID="14ad03ead95682834768feb123ecf0019669440236ada8a9470a0d336cad82e0" exitCode=0
Sep 10 20:11:09.774773 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:09.774743    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs" event={"ID":"97e7e829-3377-414e-9b66-1f9e135b6a5e","Type":"ContainerDied","Data":"14ad03ead95682834768feb123ecf0019669440236ada8a9470a0d336cad82e0"}
Sep 10 20:11:09.774773 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:09.774747    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs"
Sep 10 20:11:09.775015 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:09.774829    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs" event={"ID":"97e7e829-3377-414e-9b66-1f9e135b6a5e","Type":"ContainerDied","Data":"20ccdb470804a79a65696a43fe5f788c06068c0ed06d5f53dec0155c27e0b850"}
Sep 10 20:11:09.775015 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:09.774859    2561 scope.go:117] "RemoveContainer" containerID="14ad03ead95682834768feb123ecf0019669440236ada8a9470a0d336cad82e0"
Sep 10 20:11:09.784310 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:09.784287    2561 scope.go:117] "RemoveContainer" containerID="14ad03ead95682834768feb123ecf0019669440236ada8a9470a0d336cad82e0"
Sep 10 20:11:09.784618 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:11:09.784596    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14ad03ead95682834768feb123ecf0019669440236ada8a9470a0d336cad82e0\": container with ID starting with 14ad03ead95682834768feb123ecf0019669440236ada8a9470a0d336cad82e0 not found: ID does not exist" containerID="14ad03ead95682834768feb123ecf0019669440236ada8a9470a0d336cad82e0"
Sep 10 20:11:09.784675 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:09.784626    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14ad03ead95682834768feb123ecf0019669440236ada8a9470a0d336cad82e0"} err="failed to get container status \"14ad03ead95682834768feb123ecf0019669440236ada8a9470a0d336cad82e0\": rpc error: code = NotFound desc = could not find container \"14ad03ead95682834768feb123ecf0019669440236ada8a9470a0d336cad82e0\": container with ID starting with 14ad03ead95682834768feb123ecf0019669440236ada8a9470a0d336cad82e0 not found: ID does not exist"
Sep 10 20:11:09.799508 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:09.799448    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs"]
Sep 10 20:11:09.801195 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:09.801159    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-39487c-7fbbfd69d7-p6hzs"]
Sep 10 20:11:10.850786 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:10.850756    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="204f99a8-7694-4b1e-86da-f98b27ded49b" path="/var/lib/kubelet/pods/204f99a8-7694-4b1e-86da-f98b27ded49b/volumes"
Sep 10 20:11:10.851148 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:10.851132    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97e7e829-3377-414e-9b66-1f9e135b6a5e" path="/var/lib/kubelet/pods/97e7e829-3377-414e-9b66-1f9e135b6a5e/volumes"
Sep 10 20:11:16.311716 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.311683    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:11:16.808609 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.808574    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"]
Sep 10 20:11:16.809074 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.809048    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97e7e829-3377-414e-9b66-1f9e135b6a5e" containerName="payload-processing"
Sep 10 20:11:16.809074 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.809074    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="97e7e829-3377-414e-9b66-1f9e135b6a5e" containerName="payload-processing"
Sep 10 20:11:16.809269 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.809110    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="204f99a8-7694-4b1e-86da-f98b27ded49b" containerName="revoke-keys"
Sep 10 20:11:16.809269 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.809120    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="204f99a8-7694-4b1e-86da-f98b27ded49b" containerName="revoke-keys"
Sep 10 20:11:16.809269 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.809139    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" containerName="istio-proxy"
Sep 10 20:11:16.809269 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.809147    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" containerName="istio-proxy"
Sep 10 20:11:16.809269 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.809214    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e57fd98d-fa6f-427b-87cd-c0f8bdaee8b4" containerName="istio-proxy"
Sep 10 20:11:16.809269 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.809223    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="204f99a8-7694-4b1e-86da-f98b27ded49b" containerName="revoke-keys"
Sep 10 20:11:16.809269 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.809232    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="97e7e829-3377-414e-9b66-1f9e135b6a5e" containerName="payload-processing"
Sep 10 20:11:16.812449 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.812427    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.815225 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.815204    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-591d7c-openshift-default-dockercfg-fb2dm\""
Sep 10 20:11:16.827092 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.827068    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"]
Sep 10 20:11:16.865576 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.865545    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-credential-socket\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.865743 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.865595    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-envoy\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.865743 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.865621    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istiod-ca-cert\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.865743 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.865658    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hldmt\" (UniqueName: \"kubernetes.io/projected/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-kube-api-access-hldmt\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.865912 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.865776    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-workload-socket\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.865912 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.865814    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-workload-certs\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.865912 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.865846    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-data\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.865912 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.865895    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-podinfo\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.866125 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.865922    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-token\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.966430 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.966378    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-podinfo\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.966533 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.966444    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-token\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.966533 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.966488    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-credential-socket\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.966615 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.966582    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-envoy\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.966671 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.966617    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istiod-ca-cert\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.966730 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.966690    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hldmt\" (UniqueName: \"kubernetes.io/projected/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-kube-api-access-hldmt\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.966785 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.966750    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-workload-socket\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.966785 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.966774    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-workload-certs\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.966893 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.966798    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-data\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.967133 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.967104    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-credential-socket\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.967358 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.967157    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-data\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.967358 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.967262    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-workload-socket\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.967630 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.967605    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istiod-ca-cert\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.967716 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.967700    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-workload-certs\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.969043 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.969021    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-envoy\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.969507 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.969484    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-podinfo\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.978256 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.978229    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-token\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:16.978427 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:16.978380    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hldmt\" (UniqueName: \"kubernetes.io/projected/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-kube-api-access-hldmt\") pod \"e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") " pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:17.122785 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:17.122747    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:17.403154 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:17.403110    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"]
Sep 10 20:11:17.405690 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:11:17.405657    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eef44d1_6da0_4116_8e48_f84c2c1cc13e.slice/crio-be52dc86013a17a0addd52733fc141f8e07a607d9f13bbf8c4b27b5ae0659346 WatchSource:0}: Error finding container be52dc86013a17a0addd52733fc141f8e07a607d9f13bbf8c4b27b5ae0659346: Status 404 returned error can't find the container with id be52dc86013a17a0addd52733fc141f8e07a607d9f13bbf8c4b27b5ae0659346
Sep 10 20:11:17.407758 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:17.407724    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:11:17.407858 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:17.407802    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:11:17.407858 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:17.407847    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:11:17.820740 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:17.820644    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq" event={"ID":"5eef44d1-6da0-4116-8e48-f84c2c1cc13e","Type":"ContainerStarted","Data":"1cab799923ac0739c5e50fb58dc1f43d5a2f21cefdc37abacbbc9f8c7c1ff30a"}
Sep 10 20:11:17.820740 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:17.820710    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq" event={"ID":"5eef44d1-6da0-4116-8e48-f84c2c1cc13e","Type":"ContainerStarted","Data":"be52dc86013a17a0addd52733fc141f8e07a607d9f13bbf8c4b27b5ae0659346"}
Sep 10 20:11:17.853040 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:17.852990    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq" podStartSLOduration=1.852975307 podStartE2EDuration="1.852975307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:11:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:11:17.850530574 +0000 UTC m=+1021.515634822" watchObservedRunningTime="2026-09-10 20:11:17.852975307 +0000 UTC m=+1021.518079553"
Sep 10 20:11:18.123926 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:18.123890    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:18.129301 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:18.129276    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:18.826441 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:18.826405    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:18.827322 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:18.827301    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:20.405557 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.405520    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"]
Sep 10 20:11:20.409416 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.409369    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.412353 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.412332    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-2017ae11-openshift-default-dockercfg-7z7w5\""
Sep 10 20:11:20.430146 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.430124    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"]
Sep 10 20:11:20.505763 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.505733    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a9eca39-4656-435c-ba0f-841841af77cb-istio-podinfo\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.505922 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.505776    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-credential-socket\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.505922 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.505808    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-workload-certs\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.505922 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.505844    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kgsr\" (UniqueName: \"kubernetes.io/projected/9a9eca39-4656-435c-ba0f-841841af77cb-kube-api-access-5kgsr\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.506032 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.505984    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-istio-data\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.506068 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.506029    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-workload-socket\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.506103 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.506069    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-istio-envoy\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.506143 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.506101    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a9eca39-4656-435c-ba0f-841841af77cb-istiod-ca-cert\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.506183 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.506160    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a9eca39-4656-435c-ba0f-841841af77cb-istio-token\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.606988 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.606947    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a9eca39-4656-435c-ba0f-841841af77cb-istio-token\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.606988 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.606986    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a9eca39-4656-435c-ba0f-841841af77cb-istio-podinfo\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.606988 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.607018    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-credential-socket\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.607334 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.607042    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-workload-certs\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.607334 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.607074    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kgsr\" (UniqueName: \"kubernetes.io/projected/9a9eca39-4656-435c-ba0f-841841af77cb-kube-api-access-5kgsr\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.607334 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.607174    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-istio-data\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.607334 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.607205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-workload-socket\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.607698 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.607567    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-credential-socket\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.607698 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.607592    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-workload-socket\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.607698 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.607622    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-istio-data\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.608008 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.607238    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-istio-envoy\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.608084 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.608045    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a9eca39-4656-435c-ba0f-841841af77cb-istiod-ca-cert\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.608141 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.608098    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-workload-certs\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.608993 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.608955    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a9eca39-4656-435c-ba0f-841841af77cb-istiod-ca-cert\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.610361 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.610337    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-istio-envoy\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.610742 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.610725    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a9eca39-4656-435c-ba0f-841841af77cb-istio-podinfo\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.622865 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.622822    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kgsr\" (UniqueName: \"kubernetes.io/projected/9a9eca39-4656-435c-ba0f-841841af77cb-kube-api-access-5kgsr\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.625813 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.625791    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a9eca39-4656-435c-ba0f-841841af77cb-istio-token\") pod \"e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") " pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:20.721597 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:20.721519    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:21.027838 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:21.027757    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"]
Sep 10 20:11:21.030768 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:11:21.030736    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a9eca39_4656_435c_ba0f_841841af77cb.slice/crio-e55281af9932f0fa7aaccdae5b2af9c35e86fb30db504b251331438d0d35b38d WatchSource:0}: Error finding container e55281af9932f0fa7aaccdae5b2af9c35e86fb30db504b251331438d0d35b38d: Status 404 returned error can't find the container with id e55281af9932f0fa7aaccdae5b2af9c35e86fb30db504b251331438d0d35b38d
Sep 10 20:11:21.032964 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:21.032932    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:11:21.033020 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:21.032999    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:11:21.033054 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:21.033027    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:11:21.849442 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:21.849386    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv" event={"ID":"9a9eca39-4656-435c-ba0f-841841af77cb","Type":"ContainerStarted","Data":"7395d5da9438076e173950c761c80002793300cb8cde49f03d0cc69d42907810"}
Sep 10 20:11:21.849794 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:21.849460    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv" event={"ID":"9a9eca39-4656-435c-ba0f-841841af77cb","Type":"ContainerStarted","Data":"e55281af9932f0fa7aaccdae5b2af9c35e86fb30db504b251331438d0d35b38d"}
Sep 10 20:11:21.876674 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:21.876621    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv" podStartSLOduration=1.8766061349999998 podStartE2EDuration="1.876606135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:11:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:11:21.875438557 +0000 UTC m=+1025.540542829" watchObservedRunningTime="2026-09-10 20:11:21.876606135 +0000 UTC m=+1025.541710381"
Sep 10 20:11:22.722578 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:22.722539    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:22.724172 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:22.724144    2561 patch_prober.go:28] interesting pod/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 10 20:11:22.724296 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:22.724205    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv" podUID="9a9eca39-4656-435c-ba0f-841841af77cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 10 20:11:23.726475 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:23.726443    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:23.859877 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:23.859839    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:23.860867 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:23.860844    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:25.826081 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:25.826045    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:11:34.868579 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:34.868538    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 20:11:34.869023 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:34.868651    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq" podUID="5eef44d1-6da0-4116-8e48-f84c2c1cc13e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 20:11:36.839012 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:36.838981    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:11:36.945885 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:36.945798    2561 generic.go:356] "Generic (PLEG): container finished" podID="5eef44d1-6da0-4116-8e48-f84c2c1cc13e" containerID="1cab799923ac0739c5e50fb58dc1f43d5a2f21cefdc37abacbbc9f8c7c1ff30a" exitCode=0
Sep 10 20:11:36.945885 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:36.945868    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq" event={"ID":"5eef44d1-6da0-4116-8e48-f84c2c1cc13e","Type":"ContainerDied","Data":"1cab799923ac0739c5e50fb58dc1f43d5a2f21cefdc37abacbbc9f8c7c1ff30a"}
Sep 10 20:11:36.946267 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:36.946252    2561 scope.go:117] "RemoveContainer" containerID="1cab799923ac0739c5e50fb58dc1f43d5a2f21cefdc37abacbbc9f8c7c1ff30a"
Sep 10 20:11:36.947337 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:36.947306    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:11:36.947480 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:36.947405    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:11:36.947480 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:36.947457    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:11:37.953407 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:37.953364    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq" event={"ID":"5eef44d1-6da0-4116-8e48-f84c2c1cc13e","Type":"ContainerStarted","Data":"53ade3f7e81fe2fd859593d05c38b6300a91d47500b52ecec6ec433e77f64da3"}
Sep 10 20:11:38.123053 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:38.123021    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:38.123284 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:38.123258    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 10 20:11:38.123356 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:38.123335    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq" podUID="5eef44d1-6da0-4116-8e48-f84c2c1cc13e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 10 20:11:39.123284 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:39.123245    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 10 20:11:39.123678 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:39.123316    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq" podUID="5eef44d1-6da0-4116-8e48-f84c2c1cc13e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 10 20:11:39.902761 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:39.902695    2561 patch_prober.go:28] interesting pod/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 20:11:39.902965 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:39.902809    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv" podUID="9a9eca39-4656-435c-ba0f-841841af77cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 20:11:40.123637 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:40.123595    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 10 20:11:40.124012 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:40.123667    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq" podUID="5eef44d1-6da0-4116-8e48-f84c2c1cc13e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 10 20:11:41.123960 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:41.123914    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 10 20:11:41.124528 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:41.123975    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq" podUID="5eef44d1-6da0-4116-8e48-f84c2c1cc13e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 10 20:11:41.976153 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:41.976120    2561 generic.go:356] "Generic (PLEG): container finished" podID="9a9eca39-4656-435c-ba0f-841841af77cb" containerID="7395d5da9438076e173950c761c80002793300cb8cde49f03d0cc69d42907810" exitCode=0
Sep 10 20:11:41.976353 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:41.976188    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv" event={"ID":"9a9eca39-4656-435c-ba0f-841841af77cb","Type":"ContainerDied","Data":"7395d5da9438076e173950c761c80002793300cb8cde49f03d0cc69d42907810"}
Sep 10 20:11:41.976720 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:41.976585    2561 scope.go:117] "RemoveContainer" containerID="7395d5da9438076e173950c761c80002793300cb8cde49f03d0cc69d42907810"
Sep 10 20:11:41.977662 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:41.977631    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:11:41.977754 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:41.977701    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:11:41.977754 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:41.977729    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:11:42.124076 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:42.123919    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 10 20:11:42.124076 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:42.123975    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq" podUID="5eef44d1-6da0-4116-8e48-f84c2c1cc13e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 10 20:11:42.985329 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:42.985293    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv" event={"ID":"9a9eca39-4656-435c-ba0f-841841af77cb","Type":"ContainerStarted","Data":"e280aff6620cba466b3e847e3bb0ed0f0eb99a153baa10ef00c56b7792867771"}
Sep 10 20:11:43.263321 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:43.263230    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:43.263784 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:43.263767    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:43.264546 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:43.264519    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:11:43.722690 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:43.722656    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:43.722884 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:43.722859    2561 patch_prober.go:28] interesting pod/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 10 20:11:43.722954 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:43.722913    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv" podUID="9a9eca39-4656-435c-ba0f-841841af77cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 10 20:11:44.722749 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:44.722713    2561 patch_prober.go:28] interesting pod/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 10 20:11:44.723128 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:44.722796    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv" podUID="9a9eca39-4656-435c-ba0f-841841af77cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 10 20:11:45.722078 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:45.722030    2561 patch_prober.go:28] interesting pod/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 10 20:11:45.722248 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:45.722104    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv" podUID="9a9eca39-4656-435c-ba0f-841841af77cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 10 20:11:46.722180 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:46.722146    2561 patch_prober.go:28] interesting pod/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 10 20:11:46.722655 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:46.722201    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv" podUID="9a9eca39-4656-435c-ba0f-841841af77cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 10 20:11:47.721878 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:47.721830    2561 patch_prober.go:28] interesting pod/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 10 20:11:47.722059 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:47.721900    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv" podUID="9a9eca39-4656-435c-ba0f-841841af77cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 10 20:11:48.953067 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:48.953009    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:48.953668 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:48.953624    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:48.955467 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:48.955447    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:11:50.648499 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:50.648468    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94"]
Sep 10 20:11:50.651802 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:50.651780    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94"
Sep 10 20:11:50.655835 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:50.655812    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-6550b4\""
Sep 10 20:11:50.668723 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:50.668681    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94"]
Sep 10 20:11:50.719567 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:50.719533    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/009c2b9c-1b11-406f-92ed-5845a8775388-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94\" (UID: \"009c2b9c-1b11-406f-92ed-5845a8775388\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94"
Sep 10 20:11:50.719722 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:50.719607    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g27p\" (UniqueName: \"kubernetes.io/projected/009c2b9c-1b11-406f-92ed-5845a8775388-kube-api-access-6g27p\") pod \"payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94\" (UID: \"009c2b9c-1b11-406f-92ed-5845a8775388\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94"
Sep 10 20:11:50.820785 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:50.820745    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/009c2b9c-1b11-406f-92ed-5845a8775388-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94\" (UID: \"009c2b9c-1b11-406f-92ed-5845a8775388\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94"
Sep 10 20:11:50.820955 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:50.820817    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g27p\" (UniqueName: \"kubernetes.io/projected/009c2b9c-1b11-406f-92ed-5845a8775388-kube-api-access-6g27p\") pod \"payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94\" (UID: \"009c2b9c-1b11-406f-92ed-5845a8775388\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94"
Sep 10 20:11:50.821531 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:50.821506    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/009c2b9c-1b11-406f-92ed-5845a8775388-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94\" (UID: \"009c2b9c-1b11-406f-92ed-5845a8775388\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94"
Sep 10 20:11:50.835275 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:50.835252    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g27p\" (UniqueName: \"kubernetes.io/projected/009c2b9c-1b11-406f-92ed-5845a8775388-kube-api-access-6g27p\") pod \"payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94\" (UID: \"009c2b9c-1b11-406f-92ed-5845a8775388\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94"
Sep 10 20:11:50.964386 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:50.964293    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94"
Sep 10 20:11:51.246644 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:51.246614    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94"]
Sep 10 20:11:51.248498 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:11:51.248471    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod009c2b9c_1b11_406f_92ed_5845a8775388.slice/crio-7f06d50538526811bfc1715df6f8ac0e80c0c710e3eb2fa43b4ef42f00ddd245 WatchSource:0}: Error finding container 7f06d50538526811bfc1715df6f8ac0e80c0c710e3eb2fa43b4ef42f00ddd245: Status 404 returned error can't find the container with id 7f06d50538526811bfc1715df6f8ac0e80c0c710e3eb2fa43b4ef42f00ddd245
Sep 10 20:11:52.045581 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:52.045547    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94" event={"ID":"009c2b9c-1b11-406f-92ed-5845a8775388","Type":"ContainerStarted","Data":"f1e496c9783b84168aaa249412a12637bcea42899e29b6d6598ad21d3cdda784"}
Sep 10 20:11:52.045983 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:52.045607    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94" event={"ID":"009c2b9c-1b11-406f-92ed-5845a8775388","Type":"ContainerStarted","Data":"7f06d50538526811bfc1715df6f8ac0e80c0c710e3eb2fa43b4ef42f00ddd245"}
Sep 10 20:11:52.045983 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:52.045687    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94"
Sep 10 20:11:52.069127 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:52.069073    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94" podStartSLOduration=2.069053527 podStartE2EDuration="2.069053527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:11:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:11:52.068715742 +0000 UTC m=+1055.733819971" watchObservedRunningTime="2026-09-10 20:11:52.069053527 +0000 UTC m=+1055.734157779"
Sep 10 20:11:55.164532 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:55.164495    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:11:57.311086 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:57.311045    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2017ae11-2jvbq"]
Sep 10 20:11:57.314042 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:57.314019    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2017ae11-2jvbq"
Sep 10 20:11:57.316787 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:57.316766    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zdpml\""
Sep 10 20:11:57.324056 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:57.324030    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2017ae11-2jvbq"]
Sep 10 20:11:57.379990 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:57.379949    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5f397c1-c753-443d-be06-cba0a429851a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2017ae11-2jvbq\" (UID: \"d5f397c1-c753-443d-be06-cba0a429851a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2017ae11-2jvbq"
Sep 10 20:11:57.481363 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:57.481330    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5f397c1-c753-443d-be06-cba0a429851a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2017ae11-2jvbq\" (UID: \"d5f397c1-c753-443d-be06-cba0a429851a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2017ae11-2jvbq"
Sep 10 20:11:57.482029 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:57.482008    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5f397c1-c753-443d-be06-cba0a429851a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2017ae11-2jvbq\" (UID: \"d5f397c1-c753-443d-be06-cba0a429851a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2017ae11-2jvbq"
Sep 10 20:11:57.624782 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:57.624748    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2017ae11-2jvbq"
Sep 10 20:11:57.901804 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:57.901771    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2017ae11-2jvbq"]
Sep 10 20:11:57.904355 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:11:57.904327    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5f397c1_c753_443d_be06_cba0a429851a.slice/crio-8f30aea55f8f49beb3a7bf7c98859389dde7c8745c384519e3d60b732e0a60ac WatchSource:0}: Error finding container 8f30aea55f8f49beb3a7bf7c98859389dde7c8745c384519e3d60b732e0a60ac: Status 404 returned error can't find the container with id 8f30aea55f8f49beb3a7bf7c98859389dde7c8745c384519e3d60b732e0a60ac
Sep 10 20:11:58.086356 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:58.086324    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2017ae11-2jvbq" event={"ID":"d5f397c1-c753-443d-be06-cba0a429851a","Type":"ContainerStarted","Data":"8f30aea55f8f49beb3a7bf7c98859389dde7c8745c384519e3d60b732e0a60ac"}
Sep 10 20:11:59.093383 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:59.093351    2561 generic.go:356] "Generic (PLEG): container finished" podID="d5f397c1-c753-443d-be06-cba0a429851a" containerID="fdf8fe011fcb3198e2e01b82879d1d151d8aec6410d35d93d18711f60b92006e" exitCode=0
Sep 10 20:11:59.093762 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:11:59.093429    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2017ae11-2jvbq" event={"ID":"d5f397c1-c753-443d-be06-cba0a429851a","Type":"ContainerDied","Data":"fdf8fe011fcb3198e2e01b82879d1d151d8aec6410d35d93d18711f60b92006e"}
Sep 10 20:12:00.567561 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:00.567539    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2017ae11-2jvbq"
Sep 10 20:12:00.715465 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:00.715430    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5f397c1-c753-443d-be06-cba0a429851a-maas-api-service-ca\") pod \"d5f397c1-c753-443d-be06-cba0a429851a\" (UID: \"d5f397c1-c753-443d-be06-cba0a429851a\") "
Sep 10 20:12:00.715801 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:00.715778    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5f397c1-c753-443d-be06-cba0a429851a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d5f397c1-c753-443d-be06-cba0a429851a" (UID: "d5f397c1-c753-443d-be06-cba0a429851a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:12:00.816491 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:00.816380    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5f397c1-c753-443d-be06-cba0a429851a-maas-api-service-ca\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:12:01.106691 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:01.106608    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2017ae11-2jvbq"
Sep 10 20:12:01.106924 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:01.106604    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2017ae11-2jvbq" event={"ID":"d5f397c1-c753-443d-be06-cba0a429851a","Type":"ContainerDied","Data":"8f30aea55f8f49beb3a7bf7c98859389dde7c8745c384519e3d60b732e0a60ac"}
Sep 10 20:12:01.106924 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:01.106747    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f30aea55f8f49beb3a7bf7c98859389dde7c8745c384519e3d60b732e0a60ac"
Sep 10 20:12:03.053093 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:03.053065    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94"
Sep 10 20:12:09.089930 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:09.089896    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2017ae11-2jvbq"]
Sep 10 20:12:09.114171 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:09.114145    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2017ae11-2jvbq"]
Sep 10 20:12:10.850558 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:10.850526    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5f397c1-c753-443d-be06-cba0a429851a" path="/var/lib/kubelet/pods/d5f397c1-c753-443d-be06-cba0a429851a/volumes"
Sep 10 20:12:11.838429 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:11.838386    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:12:16.652285 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:16.652254    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"]
Sep 10 20:12:16.652697 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:16.652478    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv" podUID="9a9eca39-4656-435c-ba0f-841841af77cb" containerName="istio-proxy" containerID="cri-o://e280aff6620cba466b3e847e3bb0ed0f0eb99a153baa10ef00c56b7792867771" gracePeriod=30
Sep 10 20:12:18.955672 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:18.955636    2561 patch_prober.go:28] interesting pod/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 20:12:18.956115 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:18.955698    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv" podUID="9a9eca39-4656-435c-ba0f-841841af77cb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 20:12:22.221372 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.221340    2561 generic.go:356] "Generic (PLEG): container finished" podID="9a9eca39-4656-435c-ba0f-841841af77cb" containerID="e280aff6620cba466b3e847e3bb0ed0f0eb99a153baa10ef00c56b7792867771" exitCode=0
Sep 10 20:12:22.221834 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.221423    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv" event={"ID":"9a9eca39-4656-435c-ba0f-841841af77cb","Type":"ContainerDied","Data":"e280aff6620cba466b3e847e3bb0ed0f0eb99a153baa10ef00c56b7792867771"}
Sep 10 20:12:22.221834 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.221484    2561 scope.go:117] "RemoveContainer" containerID="7395d5da9438076e173950c761c80002793300cb8cde49f03d0cc69d42907810"
Sep 10 20:12:22.300321 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.300298    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:12:22.325604 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.325580    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-workload-certs\") pod \"9a9eca39-4656-435c-ba0f-841841af77cb\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") "
Sep 10 20:12:22.325753 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.325618    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kgsr\" (UniqueName: \"kubernetes.io/projected/9a9eca39-4656-435c-ba0f-841841af77cb-kube-api-access-5kgsr\") pod \"9a9eca39-4656-435c-ba0f-841841af77cb\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") "
Sep 10 20:12:22.325753 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.325655    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a9eca39-4656-435c-ba0f-841841af77cb-istio-token\") pod \"9a9eca39-4656-435c-ba0f-841841af77cb\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") "
Sep 10 20:12:22.325753 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.325684    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-credential-socket\") pod \"9a9eca39-4656-435c-ba0f-841841af77cb\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") "
Sep 10 20:12:22.325753 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.325728    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a9eca39-4656-435c-ba0f-841841af77cb-istio-podinfo\") pod \"9a9eca39-4656-435c-ba0f-841841af77cb\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") "
Sep 10 20:12:22.325753 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.325748    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-istio-data\") pod \"9a9eca39-4656-435c-ba0f-841841af77cb\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") "
Sep 10 20:12:22.326023 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.325771    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-workload-socket\") pod \"9a9eca39-4656-435c-ba0f-841841af77cb\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") "
Sep 10 20:12:22.326023 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.325857    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-istio-envoy\") pod \"9a9eca39-4656-435c-ba0f-841841af77cb\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") "
Sep 10 20:12:22.326023 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.325858    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9a9eca39-4656-435c-ba0f-841841af77cb" (UID: "9a9eca39-4656-435c-ba0f-841841af77cb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:12:22.326023 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.325923    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a9eca39-4656-435c-ba0f-841841af77cb-istiod-ca-cert\") pod \"9a9eca39-4656-435c-ba0f-841841af77cb\" (UID: \"9a9eca39-4656-435c-ba0f-841841af77cb\") "
Sep 10 20:12:22.326023 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.325965    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9a9eca39-4656-435c-ba0f-841841af77cb" (UID: "9a9eca39-4656-435c-ba0f-841841af77cb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:12:22.326286 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.326264    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-workload-certs\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:12:22.326286 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.326283    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-credential-socket\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:12:22.326405 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.326332    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a9eca39-4656-435c-ba0f-841841af77cb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9a9eca39-4656-435c-ba0f-841841af77cb" (UID: "9a9eca39-4656-435c-ba0f-841841af77cb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:12:22.326405 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.326353    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9a9eca39-4656-435c-ba0f-841841af77cb" (UID: "9a9eca39-4656-435c-ba0f-841841af77cb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:12:22.326523 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.326209    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-istio-data" (OuterVolumeSpecName: "istio-data") pod "9a9eca39-4656-435c-ba0f-841841af77cb" (UID: "9a9eca39-4656-435c-ba0f-841841af77cb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:12:22.328069 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.328045    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9a9eca39-4656-435c-ba0f-841841af77cb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9a9eca39-4656-435c-ba0f-841841af77cb" (UID: "9a9eca39-4656-435c-ba0f-841841af77cb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 20:12:22.328373 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.328350    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9a9eca39-4656-435c-ba0f-841841af77cb" (UID: "9a9eca39-4656-435c-ba0f-841841af77cb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:12:22.328471 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.328425    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a9eca39-4656-435c-ba0f-841841af77cb-istio-token" (OuterVolumeSpecName: "istio-token") pod "9a9eca39-4656-435c-ba0f-841841af77cb" (UID: "9a9eca39-4656-435c-ba0f-841841af77cb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:12:22.328512 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.328497    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a9eca39-4656-435c-ba0f-841841af77cb-kube-api-access-5kgsr" (OuterVolumeSpecName: "kube-api-access-5kgsr") pod "9a9eca39-4656-435c-ba0f-841841af77cb" (UID: "9a9eca39-4656-435c-ba0f-841841af77cb"). InnerVolumeSpecName "kube-api-access-5kgsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:12:22.427541 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.427513    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-istio-envoy\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:12:22.427541 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.427539    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a9eca39-4656-435c-ba0f-841841af77cb-istiod-ca-cert\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:12:22.427726 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.427548    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kgsr\" (UniqueName: \"kubernetes.io/projected/9a9eca39-4656-435c-ba0f-841841af77cb-kube-api-access-5kgsr\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:12:22.427726 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.427558    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a9eca39-4656-435c-ba0f-841841af77cb-istio-token\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:12:22.427726 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.427566    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a9eca39-4656-435c-ba0f-841841af77cb-istio-podinfo\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:12:22.427726 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.427573    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-istio-data\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:12:22.427726 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:22.427581    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9eca39-4656-435c-ba0f-841841af77cb-workload-socket\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:12:23.228261 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:23.228180    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"
Sep 10 20:12:23.228261 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:23.228221    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv" event={"ID":"9a9eca39-4656-435c-ba0f-841841af77cb","Type":"ContainerDied","Data":"e55281af9932f0fa7aaccdae5b2af9c35e86fb30db504b251331438d0d35b38d"}
Sep 10 20:12:23.228750 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:23.228278    2561 scope.go:117] "RemoveContainer" containerID="e280aff6620cba466b3e847e3bb0ed0f0eb99a153baa10ef00c56b7792867771"
Sep 10 20:12:23.259546 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:23.259521    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"]
Sep 10 20:12:23.276158 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:23.276133    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-2017ae11-openshift-default-79fbdf4cd4-svhpv"]
Sep 10 20:12:24.850587 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:24.850544    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a9eca39-4656-435c-ba0f-841841af77cb" path="/var/lib/kubelet/pods/9a9eca39-4656-435c-ba0f-841841af77cb/volumes"
Sep 10 20:12:33.423806 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:33.423767    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:12:34.666991 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.666956    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"]
Sep 10 20:12:34.667607 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.667586    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9eca39-4656-435c-ba0f-841841af77cb" containerName="istio-proxy"
Sep 10 20:12:34.667674 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.667613    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9eca39-4656-435c-ba0f-841841af77cb" containerName="istio-proxy"
Sep 10 20:12:34.667674 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.667628    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5f397c1-c753-443d-be06-cba0a429851a" containerName="revoke-keys"
Sep 10 20:12:34.667674 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.667638    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5f397c1-c753-443d-be06-cba0a429851a" containerName="revoke-keys"
Sep 10 20:12:34.667674 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.667658    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9eca39-4656-435c-ba0f-841841af77cb" containerName="istio-proxy"
Sep 10 20:12:34.667674 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.667668    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9eca39-4656-435c-ba0f-841841af77cb" containerName="istio-proxy"
Sep 10 20:12:34.667844 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.667790    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a9eca39-4656-435c-ba0f-841841af77cb" containerName="istio-proxy"
Sep 10 20:12:34.667844 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.667802    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a9eca39-4656-435c-ba0f-841841af77cb" containerName="istio-proxy"
Sep 10 20:12:34.667844 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.667812    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5f397c1-c753-443d-be06-cba0a429851a" containerName="revoke-keys"
Sep 10 20:12:34.671438 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.671413    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.675482 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.675464    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-214b09-openshift-default-dockercfg-bnlh6\""
Sep 10 20:12:34.694602 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.693946    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"]
Sep 10 20:12:34.735847 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.735816    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfc4249a-9707-48d9-bf73-b919a632614c-istio-podinfo\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.736003 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.735908    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-workload-socket\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.736003 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.735969    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-istio-envoy\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.736099 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.735999    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-workload-certs\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.736099 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.736023    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfc4249a-9707-48d9-bf73-b919a632614c-istio-token\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.736189 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.736161    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfc4249a-9707-48d9-bf73-b919a632614c-istiod-ca-cert\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.736228 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.736204    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gknfg\" (UniqueName: \"kubernetes.io/projected/cfc4249a-9707-48d9-bf73-b919a632614c-kube-api-access-gknfg\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.736294 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.736280    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-credential-socket\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.736349 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.736316    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-istio-data\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.837013 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.836969    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-credential-socket\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.837255 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.837032    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-istio-data\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.837255 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.837097    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfc4249a-9707-48d9-bf73-b919a632614c-istio-podinfo\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.837255 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.837136    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-workload-socket\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.837255 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.837188    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-istio-envoy\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.837255 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.837218    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-workload-certs\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.837255 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.837238    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfc4249a-9707-48d9-bf73-b919a632614c-istio-token\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.837661 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.837342    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfc4249a-9707-48d9-bf73-b919a632614c-istiod-ca-cert\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.837661 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.837368    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gknfg\" (UniqueName: \"kubernetes.io/projected/cfc4249a-9707-48d9-bf73-b919a632614c-kube-api-access-gknfg\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.837661 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.837483    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-istio-data\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.837845 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.837832    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-workload-socket\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.838067 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.838017    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-credential-socket\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.838227 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.838186    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-workload-certs\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.838621 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.838571    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfc4249a-9707-48d9-bf73-b919a632614c-istiod-ca-cert\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.840561 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.840540    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-istio-envoy\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.841074 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.841050    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfc4249a-9707-48d9-bf73-b919a632614c-istio-podinfo\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.848147 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.848127    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfc4249a-9707-48d9-bf73-b919a632614c-istio-token\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.848678 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.848659    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gknfg\" (UniqueName: \"kubernetes.io/projected/cfc4249a-9707-48d9-bf73-b919a632614c-kube-api-access-gknfg\") pod \"e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") " pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:34.983997 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:34.983917    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:35.262970 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:35.262944    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"]
Sep 10 20:12:35.264933 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:12:35.264907    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfc4249a_9707_48d9_bf73_b919a632614c.slice/crio-a2371c99744552e719cc3b659c78f77051b5059153ae91a1fd24ebbb15b832da WatchSource:0}: Error finding container a2371c99744552e719cc3b659c78f77051b5059153ae91a1fd24ebbb15b832da: Status 404 returned error can't find the container with id a2371c99744552e719cc3b659c78f77051b5059153ae91a1fd24ebbb15b832da
Sep 10 20:12:35.267055 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:35.267025    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:12:35.267118 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:35.267096    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:12:35.267155 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:35.267127    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:12:35.297586 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:35.297557    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69" event={"ID":"cfc4249a-9707-48d9-bf73-b919a632614c","Type":"ContainerStarted","Data":"a2371c99744552e719cc3b659c78f77051b5059153ae91a1fd24ebbb15b832da"}
Sep 10 20:12:36.304467 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:36.304433    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69" event={"ID":"cfc4249a-9707-48d9-bf73-b919a632614c","Type":"ContainerStarted","Data":"253621e81736c7c9daf0bc4b258efcf2e8858920ffb13e55ed5d68529a3b0331"}
Sep 10 20:12:36.352480 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:36.352432    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69" podStartSLOduration=2.352415821 podStartE2EDuration="2.352415821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:12:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:12:36.351311802 +0000 UTC m=+1100.016416069" watchObservedRunningTime="2026-09-10 20:12:36.352415821 +0000 UTC m=+1100.017520062"
Sep 10 20:12:36.984243 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:36.984208    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:36.991049 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:36.991025    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:37.309717 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:37.309641    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:37.310593 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:37.310570    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:46.306421 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:46.306376    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:12:56.410930 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:56.410897    2561 generic.go:356] "Generic (PLEG): container finished" podID="cfc4249a-9707-48d9-bf73-b919a632614c" containerID="253621e81736c7c9daf0bc4b258efcf2e8858920ffb13e55ed5d68529a3b0331" exitCode=0
Sep 10 20:12:56.411487 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:56.410972    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69" event={"ID":"cfc4249a-9707-48d9-bf73-b919a632614c","Type":"ContainerDied","Data":"253621e81736c7c9daf0bc4b258efcf2e8858920ffb13e55ed5d68529a3b0331"}
Sep 10 20:12:56.411487 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:56.411470    2561 scope.go:117] "RemoveContainer" containerID="253621e81736c7c9daf0bc4b258efcf2e8858920ffb13e55ed5d68529a3b0331"
Sep 10 20:12:56.412543 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:56.412517    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:12:56.412607 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:56.412592    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:12:56.412644 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:56.412622    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:12:57.420469 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:57.420431    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69" event={"ID":"cfc4249a-9707-48d9-bf73-b919a632614c","Type":"ContainerStarted","Data":"2a35ecd5c45c74d7a007473908989a452b12fdd8eab7dbfccaaf3ad490d9b063"}
Sep 10 20:12:57.984409 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:57.984357    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:12:57.984585 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:57.984503    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 20:12:57.984585 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:57.984548    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69" podUID="cfc4249a-9707-48d9-bf73-b919a632614c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 20:12:58.984347 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:58.984313    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 20:12:58.984750 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:58.984368    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69" podUID="cfc4249a-9707-48d9-bf73-b919a632614c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 20:12:59.984722 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:59.984684    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 20:12:59.985163 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:12:59.984747    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69" podUID="cfc4249a-9707-48d9-bf73-b919a632614c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 20:13:00.984527 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:00.984496    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 20:13:00.984716 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:00.984549    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69" podUID="cfc4249a-9707-48d9-bf73-b919a632614c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 20:13:01.985037 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:01.984992    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 20:13:01.985410 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:01.985082    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69" podUID="cfc4249a-9707-48d9-bf73-b919a632614c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 20:13:02.988626 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:02.988596    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:13:02.988991 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:02.988971    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:13:02.989840 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:02.989821    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:13:10.021359 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.021326    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d"]
Sep 10 20:13:10.023928 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.023912    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d"
Sep 10 20:13:10.027928 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.027905    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-6ef723-dockercfg-fd92h\""
Sep 10 20:13:10.028045 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.027927    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-6ef723\""
Sep 10 20:13:10.043307 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.043281    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d"]
Sep 10 20:13:10.045466 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.045444    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6228659b-71ea-49c4-8bba-b2e012c9d301-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d\" (UID: \"6228659b-71ea-49c4-8bba-b2e012c9d301\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d"
Sep 10 20:13:10.045574 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.045472    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tczcb\" (UniqueName: \"kubernetes.io/projected/6228659b-71ea-49c4-8bba-b2e012c9d301-kube-api-access-tczcb\") pod \"payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d\" (UID: \"6228659b-71ea-49c4-8bba-b2e012c9d301\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d"
Sep 10 20:13:10.060642 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.060618    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl"]
Sep 10 20:13:10.063043 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.063026    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl"
Sep 10 20:13:10.078428 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.078383    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl"]
Sep 10 20:13:10.146046 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.146015    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44c0c91d-c5a4-4ea2-9b48-355ba612a6f7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl\" (UID: \"44c0c91d-c5a4-4ea2-9b48-355ba612a6f7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl"
Sep 10 20:13:10.146228 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.146057    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6228659b-71ea-49c4-8bba-b2e012c9d301-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d\" (UID: \"6228659b-71ea-49c4-8bba-b2e012c9d301\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d"
Sep 10 20:13:10.146228 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.146084    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tczcb\" (UniqueName: \"kubernetes.io/projected/6228659b-71ea-49c4-8bba-b2e012c9d301-kube-api-access-tczcb\") pod \"payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d\" (UID: \"6228659b-71ea-49c4-8bba-b2e012c9d301\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d"
Sep 10 20:13:10.146228 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.146123    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f48bl\" (UniqueName: \"kubernetes.io/projected/44c0c91d-c5a4-4ea2-9b48-355ba612a6f7-kube-api-access-f48bl\") pod \"payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl\" (UID: \"44c0c91d-c5a4-4ea2-9b48-355ba612a6f7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl"
Sep 10 20:13:10.146826 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.146808    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6228659b-71ea-49c4-8bba-b2e012c9d301-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d\" (UID: \"6228659b-71ea-49c4-8bba-b2e012c9d301\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d"
Sep 10 20:13:10.157931 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.157908    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tczcb\" (UniqueName: \"kubernetes.io/projected/6228659b-71ea-49c4-8bba-b2e012c9d301-kube-api-access-tczcb\") pod \"payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d\" (UID: \"6228659b-71ea-49c4-8bba-b2e012c9d301\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d"
Sep 10 20:13:10.247642 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.247608    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44c0c91d-c5a4-4ea2-9b48-355ba612a6f7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl\" (UID: \"44c0c91d-c5a4-4ea2-9b48-355ba612a6f7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl"
Sep 10 20:13:10.247828 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.247670    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f48bl\" (UniqueName: \"kubernetes.io/projected/44c0c91d-c5a4-4ea2-9b48-355ba612a6f7-kube-api-access-f48bl\") pod \"payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl\" (UID: \"44c0c91d-c5a4-4ea2-9b48-355ba612a6f7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl"
Sep 10 20:13:10.248252 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.248233    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44c0c91d-c5a4-4ea2-9b48-355ba612a6f7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl\" (UID: \"44c0c91d-c5a4-4ea2-9b48-355ba612a6f7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl"
Sep 10 20:13:10.257367 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.257343    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f48bl\" (UniqueName: \"kubernetes.io/projected/44c0c91d-c5a4-4ea2-9b48-355ba612a6f7-kube-api-access-f48bl\") pod \"payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl\" (UID: \"44c0c91d-c5a4-4ea2-9b48-355ba612a6f7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl"
Sep 10 20:13:10.333530 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.333509    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d"
Sep 10 20:13:10.375769 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.375736    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl"
Sep 10 20:13:10.617943 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.617865    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d"]
Sep 10 20:13:10.622182 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:13:10.622157    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6228659b_71ea_49c4_8bba_b2e012c9d301.slice/crio-23a27e9b335dd2835123438a6f6026b98542865f2fef26a840ccb3763a9adf01 WatchSource:0}: Error finding container 23a27e9b335dd2835123438a6f6026b98542865f2fef26a840ccb3763a9adf01: Status 404 returned error can't find the container with id 23a27e9b335dd2835123438a6f6026b98542865f2fef26a840ccb3763a9adf01
Sep 10 20:13:10.674883 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:10.674858    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl"]
Sep 10 20:13:10.675877 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:13:10.675849    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44c0c91d_c5a4_4ea2_9b48_355ba612a6f7.slice/crio-8c332f587e6df59fdd405145d6f3ebaf8e9bb896c87605af5f54138ee7989dec WatchSource:0}: Error finding container 8c332f587e6df59fdd405145d6f3ebaf8e9bb896c87605af5f54138ee7989dec: Status 404 returned error can't find the container with id 8c332f587e6df59fdd405145d6f3ebaf8e9bb896c87605af5f54138ee7989dec
Sep 10 20:13:11.495819 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:11.495773    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl" event={"ID":"44c0c91d-c5a4-4ea2-9b48-355ba612a6f7","Type":"ContainerStarted","Data":"f3f41d1a2ca1727f0d0eec428273809934c91359a0a7bc1b77ec46534011f218"}
Sep 10 20:13:11.496268 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:11.495872    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl" event={"ID":"44c0c91d-c5a4-4ea2-9b48-355ba612a6f7","Type":"ContainerStarted","Data":"8c332f587e6df59fdd405145d6f3ebaf8e9bb896c87605af5f54138ee7989dec"}
Sep 10 20:13:11.496268 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:11.495905    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl"
Sep 10 20:13:11.497622 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:11.497594    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d" event={"ID":"6228659b-71ea-49c4-8bba-b2e012c9d301","Type":"ContainerStarted","Data":"4b5b18963bb862e05982d8959fbff9a034143010d40fcd8dc520da8015ecb9da"}
Sep 10 20:13:11.497760 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:11.497646    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d" event={"ID":"6228659b-71ea-49c4-8bba-b2e012c9d301","Type":"ContainerStarted","Data":"23a27e9b335dd2835123438a6f6026b98542865f2fef26a840ccb3763a9adf01"}
Sep 10 20:13:11.497760 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:11.497674    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d"
Sep 10 20:13:11.522497 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:11.522444    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl" podStartSLOduration=1.522426057 podStartE2EDuration="1.522426057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:13:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:13:11.521415139 +0000 UTC m=+1135.186519378" watchObservedRunningTime="2026-09-10 20:13:11.522426057 +0000 UTC m=+1135.187530305"
Sep 10 20:13:11.545360 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:11.545322    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d" podStartSLOduration=2.545297192 podStartE2EDuration="2.545297192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:13:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:13:11.545077499 +0000 UTC m=+1135.210181747" watchObservedRunningTime="2026-09-10 20:13:11.545297192 +0000 UTC m=+1135.210401438"
Sep 10 20:13:15.913541 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:15.913498    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:13:22.505276 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:22.505244    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl"
Sep 10 20:13:22.505796 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:22.505329    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d"
Sep 10 20:13:34.816515 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:34.816480    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:13:46.812679 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:46.812601    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:13:47.026999 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.026967    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft"]
Sep 10 20:13:47.030524 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.030503    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft"
Sep 10 20:13:47.033133 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.033113    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-e88b3e4f-dockercfg-zk99f\""
Sep 10 20:13:47.033466 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.033446    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-e88b3e4f\""
Sep 10 20:13:47.039979 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.039956    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv"]
Sep 10 20:13:47.043335 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.043313    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv"
Sep 10 20:13:47.043609 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.043591    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft"]
Sep 10 20:13:47.061699 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.061676    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv"]
Sep 10 20:13:47.171432 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.171385    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e02c595-5deb-4b0c-911c-ad0aa5166c26-plugins-config-volume\") pod \"payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv\" (UID: \"6e02c595-5deb-4b0c-911c-ad0aa5166c26\") " pod="openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv"
Sep 10 20:13:47.171604 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.171450    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptqgd\" (UniqueName: \"kubernetes.io/projected/b06cd4fe-ed85-4a65-a53d-68ba468507ed-kube-api-access-ptqgd\") pod \"payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft\" (UID: \"b06cd4fe-ed85-4a65-a53d-68ba468507ed\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft"
Sep 10 20:13:47.171604 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.171472    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b06cd4fe-ed85-4a65-a53d-68ba468507ed-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft\" (UID: \"b06cd4fe-ed85-4a65-a53d-68ba468507ed\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft"
Sep 10 20:13:47.171604 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.171520    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmrsl\" (UniqueName: \"kubernetes.io/projected/6e02c595-5deb-4b0c-911c-ad0aa5166c26-kube-api-access-tmrsl\") pod \"payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv\" (UID: \"6e02c595-5deb-4b0c-911c-ad0aa5166c26\") " pod="openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv"
Sep 10 20:13:47.272167 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.272135    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmrsl\" (UniqueName: \"kubernetes.io/projected/6e02c595-5deb-4b0c-911c-ad0aa5166c26-kube-api-access-tmrsl\") pod \"payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv\" (UID: \"6e02c595-5deb-4b0c-911c-ad0aa5166c26\") " pod="openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv"
Sep 10 20:13:47.272320 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.272203    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e02c595-5deb-4b0c-911c-ad0aa5166c26-plugins-config-volume\") pod \"payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv\" (UID: \"6e02c595-5deb-4b0c-911c-ad0aa5166c26\") " pod="openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv"
Sep 10 20:13:47.272320 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.272226    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptqgd\" (UniqueName: \"kubernetes.io/projected/b06cd4fe-ed85-4a65-a53d-68ba468507ed-kube-api-access-ptqgd\") pod \"payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft\" (UID: \"b06cd4fe-ed85-4a65-a53d-68ba468507ed\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft"
Sep 10 20:13:47.272320 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.272245    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b06cd4fe-ed85-4a65-a53d-68ba468507ed-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft\" (UID: \"b06cd4fe-ed85-4a65-a53d-68ba468507ed\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft"
Sep 10 20:13:47.272940 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.272921    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e02c595-5deb-4b0c-911c-ad0aa5166c26-plugins-config-volume\") pod \"payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv\" (UID: \"6e02c595-5deb-4b0c-911c-ad0aa5166c26\") " pod="openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv"
Sep 10 20:13:47.272980 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.272952    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b06cd4fe-ed85-4a65-a53d-68ba468507ed-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft\" (UID: \"b06cd4fe-ed85-4a65-a53d-68ba468507ed\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft"
Sep 10 20:13:47.281228 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.281204    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmrsl\" (UniqueName: \"kubernetes.io/projected/6e02c595-5deb-4b0c-911c-ad0aa5166c26-kube-api-access-tmrsl\") pod \"payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv\" (UID: \"6e02c595-5deb-4b0c-911c-ad0aa5166c26\") " pod="openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv"
Sep 10 20:13:47.281356 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.281243    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptqgd\" (UniqueName: \"kubernetes.io/projected/b06cd4fe-ed85-4a65-a53d-68ba468507ed-kube-api-access-ptqgd\") pod \"payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft\" (UID: \"b06cd4fe-ed85-4a65-a53d-68ba468507ed\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft"
Sep 10 20:13:47.341287 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.341254    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft"
Sep 10 20:13:47.354465 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.354447    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv"
Sep 10 20:13:47.620040 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.620001    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft"]
Sep 10 20:13:47.705729 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.705698    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft" event={"ID":"b06cd4fe-ed85-4a65-a53d-68ba468507ed","Type":"ContainerStarted","Data":"aebfebd56bf8c019018f21a78fec54474b362ebc40e39e0e10fbebdcd86096d2"}
Sep 10 20:13:47.705861 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.705759    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft" event={"ID":"b06cd4fe-ed85-4a65-a53d-68ba468507ed","Type":"ContainerStarted","Data":"cab72a8bf8d684240beca58754a0f2ad2793650a3d1bd80a3416055af94d4737"}
Sep 10 20:13:47.705861 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.705785    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft"
Sep 10 20:13:47.729083 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.729037    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft" podStartSLOduration=0.729021864 podStartE2EDuration="729.021864ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:13:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:13:47.727053399 +0000 UTC m=+1171.392157653" watchObservedRunningTime="2026-09-10 20:13:47.729021864 +0000 UTC m=+1171.394126134"
Sep 10 20:13:47.846167 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:47.846133    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv"]
Sep 10 20:13:47.848182 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:13:47.848157    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e02c595_5deb_4b0c_911c_ad0aa5166c26.slice/crio-d3e1124691fc2c2d98234a6f007f84f4ae5bdf1e25c86a25cf89ae2c4491f6fb WatchSource:0}: Error finding container d3e1124691fc2c2d98234a6f007f84f4ae5bdf1e25c86a25cf89ae2c4491f6fb: Status 404 returned error can't find the container with id d3e1124691fc2c2d98234a6f007f84f4ae5bdf1e25c86a25cf89ae2c4491f6fb
Sep 10 20:13:48.714446 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:48.714411    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv" event={"ID":"6e02c595-5deb-4b0c-911c-ad0aa5166c26","Type":"ContainerStarted","Data":"5ada2ced43fcbfbebd9271ca5ba6a9589975c809d318359eb70ade0077645ef7"}
Sep 10 20:13:48.714626 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:48.714471    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv" event={"ID":"6e02c595-5deb-4b0c-911c-ad0aa5166c26","Type":"ContainerStarted","Data":"d3e1124691fc2c2d98234a6f007f84f4ae5bdf1e25c86a25cf89ae2c4491f6fb"}
Sep 10 20:13:48.737185 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:48.737134    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv" podStartSLOduration=1.737122037 podStartE2EDuration="1.737122037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:13:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:13:48.73517012 +0000 UTC m=+1172.400274368" watchObservedRunningTime="2026-09-10 20:13:48.737122037 +0000 UTC m=+1172.402226282"
Sep 10 20:13:49.721606 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:49.721568    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv"
Sep 10 20:13:58.716818 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:13:58.716789    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft"
Sep 10 20:14:00.728643 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:14:00.728614    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv"
Sep 10 20:14:05.709465 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:14:05.709431    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:14:16.988531 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:14:16.988497    2561 scope.go:117] "RemoveContainer" containerID="c4056e9034b7143cf6f0dedd84c2a5e4614b1736df06b8138b7d251dce4644c3"
Sep 10 20:14:23.196703 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:14:23.196657    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:14:40.527266 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:14:40.527223    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:15:00.157326 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:00.157275    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6ef723-29817855-4t42w"]
Sep 10 20:15:00.160933 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:00.160913    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6ef723-29817855-4t42w"
Sep 10 20:15:00.163603 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:00.163580    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zdpml\""
Sep 10 20:15:00.163788 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:00.163768    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-6550b4-29817855-crxkg"]
Sep 10 20:15:00.168932 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:00.168496    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-6550b4-29817855-crxkg"
Sep 10 20:15:00.172050 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:00.172034    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6ef723-29817855-4t42w"
Sep 10 20:15:00.176753 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:00.176733    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-591d7c-29817855-n7t8q"]
Sep 10 20:15:00.180621 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:00.180597    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-591d7c-29817855-n7t8q"
Sep 10 20:15:00.181938 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:00.181916    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-6550b4-29817855-crxkg"
Sep 10 20:15:00.184745 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:00.184592    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6ef723-29817855-4t42w"]
Sep 10 20:15:00.191023 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:00.190999    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-6550b4-29817855-crxkg"]
Sep 10 20:15:00.196534 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:00.196496    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e88b3e4f-29817855-7jw45"]
Sep 10 20:15:00.206003 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:00.205945    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-591d7c-29817855-n7t8q"]
Sep 10 20:15:00.206111 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:00.206086    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e88b3e4f-29817855-7jw45"
Sep 10 20:15:00.211254 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:00.211228    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e88b3e4f-29817855-7jw45"]
Sep 10 20:15:00.233790 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:00.233769    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-591d7c-29817855-n7t8q"
Sep 10 20:15:00.244868 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:00.244670    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e88b3e4f-29817855-7jw45"
Sep 10 20:15:00.464135 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:00.464104    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6ef723-29817855-4t42w"]
Sep 10 20:15:00.465174 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:15:00.465141    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1325ac9_a30d_44b8_a0c5_7279d92ec415.slice/crio-9c1d437ac7d4b26e618b56b798a2d710f064ba0f3c668d5131a254a36ce2dc53 WatchSource:0}: Error finding container 9c1d437ac7d4b26e618b56b798a2d710f064ba0f3c668d5131a254a36ce2dc53: Status 404 returned error can't find the container with id 9c1d437ac7d4b26e618b56b798a2d710f064ba0f3c668d5131a254a36ce2dc53
Sep 10 20:15:00.892786 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:00.892761    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-6550b4-29817855-crxkg"]
Sep 10 20:15:00.895119 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:15:00.895093    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55786e1b_9d92_47e4_9bdd_8af4427948b7.slice/crio-a5379988b2acccf87dcbf9d5784cc73020b34cd759440fd1b9518eeeedff5f11 WatchSource:0}: Error finding container a5379988b2acccf87dcbf9d5784cc73020b34cd759440fd1b9518eeeedff5f11: Status 404 returned error can't find the container with id a5379988b2acccf87dcbf9d5784cc73020b34cd759440fd1b9518eeeedff5f11
Sep 10 20:15:00.947755 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:00.947729    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-591d7c-29817855-n7t8q"]
Sep 10 20:15:00.949831 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:15:00.949807    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72304d70_7b28_4db4_80a9_5bc27f4ec670.slice/crio-e5cc7e1ed5bd1237120695ffdaf1c923fa5c24b0da554f5cfd7cf929c3027e7f WatchSource:0}: Error finding container e5cc7e1ed5bd1237120695ffdaf1c923fa5c24b0da554f5cfd7cf929c3027e7f: Status 404 returned error can't find the container with id e5cc7e1ed5bd1237120695ffdaf1c923fa5c24b0da554f5cfd7cf929c3027e7f
Sep 10 20:15:00.955868 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:00.955843    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e88b3e4f-29817855-7jw45"]
Sep 10 20:15:00.957696 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:15:00.957673    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd8f68f_3279_4507_a7c3_d9fda338ab45.slice/crio-76eb651fa7349a60c4cf9919f2e8495ad3d4f97c537391c5da59de2302bb8482 WatchSource:0}: Error finding container 76eb651fa7349a60c4cf9919f2e8495ad3d4f97c537391c5da59de2302bb8482: Status 404 returned error can't find the container with id 76eb651fa7349a60c4cf9919f2e8495ad3d4f97c537391c5da59de2302bb8482
Sep 10 20:15:01.117059 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:01.117028    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-6550b4-29817855-crxkg" event={"ID":"55786e1b-9d92-47e4-9bdd-8af4427948b7","Type":"ContainerStarted","Data":"a5379988b2acccf87dcbf9d5784cc73020b34cd759440fd1b9518eeeedff5f11"}
Sep 10 20:15:01.118269 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:01.118246    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-591d7c-29817855-n7t8q" event={"ID":"72304d70-7b28-4db4-80a9-5bc27f4ec670","Type":"ContainerStarted","Data":"e5cc7e1ed5bd1237120695ffdaf1c923fa5c24b0da554f5cfd7cf929c3027e7f"}
Sep 10 20:15:01.119510 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:01.119490    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e88b3e4f-29817855-7jw45" event={"ID":"2fd8f68f-3279-4507-a7c3-d9fda338ab45","Type":"ContainerStarted","Data":"76eb651fa7349a60c4cf9919f2e8495ad3d4f97c537391c5da59de2302bb8482"}
Sep 10 20:15:01.121021 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:01.121003    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6ef723-29817855-4t42w" event={"ID":"c1325ac9-a30d-44b8-a0c5-7279d92ec415","Type":"ContainerStarted","Data":"768f4015d0b3dc9e1ded88f0f0fc2dda44221af9f53685805e41b0c176ffb612"}
Sep 10 20:15:01.121100 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:01.121040    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6ef723-29817855-4t42w" event={"ID":"c1325ac9-a30d-44b8-a0c5-7279d92ec415","Type":"ContainerStarted","Data":"9c1d437ac7d4b26e618b56b798a2d710f064ba0f3c668d5131a254a36ce2dc53"}
Sep 10 20:15:01.137072 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:01.137032    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6ef723-29817855-4t42w" podStartSLOduration=1.137018692 podStartE2EDuration="1.137018692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:15:01.136151667 +0000 UTC m=+1244.801255926" watchObservedRunningTime="2026-09-10 20:15:01.137018692 +0000 UTC m=+1244.802122938"
Sep 10 20:15:02.128629 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:02.128597    2561 generic.go:356] "Generic (PLEG): container finished" podID="55786e1b-9d92-47e4-9bdd-8af4427948b7" containerID="b86e65ac8254dd38232654e16cc3fee2f8d2765da00007b683af73b720a771a1" exitCode=0
Sep 10 20:15:02.129027 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:02.128696    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-6550b4-29817855-crxkg" event={"ID":"55786e1b-9d92-47e4-9bdd-8af4427948b7","Type":"ContainerDied","Data":"b86e65ac8254dd38232654e16cc3fee2f8d2765da00007b683af73b720a771a1"}
Sep 10 20:15:02.130325 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:02.130302    2561 generic.go:356] "Generic (PLEG): container finished" podID="72304d70-7b28-4db4-80a9-5bc27f4ec670" containerID="b96c6360f5497e0592a905ada28be7c5f2f7a0235f14ba955c77ab2878629473" exitCode=0
Sep 10 20:15:02.130464 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:02.130360    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-591d7c-29817855-n7t8q" event={"ID":"72304d70-7b28-4db4-80a9-5bc27f4ec670","Type":"ContainerDied","Data":"b96c6360f5497e0592a905ada28be7c5f2f7a0235f14ba955c77ab2878629473"}
Sep 10 20:15:02.131814 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:02.131795    2561 generic.go:356] "Generic (PLEG): container finished" podID="2fd8f68f-3279-4507-a7c3-d9fda338ab45" containerID="ec1c86f03d383e3683947b4b4eb85853272f7f63d980ed696baf47ba2dd45e6a" exitCode=0
Sep 10 20:15:02.131907 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:02.131861    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e88b3e4f-29817855-7jw45" event={"ID":"2fd8f68f-3279-4507-a7c3-d9fda338ab45","Type":"ContainerDied","Data":"ec1c86f03d383e3683947b4b4eb85853272f7f63d980ed696baf47ba2dd45e6a"}
Sep 10 20:15:02.133439 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:02.133419    2561 generic.go:356] "Generic (PLEG): container finished" podID="c1325ac9-a30d-44b8-a0c5-7279d92ec415" containerID="768f4015d0b3dc9e1ded88f0f0fc2dda44221af9f53685805e41b0c176ffb612" exitCode=0
Sep 10 20:15:02.133533 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:02.133487    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6ef723-29817855-4t42w" event={"ID":"c1325ac9-a30d-44b8-a0c5-7279d92ec415","Type":"ContainerDied","Data":"768f4015d0b3dc9e1ded88f0f0fc2dda44221af9f53685805e41b0c176ffb612"}
Sep 10 20:15:02.709582 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:02.709552    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:15:03.694615 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:03.694589    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6ef723-29817855-4t42w"
Sep 10 20:15:03.804527 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:03.804498    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e88b3e4f-29817855-7jw45"
Sep 10 20:15:04.145502 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:04.145481    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6ef723-29817855-4t42w"
Sep 10 20:15:04.145614 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:04.145509    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6ef723-29817855-4t42w" event={"ID":"c1325ac9-a30d-44b8-a0c5-7279d92ec415","Type":"ContainerDied","Data":"9c1d437ac7d4b26e618b56b798a2d710f064ba0f3c668d5131a254a36ce2dc53"}
Sep 10 20:15:04.145614 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:04.145554    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c1d437ac7d4b26e618b56b798a2d710f064ba0f3c668d5131a254a36ce2dc53"
Sep 10 20:15:04.146163 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:04.146145    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-591d7c-29817855-n7t8q"
Sep 10 20:15:04.147136 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:04.147113    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-6550b4-29817855-crxkg" event={"ID":"55786e1b-9d92-47e4-9bdd-8af4427948b7","Type":"ContainerDied","Data":"a5379988b2acccf87dcbf9d5784cc73020b34cd759440fd1b9518eeeedff5f11"}
Sep 10 20:15:04.147247 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:04.147157    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5379988b2acccf87dcbf9d5784cc73020b34cd759440fd1b9518eeeedff5f11"
Sep 10 20:15:04.148451 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:04.148436    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-591d7c-29817855-n7t8q"
Sep 10 20:15:04.148561 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:04.148436    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-591d7c-29817855-n7t8q" event={"ID":"72304d70-7b28-4db4-80a9-5bc27f4ec670","Type":"ContainerDied","Data":"e5cc7e1ed5bd1237120695ffdaf1c923fa5c24b0da554f5cfd7cf929c3027e7f"}
Sep 10 20:15:04.148561 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:04.148539    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5cc7e1ed5bd1237120695ffdaf1c923fa5c24b0da554f5cfd7cf929c3027e7f"
Sep 10 20:15:04.148789 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:04.148768    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-6550b4-29817855-crxkg"
Sep 10 20:15:04.149812 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:04.149792    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e88b3e4f-29817855-7jw45" event={"ID":"2fd8f68f-3279-4507-a7c3-d9fda338ab45","Type":"ContainerDied","Data":"76eb651fa7349a60c4cf9919f2e8495ad3d4f97c537391c5da59de2302bb8482"}
Sep 10 20:15:04.149905 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:04.149833    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76eb651fa7349a60c4cf9919f2e8495ad3d4f97c537391c5da59de2302bb8482"
Sep 10 20:15:04.149905 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:04.149838    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e88b3e4f-29817855-7jw45"
Sep 10 20:15:05.155462 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:05.155432    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-6550b4-29817855-crxkg"
Sep 10 20:15:15.032720 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:15.032680    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e88b3e4f-29817855-7jw45"]
Sep 10 20:15:15.044584 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:15.044553    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e88b3e4f-29817855-7jw45"]
Sep 10 20:15:15.059838 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:15.059808    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv"]
Sep 10 20:15:15.060083 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:15.060058    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv" podUID="6e02c595-5deb-4b0c-911c-ad0aa5166c26" containerName="payload-processing" containerID="cri-o://5ada2ced43fcbfbebd9271ca5ba6a9589975c809d318359eb70ade0077645ef7" gracePeriod=30
Sep 10 20:15:15.069441 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:15.069413    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft"]
Sep 10 20:15:15.069865 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:15.069810    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft" podUID="b06cd4fe-ed85-4a65-a53d-68ba468507ed" containerName="payload-pre-processing" containerID="cri-o://aebfebd56bf8c019018f21a78fec54474b362ebc40e39e0e10fbebdcd86096d2" gracePeriod=30
Sep 10 20:15:15.214325 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:15.214247    2561 generic.go:356] "Generic (PLEG): container finished" podID="6e02c595-5deb-4b0c-911c-ad0aa5166c26" containerID="5ada2ced43fcbfbebd9271ca5ba6a9589975c809d318359eb70ade0077645ef7" exitCode=0
Sep 10 20:15:15.214498 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:15.214328    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv" event={"ID":"6e02c595-5deb-4b0c-911c-ad0aa5166c26","Type":"ContainerDied","Data":"5ada2ced43fcbfbebd9271ca5ba6a9589975c809d318359eb70ade0077645ef7"}
Sep 10 20:15:15.216035 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:15.215959    2561 generic.go:356] "Generic (PLEG): container finished" podID="b06cd4fe-ed85-4a65-a53d-68ba468507ed" containerID="aebfebd56bf8c019018f21a78fec54474b362ebc40e39e0e10fbebdcd86096d2" exitCode=0
Sep 10 20:15:15.216035 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:15.215991    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft" event={"ID":"b06cd4fe-ed85-4a65-a53d-68ba468507ed","Type":"ContainerDied","Data":"aebfebd56bf8c019018f21a78fec54474b362ebc40e39e0e10fbebdcd86096d2"}
Sep 10 20:15:15.691254 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:15.691231    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv"
Sep 10 20:15:15.797554 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:15.797462    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmrsl\" (UniqueName: \"kubernetes.io/projected/6e02c595-5deb-4b0c-911c-ad0aa5166c26-kube-api-access-tmrsl\") pod \"6e02c595-5deb-4b0c-911c-ad0aa5166c26\" (UID: \"6e02c595-5deb-4b0c-911c-ad0aa5166c26\") "
Sep 10 20:15:15.797554 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:15.797512    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e02c595-5deb-4b0c-911c-ad0aa5166c26-plugins-config-volume\") pod \"6e02c595-5deb-4b0c-911c-ad0aa5166c26\" (UID: \"6e02c595-5deb-4b0c-911c-ad0aa5166c26\") "
Sep 10 20:15:15.797978 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:15.797948    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e02c595-5deb-4b0c-911c-ad0aa5166c26-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6e02c595-5deb-4b0c-911c-ad0aa5166c26" (UID: "6e02c595-5deb-4b0c-911c-ad0aa5166c26"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:15:15.799638 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:15.799606    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e02c595-5deb-4b0c-911c-ad0aa5166c26-kube-api-access-tmrsl" (OuterVolumeSpecName: "kube-api-access-tmrsl") pod "6e02c595-5deb-4b0c-911c-ad0aa5166c26" (UID: "6e02c595-5deb-4b0c-911c-ad0aa5166c26"). InnerVolumeSpecName "kube-api-access-tmrsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:15:15.899282 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:15.899244    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmrsl\" (UniqueName: \"kubernetes.io/projected/6e02c595-5deb-4b0c-911c-ad0aa5166c26-kube-api-access-tmrsl\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:15:15.899282 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:15.899281    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e02c595-5deb-4b0c-911c-ad0aa5166c26-plugins-config-volume\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:15:15.922095 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:15.922070    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft"
Sep 10 20:15:15.999771 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:15.999736    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b06cd4fe-ed85-4a65-a53d-68ba468507ed-plugins-config-volume\") pod \"b06cd4fe-ed85-4a65-a53d-68ba468507ed\" (UID: \"b06cd4fe-ed85-4a65-a53d-68ba468507ed\") "
Sep 10 20:15:15.999943 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:15.999781    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptqgd\" (UniqueName: \"kubernetes.io/projected/b06cd4fe-ed85-4a65-a53d-68ba468507ed-kube-api-access-ptqgd\") pod \"b06cd4fe-ed85-4a65-a53d-68ba468507ed\" (UID: \"b06cd4fe-ed85-4a65-a53d-68ba468507ed\") "
Sep 10 20:15:16.000176 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:16.000150    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b06cd4fe-ed85-4a65-a53d-68ba468507ed-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b06cd4fe-ed85-4a65-a53d-68ba468507ed" (UID: "b06cd4fe-ed85-4a65-a53d-68ba468507ed"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:15:16.001887 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:16.001863    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b06cd4fe-ed85-4a65-a53d-68ba468507ed-kube-api-access-ptqgd" (OuterVolumeSpecName: "kube-api-access-ptqgd") pod "b06cd4fe-ed85-4a65-a53d-68ba468507ed" (UID: "b06cd4fe-ed85-4a65-a53d-68ba468507ed"). InnerVolumeSpecName "kube-api-access-ptqgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:15:16.101070 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:16.101045    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b06cd4fe-ed85-4a65-a53d-68ba468507ed-plugins-config-volume\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:15:16.101070 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:16.101069    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptqgd\" (UniqueName: \"kubernetes.io/projected/b06cd4fe-ed85-4a65-a53d-68ba468507ed-kube-api-access-ptqgd\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:15:16.222890 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:16.222850    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv" event={"ID":"6e02c595-5deb-4b0c-911c-ad0aa5166c26","Type":"ContainerDied","Data":"d3e1124691fc2c2d98234a6f007f84f4ae5bdf1e25c86a25cf89ae2c4491f6fb"}
Sep 10 20:15:16.223069 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:16.222924    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv"
Sep 10 20:15:16.223069 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:16.222929    2561 scope.go:117] "RemoveContainer" containerID="5ada2ced43fcbfbebd9271ca5ba6a9589975c809d318359eb70ade0077645ef7"
Sep 10 20:15:16.224305 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:16.224148    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft"
Sep 10 20:15:16.224305 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:16.224156    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft" event={"ID":"b06cd4fe-ed85-4a65-a53d-68ba468507ed","Type":"ContainerDied","Data":"cab72a8bf8d684240beca58754a0f2ad2793650a3d1bd80a3416055af94d4737"}
Sep 10 20:15:16.234036 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:16.233976    2561 scope.go:117] "RemoveContainer" containerID="aebfebd56bf8c019018f21a78fec54474b362ebc40e39e0e10fbebdcd86096d2"
Sep 10 20:15:16.247941 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:16.247884    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv"]
Sep 10 20:15:16.250198 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:16.250178    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e88b3e4f-77ff444c7-4v9hv"]
Sep 10 20:15:16.263080 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:16.263057    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft"]
Sep 10 20:15:16.268568 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:16.268546    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e88b3e4f-57b8f8864b-56fft"]
Sep 10 20:15:16.849863 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:16.849832    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fd8f68f-3279-4507-a7c3-d9fda338ab45" path="/var/lib/kubelet/pods/2fd8f68f-3279-4507-a7c3-d9fda338ab45/volumes"
Sep 10 20:15:16.850164 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:16.850151    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e02c595-5deb-4b0c-911c-ad0aa5166c26" path="/var/lib/kubelet/pods/6e02c595-5deb-4b0c-911c-ad0aa5166c26/volumes"
Sep 10 20:15:16.850505 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:16.850492    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b06cd4fe-ed85-4a65-a53d-68ba468507ed" path="/var/lib/kubelet/pods/b06cd4fe-ed85-4a65-a53d-68ba468507ed/volumes"
Sep 10 20:15:17.010270 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:17.010238    2561 scope.go:117] "RemoveContainer" containerID="e39fc700b44726b01b2de0ee64423f7af47a507120ae50f0ef5af0e668fa38cb"
Sep 10 20:15:17.018670 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:17.018650    2561 scope.go:117] "RemoveContainer" containerID="10574534d0d8427bf55fc8d8e9fb2ea147b9d4bdaaec21d9930960fade0ccbae"
Sep 10 20:15:19.598815 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:19.598774    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:15:35.200729 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:35.200693    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:15:45.990485 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:15:45.990453    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:16:03.602355 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:03.602321    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:16:20.002578 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:20.002543    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:16:44.596218 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:44.596146    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:16:49.840848 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.840814    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q"]
Sep 10 20:16:49.841214 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.841196    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd8f68f-3279-4507-a7c3-d9fda338ab45" containerName="cleanup"
Sep 10 20:16:49.841214 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.841209    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd8f68f-3279-4507-a7c3-d9fda338ab45" containerName="cleanup"
Sep 10 20:16:49.841292 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.841227    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72304d70-7b28-4db4-80a9-5bc27f4ec670" containerName="cleanup"
Sep 10 20:16:49.841292 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.841233    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="72304d70-7b28-4db4-80a9-5bc27f4ec670" containerName="cleanup"
Sep 10 20:16:49.841292 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.841239    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e02c595-5deb-4b0c-911c-ad0aa5166c26" containerName="payload-processing"
Sep 10 20:16:49.841292 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.841244    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e02c595-5deb-4b0c-911c-ad0aa5166c26" containerName="payload-processing"
Sep 10 20:16:49.841292 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.841250    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55786e1b-9d92-47e4-9bdd-8af4427948b7" containerName="cleanup"
Sep 10 20:16:49.841292 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.841255    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="55786e1b-9d92-47e4-9bdd-8af4427948b7" containerName="cleanup"
Sep 10 20:16:49.841292 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.841265    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b06cd4fe-ed85-4a65-a53d-68ba468507ed" containerName="payload-pre-processing"
Sep 10 20:16:49.841292 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.841271    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b06cd4fe-ed85-4a65-a53d-68ba468507ed" containerName="payload-pre-processing"
Sep 10 20:16:49.841292 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.841277    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1325ac9-a30d-44b8-a0c5-7279d92ec415" containerName="cleanup"
Sep 10 20:16:49.841292 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.841282    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1325ac9-a30d-44b8-a0c5-7279d92ec415" containerName="cleanup"
Sep 10 20:16:49.841627 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.841341    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b06cd4fe-ed85-4a65-a53d-68ba468507ed" containerName="payload-pre-processing"
Sep 10 20:16:49.841627 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.841349    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="72304d70-7b28-4db4-80a9-5bc27f4ec670" containerName="cleanup"
Sep 10 20:16:49.841627 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.841359    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1325ac9-a30d-44b8-a0c5-7279d92ec415" containerName="cleanup"
Sep 10 20:16:49.841627 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.841365    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fd8f68f-3279-4507-a7c3-d9fda338ab45" containerName="cleanup"
Sep 10 20:16:49.841627 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.841370    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e02c595-5deb-4b0c-911c-ad0aa5166c26" containerName="payload-processing"
Sep 10 20:16:49.841627 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.841375    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="55786e1b-9d92-47e4-9bdd-8af4427948b7" containerName="cleanup"
Sep 10 20:16:49.844360 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.844345    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q"
Sep 10 20:16:49.847251 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.847230    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-bd3eab-dockercfg-gb4fd\""
Sep 10 20:16:49.847636 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.847619    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-bd3eab\""
Sep 10 20:16:49.856849 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.856824    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q"]
Sep 10 20:16:49.863860 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.863840    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25cbd\" (UniqueName: \"kubernetes.io/projected/de6779b2-3841-4505-8286-7dae380923aa-kube-api-access-25cbd\") pod \"payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q\" (UID: \"de6779b2-3841-4505-8286-7dae380923aa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q"
Sep 10 20:16:49.863947 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.863884    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de6779b2-3841-4505-8286-7dae380923aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q\" (UID: \"de6779b2-3841-4505-8286-7dae380923aa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q"
Sep 10 20:16:49.964767 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.964734    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25cbd\" (UniqueName: \"kubernetes.io/projected/de6779b2-3841-4505-8286-7dae380923aa-kube-api-access-25cbd\") pod \"payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q\" (UID: \"de6779b2-3841-4505-8286-7dae380923aa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q"
Sep 10 20:16:49.964961 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.964787    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de6779b2-3841-4505-8286-7dae380923aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q\" (UID: \"de6779b2-3841-4505-8286-7dae380923aa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q"
Sep 10 20:16:49.965481 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.965461    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de6779b2-3841-4505-8286-7dae380923aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q\" (UID: \"de6779b2-3841-4505-8286-7dae380923aa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q"
Sep 10 20:16:49.973465 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:49.973443    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25cbd\" (UniqueName: \"kubernetes.io/projected/de6779b2-3841-4505-8286-7dae380923aa-kube-api-access-25cbd\") pod \"payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q\" (UID: \"de6779b2-3841-4505-8286-7dae380923aa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q"
Sep 10 20:16:50.155009 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:50.154939    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q"
Sep 10 20:16:50.431132 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:50.431105    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q"]
Sep 10 20:16:50.432884 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:16:50.432853    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde6779b2_3841_4505_8286_7dae380923aa.slice/crio-7a3d7348623e04d62be00666b58e60b3e9ad09914121797dd8212c909f8adf2f WatchSource:0}: Error finding container 7a3d7348623e04d62be00666b58e60b3e9ad09914121797dd8212c909f8adf2f: Status 404 returned error can't find the container with id 7a3d7348623e04d62be00666b58e60b3e9ad09914121797dd8212c909f8adf2f
Sep 10 20:16:50.753857 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:50.753773    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q" event={"ID":"de6779b2-3841-4505-8286-7dae380923aa","Type":"ContainerStarted","Data":"8ee6a4a28c811116b4ec67a11bcf14c323d7c29158145cf66817557c8409c009"}
Sep 10 20:16:50.753857 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:50.753835    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q" event={"ID":"de6779b2-3841-4505-8286-7dae380923aa","Type":"ContainerStarted","Data":"7a3d7348623e04d62be00666b58e60b3e9ad09914121797dd8212c909f8adf2f"}
Sep 10 20:16:50.754043 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:50.753874    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q"
Sep 10 20:16:50.773518 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:16:50.773473    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q" podStartSLOduration=1.7734582319999999 podStartE2EDuration="1.773458232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:16:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:16:50.771445785 +0000 UTC m=+1354.436550059" watchObservedRunningTime="2026-09-10 20:16:50.773458232 +0000 UTC m=+1354.438562514"
Sep 10 20:17:01.761587 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:01.761553    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q"
Sep 10 20:17:09.206793 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:09.206759    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:17:13.940593 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:13.940560    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"]
Sep 10 20:17:13.944453 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:13.944427    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:13.947495 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:13.947471    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-84c19e-openshift-default-dockercfg-h5q64\""
Sep 10 20:17:13.969707 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:13.969674    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"]
Sep 10 20:17:14.100339 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.100303    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-token\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.100535 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.100377    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-credential-socket\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.100535 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.100441    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-workload-socket\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.100535 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.100480    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-workload-certs\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.100535 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.100506    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istiod-ca-cert\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.100748 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.100542    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-envoy\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.100748 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.100572    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-data\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.100748 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.100603    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnxj9\" (UniqueName: \"kubernetes.io/projected/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-kube-api-access-tnxj9\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.100748 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.100666    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-podinfo\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.201805 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.201723    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-workload-certs\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.201805 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.201759    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istiod-ca-cert\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.201805 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.201784    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-envoy\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.201805 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.201804    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-data\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.202103 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.201828    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnxj9\" (UniqueName: \"kubernetes.io/projected/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-kube-api-access-tnxj9\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.202103 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.201866    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-podinfo\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.202103 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.201919    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-token\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.202103 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.201963    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-credential-socket\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.202103 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.201992    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-workload-socket\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.202348 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.202326    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-workload-certs\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.202480 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.202454    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-data\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.202607 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.202506    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-workload-socket\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.202607 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.202542    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-credential-socket\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.202704 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.202650    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istiod-ca-cert\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.204297 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.204271    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-envoy\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.204495 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.204476    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-podinfo\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.213568 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.213546    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnxj9\" (UniqueName: \"kubernetes.io/projected/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-kube-api-access-tnxj9\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.213655 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.213580    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-token\") pod \"e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") " pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.262698 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.262673    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:14.541370 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.541346    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"]
Sep 10 20:17:14.542887 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:17:14.542859    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f7f6c7_7a6a_42b7_8dc3_eed1beffc86e.slice/crio-198cac79c614a68a3e6b14a87b3d1870c6fc6895cf67ba3cc1558d01f94fbe1d WatchSource:0}: Error finding container 198cac79c614a68a3e6b14a87b3d1870c6fc6895cf67ba3cc1558d01f94fbe1d: Status 404 returned error can't find the container with id 198cac79c614a68a3e6b14a87b3d1870c6fc6895cf67ba3cc1558d01f94fbe1d
Sep 10 20:17:14.545108 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.545072    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:17:14.545204 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.545149    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:17:14.545204 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.545189    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:17:14.888319 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.888289    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5" event={"ID":"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e","Type":"ContainerStarted","Data":"de203ac72cba22127eadf1728f04a67bc0e25646d3e4e57e0fec25c3ba5a9d83"}
Sep 10 20:17:14.888526 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.888338    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5" event={"ID":"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e","Type":"ContainerStarted","Data":"198cac79c614a68a3e6b14a87b3d1870c6fc6895cf67ba3cc1558d01f94fbe1d"}
Sep 10 20:17:14.909911 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:14.909864    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5" podStartSLOduration=1.909846195 podStartE2EDuration="1.909846195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:17:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:17:14.907600296 +0000 UTC m=+1378.572704541" watchObservedRunningTime="2026-09-10 20:17:14.909846195 +0000 UTC m=+1378.574950441"
Sep 10 20:17:15.263258 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:15.263185    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:15.264626 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:15.264601    2561 patch_prober.go:28] interesting pod/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 20:17:15.264745 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:15.264659    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5" podUID="79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 20:17:16.266912 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:16.266876    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:16.903684 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:16.903570    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:16.909816 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:16.906759    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:17.061450 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:17.061420    2561 scope.go:117] "RemoveContainer" containerID="3e2cf1f20ef2d0d7e89d600904616c42a81023148ae0659489ea0d7c41a8e767"
Sep 10 20:17:17.070526 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:17.070508    2561 scope.go:117] "RemoveContainer" containerID="4fe4f9f4e2902bc9472679f1520ef8717e9e33d04cb65053f6fbeab3aa991dfd"
Sep 10 20:17:17.078042 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:17.078025    2561 scope.go:117] "RemoveContainer" containerID="577974dfb748132fd8dcd04dfbdcd9ad7927464d72718ae9d495c155293cafcb"
Sep 10 20:17:18.573773 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:18.573737    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s"]
Sep 10 20:17:18.578628 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:18.578606    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s"
Sep 10 20:17:18.581544 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:18.581521    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-84c19e\""
Sep 10 20:17:18.581662 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:18.581565    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-84c19e-dockercfg-qtzkk\""
Sep 10 20:17:18.593279 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:18.593251    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s"]
Sep 10 20:17:18.615035 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:18.615012    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745"]
Sep 10 20:17:18.618371 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:18.618353    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745"
Sep 10 20:17:18.627624 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:18.627603    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745"]
Sep 10 20:17:18.745145 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:18.745114    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45t5x\" (UniqueName: \"kubernetes.io/projected/89e79862-1081-4ded-acd2-8b88954b94bc-kube-api-access-45t5x\") pod \"payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s\" (UID: \"89e79862-1081-4ded-acd2-8b88954b94bc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s"
Sep 10 20:17:18.745317 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:18.745157    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89e79862-1081-4ded-acd2-8b88954b94bc-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s\" (UID: \"89e79862-1081-4ded-acd2-8b88954b94bc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s"
Sep 10 20:17:18.745317 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:18.745183    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dz62\" (UniqueName: \"kubernetes.io/projected/7364d736-2b9a-447b-9a78-d0a5ce375c89-kube-api-access-5dz62\") pod \"payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745\" (UID: \"7364d736-2b9a-447b-9a78-d0a5ce375c89\") " pod="openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745"
Sep 10 20:17:18.745317 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:18.745287    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7364d736-2b9a-447b-9a78-d0a5ce375c89-plugins-config-volume\") pod \"payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745\" (UID: \"7364d736-2b9a-447b-9a78-d0a5ce375c89\") " pod="openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745"
Sep 10 20:17:18.845933 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:18.845837    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45t5x\" (UniqueName: \"kubernetes.io/projected/89e79862-1081-4ded-acd2-8b88954b94bc-kube-api-access-45t5x\") pod \"payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s\" (UID: \"89e79862-1081-4ded-acd2-8b88954b94bc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s"
Sep 10 20:17:18.845933 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:18.845893    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89e79862-1081-4ded-acd2-8b88954b94bc-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s\" (UID: \"89e79862-1081-4ded-acd2-8b88954b94bc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s"
Sep 10 20:17:18.845933 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:18.845916    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dz62\" (UniqueName: \"kubernetes.io/projected/7364d736-2b9a-447b-9a78-d0a5ce375c89-kube-api-access-5dz62\") pod \"payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745\" (UID: \"7364d736-2b9a-447b-9a78-d0a5ce375c89\") " pod="openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745"
Sep 10 20:17:18.846206 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:18.845945    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7364d736-2b9a-447b-9a78-d0a5ce375c89-plugins-config-volume\") pod \"payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745\" (UID: \"7364d736-2b9a-447b-9a78-d0a5ce375c89\") " pod="openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745"
Sep 10 20:17:18.846729 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:18.846707    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89e79862-1081-4ded-acd2-8b88954b94bc-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s\" (UID: \"89e79862-1081-4ded-acd2-8b88954b94bc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s"
Sep 10 20:17:18.846830 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:18.846713    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7364d736-2b9a-447b-9a78-d0a5ce375c89-plugins-config-volume\") pod \"payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745\" (UID: \"7364d736-2b9a-447b-9a78-d0a5ce375c89\") " pod="openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745"
Sep 10 20:17:18.854922 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:18.854901    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dz62\" (UniqueName: \"kubernetes.io/projected/7364d736-2b9a-447b-9a78-d0a5ce375c89-kube-api-access-5dz62\") pod \"payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745\" (UID: \"7364d736-2b9a-447b-9a78-d0a5ce375c89\") " pod="openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745"
Sep 10 20:17:18.855599 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:18.855582    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45t5x\" (UniqueName: \"kubernetes.io/projected/89e79862-1081-4ded-acd2-8b88954b94bc-kube-api-access-45t5x\") pod \"payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s\" (UID: \"89e79862-1081-4ded-acd2-8b88954b94bc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s"
Sep 10 20:17:18.889550 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:18.889524    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s"
Sep 10 20:17:18.929305 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:18.929276    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745"
Sep 10 20:17:19.164800 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:19.164768    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s"]
Sep 10 20:17:19.166660 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:17:19.166630    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89e79862_1081_4ded_acd2_8b88954b94bc.slice/crio-d9f919ce61ef1a8de96df3fe8ac7f3e6bfd0bc87a1f877444a2b2c99b9d5949b WatchSource:0}: Error finding container d9f919ce61ef1a8de96df3fe8ac7f3e6bfd0bc87a1f877444a2b2c99b9d5949b: Status 404 returned error can't find the container with id d9f919ce61ef1a8de96df3fe8ac7f3e6bfd0bc87a1f877444a2b2c99b9d5949b
Sep 10 20:17:19.412999 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:19.412974    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745"]
Sep 10 20:17:19.413624 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:17:19.413601    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7364d736_2b9a_447b_9a78_d0a5ce375c89.slice/crio-1e68a6a75121ec7d9b55f65940686fe25815bb6faff2079d4eebb0e8aa36ac06 WatchSource:0}: Error finding container 1e68a6a75121ec7d9b55f65940686fe25815bb6faff2079d4eebb0e8aa36ac06: Status 404 returned error can't find the container with id 1e68a6a75121ec7d9b55f65940686fe25815bb6faff2079d4eebb0e8aa36ac06
Sep 10 20:17:19.922758 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:19.922727    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745" event={"ID":"7364d736-2b9a-447b-9a78-d0a5ce375c89","Type":"ContainerStarted","Data":"4f4cb4a1a2582b2d10d7db3f1a96289270c3e08b822a84ab86c23a86deb5294e"}
Sep 10 20:17:19.923197 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:19.922781    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745" event={"ID":"7364d736-2b9a-447b-9a78-d0a5ce375c89","Type":"ContainerStarted","Data":"1e68a6a75121ec7d9b55f65940686fe25815bb6faff2079d4eebb0e8aa36ac06"}
Sep 10 20:17:19.923197 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:19.922826    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745"
Sep 10 20:17:19.924489 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:19.924465    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s" event={"ID":"89e79862-1081-4ded-acd2-8b88954b94bc","Type":"ContainerStarted","Data":"7549ff814d423b104cfd0af2eba9e9e1d703e37683fad2061d64219b308970fc"}
Sep 10 20:17:19.924630 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:19.924506    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s" event={"ID":"89e79862-1081-4ded-acd2-8b88954b94bc","Type":"ContainerStarted","Data":"d9f919ce61ef1a8de96df3fe8ac7f3e6bfd0bc87a1f877444a2b2c99b9d5949b"}
Sep 10 20:17:19.924630 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:19.924533    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s"
Sep 10 20:17:19.939553 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:19.939512    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745" podStartSLOduration=1.9394984709999998 podStartE2EDuration="1.939498471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:17:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:17:19.938505838 +0000 UTC m=+1383.603610085" watchObservedRunningTime="2026-09-10 20:17:19.939498471 +0000 UTC m=+1383.604602717"
Sep 10 20:17:19.955325 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:19.955281    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s" podStartSLOduration=1.9552689989999998 podStartE2EDuration="1.955268999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:17:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:17:19.954252401 +0000 UTC m=+1383.619356648" watchObservedRunningTime="2026-09-10 20:17:19.955268999 +0000 UTC m=+1383.620373244"
Sep 10 20:17:25.701797 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:25.701761    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:17:30.939354 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:30.939320    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s"
Sep 10 20:17:30.939883 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:30.939424    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745"
Sep 10 20:17:36.039216 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:36.039124    2561 generic.go:356] "Generic (PLEG): container finished" podID="79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" containerID="de203ac72cba22127eadf1728f04a67bc0e25646d3e4e57e0fec25c3ba5a9d83" exitCode=0
Sep 10 20:17:36.039216 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:36.039191    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5" event={"ID":"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e","Type":"ContainerDied","Data":"de203ac72cba22127eadf1728f04a67bc0e25646d3e4e57e0fec25c3ba5a9d83"}
Sep 10 20:17:36.039656 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:36.039600    2561 scope.go:117] "RemoveContainer" containerID="de203ac72cba22127eadf1728f04a67bc0e25646d3e4e57e0fec25c3ba5a9d83"
Sep 10 20:17:36.040763 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:36.040733    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:17:36.040868 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:36.040820    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:17:36.040868 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:36.040861    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 20:17:37.046160 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:37.046128    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5" event={"ID":"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e","Type":"ContainerStarted","Data":"4e34f6c539a27df0d160905f4b1a484c51250b03a8d1275a43bea733b5b16d12"}
Sep 10 20:17:37.263313 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:37.263284    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:37.263506 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:37.263449    2561 patch_prober.go:28] interesting pod/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 20:17:37.263579 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:37.263504    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5" podUID="79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 20:17:38.263221 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:38.263182    2561 patch_prober.go:28] interesting pod/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 20:17:38.263643 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:38.263280    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5" podUID="79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 20:17:38.495775 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:38.495741    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:17:39.263175 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:39.263134    2561 patch_prober.go:28] interesting pod/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 20:17:39.263348 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:39.263196    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5" podUID="79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 20:17:40.263636 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:40.263604    2561 patch_prober.go:28] interesting pod/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 20:17:40.263998 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:40.263657    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5" podUID="79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 20:17:41.263946 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:41.263910    2561 patch_prober.go:28] interesting pod/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 20:17:41.264437 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:41.263975    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5" podUID="79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 20:17:42.266809 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:42.266778    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:42.267253 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:42.267150    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:42.267786 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:42.267769    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:17:55.504251 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:17:55.504218    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:18:00.402298 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:00.402263    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q"]
Sep 10 20:18:00.402873 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:00.402526    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q" podUID="de6779b2-3841-4505-8286-7dae380923aa" containerName="payload-pre-processing" containerID="cri-o://8ee6a4a28c811116b4ec67a11bcf14c323d7c29158145cf66817557c8409c009" gracePeriod=30
Sep 10 20:18:01.001314 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:01.001290    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q"
Sep 10 20:18:01.060169 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:01.060133    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25cbd\" (UniqueName: \"kubernetes.io/projected/de6779b2-3841-4505-8286-7dae380923aa-kube-api-access-25cbd\") pod \"de6779b2-3841-4505-8286-7dae380923aa\" (UID: \"de6779b2-3841-4505-8286-7dae380923aa\") "
Sep 10 20:18:01.060331 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:01.060320    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de6779b2-3841-4505-8286-7dae380923aa-plugins-config-volume\") pod \"de6779b2-3841-4505-8286-7dae380923aa\" (UID: \"de6779b2-3841-4505-8286-7dae380923aa\") "
Sep 10 20:18:01.060682 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:01.060649    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de6779b2-3841-4505-8286-7dae380923aa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "de6779b2-3841-4505-8286-7dae380923aa" (UID: "de6779b2-3841-4505-8286-7dae380923aa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:18:01.062964 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:01.062938    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de6779b2-3841-4505-8286-7dae380923aa-kube-api-access-25cbd" (OuterVolumeSpecName: "kube-api-access-25cbd") pod "de6779b2-3841-4505-8286-7dae380923aa" (UID: "de6779b2-3841-4505-8286-7dae380923aa"). InnerVolumeSpecName "kube-api-access-25cbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:18:01.161689 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:01.161652    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25cbd\" (UniqueName: \"kubernetes.io/projected/de6779b2-3841-4505-8286-7dae380923aa-kube-api-access-25cbd\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:01.161848 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:01.161685    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de6779b2-3841-4505-8286-7dae380923aa-plugins-config-volume\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:01.176678 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:01.174427    2561 generic.go:356] "Generic (PLEG): container finished" podID="de6779b2-3841-4505-8286-7dae380923aa" containerID="8ee6a4a28c811116b4ec67a11bcf14c323d7c29158145cf66817557c8409c009" exitCode=0
Sep 10 20:18:01.176678 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:01.174472    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q" event={"ID":"de6779b2-3841-4505-8286-7dae380923aa","Type":"ContainerDied","Data":"8ee6a4a28c811116b4ec67a11bcf14c323d7c29158145cf66817557c8409c009"}
Sep 10 20:18:01.176678 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:01.174537    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q" event={"ID":"de6779b2-3841-4505-8286-7dae380923aa","Type":"ContainerDied","Data":"7a3d7348623e04d62be00666b58e60b3e9ad09914121797dd8212c909f8adf2f"}
Sep 10 20:18:01.176678 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:01.174581    2561 scope.go:117] "RemoveContainer" containerID="8ee6a4a28c811116b4ec67a11bcf14c323d7c29158145cf66817557c8409c009"
Sep 10 20:18:01.176678 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:01.174765    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q"
Sep 10 20:18:01.202627 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:01.202606    2561 scope.go:117] "RemoveContainer" containerID="8ee6a4a28c811116b4ec67a11bcf14c323d7c29158145cf66817557c8409c009"
Sep 10 20:18:01.202926 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:18:01.202904    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ee6a4a28c811116b4ec67a11bcf14c323d7c29158145cf66817557c8409c009\": container with ID starting with 8ee6a4a28c811116b4ec67a11bcf14c323d7c29158145cf66817557c8409c009 not found: ID does not exist" containerID="8ee6a4a28c811116b4ec67a11bcf14c323d7c29158145cf66817557c8409c009"
Sep 10 20:18:01.203019 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:01.202937    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ee6a4a28c811116b4ec67a11bcf14c323d7c29158145cf66817557c8409c009"} err="failed to get container status \"8ee6a4a28c811116b4ec67a11bcf14c323d7c29158145cf66817557c8409c009\": rpc error: code = NotFound desc = could not find container \"8ee6a4a28c811116b4ec67a11bcf14c323d7c29158145cf66817557c8409c009\": container with ID starting with 8ee6a4a28c811116b4ec67a11bcf14c323d7c29158145cf66817557c8409c009 not found: ID does not exist"
Sep 10 20:18:01.212165 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:01.212144    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q"]
Sep 10 20:18:01.218026 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:01.217998    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bd3eab-5f987bbbf8-vb48q"]
Sep 10 20:18:02.850367 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:02.850336    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de6779b2-3841-4505-8286-7dae380923aa" path="/var/lib/kubelet/pods/de6779b2-3841-4505-8286-7dae380923aa/volumes"
Sep 10 20:18:14.590469 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:14.590433    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:18:17.107866 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:17.107832    2561 scope.go:117] "RemoveContainer" containerID="fdf8fe011fcb3198e2e01b82879d1d151d8aec6410d35d93d18711f60b92006e"
Sep 10 20:18:23.197369 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:23.197325    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745"]
Sep 10 20:18:23.198035 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:23.197639    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745" podUID="7364d736-2b9a-447b-9a78-d0a5ce375c89" containerName="payload-processing" containerID="cri-o://4f4cb4a1a2582b2d10d7db3f1a96289270c3e08b822a84ab86c23a86deb5294e" gracePeriod=30
Sep 10 20:18:23.204246 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:23.204216    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s"]
Sep 10 20:18:23.204522 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:23.204476    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s" podUID="89e79862-1081-4ded-acd2-8b88954b94bc" containerName="payload-pre-processing" containerID="cri-o://7549ff814d423b104cfd0af2eba9e9e1d703e37683fad2061d64219b308970fc" gracePeriod=30
Sep 10 20:18:23.855944 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:23.855917    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745"
Sep 10 20:18:23.982766 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:23.982665    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dz62\" (UniqueName: \"kubernetes.io/projected/7364d736-2b9a-447b-9a78-d0a5ce375c89-kube-api-access-5dz62\") pod \"7364d736-2b9a-447b-9a78-d0a5ce375c89\" (UID: \"7364d736-2b9a-447b-9a78-d0a5ce375c89\") "
Sep 10 20:18:23.982766 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:23.982714    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7364d736-2b9a-447b-9a78-d0a5ce375c89-plugins-config-volume\") pod \"7364d736-2b9a-447b-9a78-d0a5ce375c89\" (UID: \"7364d736-2b9a-447b-9a78-d0a5ce375c89\") "
Sep 10 20:18:23.983139 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:23.983117    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7364d736-2b9a-447b-9a78-d0a5ce375c89-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7364d736-2b9a-447b-9a78-d0a5ce375c89" (UID: "7364d736-2b9a-447b-9a78-d0a5ce375c89"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:18:23.984753 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:23.984723    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7364d736-2b9a-447b-9a78-d0a5ce375c89-kube-api-access-5dz62" (OuterVolumeSpecName: "kube-api-access-5dz62") pod "7364d736-2b9a-447b-9a78-d0a5ce375c89" (UID: "7364d736-2b9a-447b-9a78-d0a5ce375c89"). InnerVolumeSpecName "kube-api-access-5dz62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:18:24.052562 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.052537    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s"
Sep 10 20:18:24.084602 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.084571    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dz62\" (UniqueName: \"kubernetes.io/projected/7364d736-2b9a-447b-9a78-d0a5ce375c89-kube-api-access-5dz62\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:24.084602 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.084598    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7364d736-2b9a-447b-9a78-d0a5ce375c89-plugins-config-volume\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:24.185450 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.185410    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45t5x\" (UniqueName: \"kubernetes.io/projected/89e79862-1081-4ded-acd2-8b88954b94bc-kube-api-access-45t5x\") pod \"89e79862-1081-4ded-acd2-8b88954b94bc\" (UID: \"89e79862-1081-4ded-acd2-8b88954b94bc\") "
Sep 10 20:18:24.185612 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.185467    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89e79862-1081-4ded-acd2-8b88954b94bc-plugins-config-volume\") pod \"89e79862-1081-4ded-acd2-8b88954b94bc\" (UID: \"89e79862-1081-4ded-acd2-8b88954b94bc\") "
Sep 10 20:18:24.185885 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.185859    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89e79862-1081-4ded-acd2-8b88954b94bc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "89e79862-1081-4ded-acd2-8b88954b94bc" (UID: "89e79862-1081-4ded-acd2-8b88954b94bc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:18:24.187363 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.187342    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89e79862-1081-4ded-acd2-8b88954b94bc-kube-api-access-45t5x" (OuterVolumeSpecName: "kube-api-access-45t5x") pod "89e79862-1081-4ded-acd2-8b88954b94bc" (UID: "89e79862-1081-4ded-acd2-8b88954b94bc"). InnerVolumeSpecName "kube-api-access-45t5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:18:24.286965 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.286881    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89e79862-1081-4ded-acd2-8b88954b94bc-plugins-config-volume\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:24.286965 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.286913    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45t5x\" (UniqueName: \"kubernetes.io/projected/89e79862-1081-4ded-acd2-8b88954b94bc-kube-api-access-45t5x\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:24.300557 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.300525    2561 generic.go:356] "Generic (PLEG): container finished" podID="7364d736-2b9a-447b-9a78-d0a5ce375c89" containerID="4f4cb4a1a2582b2d10d7db3f1a96289270c3e08b822a84ab86c23a86deb5294e" exitCode=0
Sep 10 20:18:24.300712 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.300570    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745"
Sep 10 20:18:24.300712 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.300615    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745" event={"ID":"7364d736-2b9a-447b-9a78-d0a5ce375c89","Type":"ContainerDied","Data":"4f4cb4a1a2582b2d10d7db3f1a96289270c3e08b822a84ab86c23a86deb5294e"}
Sep 10 20:18:24.300712 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.300675    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745" event={"ID":"7364d736-2b9a-447b-9a78-d0a5ce375c89","Type":"ContainerDied","Data":"1e68a6a75121ec7d9b55f65940686fe25815bb6faff2079d4eebb0e8aa36ac06"}
Sep 10 20:18:24.300712 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.300693    2561 scope.go:117] "RemoveContainer" containerID="4f4cb4a1a2582b2d10d7db3f1a96289270c3e08b822a84ab86c23a86deb5294e"
Sep 10 20:18:24.302024 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.302001    2561 generic.go:356] "Generic (PLEG): container finished" podID="89e79862-1081-4ded-acd2-8b88954b94bc" containerID="7549ff814d423b104cfd0af2eba9e9e1d703e37683fad2061d64219b308970fc" exitCode=0
Sep 10 20:18:24.302084 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.302048    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s"
Sep 10 20:18:24.302126 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.302082    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s" event={"ID":"89e79862-1081-4ded-acd2-8b88954b94bc","Type":"ContainerDied","Data":"7549ff814d423b104cfd0af2eba9e9e1d703e37683fad2061d64219b308970fc"}
Sep 10 20:18:24.302171 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.302138    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s" event={"ID":"89e79862-1081-4ded-acd2-8b88954b94bc","Type":"ContainerDied","Data":"d9f919ce61ef1a8de96df3fe8ac7f3e6bfd0bc87a1f877444a2b2c99b9d5949b"}
Sep 10 20:18:24.309875 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.309859    2561 scope.go:117] "RemoveContainer" containerID="4f4cb4a1a2582b2d10d7db3f1a96289270c3e08b822a84ab86c23a86deb5294e"
Sep 10 20:18:24.310136 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:18:24.310115    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f4cb4a1a2582b2d10d7db3f1a96289270c3e08b822a84ab86c23a86deb5294e\": container with ID starting with 4f4cb4a1a2582b2d10d7db3f1a96289270c3e08b822a84ab86c23a86deb5294e not found: ID does not exist" containerID="4f4cb4a1a2582b2d10d7db3f1a96289270c3e08b822a84ab86c23a86deb5294e"
Sep 10 20:18:24.310196 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.310147    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f4cb4a1a2582b2d10d7db3f1a96289270c3e08b822a84ab86c23a86deb5294e"} err="failed to get container status \"4f4cb4a1a2582b2d10d7db3f1a96289270c3e08b822a84ab86c23a86deb5294e\": rpc error: code = NotFound desc = could not find container \"4f4cb4a1a2582b2d10d7db3f1a96289270c3e08b822a84ab86c23a86deb5294e\": container with ID starting with 4f4cb4a1a2582b2d10d7db3f1a96289270c3e08b822a84ab86c23a86deb5294e not found: ID does not exist"
Sep 10 20:18:24.310196 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.310168    2561 scope.go:117] "RemoveContainer" containerID="7549ff814d423b104cfd0af2eba9e9e1d703e37683fad2061d64219b308970fc"
Sep 10 20:18:24.318130 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.318114    2561 scope.go:117] "RemoveContainer" containerID="7549ff814d423b104cfd0af2eba9e9e1d703e37683fad2061d64219b308970fc"
Sep 10 20:18:24.318380 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:18:24.318363    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7549ff814d423b104cfd0af2eba9e9e1d703e37683fad2061d64219b308970fc\": container with ID starting with 7549ff814d423b104cfd0af2eba9e9e1d703e37683fad2061d64219b308970fc not found: ID does not exist" containerID="7549ff814d423b104cfd0af2eba9e9e1d703e37683fad2061d64219b308970fc"
Sep 10 20:18:24.318493 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.318386    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7549ff814d423b104cfd0af2eba9e9e1d703e37683fad2061d64219b308970fc"} err="failed to get container status \"7549ff814d423b104cfd0af2eba9e9e1d703e37683fad2061d64219b308970fc\": rpc error: code = NotFound desc = could not find container \"7549ff814d423b104cfd0af2eba9e9e1d703e37683fad2061d64219b308970fc\": container with ID starting with 7549ff814d423b104cfd0af2eba9e9e1d703e37683fad2061d64219b308970fc not found: ID does not exist"
Sep 10 20:18:24.325544 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.325524    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s"]
Sep 10 20:18:24.331304 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.331284    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-84c19e-587dc869f4-9gf2s"]
Sep 10 20:18:24.340876 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.340855    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745"]
Sep 10 20:18:24.348329 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.348311    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-84c19e-5cdcd57fb5-48745"]
Sep 10 20:18:24.850590 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.850553    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7364d736-2b9a-447b-9a78-d0a5ce375c89" path="/var/lib/kubelet/pods/7364d736-2b9a-447b-9a78-d0a5ce375c89/volumes"
Sep 10 20:18:24.850997 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:24.850980    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89e79862-1081-4ded-acd2-8b88954b94bc" path="/var/lib/kubelet/pods/89e79862-1081-4ded-acd2-8b88954b94bc/volumes"
Sep 10 20:18:26.804052 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:26.804017    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:18:29.827123 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:29.827087    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"]
Sep 10 20:18:29.827570 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:29.827318    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5" podUID="79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" containerName="istio-proxy" containerID="cri-o://4e34f6c539a27df0d160905f4b1a484c51250b03a8d1275a43bea733b5b16d12" gracePeriod=30
Sep 10 20:18:35.363803 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.363776    2561 generic.go:356] "Generic (PLEG): container finished" podID="79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" containerID="4e34f6c539a27df0d160905f4b1a484c51250b03a8d1275a43bea733b5b16d12" exitCode=0
Sep 10 20:18:35.364112 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.363831    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5" event={"ID":"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e","Type":"ContainerDied","Data":"4e34f6c539a27df0d160905f4b1a484c51250b03a8d1275a43bea733b5b16d12"}
Sep 10 20:18:35.364112 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.363885    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5" event={"ID":"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e","Type":"ContainerDied","Data":"198cac79c614a68a3e6b14a87b3d1870c6fc6895cf67ba3cc1558d01f94fbe1d"}
Sep 10 20:18:35.364112 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.363901    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="198cac79c614a68a3e6b14a87b3d1870c6fc6895cf67ba3cc1558d01f94fbe1d"
Sep 10 20:18:35.364112 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.363914    2561 scope.go:117] "RemoveContainer" containerID="de203ac72cba22127eadf1728f04a67bc0e25646d3e4e57e0fec25c3ba5a9d83"
Sep 10 20:18:35.364712 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.364693    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:18:35.388322 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.388300    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-podinfo\") pod \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") "
Sep 10 20:18:35.388616 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.388344    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-data\") pod \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") "
Sep 10 20:18:35.388616 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.388366    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnxj9\" (UniqueName: \"kubernetes.io/projected/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-kube-api-access-tnxj9\") pod \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") "
Sep 10 20:18:35.388616 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.388433    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-credential-socket\") pod \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") "
Sep 10 20:18:35.388616 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.388468    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-workload-certs\") pod \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") "
Sep 10 20:18:35.388616 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.388500    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-workload-socket\") pod \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") "
Sep 10 20:18:35.388616 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.388522    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-envoy\") pod \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") "
Sep 10 20:18:35.388616 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.388557    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-token\") pod \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") "
Sep 10 20:18:35.388616 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.388589    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istiod-ca-cert\") pod \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\" (UID: \"79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e\") "
Sep 10 20:18:35.389123 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.388772    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" (UID: "79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:18:35.389123 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.388924    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-credential-socket\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:35.389242 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.389214    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" (UID: "79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:18:35.389505 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.389482    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-data" (OuterVolumeSpecName: "istio-data") pod "79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" (UID: "79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:18:35.389585 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.389503    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" (UID: "79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:18:35.389702 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.389680    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" (UID: "79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:18:35.391254 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.391215    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-token" (OuterVolumeSpecName: "istio-token") pod "79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" (UID: "79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:18:35.391652 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.391607    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-kube-api-access-tnxj9" (OuterVolumeSpecName: "kube-api-access-tnxj9") pod "79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" (UID: "79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e"). InnerVolumeSpecName "kube-api-access-tnxj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:18:35.391748 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.391673    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" (UID: "79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 20:18:35.391965 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.391937    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" (UID: "79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:18:35.489327 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.489297    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-workload-socket\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:35.489327 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.489324    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-envoy\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:35.489327 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.489333    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-token\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:35.489597 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.489340    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istiod-ca-cert\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:35.489597 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.489349    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-podinfo\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:35.489597 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.489357    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-istio-data\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:35.489597 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.489366    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnxj9\" (UniqueName: \"kubernetes.io/projected/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-kube-api-access-tnxj9\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:35.489597 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:35.489374    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e-workload-certs\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:36.370717 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:36.370692    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"
Sep 10 20:18:36.407333 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:36.407305    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"]
Sep 10 20:18:36.411430 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:36.411405    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-84c19e-openshift-default-df86fc49d-slbp5"]
Sep 10 20:18:36.850386 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:36.850352    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" path="/var/lib/kubelet/pods/79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e/volumes"
Sep 10 20:18:42.002139 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:42.002109    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:18:47.354598 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:47.354565    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"]
Sep 10 20:18:47.354982 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:47.354779    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69" podUID="cfc4249a-9707-48d9-bf73-b919a632614c" containerName="istio-proxy" containerID="cri-o://2a35ecd5c45c74d7a007473908989a452b12fdd8eab7dbfccaaf3ad490d9b063" gracePeriod=30
Sep 10 20:18:47.991919 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:47.991873    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 20:18:47.992109 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:47.991965    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69" podUID="cfc4249a-9707-48d9-bf73-b919a632614c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 20:18:52.918592 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:52.918567    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:18:53.046500 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.046467    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-workload-certs\") pod \"cfc4249a-9707-48d9-bf73-b919a632614c\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") "
Sep 10 20:18:53.046685 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.046529    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfc4249a-9707-48d9-bf73-b919a632614c-istio-token\") pod \"cfc4249a-9707-48d9-bf73-b919a632614c\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") "
Sep 10 20:18:53.046685 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.046599    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-credential-socket\") pod \"cfc4249a-9707-48d9-bf73-b919a632614c\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") "
Sep 10 20:18:53.046685 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.046631    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-workload-socket\") pod \"cfc4249a-9707-48d9-bf73-b919a632614c\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") "
Sep 10 20:18:53.046685 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.046662    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-istio-envoy\") pod \"cfc4249a-9707-48d9-bf73-b919a632614c\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") "
Sep 10 20:18:53.046906 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.046687    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-istio-data\") pod \"cfc4249a-9707-48d9-bf73-b919a632614c\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") "
Sep 10 20:18:53.046906 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.046724    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfc4249a-9707-48d9-bf73-b919a632614c-istio-podinfo\") pod \"cfc4249a-9707-48d9-bf73-b919a632614c\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") "
Sep 10 20:18:53.046906 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.046761    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gknfg\" (UniqueName: \"kubernetes.io/projected/cfc4249a-9707-48d9-bf73-b919a632614c-kube-api-access-gknfg\") pod \"cfc4249a-9707-48d9-bf73-b919a632614c\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") "
Sep 10 20:18:53.046906 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.046763    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cfc4249a-9707-48d9-bf73-b919a632614c" (UID: "cfc4249a-9707-48d9-bf73-b919a632614c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:18:53.046906 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.046802    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfc4249a-9707-48d9-bf73-b919a632614c-istiod-ca-cert\") pod \"cfc4249a-9707-48d9-bf73-b919a632614c\" (UID: \"cfc4249a-9707-48d9-bf73-b919a632614c\") "
Sep 10 20:18:53.046906 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.046893    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cfc4249a-9707-48d9-bf73-b919a632614c" (UID: "cfc4249a-9707-48d9-bf73-b919a632614c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:18:53.047200 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.046910    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-istio-data" (OuterVolumeSpecName: "istio-data") pod "cfc4249a-9707-48d9-bf73-b919a632614c" (UID: "cfc4249a-9707-48d9-bf73-b919a632614c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:18:53.047535 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.047508    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-credential-socket\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:53.047639 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.047547    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-istio-data\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:53.047639 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.047565    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-workload-certs\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:53.047639 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.047572    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfc4249a-9707-48d9-bf73-b919a632614c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cfc4249a-9707-48d9-bf73-b919a632614c" (UID: "cfc4249a-9707-48d9-bf73-b919a632614c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:18:53.047639 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.047606    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cfc4249a-9707-48d9-bf73-b919a632614c" (UID: "cfc4249a-9707-48d9-bf73-b919a632614c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:18:53.055544 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.049245    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfc4249a-9707-48d9-bf73-b919a632614c-istio-token" (OuterVolumeSpecName: "istio-token") pod "cfc4249a-9707-48d9-bf73-b919a632614c" (UID: "cfc4249a-9707-48d9-bf73-b919a632614c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:18:53.055544 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.049504    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cfc4249a-9707-48d9-bf73-b919a632614c" (UID: "cfc4249a-9707-48d9-bf73-b919a632614c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:18:53.055544 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.050119    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cfc4249a-9707-48d9-bf73-b919a632614c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cfc4249a-9707-48d9-bf73-b919a632614c" (UID: "cfc4249a-9707-48d9-bf73-b919a632614c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 20:18:53.056088 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.056065    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfc4249a-9707-48d9-bf73-b919a632614c-kube-api-access-gknfg" (OuterVolumeSpecName: "kube-api-access-gknfg") pod "cfc4249a-9707-48d9-bf73-b919a632614c" (UID: "cfc4249a-9707-48d9-bf73-b919a632614c"). InnerVolumeSpecName "kube-api-access-gknfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:18:53.149010 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.148939    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-workload-socket\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:53.149010 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.148966    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfc4249a-9707-48d9-bf73-b919a632614c-istio-envoy\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:53.149010 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.148975    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfc4249a-9707-48d9-bf73-b919a632614c-istio-podinfo\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:53.149010 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.148982    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gknfg\" (UniqueName: \"kubernetes.io/projected/cfc4249a-9707-48d9-bf73-b919a632614c-kube-api-access-gknfg\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:53.149010 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.148991    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfc4249a-9707-48d9-bf73-b919a632614c-istiod-ca-cert\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:53.149010 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.148999    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfc4249a-9707-48d9-bf73-b919a632614c-istio-token\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:53.465307 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.465214    2561 generic.go:356] "Generic (PLEG): container finished" podID="cfc4249a-9707-48d9-bf73-b919a632614c" containerID="2a35ecd5c45c74d7a007473908989a452b12fdd8eab7dbfccaaf3ad490d9b063" exitCode=0
Sep 10 20:18:53.465307 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.465268    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69" event={"ID":"cfc4249a-9707-48d9-bf73-b919a632614c","Type":"ContainerDied","Data":"2a35ecd5c45c74d7a007473908989a452b12fdd8eab7dbfccaaf3ad490d9b063"}
Sep 10 20:18:53.465307 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.465276    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"
Sep 10 20:18:53.465584 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.465350    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69" event={"ID":"cfc4249a-9707-48d9-bf73-b919a632614c","Type":"ContainerDied","Data":"a2371c99744552e719cc3b659c78f77051b5059153ae91a1fd24ebbb15b832da"}
Sep 10 20:18:53.465584 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.465381    2561 scope.go:117] "RemoveContainer" containerID="2a35ecd5c45c74d7a007473908989a452b12fdd8eab7dbfccaaf3ad490d9b063"
Sep 10 20:18:53.475229 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.475111    2561 scope.go:117] "RemoveContainer" containerID="253621e81736c7c9daf0bc4b258efcf2e8858920ffb13e55ed5d68529a3b0331"
Sep 10 20:18:53.483765 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.483746    2561 scope.go:117] "RemoveContainer" containerID="2a35ecd5c45c74d7a007473908989a452b12fdd8eab7dbfccaaf3ad490d9b063"
Sep 10 20:18:53.484028 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:18:53.484012    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a35ecd5c45c74d7a007473908989a452b12fdd8eab7dbfccaaf3ad490d9b063\": container with ID starting with 2a35ecd5c45c74d7a007473908989a452b12fdd8eab7dbfccaaf3ad490d9b063 not found: ID does not exist" containerID="2a35ecd5c45c74d7a007473908989a452b12fdd8eab7dbfccaaf3ad490d9b063"
Sep 10 20:18:53.484110 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.484039    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a35ecd5c45c74d7a007473908989a452b12fdd8eab7dbfccaaf3ad490d9b063"} err="failed to get container status \"2a35ecd5c45c74d7a007473908989a452b12fdd8eab7dbfccaaf3ad490d9b063\": rpc error: code = NotFound desc = could not find container \"2a35ecd5c45c74d7a007473908989a452b12fdd8eab7dbfccaaf3ad490d9b063\": container with ID starting with 2a35ecd5c45c74d7a007473908989a452b12fdd8eab7dbfccaaf3ad490d9b063 not found: ID does not exist"
Sep 10 20:18:53.484110 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.484062    2561 scope.go:117] "RemoveContainer" containerID="253621e81736c7c9daf0bc4b258efcf2e8858920ffb13e55ed5d68529a3b0331"
Sep 10 20:18:53.484306 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:18:53.484287    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"253621e81736c7c9daf0bc4b258efcf2e8858920ffb13e55ed5d68529a3b0331\": container with ID starting with 253621e81736c7c9daf0bc4b258efcf2e8858920ffb13e55ed5d68529a3b0331 not found: ID does not exist" containerID="253621e81736c7c9daf0bc4b258efcf2e8858920ffb13e55ed5d68529a3b0331"
Sep 10 20:18:53.484345 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.484312    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"253621e81736c7c9daf0bc4b258efcf2e8858920ffb13e55ed5d68529a3b0331"} err="failed to get container status \"253621e81736c7c9daf0bc4b258efcf2e8858920ffb13e55ed5d68529a3b0331\": rpc error: code = NotFound desc = could not find container \"253621e81736c7c9daf0bc4b258efcf2e8858920ffb13e55ed5d68529a3b0331\": container with ID starting with 253621e81736c7c9daf0bc4b258efcf2e8858920ffb13e55ed5d68529a3b0331 not found: ID does not exist"
Sep 10 20:18:53.490034 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.490016    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"]
Sep 10 20:18:53.494162 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.494144    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-214b09-openshift-default-75864c77c8-z8r69"]
Sep 10 20:18:53.504682 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:53.504653    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:18:54.499776 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.499742    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2"]
Sep 10 20:18:54.500102 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.500090    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfc4249a-9707-48d9-bf73-b919a632614c" containerName="istio-proxy"
Sep 10 20:18:54.500144 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.500103    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfc4249a-9707-48d9-bf73-b919a632614c" containerName="istio-proxy"
Sep 10 20:18:54.500144 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.500111    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" containerName="istio-proxy"
Sep 10 20:18:54.500144 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.500116    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" containerName="istio-proxy"
Sep 10 20:18:54.500144 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.500123    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7364d736-2b9a-447b-9a78-d0a5ce375c89" containerName="payload-processing"
Sep 10 20:18:54.500144 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.500129    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7364d736-2b9a-447b-9a78-d0a5ce375c89" containerName="payload-processing"
Sep 10 20:18:54.500144 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.500139    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de6779b2-3841-4505-8286-7dae380923aa" containerName="payload-pre-processing"
Sep 10 20:18:54.500144 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.500144    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="de6779b2-3841-4505-8286-7dae380923aa" containerName="payload-pre-processing"
Sep 10 20:18:54.500349 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.500150    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" containerName="istio-proxy"
Sep 10 20:18:54.500349 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.500155    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" containerName="istio-proxy"
Sep 10 20:18:54.500349 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.500162    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89e79862-1081-4ded-acd2-8b88954b94bc" containerName="payload-pre-processing"
Sep 10 20:18:54.500349 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.500167    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="89e79862-1081-4ded-acd2-8b88954b94bc" containerName="payload-pre-processing"
Sep 10 20:18:54.500349 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.500231    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" containerName="istio-proxy"
Sep 10 20:18:54.500349 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.500237    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7364d736-2b9a-447b-9a78-d0a5ce375c89" containerName="payload-processing"
Sep 10 20:18:54.500349 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.500245    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="de6779b2-3841-4505-8286-7dae380923aa" containerName="payload-pre-processing"
Sep 10 20:18:54.500349 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.500251    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfc4249a-9707-48d9-bf73-b919a632614c" containerName="istio-proxy"
Sep 10 20:18:54.500349 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.500258    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfc4249a-9707-48d9-bf73-b919a632614c" containerName="istio-proxy"
Sep 10 20:18:54.500349 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.500264    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="89e79862-1081-4ded-acd2-8b88954b94bc" containerName="payload-pre-processing"
Sep 10 20:18:54.500349 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.500268    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="79f7f6c7-7a6a-42b7-8dc3-eed1beffc86e" containerName="istio-proxy"
Sep 10 20:18:54.504714 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.504698    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2"
Sep 10 20:18:54.510750 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.510727    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-316fde-dockercfg-xk8tj\""
Sep 10 20:18:54.510856 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.510766    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-316fde\""
Sep 10 20:18:54.516485 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.516463    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2"]
Sep 10 20:18:54.553958 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.553933    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn"]
Sep 10 20:18:54.554286 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.554274    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfc4249a-9707-48d9-bf73-b919a632614c" containerName="istio-proxy"
Sep 10 20:18:54.554336 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.554288    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfc4249a-9707-48d9-bf73-b919a632614c" containerName="istio-proxy"
Sep 10 20:18:54.557280 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.557263    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn"
Sep 10 20:18:54.561222 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.561198    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7cb2fc5-d630-40cf-b59a-6ee08ec07360-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2\" (UID: \"c7cb2fc5-d630-40cf-b59a-6ee08ec07360\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2"
Sep 10 20:18:54.561297 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.561264    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrhdr\" (UniqueName: \"kubernetes.io/projected/c7cb2fc5-d630-40cf-b59a-6ee08ec07360-kube-api-access-hrhdr\") pod \"payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2\" (UID: \"c7cb2fc5-d630-40cf-b59a-6ee08ec07360\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2"
Sep 10 20:18:54.574330 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.574307    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn"]
Sep 10 20:18:54.662562 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.662528    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrhdr\" (UniqueName: \"kubernetes.io/projected/c7cb2fc5-d630-40cf-b59a-6ee08ec07360-kube-api-access-hrhdr\") pod \"payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2\" (UID: \"c7cb2fc5-d630-40cf-b59a-6ee08ec07360\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2"
Sep 10 20:18:54.662562 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.662574    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5flh\" (UniqueName: \"kubernetes.io/projected/fedf912e-9c70-49a3-8ca1-88de01621f19-kube-api-access-q5flh\") pod \"payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn\" (UID: \"fedf912e-9c70-49a3-8ca1-88de01621f19\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn"
Sep 10 20:18:54.662829 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.662598    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fedf912e-9c70-49a3-8ca1-88de01621f19-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn\" (UID: \"fedf912e-9c70-49a3-8ca1-88de01621f19\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn"
Sep 10 20:18:54.662829 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.662647    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7cb2fc5-d630-40cf-b59a-6ee08ec07360-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2\" (UID: \"c7cb2fc5-d630-40cf-b59a-6ee08ec07360\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2"
Sep 10 20:18:54.663581 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.663552    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7cb2fc5-d630-40cf-b59a-6ee08ec07360-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2\" (UID: \"c7cb2fc5-d630-40cf-b59a-6ee08ec07360\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2"
Sep 10 20:18:54.671089 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.671058    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrhdr\" (UniqueName: \"kubernetes.io/projected/c7cb2fc5-d630-40cf-b59a-6ee08ec07360-kube-api-access-hrhdr\") pod \"payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2\" (UID: \"c7cb2fc5-d630-40cf-b59a-6ee08ec07360\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2"
Sep 10 20:18:54.763753 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.763679    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5flh\" (UniqueName: \"kubernetes.io/projected/fedf912e-9c70-49a3-8ca1-88de01621f19-kube-api-access-q5flh\") pod \"payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn\" (UID: \"fedf912e-9c70-49a3-8ca1-88de01621f19\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn"
Sep 10 20:18:54.763753 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.763717    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fedf912e-9c70-49a3-8ca1-88de01621f19-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn\" (UID: \"fedf912e-9c70-49a3-8ca1-88de01621f19\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn"
Sep 10 20:18:54.764340 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.764323    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fedf912e-9c70-49a3-8ca1-88de01621f19-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn\" (UID: \"fedf912e-9c70-49a3-8ca1-88de01621f19\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn"
Sep 10 20:18:54.773574 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.773553    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5flh\" (UniqueName: \"kubernetes.io/projected/fedf912e-9c70-49a3-8ca1-88de01621f19-kube-api-access-q5flh\") pod \"payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn\" (UID: \"fedf912e-9c70-49a3-8ca1-88de01621f19\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn"
Sep 10 20:18:54.816635 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.816606    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2"
Sep 10 20:18:54.852170 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.852136    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfc4249a-9707-48d9-bf73-b919a632614c" path="/var/lib/kubelet/pods/cfc4249a-9707-48d9-bf73-b919a632614c/volumes"
Sep 10 20:18:54.867789 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:54.867730    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn"
Sep 10 20:18:55.086641 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:55.086617    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2"]
Sep 10 20:18:55.088954 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:18:55.088925    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7cb2fc5_d630_40cf_b59a_6ee08ec07360.slice/crio-5c4b7017eca5991014f4fe6b745f7376a5faa9a9ab5a54d8e228a1bf8d79df5e WatchSource:0}: Error finding container 5c4b7017eca5991014f4fe6b745f7376a5faa9a9ab5a54d8e228a1bf8d79df5e: Status 404 returned error can't find the container with id 5c4b7017eca5991014f4fe6b745f7376a5faa9a9ab5a54d8e228a1bf8d79df5e
Sep 10 20:18:55.146675 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:55.146651    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn"]
Sep 10 20:18:55.148449 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:18:55.148424    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfedf912e_9c70_49a3_8ca1_88de01621f19.slice/crio-7136def66d4ed9e9a2211965b11abd208a1cd86e62e7a086747a54bd844e9075 WatchSource:0}: Error finding container 7136def66d4ed9e9a2211965b11abd208a1cd86e62e7a086747a54bd844e9075: Status 404 returned error can't find the container with id 7136def66d4ed9e9a2211965b11abd208a1cd86e62e7a086747a54bd844e9075
Sep 10 20:18:55.478085 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:55.477998    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2" event={"ID":"c7cb2fc5-d630-40cf-b59a-6ee08ec07360","Type":"ContainerStarted","Data":"f52ad8bc635fb3d5f096d649891e1d0b8057eb15a1a28c2c5b3e05a152e03448"}
Sep 10 20:18:55.478085 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:55.478059    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2" event={"ID":"c7cb2fc5-d630-40cf-b59a-6ee08ec07360","Type":"ContainerStarted","Data":"5c4b7017eca5991014f4fe6b745f7376a5faa9a9ab5a54d8e228a1bf8d79df5e"}
Sep 10 20:18:55.478319 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:55.478171    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2"
Sep 10 20:18:55.479736 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:55.479712    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn" event={"ID":"fedf912e-9c70-49a3-8ca1-88de01621f19","Type":"ContainerStarted","Data":"b993118e117a5877ac8cf0991d0d67db59ee2e70fa6372b78afd0af063a822fb"}
Sep 10 20:18:55.479855 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:55.479754    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn" event={"ID":"fedf912e-9c70-49a3-8ca1-88de01621f19","Type":"ContainerStarted","Data":"7136def66d4ed9e9a2211965b11abd208a1cd86e62e7a086747a54bd844e9075"}
Sep 10 20:18:55.479855 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:55.479806    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn"
Sep 10 20:18:55.498959 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:55.498914    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2" podStartSLOduration=1.498883063 podStartE2EDuration="1.498883063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:18:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:18:55.49654731 +0000 UTC m=+1479.161651557" watchObservedRunningTime="2026-09-10 20:18:55.498883063 +0000 UTC m=+1479.163987309"
Sep 10 20:18:55.515809 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:55.515772    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn" podStartSLOduration=1.5157594840000002 podStartE2EDuration="1.515759484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:18:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:18:55.513679098 +0000 UTC m=+1479.178783367" watchObservedRunningTime="2026-09-10 20:18:55.515759484 +0000 UTC m=+1479.180863729"
Sep 10 20:18:58.429289 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:58.429254    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6ef723-29817855-4t42w"]
Sep 10 20:18:58.431515 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:58.431495    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6ef723-29817855-4t42w"]
Sep 10 20:18:58.460776 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:58.460742    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl"]
Sep 10 20:18:58.461040 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:58.460990    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl" podUID="44c0c91d-c5a4-4ea2-9b48-355ba612a6f7" containerName="payload-processing" containerID="cri-o://f3f41d1a2ca1727f0d0eec428273809934c91359a0a7bc1b77ec46534011f218" gracePeriod=30
Sep 10 20:18:58.469721 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:58.469573    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d"]
Sep 10 20:18:58.469849 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:58.469803    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d" podUID="6228659b-71ea-49c4-8bba-b2e012c9d301" containerName="payload-pre-processing" containerID="cri-o://4b5b18963bb862e05982d8959fbff9a034143010d40fcd8dc520da8015ecb9da" gracePeriod=30
Sep 10 20:18:58.851040 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:58.851004    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1325ac9-a30d-44b8-a0c5-7279d92ec415" path="/var/lib/kubelet/pods/c1325ac9-a30d-44b8-a0c5-7279d92ec415/volumes"
Sep 10 20:18:59.121608 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.121581    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl"
Sep 10 20:18:59.204063 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.204007    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44c0c91d-c5a4-4ea2-9b48-355ba612a6f7-plugins-config-volume\") pod \"44c0c91d-c5a4-4ea2-9b48-355ba612a6f7\" (UID: \"44c0c91d-c5a4-4ea2-9b48-355ba612a6f7\") "
Sep 10 20:18:59.204265 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.204122    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f48bl\" (UniqueName: \"kubernetes.io/projected/44c0c91d-c5a4-4ea2-9b48-355ba612a6f7-kube-api-access-f48bl\") pod \"44c0c91d-c5a4-4ea2-9b48-355ba612a6f7\" (UID: \"44c0c91d-c5a4-4ea2-9b48-355ba612a6f7\") "
Sep 10 20:18:59.204327 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.204300    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44c0c91d-c5a4-4ea2-9b48-355ba612a6f7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "44c0c91d-c5a4-4ea2-9b48-355ba612a6f7" (UID: "44c0c91d-c5a4-4ea2-9b48-355ba612a6f7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:18:59.204445 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.204429    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44c0c91d-c5a4-4ea2-9b48-355ba612a6f7-plugins-config-volume\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:59.206470 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.206442    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44c0c91d-c5a4-4ea2-9b48-355ba612a6f7-kube-api-access-f48bl" (OuterVolumeSpecName: "kube-api-access-f48bl") pod "44c0c91d-c5a4-4ea2-9b48-355ba612a6f7" (UID: "44c0c91d-c5a4-4ea2-9b48-355ba612a6f7"). InnerVolumeSpecName "kube-api-access-f48bl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:18:59.305126 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.305085    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f48bl\" (UniqueName: \"kubernetes.io/projected/44c0c91d-c5a4-4ea2-9b48-355ba612a6f7-kube-api-access-f48bl\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:59.319553 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.319529    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d"
Sep 10 20:18:59.406300 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.406236    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6228659b-71ea-49c4-8bba-b2e012c9d301-plugins-config-volume\") pod \"6228659b-71ea-49c4-8bba-b2e012c9d301\" (UID: \"6228659b-71ea-49c4-8bba-b2e012c9d301\") "
Sep 10 20:18:59.406455 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.406369    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tczcb\" (UniqueName: \"kubernetes.io/projected/6228659b-71ea-49c4-8bba-b2e012c9d301-kube-api-access-tczcb\") pod \"6228659b-71ea-49c4-8bba-b2e012c9d301\" (UID: \"6228659b-71ea-49c4-8bba-b2e012c9d301\") "
Sep 10 20:18:59.406607 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.406587    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6228659b-71ea-49c4-8bba-b2e012c9d301-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6228659b-71ea-49c4-8bba-b2e012c9d301" (UID: "6228659b-71ea-49c4-8bba-b2e012c9d301"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:18:59.406688 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.406672    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6228659b-71ea-49c4-8bba-b2e012c9d301-plugins-config-volume\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:59.408450 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.408417    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6228659b-71ea-49c4-8bba-b2e012c9d301-kube-api-access-tczcb" (OuterVolumeSpecName: "kube-api-access-tczcb") pod "6228659b-71ea-49c4-8bba-b2e012c9d301" (UID: "6228659b-71ea-49c4-8bba-b2e012c9d301"). InnerVolumeSpecName "kube-api-access-tczcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:18:59.503938 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.503911    2561 generic.go:356] "Generic (PLEG): container finished" podID="6228659b-71ea-49c4-8bba-b2e012c9d301" containerID="4b5b18963bb862e05982d8959fbff9a034143010d40fcd8dc520da8015ecb9da" exitCode=0
Sep 10 20:18:59.504351 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.503955    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d"
Sep 10 20:18:59.504351 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.503994    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d" event={"ID":"6228659b-71ea-49c4-8bba-b2e012c9d301","Type":"ContainerDied","Data":"4b5b18963bb862e05982d8959fbff9a034143010d40fcd8dc520da8015ecb9da"}
Sep 10 20:18:59.504351 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.504043    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d" event={"ID":"6228659b-71ea-49c4-8bba-b2e012c9d301","Type":"ContainerDied","Data":"23a27e9b335dd2835123438a6f6026b98542865f2fef26a840ccb3763a9adf01"}
Sep 10 20:18:59.504351 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.504071    2561 scope.go:117] "RemoveContainer" containerID="4b5b18963bb862e05982d8959fbff9a034143010d40fcd8dc520da8015ecb9da"
Sep 10 20:18:59.505574 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.505550    2561 generic.go:356] "Generic (PLEG): container finished" podID="44c0c91d-c5a4-4ea2-9b48-355ba612a6f7" containerID="f3f41d1a2ca1727f0d0eec428273809934c91359a0a7bc1b77ec46534011f218" exitCode=0
Sep 10 20:18:59.505696 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.505583    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl" event={"ID":"44c0c91d-c5a4-4ea2-9b48-355ba612a6f7","Type":"ContainerDied","Data":"f3f41d1a2ca1727f0d0eec428273809934c91359a0a7bc1b77ec46534011f218"}
Sep 10 20:18:59.505696 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.505596    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl"
Sep 10 20:18:59.505696 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.505617    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl" event={"ID":"44c0c91d-c5a4-4ea2-9b48-355ba612a6f7","Type":"ContainerDied","Data":"8c332f587e6df59fdd405145d6f3ebaf8e9bb896c87605af5f54138ee7989dec"}
Sep 10 20:18:59.507239 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.507219    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tczcb\" (UniqueName: \"kubernetes.io/projected/6228659b-71ea-49c4-8bba-b2e012c9d301-kube-api-access-tczcb\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:18:59.514790 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.514772    2561 scope.go:117] "RemoveContainer" containerID="4b5b18963bb862e05982d8959fbff9a034143010d40fcd8dc520da8015ecb9da"
Sep 10 20:18:59.515078 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:18:59.515058    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b5b18963bb862e05982d8959fbff9a034143010d40fcd8dc520da8015ecb9da\": container with ID starting with 4b5b18963bb862e05982d8959fbff9a034143010d40fcd8dc520da8015ecb9da not found: ID does not exist" containerID="4b5b18963bb862e05982d8959fbff9a034143010d40fcd8dc520da8015ecb9da"
Sep 10 20:18:59.515161 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.515084    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b5b18963bb862e05982d8959fbff9a034143010d40fcd8dc520da8015ecb9da"} err="failed to get container status \"4b5b18963bb862e05982d8959fbff9a034143010d40fcd8dc520da8015ecb9da\": rpc error: code = NotFound desc = could not find container \"4b5b18963bb862e05982d8959fbff9a034143010d40fcd8dc520da8015ecb9da\": container with ID starting with 4b5b18963bb862e05982d8959fbff9a034143010d40fcd8dc520da8015ecb9da not found: ID does not exist"
Sep 10 20:18:59.515161 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.515101    2561 scope.go:117] "RemoveContainer" containerID="f3f41d1a2ca1727f0d0eec428273809934c91359a0a7bc1b77ec46534011f218"
Sep 10 20:18:59.523225 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.523207    2561 scope.go:117] "RemoveContainer" containerID="f3f41d1a2ca1727f0d0eec428273809934c91359a0a7bc1b77ec46534011f218"
Sep 10 20:18:59.523497 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:18:59.523479    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3f41d1a2ca1727f0d0eec428273809934c91359a0a7bc1b77ec46534011f218\": container with ID starting with f3f41d1a2ca1727f0d0eec428273809934c91359a0a7bc1b77ec46534011f218 not found: ID does not exist" containerID="f3f41d1a2ca1727f0d0eec428273809934c91359a0a7bc1b77ec46534011f218"
Sep 10 20:18:59.523561 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.523509    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3f41d1a2ca1727f0d0eec428273809934c91359a0a7bc1b77ec46534011f218"} err="failed to get container status \"f3f41d1a2ca1727f0d0eec428273809934c91359a0a7bc1b77ec46534011f218\": rpc error: code = NotFound desc = could not find container \"f3f41d1a2ca1727f0d0eec428273809934c91359a0a7bc1b77ec46534011f218\": container with ID starting with f3f41d1a2ca1727f0d0eec428273809934c91359a0a7bc1b77ec46534011f218 not found: ID does not exist"
Sep 10 20:18:59.534937 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.534918    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d"]
Sep 10 20:18:59.542695 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.542679    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6ef723-644ff59c7d-wjm4d"]
Sep 10 20:18:59.572330 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.572310    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl"]
Sep 10 20:18:59.577200 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:18:59.577180    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6ef723-6778697945-nl4pl"]
Sep 10 20:19:00.850005 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:00.849976    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44c0c91d-c5a4-4ea2-9b48-355ba612a6f7" path="/var/lib/kubelet/pods/44c0c91d-c5a4-4ea2-9b48-355ba612a6f7/volumes"
Sep 10 20:19:00.850360 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:00.850319    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6228659b-71ea-49c4-8bba-b2e012c9d301" path="/var/lib/kubelet/pods/6228659b-71ea-49c4-8bba-b2e012c9d301/volumes"
Sep 10 20:19:06.487565 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:06.487534    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn"
Sep 10 20:19:06.488061 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:06.487622    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2"
Sep 10 20:19:08.503857 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:08.503823    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:19:23.621928 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:23.621891    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq"]
Sep 10 20:19:23.623341 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:23.623314    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6228659b-71ea-49c4-8bba-b2e012c9d301" containerName="payload-pre-processing"
Sep 10 20:19:23.623508 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:23.623495    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6228659b-71ea-49c4-8bba-b2e012c9d301" containerName="payload-pre-processing"
Sep 10 20:19:23.623705 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:23.623691    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44c0c91d-c5a4-4ea2-9b48-355ba612a6f7" containerName="payload-processing"
Sep 10 20:19:23.623799 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:23.623790    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="44c0c91d-c5a4-4ea2-9b48-355ba612a6f7" containerName="payload-processing"
Sep 10 20:19:23.624060 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:23.624047    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6228659b-71ea-49c4-8bba-b2e012c9d301" containerName="payload-pre-processing"
Sep 10 20:19:23.624163 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:23.624154    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="44c0c91d-c5a4-4ea2-9b48-355ba612a6f7" containerName="payload-processing"
Sep 10 20:19:23.629969 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:23.629940    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq"
Sep 10 20:19:23.634124 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:23.634103    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-82457a\""
Sep 10 20:19:23.634257 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:23.634210    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-82457a-dockercfg-5cz69\""
Sep 10 20:19:23.639076 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:23.639051    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq"]
Sep 10 20:19:23.721443 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:23.721385    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p92vh\" (UniqueName: \"kubernetes.io/projected/04dd2e67-db67-484e-8093-af5593537c09-kube-api-access-p92vh\") pod \"payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq\" (UID: \"04dd2e67-db67-484e-8093-af5593537c09\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq"
Sep 10 20:19:23.721633 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:23.721510    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04dd2e67-db67-484e-8093-af5593537c09-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq\" (UID: \"04dd2e67-db67-484e-8093-af5593537c09\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq"
Sep 10 20:19:23.822586 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:23.822551    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p92vh\" (UniqueName: \"kubernetes.io/projected/04dd2e67-db67-484e-8093-af5593537c09-kube-api-access-p92vh\") pod \"payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq\" (UID: \"04dd2e67-db67-484e-8093-af5593537c09\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq"
Sep 10 20:19:23.822736 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:23.822616    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04dd2e67-db67-484e-8093-af5593537c09-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq\" (UID: \"04dd2e67-db67-484e-8093-af5593537c09\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq"
Sep 10 20:19:23.823231 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:23.823214    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04dd2e67-db67-484e-8093-af5593537c09-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq\" (UID: \"04dd2e67-db67-484e-8093-af5593537c09\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq"
Sep 10 20:19:23.830613 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:23.830583    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p92vh\" (UniqueName: \"kubernetes.io/projected/04dd2e67-db67-484e-8093-af5593537c09-kube-api-access-p92vh\") pod \"payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq\" (UID: \"04dd2e67-db67-484e-8093-af5593537c09\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq"
Sep 10 20:19:23.942017 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:23.941935    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq"
Sep 10 20:19:24.216066 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:24.216037    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq"]
Sep 10 20:19:24.218558 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:19:24.218527    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04dd2e67_db67_484e_8093_af5593537c09.slice/crio-401a721e9c7ec012c268ff1bdd41627d7dafa4f595fcd30f73d3612d63ed0cfb WatchSource:0}: Error finding container 401a721e9c7ec012c268ff1bdd41627d7dafa4f595fcd30f73d3612d63ed0cfb: Status 404 returned error can't find the container with id 401a721e9c7ec012c268ff1bdd41627d7dafa4f595fcd30f73d3612d63ed0cfb
Sep 10 20:19:24.642520 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:24.642487    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq" event={"ID":"04dd2e67-db67-484e-8093-af5593537c09","Type":"ContainerStarted","Data":"21ba226ec816cf71941eb92ccae0e9cf311ceb7055cca3bae3442ecbe2dff302"}
Sep 10 20:19:24.642898 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:24.642538    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq" event={"ID":"04dd2e67-db67-484e-8093-af5593537c09","Type":"ContainerStarted","Data":"401a721e9c7ec012c268ff1bdd41627d7dafa4f595fcd30f73d3612d63ed0cfb"}
Sep 10 20:19:24.642898 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:24.642617    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq"
Sep 10 20:19:24.658541 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:24.658500    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq" podStartSLOduration=1.658486476 podStartE2EDuration="1.658486476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:19:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:19:24.657322182 +0000 UTC m=+1508.322426429" watchObservedRunningTime="2026-09-10 20:19:24.658486476 +0000 UTC m=+1508.323590723"
Sep 10 20:19:29.907700 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:29.907662    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:19:35.649797 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:35.649767    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq"
Sep 10 20:19:52.129430 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:19:52.129297    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq_04dd2e67-db67-484e-8093-af5593537c09/payload-processing/0.log"
Sep 10 20:20:21.502966 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:20:21.502923    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:20:36.790848 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:20:36.790809    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:20:43.095152 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:20:43.095123    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn_fedf912e-9c70-49a3-8ca1-88de01621f19/payload-processing/0.log"
Sep 10 20:20:43.353775 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:20:43.353701    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq_04dd2e67-db67-484e-8093-af5593537c09/payload-processing/0.log"
Sep 10 20:20:49.438012 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:20:49.437981    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh"]
Sep 10 20:20:49.441169 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:20:49.441149    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh"
Sep 10 20:20:49.443700 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:20:49.443677    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-fe603d\""
Sep 10 20:20:49.443823 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:20:49.443794    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-fe603d-dockercfg-2w5b4\""
Sep 10 20:20:49.452118 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:20:49.452094    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh"]
Sep 10 20:20:49.598378 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:20:49.598349    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljs22\" (UniqueName: \"kubernetes.io/projected/efbc153b-4a19-48cc-ac68-654c7543ef1c-kube-api-access-ljs22\") pod \"payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh\" (UID: \"efbc153b-4a19-48cc-ac68-654c7543ef1c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh"
Sep 10 20:20:49.598584 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:20:49.598456    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efbc153b-4a19-48cc-ac68-654c7543ef1c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh\" (UID: \"efbc153b-4a19-48cc-ac68-654c7543ef1c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh"
Sep 10 20:20:49.699705 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:20:49.699622    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljs22\" (UniqueName: \"kubernetes.io/projected/efbc153b-4a19-48cc-ac68-654c7543ef1c-kube-api-access-ljs22\") pod \"payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh\" (UID: \"efbc153b-4a19-48cc-ac68-654c7543ef1c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh"
Sep 10 20:20:49.699705 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:20:49.699669    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efbc153b-4a19-48cc-ac68-654c7543ef1c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh\" (UID: \"efbc153b-4a19-48cc-ac68-654c7543ef1c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh"
Sep 10 20:20:49.700552 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:20:49.700525    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efbc153b-4a19-48cc-ac68-654c7543ef1c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh\" (UID: \"efbc153b-4a19-48cc-ac68-654c7543ef1c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh"
Sep 10 20:20:49.715903 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:20:49.715875    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljs22\" (UniqueName: \"kubernetes.io/projected/efbc153b-4a19-48cc-ac68-654c7543ef1c-kube-api-access-ljs22\") pod \"payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh\" (UID: \"efbc153b-4a19-48cc-ac68-654c7543ef1c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh"
Sep 10 20:20:49.752095 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:20:49.752075    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh"
Sep 10 20:20:50.026745 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:20:50.025744    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh"]
Sep 10 20:20:50.027994 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:20:50.027967    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefbc153b_4a19_48cc_ac68_654c7543ef1c.slice/crio-602df65c173d2f051a3484d1549e291cc0534c34ec0f69c43dbb95f574e2adb0 WatchSource:0}: Error finding container 602df65c173d2f051a3484d1549e291cc0534c34ec0f69c43dbb95f574e2adb0: Status 404 returned error can't find the container with id 602df65c173d2f051a3484d1549e291cc0534c34ec0f69c43dbb95f574e2adb0
Sep 10 20:20:50.086825 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:20:50.086791    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh" event={"ID":"efbc153b-4a19-48cc-ac68-654c7543ef1c","Type":"ContainerStarted","Data":"602df65c173d2f051a3484d1549e291cc0534c34ec0f69c43dbb95f574e2adb0"}
Sep 10 20:20:51.096726 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:20:51.096692    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh" event={"ID":"efbc153b-4a19-48cc-ac68-654c7543ef1c","Type":"ContainerStarted","Data":"d5ae1ddf033d52699179de3befb56c8a20fae5d2958306aaff2b387525372ec1"}
Sep 10 20:20:51.097128 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:20:51.096809    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh"
Sep 10 20:20:51.116512 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:20:51.116463    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh" podStartSLOduration=2.116447659 podStartE2EDuration="2.116447659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:20:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:20:51.114232953 +0000 UTC m=+1594.779337200" watchObservedRunningTime="2026-09-10 20:20:51.116447659 +0000 UTC m=+1594.781551917"
Sep 10 20:20:56.807330 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:20:56.807293    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:21:02.104238 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:02.104206    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh"
Sep 10 20:21:13.113728 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:13.113694    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fe603d-4m8xv"]
Sep 10 20:21:13.117507 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:13.117481    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fe603d-4m8xv"
Sep 10 20:21:13.119890 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:13.119868    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zdpml\""
Sep 10 20:21:13.124100 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:13.124080    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fe603d-4m8xv"]
Sep 10 20:21:13.214380 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:13.214349    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d3dd91f-e319-4c66-afe9-a94d4ab2c7f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-fe603d-4m8xv\" (UID: \"2d3dd91f-e319-4c66-afe9-a94d4ab2c7f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fe603d-4m8xv"
Sep 10 20:21:13.315154 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:13.315121    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d3dd91f-e319-4c66-afe9-a94d4ab2c7f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-fe603d-4m8xv\" (UID: \"2d3dd91f-e319-4c66-afe9-a94d4ab2c7f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fe603d-4m8xv"
Sep 10 20:21:13.315800 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:13.315780    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d3dd91f-e319-4c66-afe9-a94d4ab2c7f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-fe603d-4m8xv\" (UID: \"2d3dd91f-e319-4c66-afe9-a94d4ab2c7f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fe603d-4m8xv"
Sep 10 20:21:13.429673 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:13.429577    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fe603d-4m8xv"
Sep 10 20:21:13.702012 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:13.701987    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fe603d-4m8xv"]
Sep 10 20:21:13.704384 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:21:13.704357    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3dd91f_e319_4c66_afe9_a94d4ab2c7f7.slice/crio-865feb24969c540360dd20754662dad7bb7703d098b73ea86f60ff9888c52c1f WatchSource:0}: Error finding container 865feb24969c540360dd20754662dad7bb7703d098b73ea86f60ff9888c52c1f: Status 404 returned error can't find the container with id 865feb24969c540360dd20754662dad7bb7703d098b73ea86f60ff9888c52c1f
Sep 10 20:21:14.214796 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:14.214761    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fe603d-4m8xv" event={"ID":"2d3dd91f-e319-4c66-afe9-a94d4ab2c7f7","Type":"ContainerStarted","Data":"e5993410da8f01d46a300991a455dd09e58943ac4c00656ac2734f0158d952c4"}
Sep 10 20:21:14.215148 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:14.214826    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fe603d-4m8xv" event={"ID":"2d3dd91f-e319-4c66-afe9-a94d4ab2c7f7","Type":"ContainerStarted","Data":"865feb24969c540360dd20754662dad7bb7703d098b73ea86f60ff9888c52c1f"}
Sep 10 20:21:14.232095 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:14.232047    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fe603d-4m8xv" podStartSLOduration=1.2320299590000001 podStartE2EDuration="1.232029959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:21:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:21:14.230331899 +0000 UTC m=+1617.895436169" watchObservedRunningTime="2026-09-10 20:21:14.232029959 +0000 UTC m=+1617.897134205"
Sep 10 20:21:15.221695 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:15.221663    2561 generic.go:356] "Generic (PLEG): container finished" podID="2d3dd91f-e319-4c66-afe9-a94d4ab2c7f7" containerID="e5993410da8f01d46a300991a455dd09e58943ac4c00656ac2734f0158d952c4" exitCode=0
Sep 10 20:21:15.222043 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:15.221743    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fe603d-4m8xv" event={"ID":"2d3dd91f-e319-4c66-afe9-a94d4ab2c7f7","Type":"ContainerDied","Data":"e5993410da8f01d46a300991a455dd09e58943ac4c00656ac2734f0158d952c4"}
Sep 10 20:21:16.686719 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:16.686696    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fe603d-4m8xv"
Sep 10 20:21:16.745816 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:16.745785    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d3dd91f-e319-4c66-afe9-a94d4ab2c7f7-maas-api-service-ca\") pod \"2d3dd91f-e319-4c66-afe9-a94d4ab2c7f7\" (UID: \"2d3dd91f-e319-4c66-afe9-a94d4ab2c7f7\") "
Sep 10 20:21:16.746179 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:16.746157    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d3dd91f-e319-4c66-afe9-a94d4ab2c7f7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2d3dd91f-e319-4c66-afe9-a94d4ab2c7f7" (UID: "2d3dd91f-e319-4c66-afe9-a94d4ab2c7f7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:21:16.846601 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:16.846569    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d3dd91f-e319-4c66-afe9-a94d4ab2c7f7-maas-api-service-ca\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:21:17.167176 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:17.167146    2561 scope.go:117] "RemoveContainer" containerID="ec1c86f03d383e3683947b4b4eb85853272f7f63d980ed696baf47ba2dd45e6a"
Sep 10 20:21:17.175227 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:17.175209    2561 scope.go:117] "RemoveContainer" containerID="768f4015d0b3dc9e1ded88f0f0fc2dda44221af9f53685805e41b0c176ffb612"
Sep 10 20:21:17.232919 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:17.232890    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fe603d-4m8xv" event={"ID":"2d3dd91f-e319-4c66-afe9-a94d4ab2c7f7","Type":"ContainerDied","Data":"865feb24969c540360dd20754662dad7bb7703d098b73ea86f60ff9888c52c1f"}
Sep 10 20:21:17.233049 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:17.232953    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fe603d-4m8xv"
Sep 10 20:21:17.233049 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:17.232970    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="865feb24969c540360dd20754662dad7bb7703d098b73ea86f60ff9888c52c1f"
Sep 10 20:21:19.330532 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:19.330488    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh"]
Sep 10 20:21:19.330989 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:19.330720    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh" podUID="efbc153b-4a19-48cc-ac68-654c7543ef1c" containerName="payload-pre-processing" containerID="cri-o://d5ae1ddf033d52699179de3befb56c8a20fae5d2958306aaff2b387525372ec1" gracePeriod=30
Sep 10 20:21:19.482778 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:19.482748    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fe603d-4m8xv"]
Sep 10 20:21:19.489448 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:19.489419    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fe603d-4m8xv"]
Sep 10 20:21:19.941068 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:19.941042    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh"
Sep 10 20:21:19.976046 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:19.975984    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efbc153b-4a19-48cc-ac68-654c7543ef1c-plugins-config-volume\") pod \"efbc153b-4a19-48cc-ac68-654c7543ef1c\" (UID: \"efbc153b-4a19-48cc-ac68-654c7543ef1c\") "
Sep 10 20:21:19.976236 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:19.976065    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljs22\" (UniqueName: \"kubernetes.io/projected/efbc153b-4a19-48cc-ac68-654c7543ef1c-kube-api-access-ljs22\") pod \"efbc153b-4a19-48cc-ac68-654c7543ef1c\" (UID: \"efbc153b-4a19-48cc-ac68-654c7543ef1c\") "
Sep 10 20:21:19.976407 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:19.976371    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efbc153b-4a19-48cc-ac68-654c7543ef1c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "efbc153b-4a19-48cc-ac68-654c7543ef1c" (UID: "efbc153b-4a19-48cc-ac68-654c7543ef1c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:21:19.978283 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:19.978252    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efbc153b-4a19-48cc-ac68-654c7543ef1c-kube-api-access-ljs22" (OuterVolumeSpecName: "kube-api-access-ljs22") pod "efbc153b-4a19-48cc-ac68-654c7543ef1c" (UID: "efbc153b-4a19-48cc-ac68-654c7543ef1c"). InnerVolumeSpecName "kube-api-access-ljs22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:21:20.077089 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:20.077051    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efbc153b-4a19-48cc-ac68-654c7543ef1c-plugins-config-volume\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:21:20.077089 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:20.077090    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljs22\" (UniqueName: \"kubernetes.io/projected/efbc153b-4a19-48cc-ac68-654c7543ef1c-kube-api-access-ljs22\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:21:20.253572 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:20.253485    2561 generic.go:356] "Generic (PLEG): container finished" podID="efbc153b-4a19-48cc-ac68-654c7543ef1c" containerID="d5ae1ddf033d52699179de3befb56c8a20fae5d2958306aaff2b387525372ec1" exitCode=0
Sep 10 20:21:20.253572 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:20.253526    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh"
Sep 10 20:21:20.253572 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:20.253560    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh" event={"ID":"efbc153b-4a19-48cc-ac68-654c7543ef1c","Type":"ContainerDied","Data":"d5ae1ddf033d52699179de3befb56c8a20fae5d2958306aaff2b387525372ec1"}
Sep 10 20:21:20.253850 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:20.253613    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh" event={"ID":"efbc153b-4a19-48cc-ac68-654c7543ef1c","Type":"ContainerDied","Data":"602df65c173d2f051a3484d1549e291cc0534c34ec0f69c43dbb95f574e2adb0"}
Sep 10 20:21:20.253850 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:20.253635    2561 scope.go:117] "RemoveContainer" containerID="d5ae1ddf033d52699179de3befb56c8a20fae5d2958306aaff2b387525372ec1"
Sep 10 20:21:20.263041 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:20.263017    2561 scope.go:117] "RemoveContainer" containerID="d5ae1ddf033d52699179de3befb56c8a20fae5d2958306aaff2b387525372ec1"
Sep 10 20:21:20.263293 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:21:20.263276    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5ae1ddf033d52699179de3befb56c8a20fae5d2958306aaff2b387525372ec1\": container with ID starting with d5ae1ddf033d52699179de3befb56c8a20fae5d2958306aaff2b387525372ec1 not found: ID does not exist" containerID="d5ae1ddf033d52699179de3befb56c8a20fae5d2958306aaff2b387525372ec1"
Sep 10 20:21:20.263378 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:20.263299    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5ae1ddf033d52699179de3befb56c8a20fae5d2958306aaff2b387525372ec1"} err="failed to get container status \"d5ae1ddf033d52699179de3befb56c8a20fae5d2958306aaff2b387525372ec1\": rpc error: code = NotFound desc = could not find container \"d5ae1ddf033d52699179de3befb56c8a20fae5d2958306aaff2b387525372ec1\": container with ID starting with d5ae1ddf033d52699179de3befb56c8a20fae5d2958306aaff2b387525372ec1 not found: ID does not exist"
Sep 10 20:21:20.276843 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:20.276817    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh"]
Sep 10 20:21:20.279221 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:20.279197    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fe603d-58694fbc66-h7pbh"]
Sep 10 20:21:20.850669 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:20.850634    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d3dd91f-e319-4c66-afe9-a94d4ab2c7f7" path="/var/lib/kubelet/pods/2d3dd91f-e319-4c66-afe9-a94d4ab2c7f7/volumes"
Sep 10 20:21:20.851028 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:20.851005    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efbc153b-4a19-48cc-ac68-654c7543ef1c" path="/var/lib/kubelet/pods/efbc153b-4a19-48cc-ac68-654c7543ef1c/volumes"
Sep 10 20:21:23.891465 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:23.891433    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:21:29.449467 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:29.449436    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-316fde-5fx7l"]
Sep 10 20:21:29.450064 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:29.450008    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d3dd91f-e319-4c66-afe9-a94d4ab2c7f7" containerName="revoke-keys"
Sep 10 20:21:29.450064 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:29.450026    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d3dd91f-e319-4c66-afe9-a94d4ab2c7f7" containerName="revoke-keys"
Sep 10 20:21:29.450204 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:29.450065    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efbc153b-4a19-48cc-ac68-654c7543ef1c" containerName="payload-pre-processing"
Sep 10 20:21:29.450204 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:29.450074    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="efbc153b-4a19-48cc-ac68-654c7543ef1c" containerName="payload-pre-processing"
Sep 10 20:21:29.450204 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:29.450156    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="efbc153b-4a19-48cc-ac68-654c7543ef1c" containerName="payload-pre-processing"
Sep 10 20:21:29.450204 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:29.450171    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d3dd91f-e319-4c66-afe9-a94d4ab2c7f7" containerName="revoke-keys"
Sep 10 20:21:29.454631 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:29.454611    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-316fde-5fx7l"
Sep 10 20:21:29.457153 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:29.457135    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zdpml\""
Sep 10 20:21:29.460697 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:29.460669    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-316fde-5fx7l"]
Sep 10 20:21:29.563210 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:29.563182    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65454a39-cdf0-4476-8e45-32e393a6ea04-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-316fde-5fx7l\" (UID: \"65454a39-cdf0-4476-8e45-32e393a6ea04\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-316fde-5fx7l"
Sep 10 20:21:29.663812 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:29.663785    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65454a39-cdf0-4476-8e45-32e393a6ea04-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-316fde-5fx7l\" (UID: \"65454a39-cdf0-4476-8e45-32e393a6ea04\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-316fde-5fx7l"
Sep 10 20:21:29.664385 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:29.664363    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65454a39-cdf0-4476-8e45-32e393a6ea04-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-316fde-5fx7l\" (UID: \"65454a39-cdf0-4476-8e45-32e393a6ea04\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-316fde-5fx7l"
Sep 10 20:21:29.767375 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:29.767308    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-316fde-5fx7l"
Sep 10 20:21:30.036263 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:30.036094    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-316fde-5fx7l"]
Sep 10 20:21:30.038854 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:21:30.038822    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65454a39_cdf0_4476_8e45_32e393a6ea04.slice/crio-e26ab58e680a62a5a12be01de5816d9d81f4edefa2689624822c28cb704f6d7b WatchSource:0}: Error finding container e26ab58e680a62a5a12be01de5816d9d81f4edefa2689624822c28cb704f6d7b: Status 404 returned error can't find the container with id e26ab58e680a62a5a12be01de5816d9d81f4edefa2689624822c28cb704f6d7b
Sep 10 20:21:30.306990 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:30.306915    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-316fde-5fx7l" event={"ID":"65454a39-cdf0-4476-8e45-32e393a6ea04","Type":"ContainerStarted","Data":"3ae818623fd92515f442563d0e66d54edef3e15e977b017f5bf5faed96c41b61"}
Sep 10 20:21:30.306990 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:30.306971    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-316fde-5fx7l" event={"ID":"65454a39-cdf0-4476-8e45-32e393a6ea04","Type":"ContainerStarted","Data":"e26ab58e680a62a5a12be01de5816d9d81f4edefa2689624822c28cb704f6d7b"}
Sep 10 20:21:30.323451 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:30.323406    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-316fde-5fx7l" podStartSLOduration=1.323378294 podStartE2EDuration="1.323378294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:21:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:21:30.321189828 +0000 UTC m=+1633.986294074" watchObservedRunningTime="2026-09-10 20:21:30.323378294 +0000 UTC m=+1633.988482539"
Sep 10 20:21:31.313651 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:31.313619    2561 generic.go:356] "Generic (PLEG): container finished" podID="65454a39-cdf0-4476-8e45-32e393a6ea04" containerID="3ae818623fd92515f442563d0e66d54edef3e15e977b017f5bf5faed96c41b61" exitCode=0
Sep 10 20:21:31.313998 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:31.313665    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-316fde-5fx7l" event={"ID":"65454a39-cdf0-4476-8e45-32e393a6ea04","Type":"ContainerDied","Data":"3ae818623fd92515f442563d0e66d54edef3e15e977b017f5bf5faed96c41b61"}
Sep 10 20:21:32.755258 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:32.755234    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-316fde-5fx7l"
Sep 10 20:21:32.892207 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:32.892180    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65454a39-cdf0-4476-8e45-32e393a6ea04-maas-api-service-ca\") pod \"65454a39-cdf0-4476-8e45-32e393a6ea04\" (UID: \"65454a39-cdf0-4476-8e45-32e393a6ea04\") "
Sep 10 20:21:32.892571 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:32.892552    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65454a39-cdf0-4476-8e45-32e393a6ea04-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "65454a39-cdf0-4476-8e45-32e393a6ea04" (UID: "65454a39-cdf0-4476-8e45-32e393a6ea04"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:21:32.993279 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:32.993201    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65454a39-cdf0-4476-8e45-32e393a6ea04-maas-api-service-ca\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:21:33.325083 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:33.325053    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-316fde-5fx7l" event={"ID":"65454a39-cdf0-4476-8e45-32e393a6ea04","Type":"ContainerDied","Data":"e26ab58e680a62a5a12be01de5816d9d81f4edefa2689624822c28cb704f6d7b"}
Sep 10 20:21:33.325083 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:33.325071    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-316fde-5fx7l"
Sep 10 20:21:33.325293 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:33.325099    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e26ab58e680a62a5a12be01de5816d9d81f4edefa2689624822c28cb704f6d7b"
Sep 10 20:21:43.094136 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:43.094096    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:21:44.994911 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:44.994873    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn"]
Sep 10 20:21:44.995438 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:44.995090    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn" podUID="fedf912e-9c70-49a3-8ca1-88de01621f19" containerName="payload-processing" containerID="cri-o://b993118e117a5877ac8cf0991d0d67db59ee2e70fa6372b78afd0af063a822fb" gracePeriod=30
Sep 10 20:21:45.001442 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:45.000948    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2"]
Sep 10 20:21:45.001442 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:45.001161    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2" podUID="c7cb2fc5-d630-40cf-b59a-6ee08ec07360" containerName="payload-pre-processing" containerID="cri-o://f52ad8bc635fb3d5f096d649891e1d0b8057eb15a1a28c2c5b3e05a152e03448" gracePeriod=30
Sep 10 20:21:45.162073 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:45.162001    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-316fde-5fx7l"]
Sep 10 20:21:45.163994 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:45.163966    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-316fde-5fx7l"]
Sep 10 20:21:45.391324 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:45.391285    2561 generic.go:356] "Generic (PLEG): container finished" podID="c7cb2fc5-d630-40cf-b59a-6ee08ec07360" containerID="f52ad8bc635fb3d5f096d649891e1d0b8057eb15a1a28c2c5b3e05a152e03448" exitCode=0
Sep 10 20:21:45.391562 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:45.391359    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2" event={"ID":"c7cb2fc5-d630-40cf-b59a-6ee08ec07360","Type":"ContainerDied","Data":"f52ad8bc635fb3d5f096d649891e1d0b8057eb15a1a28c2c5b3e05a152e03448"}
Sep 10 20:21:45.393316 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:45.393292    2561 generic.go:356] "Generic (PLEG): container finished" podID="fedf912e-9c70-49a3-8ca1-88de01621f19" containerID="b993118e117a5877ac8cf0991d0d67db59ee2e70fa6372b78afd0af063a822fb" exitCode=0
Sep 10 20:21:45.393463 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:45.393368    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn" event={"ID":"fedf912e-9c70-49a3-8ca1-88de01621f19","Type":"ContainerDied","Data":"b993118e117a5877ac8cf0991d0d67db59ee2e70fa6372b78afd0af063a822fb"}
Sep 10 20:21:45.869158 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:45.869132    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2"
Sep 10 20:21:45.872399 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:45.872368    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn"
Sep 10 20:21:46.013237 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.013199    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7cb2fc5-d630-40cf-b59a-6ee08ec07360-plugins-config-volume\") pod \"c7cb2fc5-d630-40cf-b59a-6ee08ec07360\" (UID: \"c7cb2fc5-d630-40cf-b59a-6ee08ec07360\") "
Sep 10 20:21:46.013704 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.013284    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fedf912e-9c70-49a3-8ca1-88de01621f19-plugins-config-volume\") pod \"fedf912e-9c70-49a3-8ca1-88de01621f19\" (UID: \"fedf912e-9c70-49a3-8ca1-88de01621f19\") "
Sep 10 20:21:46.013704 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.013340    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrhdr\" (UniqueName: \"kubernetes.io/projected/c7cb2fc5-d630-40cf-b59a-6ee08ec07360-kube-api-access-hrhdr\") pod \"c7cb2fc5-d630-40cf-b59a-6ee08ec07360\" (UID: \"c7cb2fc5-d630-40cf-b59a-6ee08ec07360\") "
Sep 10 20:21:46.013704 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.013443    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5flh\" (UniqueName: \"kubernetes.io/projected/fedf912e-9c70-49a3-8ca1-88de01621f19-kube-api-access-q5flh\") pod \"fedf912e-9c70-49a3-8ca1-88de01621f19\" (UID: \"fedf912e-9c70-49a3-8ca1-88de01621f19\") "
Sep 10 20:21:46.013704 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.013631    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7cb2fc5-d630-40cf-b59a-6ee08ec07360-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c7cb2fc5-d630-40cf-b59a-6ee08ec07360" (UID: "c7cb2fc5-d630-40cf-b59a-6ee08ec07360"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:21:46.013704 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.013660    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fedf912e-9c70-49a3-8ca1-88de01621f19-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fedf912e-9c70-49a3-8ca1-88de01621f19" (UID: "fedf912e-9c70-49a3-8ca1-88de01621f19"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:21:46.013902 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.013766    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fedf912e-9c70-49a3-8ca1-88de01621f19-plugins-config-volume\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:21:46.013902 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.013789    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7cb2fc5-d630-40cf-b59a-6ee08ec07360-plugins-config-volume\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:21:46.015495 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.015468    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fedf912e-9c70-49a3-8ca1-88de01621f19-kube-api-access-q5flh" (OuterVolumeSpecName: "kube-api-access-q5flh") pod "fedf912e-9c70-49a3-8ca1-88de01621f19" (UID: "fedf912e-9c70-49a3-8ca1-88de01621f19"). InnerVolumeSpecName "kube-api-access-q5flh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:21:46.015693 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.015677    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7cb2fc5-d630-40cf-b59a-6ee08ec07360-kube-api-access-hrhdr" (OuterVolumeSpecName: "kube-api-access-hrhdr") pod "c7cb2fc5-d630-40cf-b59a-6ee08ec07360" (UID: "c7cb2fc5-d630-40cf-b59a-6ee08ec07360"). InnerVolumeSpecName "kube-api-access-hrhdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:21:46.115027 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.114951    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrhdr\" (UniqueName: \"kubernetes.io/projected/c7cb2fc5-d630-40cf-b59a-6ee08ec07360-kube-api-access-hrhdr\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:21:46.115027 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.114979    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5flh\" (UniqueName: \"kubernetes.io/projected/fedf912e-9c70-49a3-8ca1-88de01621f19-kube-api-access-q5flh\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:21:46.399703 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.399621    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn"
Sep 10 20:21:46.399703 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.399657    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn" event={"ID":"fedf912e-9c70-49a3-8ca1-88de01621f19","Type":"ContainerDied","Data":"7136def66d4ed9e9a2211965b11abd208a1cd86e62e7a086747a54bd844e9075"}
Sep 10 20:21:46.399925 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.399724    2561 scope.go:117] "RemoveContainer" containerID="b993118e117a5877ac8cf0991d0d67db59ee2e70fa6372b78afd0af063a822fb"
Sep 10 20:21:46.401167 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.401049    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2" event={"ID":"c7cb2fc5-d630-40cf-b59a-6ee08ec07360","Type":"ContainerDied","Data":"5c4b7017eca5991014f4fe6b745f7376a5faa9a9ab5a54d8e228a1bf8d79df5e"}
Sep 10 20:21:46.401167 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.401094    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2"
Sep 10 20:21:46.410816 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.410797    2561 scope.go:117] "RemoveContainer" containerID="f52ad8bc635fb3d5f096d649891e1d0b8057eb15a1a28c2c5b3e05a152e03448"
Sep 10 20:21:46.449122 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.449102    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2"]
Sep 10 20:21:46.451123 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.451102    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-316fde-7c5d5d68c4-5j2t2"]
Sep 10 20:21:46.469098 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.469077    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn"]
Sep 10 20:21:46.473275 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.473255    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-316fde-c7f5f6c5f-kjjtn"]
Sep 10 20:21:46.850256 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.850222    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65454a39-cdf0-4476-8e45-32e393a6ea04" path="/var/lib/kubelet/pods/65454a39-cdf0-4476-8e45-32e393a6ea04/volumes"
Sep 10 20:21:46.850615 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.850601    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7cb2fc5-d630-40cf-b59a-6ee08ec07360" path="/var/lib/kubelet/pods/c7cb2fc5-d630-40cf-b59a-6ee08ec07360/volumes"
Sep 10 20:21:46.850927 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:46.850915    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fedf912e-9c70-49a3-8ca1-88de01621f19" path="/var/lib/kubelet/pods/fedf912e-9c70-49a3-8ca1-88de01621f19/volumes"
Sep 10 20:21:55.298067 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:21:55.298030    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:22:33.774495 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:33.774455    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-82457a-85txs"]
Sep 10 20:22:33.775003 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:33.774983    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fedf912e-9c70-49a3-8ca1-88de01621f19" containerName="payload-processing"
Sep 10 20:22:33.775083 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:33.775008    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fedf912e-9c70-49a3-8ca1-88de01621f19" containerName="payload-processing"
Sep 10 20:22:33.775083 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:33.775043    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65454a39-cdf0-4476-8e45-32e393a6ea04" containerName="revoke-keys"
Sep 10 20:22:33.775083 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:33.775054    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="65454a39-cdf0-4476-8e45-32e393a6ea04" containerName="revoke-keys"
Sep 10 20:22:33.775083 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:33.775074    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7cb2fc5-d630-40cf-b59a-6ee08ec07360" containerName="payload-pre-processing"
Sep 10 20:22:33.775282 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:33.775083    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7cb2fc5-d630-40cf-b59a-6ee08ec07360" containerName="payload-pre-processing"
Sep 10 20:22:33.775282 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:33.775181    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fedf912e-9c70-49a3-8ca1-88de01621f19" containerName="payload-processing"
Sep 10 20:22:33.775282 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:33.775195    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7cb2fc5-d630-40cf-b59a-6ee08ec07360" containerName="payload-pre-processing"
Sep 10 20:22:33.775282 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:33.775205    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="65454a39-cdf0-4476-8e45-32e393a6ea04" containerName="revoke-keys"
Sep 10 20:22:33.778207 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:33.778189    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-82457a-85txs"
Sep 10 20:22:33.780616 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:33.780596    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zdpml\""
Sep 10 20:22:33.787413 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:33.786025    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-82457a-85txs"]
Sep 10 20:22:33.948013 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:33.947970    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f6deb3b-29ee-4925-95c0-fab4bd0f49e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-82457a-85txs\" (UID: \"2f6deb3b-29ee-4925-95c0-fab4bd0f49e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-82457a-85txs"
Sep 10 20:22:34.048942 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:34.048856    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f6deb3b-29ee-4925-95c0-fab4bd0f49e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-82457a-85txs\" (UID: \"2f6deb3b-29ee-4925-95c0-fab4bd0f49e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-82457a-85txs"
Sep 10 20:22:34.049517 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:34.049496    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f6deb3b-29ee-4925-95c0-fab4bd0f49e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-82457a-85txs\" (UID: \"2f6deb3b-29ee-4925-95c0-fab4bd0f49e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-82457a-85txs"
Sep 10 20:22:34.098960 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:34.098928    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-82457a-85txs"
Sep 10 20:22:34.371865 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:34.371723    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-82457a-85txs"]
Sep 10 20:22:34.374768 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:22:34.374740    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f6deb3b_29ee_4925_95c0_fab4bd0f49e2.slice/crio-0df7699fcf88ad1c4def59d3d9abbfd05d3eaa3d2216c2736d8983022b90a787 WatchSource:0}: Error finding container 0df7699fcf88ad1c4def59d3d9abbfd05d3eaa3d2216c2736d8983022b90a787: Status 404 returned error can't find the container with id 0df7699fcf88ad1c4def59d3d9abbfd05d3eaa3d2216c2736d8983022b90a787
Sep 10 20:22:34.651934 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:34.651901    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-82457a-85txs" event={"ID":"2f6deb3b-29ee-4925-95c0-fab4bd0f49e2","Type":"ContainerStarted","Data":"bc50edb5dd296970a6377ffd948be906380551a897942096225c5d424866fb4e"}
Sep 10 20:22:34.652072 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:34.651953    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-82457a-85txs" event={"ID":"2f6deb3b-29ee-4925-95c0-fab4bd0f49e2","Type":"ContainerStarted","Data":"0df7699fcf88ad1c4def59d3d9abbfd05d3eaa3d2216c2736d8983022b90a787"}
Sep 10 20:22:34.670731 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:34.670688    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-82457a-85txs" podStartSLOduration=1.6706743149999999 podStartE2EDuration="1.670674315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:22:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:22:34.669708487 +0000 UTC m=+1698.334812747" watchObservedRunningTime="2026-09-10 20:22:34.670674315 +0000 UTC m=+1698.335778563"
Sep 10 20:22:35.658682 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:35.658648    2561 generic.go:356] "Generic (PLEG): container finished" podID="2f6deb3b-29ee-4925-95c0-fab4bd0f49e2" containerID="bc50edb5dd296970a6377ffd948be906380551a897942096225c5d424866fb4e" exitCode=0
Sep 10 20:22:35.659062 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:35.658730    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-82457a-85txs" event={"ID":"2f6deb3b-29ee-4925-95c0-fab4bd0f49e2","Type":"ContainerDied","Data":"bc50edb5dd296970a6377ffd948be906380551a897942096225c5d424866fb4e"}
Sep 10 20:22:37.148815 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:37.148793    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-82457a-85txs"
Sep 10 20:22:37.278297 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:37.278265    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f6deb3b-29ee-4925-95c0-fab4bd0f49e2-maas-api-service-ca\") pod \"2f6deb3b-29ee-4925-95c0-fab4bd0f49e2\" (UID: \"2f6deb3b-29ee-4925-95c0-fab4bd0f49e2\") "
Sep 10 20:22:37.278618 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:37.278597    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f6deb3b-29ee-4925-95c0-fab4bd0f49e2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2f6deb3b-29ee-4925-95c0-fab4bd0f49e2" (UID: "2f6deb3b-29ee-4925-95c0-fab4bd0f49e2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:22:37.379803 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:37.379733    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f6deb3b-29ee-4925-95c0-fab4bd0f49e2-maas-api-service-ca\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:22:37.669717 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:37.669616    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-82457a-85txs" event={"ID":"2f6deb3b-29ee-4925-95c0-fab4bd0f49e2","Type":"ContainerDied","Data":"0df7699fcf88ad1c4def59d3d9abbfd05d3eaa3d2216c2736d8983022b90a787"}
Sep 10 20:22:37.669717 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:37.669640    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-82457a-85txs"
Sep 10 20:22:37.669717 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:37.669673    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0df7699fcf88ad1c4def59d3d9abbfd05d3eaa3d2216c2736d8983022b90a787"
Sep 10 20:22:44.299653 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:44.299573    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq"]
Sep 10 20:22:44.300107 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:44.299780    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq" podUID="04dd2e67-db67-484e-8093-af5593537c09" containerName="payload-processing" containerID="cri-o://21ba226ec816cf71941eb92ccae0e9cf311ceb7055cca3bae3442ecbe2dff302" gracePeriod=30
Sep 10 20:22:44.514320 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:44.514287    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-82457a-85txs"]
Sep 10 20:22:44.517041 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:44.517011    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-82457a-85txs"]
Sep 10 20:22:44.714072 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:44.714042    2561 generic.go:356] "Generic (PLEG): container finished" podID="04dd2e67-db67-484e-8093-af5593537c09" containerID="21ba226ec816cf71941eb92ccae0e9cf311ceb7055cca3bae3442ecbe2dff302" exitCode=0
Sep 10 20:22:44.714237 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:44.714127    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq" event={"ID":"04dd2e67-db67-484e-8093-af5593537c09","Type":"ContainerDied","Data":"21ba226ec816cf71941eb92ccae0e9cf311ceb7055cca3bae3442ecbe2dff302"}
Sep 10 20:22:44.851542 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:44.851514    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f6deb3b-29ee-4925-95c0-fab4bd0f49e2" path="/var/lib/kubelet/pods/2f6deb3b-29ee-4925-95c0-fab4bd0f49e2/volumes"
Sep 10 20:22:44.910049 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:44.910025    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq"
Sep 10 20:22:44.941643 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:44.941617    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04dd2e67-db67-484e-8093-af5593537c09-plugins-config-volume\") pod \"04dd2e67-db67-484e-8093-af5593537c09\" (UID: \"04dd2e67-db67-484e-8093-af5593537c09\") "
Sep 10 20:22:44.941813 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:44.941668    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p92vh\" (UniqueName: \"kubernetes.io/projected/04dd2e67-db67-484e-8093-af5593537c09-kube-api-access-p92vh\") pod \"04dd2e67-db67-484e-8093-af5593537c09\" (UID: \"04dd2e67-db67-484e-8093-af5593537c09\") "
Sep 10 20:22:44.942042 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:44.942013    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04dd2e67-db67-484e-8093-af5593537c09-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "04dd2e67-db67-484e-8093-af5593537c09" (UID: "04dd2e67-db67-484e-8093-af5593537c09"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:22:44.943863 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:44.943842    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04dd2e67-db67-484e-8093-af5593537c09-kube-api-access-p92vh" (OuterVolumeSpecName: "kube-api-access-p92vh") pod "04dd2e67-db67-484e-8093-af5593537c09" (UID: "04dd2e67-db67-484e-8093-af5593537c09"). InnerVolumeSpecName "kube-api-access-p92vh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:22:45.042712 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:45.042626    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04dd2e67-db67-484e-8093-af5593537c09-plugins-config-volume\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:22:45.042712 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:45.042655    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p92vh\" (UniqueName: \"kubernetes.io/projected/04dd2e67-db67-484e-8093-af5593537c09-kube-api-access-p92vh\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:22:45.720168 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:45.720134    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq" event={"ID":"04dd2e67-db67-484e-8093-af5593537c09","Type":"ContainerDied","Data":"401a721e9c7ec012c268ff1bdd41627d7dafa4f595fcd30f73d3612d63ed0cfb"}
Sep 10 20:22:45.720168 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:45.720155    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq"
Sep 10 20:22:45.720720 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:45.720221    2561 scope.go:117] "RemoveContainer" containerID="21ba226ec816cf71941eb92ccae0e9cf311ceb7055cca3bae3442ecbe2dff302"
Sep 10 20:22:45.740629 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:45.740606    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq"]
Sep 10 20:22:45.744896 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:45.744872    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-82457a-7686466f6f-wpvsq"]
Sep 10 20:22:46.851040 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:46.851008    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04dd2e67-db67-484e-8093-af5593537c09" path="/var/lib/kubelet/pods/04dd2e67-db67-484e-8093-af5593537c09/volumes"
Sep 10 20:22:47.594793 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:47.594762    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:22:51.334966 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:51.334932    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-591d7c-db26n"]
Sep 10 20:22:51.335460 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:51.335350    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f6deb3b-29ee-4925-95c0-fab4bd0f49e2" containerName="revoke-keys"
Sep 10 20:22:51.335460 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:51.335363    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f6deb3b-29ee-4925-95c0-fab4bd0f49e2" containerName="revoke-keys"
Sep 10 20:22:51.335460 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:51.335381    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04dd2e67-db67-484e-8093-af5593537c09" containerName="payload-processing"
Sep 10 20:22:51.335460 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:51.335386    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="04dd2e67-db67-484e-8093-af5593537c09" containerName="payload-processing"
Sep 10 20:22:51.335615 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:51.335469    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="04dd2e67-db67-484e-8093-af5593537c09" containerName="payload-processing"
Sep 10 20:22:51.335615 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:51.335478    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f6deb3b-29ee-4925-95c0-fab4bd0f49e2" containerName="revoke-keys"
Sep 10 20:22:51.338331 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:51.338311    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-591d7c-db26n"
Sep 10 20:22:51.340868 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:51.340847    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zdpml\""
Sep 10 20:22:51.345373 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:51.345352    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-591d7c-db26n"]
Sep 10 20:22:51.400622 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:51.400588    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfcbb74c-2b5e-4c1b-b9f5-ab3056d40876-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-591d7c-db26n\" (UID: \"cfcbb74c-2b5e-4c1b-b9f5-ab3056d40876\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-591d7c-db26n"
Sep 10 20:22:51.501229 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:51.501196    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfcbb74c-2b5e-4c1b-b9f5-ab3056d40876-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-591d7c-db26n\" (UID: \"cfcbb74c-2b5e-4c1b-b9f5-ab3056d40876\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-591d7c-db26n"
Sep 10 20:22:51.501811 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:51.501788    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfcbb74c-2b5e-4c1b-b9f5-ab3056d40876-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-591d7c-db26n\" (UID: \"cfcbb74c-2b5e-4c1b-b9f5-ab3056d40876\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-591d7c-db26n"
Sep 10 20:22:51.650380 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:51.650302    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-591d7c-db26n"
Sep 10 20:22:51.924983 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:51.924951    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-591d7c-db26n"]
Sep 10 20:22:51.927235 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:22:51.927208    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfcbb74c_2b5e_4c1b_b9f5_ab3056d40876.slice/crio-b1d62233442281b62b38d7aa8ecfccb74093f5790683edb6d56dbb9af15c97f9 WatchSource:0}: Error finding container b1d62233442281b62b38d7aa8ecfccb74093f5790683edb6d56dbb9af15c97f9: Status 404 returned error can't find the container with id b1d62233442281b62b38d7aa8ecfccb74093f5790683edb6d56dbb9af15c97f9
Sep 10 20:22:52.758349 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:52.758274    2561 generic.go:356] "Generic (PLEG): container finished" podID="cfcbb74c-2b5e-4c1b-b9f5-ab3056d40876" containerID="aa8fc0aa63d4bcdaa6355881ce0379f6e54df7fadb2bf18670081e1786cc2ac7" exitCode=0
Sep 10 20:22:52.758349 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:52.758314    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-591d7c-db26n" event={"ID":"cfcbb74c-2b5e-4c1b-b9f5-ab3056d40876","Type":"ContainerDied","Data":"aa8fc0aa63d4bcdaa6355881ce0379f6e54df7fadb2bf18670081e1786cc2ac7"}
Sep 10 20:22:52.758737 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:52.758356    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-591d7c-db26n" event={"ID":"cfcbb74c-2b5e-4c1b-b9f5-ab3056d40876","Type":"ContainerStarted","Data":"b1d62233442281b62b38d7aa8ecfccb74093f5790683edb6d56dbb9af15c97f9"}
Sep 10 20:22:54.208204 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:54.208179    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-591d7c-db26n"
Sep 10 20:22:54.323824 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:54.323795    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfcbb74c-2b5e-4c1b-b9f5-ab3056d40876-maas-api-service-ca\") pod \"cfcbb74c-2b5e-4c1b-b9f5-ab3056d40876\" (UID: \"cfcbb74c-2b5e-4c1b-b9f5-ab3056d40876\") "
Sep 10 20:22:54.324138 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:54.324115    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfcbb74c-2b5e-4c1b-b9f5-ab3056d40876-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cfcbb74c-2b5e-4c1b-b9f5-ab3056d40876" (UID: "cfcbb74c-2b5e-4c1b-b9f5-ab3056d40876"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:22:54.425214 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:54.425180    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfcbb74c-2b5e-4c1b-b9f5-ab3056d40876-maas-api-service-ca\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:22:54.769871 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:54.769795    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-591d7c-db26n" event={"ID":"cfcbb74c-2b5e-4c1b-b9f5-ab3056d40876","Type":"ContainerDied","Data":"b1d62233442281b62b38d7aa8ecfccb74093f5790683edb6d56dbb9af15c97f9"}
Sep 10 20:22:54.769871 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:54.769823    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-591d7c-db26n"
Sep 10 20:22:54.769871 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:22:54.769840    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1d62233442281b62b38d7aa8ecfccb74093f5790683edb6d56dbb9af15c97f9"
Sep 10 20:23:01.891968 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:01.891931    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-591d7c-29817855-n7t8q"]
Sep 10 20:23:01.896259 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:01.896234    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-591d7c-29817855-n7t8q"]
Sep 10 20:23:02.158444 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:02.158352    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-591d7c-db26n"]
Sep 10 20:23:02.163593 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:02.163567    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-591d7c-db26n"]
Sep 10 20:23:02.849644 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:02.849608    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72304d70-7b28-4db4-80a9-5bc27f4ec670" path="/var/lib/kubelet/pods/72304d70-7b28-4db4-80a9-5bc27f4ec670/volumes"
Sep 10 20:23:02.849991 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:02.849971    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfcbb74c-2b5e-4c1b-b9f5-ab3056d40876" path="/var/lib/kubelet/pods/cfcbb74c-2b5e-4c1b-b9f5-ab3056d40876/volumes"
Sep 10 20:23:04.793630 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:04.793595    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:23:08.762465 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:08.762433    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"]
Sep 10 20:23:08.762893 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:08.762637    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq" podUID="5eef44d1-6da0-4116-8e48-f84c2c1cc13e" containerName="istio-proxy" containerID="cri-o://53ade3f7e81fe2fd859593d05c38b6300a91d47500b52ecec6ec433e77f64da3" gracePeriod=30
Sep 10 20:23:13.266596 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:13.266559    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 20:23:13.266970 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:13.266630    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq" podUID="5eef44d1-6da0-4116-8e48-f84c2c1cc13e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 20:23:14.317554 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.317503    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:23:14.415299 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.415270    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istiod-ca-cert\") pod \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") "
Sep 10 20:23:14.415482 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.415360    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-envoy\") pod \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") "
Sep 10 20:23:14.415482 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.415411    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-podinfo\") pod \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") "
Sep 10 20:23:14.415482 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.415440    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-data\") pod \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") "
Sep 10 20:23:14.415482 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.415467    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-workload-socket\") pod \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") "
Sep 10 20:23:14.415724 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.415495    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hldmt\" (UniqueName: \"kubernetes.io/projected/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-kube-api-access-hldmt\") pod \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") "
Sep 10 20:23:14.415724 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.415541    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-workload-certs\") pod \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") "
Sep 10 20:23:14.415724 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.415582    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-credential-socket\") pod \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") "
Sep 10 20:23:14.415724 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.415634    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-token\") pod \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\" (UID: \"5eef44d1-6da0-4116-8e48-f84c2c1cc13e\") "
Sep 10 20:23:14.415724 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.415693    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5eef44d1-6da0-4116-8e48-f84c2c1cc13e" (UID: "5eef44d1-6da0-4116-8e48-f84c2c1cc13e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:23:14.415984 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.415782    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5eef44d1-6da0-4116-8e48-f84c2c1cc13e" (UID: "5eef44d1-6da0-4116-8e48-f84c2c1cc13e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:23:14.415984 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.415904    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5eef44d1-6da0-4116-8e48-f84c2c1cc13e" (UID: "5eef44d1-6da0-4116-8e48-f84c2c1cc13e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:23:14.415984 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.415748    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-data" (OuterVolumeSpecName: "istio-data") pod "5eef44d1-6da0-4116-8e48-f84c2c1cc13e" (UID: "5eef44d1-6da0-4116-8e48-f84c2c1cc13e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:23:14.415984 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.415979    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-data\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:23:14.416186 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.415998    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-workload-socket\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:23:14.416186 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.416013    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-workload-certs\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:23:14.416186 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.416027    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istiod-ca-cert\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:23:14.416186 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.416028    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5eef44d1-6da0-4116-8e48-f84c2c1cc13e" (UID: "5eef44d1-6da0-4116-8e48-f84c2c1cc13e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:23:14.417621 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.417595    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5eef44d1-6da0-4116-8e48-f84c2c1cc13e" (UID: "5eef44d1-6da0-4116-8e48-f84c2c1cc13e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 20:23:14.417742 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.417680    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5eef44d1-6da0-4116-8e48-f84c2c1cc13e" (UID: "5eef44d1-6da0-4116-8e48-f84c2c1cc13e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:23:14.417807 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.417762    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-kube-api-access-hldmt" (OuterVolumeSpecName: "kube-api-access-hldmt") pod "5eef44d1-6da0-4116-8e48-f84c2c1cc13e" (UID: "5eef44d1-6da0-4116-8e48-f84c2c1cc13e"). InnerVolumeSpecName "kube-api-access-hldmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:23:14.417897 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.417881    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-token" (OuterVolumeSpecName: "istio-token") pod "5eef44d1-6da0-4116-8e48-f84c2c1cc13e" (UID: "5eef44d1-6da0-4116-8e48-f84c2c1cc13e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:23:14.516483 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.516450    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-envoy\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:23:14.516483 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.516477    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-podinfo\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:23:14.516483 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.516486    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hldmt\" (UniqueName: \"kubernetes.io/projected/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-kube-api-access-hldmt\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:23:14.516704 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.516495    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-credential-socket\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:23:14.516704 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.516505    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eef44d1-6da0-4116-8e48-f84c2c1cc13e-istio-token\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:23:14.873210 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.873182    2561 generic.go:356] "Generic (PLEG): container finished" podID="5eef44d1-6da0-4116-8e48-f84c2c1cc13e" containerID="53ade3f7e81fe2fd859593d05c38b6300a91d47500b52ecec6ec433e77f64da3" exitCode=0
Sep 10 20:23:14.873321 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.873240    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"
Sep 10 20:23:14.873321 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.873270    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq" event={"ID":"5eef44d1-6da0-4116-8e48-f84c2c1cc13e","Type":"ContainerDied","Data":"53ade3f7e81fe2fd859593d05c38b6300a91d47500b52ecec6ec433e77f64da3"}
Sep 10 20:23:14.873321 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.873308    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq" event={"ID":"5eef44d1-6da0-4116-8e48-f84c2c1cc13e","Type":"ContainerDied","Data":"be52dc86013a17a0addd52733fc141f8e07a607d9f13bbf8c4b27b5ae0659346"}
Sep 10 20:23:14.873493 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.873328    2561 scope.go:117] "RemoveContainer" containerID="53ade3f7e81fe2fd859593d05c38b6300a91d47500b52ecec6ec433e77f64da3"
Sep 10 20:23:14.881877 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.881854    2561 scope.go:117] "RemoveContainer" containerID="1cab799923ac0739c5e50fb58dc1f43d5a2f21cefdc37abacbbc9f8c7c1ff30a"
Sep 10 20:23:14.889809 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.889787    2561 scope.go:117] "RemoveContainer" containerID="53ade3f7e81fe2fd859593d05c38b6300a91d47500b52ecec6ec433e77f64da3"
Sep 10 20:23:14.890103 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:23:14.890086    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53ade3f7e81fe2fd859593d05c38b6300a91d47500b52ecec6ec433e77f64da3\": container with ID starting with 53ade3f7e81fe2fd859593d05c38b6300a91d47500b52ecec6ec433e77f64da3 not found: ID does not exist" containerID="53ade3f7e81fe2fd859593d05c38b6300a91d47500b52ecec6ec433e77f64da3"
Sep 10 20:23:14.890182 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.890115    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53ade3f7e81fe2fd859593d05c38b6300a91d47500b52ecec6ec433e77f64da3"} err="failed to get container status \"53ade3f7e81fe2fd859593d05c38b6300a91d47500b52ecec6ec433e77f64da3\": rpc error: code = NotFound desc = could not find container \"53ade3f7e81fe2fd859593d05c38b6300a91d47500b52ecec6ec433e77f64da3\": container with ID starting with 53ade3f7e81fe2fd859593d05c38b6300a91d47500b52ecec6ec433e77f64da3 not found: ID does not exist"
Sep 10 20:23:14.890182 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.890139    2561 scope.go:117] "RemoveContainer" containerID="1cab799923ac0739c5e50fb58dc1f43d5a2f21cefdc37abacbbc9f8c7c1ff30a"
Sep 10 20:23:14.890478 ip-10-0-133-162 kubenswrapper[2561]: E0910 20:23:14.890406    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cab799923ac0739c5e50fb58dc1f43d5a2f21cefdc37abacbbc9f8c7c1ff30a\": container with ID starting with 1cab799923ac0739c5e50fb58dc1f43d5a2f21cefdc37abacbbc9f8c7c1ff30a not found: ID does not exist" containerID="1cab799923ac0739c5e50fb58dc1f43d5a2f21cefdc37abacbbc9f8c7c1ff30a"
Sep 10 20:23:14.890478 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.890433    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cab799923ac0739c5e50fb58dc1f43d5a2f21cefdc37abacbbc9f8c7c1ff30a"} err="failed to get container status \"1cab799923ac0739c5e50fb58dc1f43d5a2f21cefdc37abacbbc9f8c7c1ff30a\": rpc error: code = NotFound desc = could not find container \"1cab799923ac0739c5e50fb58dc1f43d5a2f21cefdc37abacbbc9f8c7c1ff30a\": container with ID starting with 1cab799923ac0739c5e50fb58dc1f43d5a2f21cefdc37abacbbc9f8c7c1ff30a not found: ID does not exist"
Sep 10 20:23:14.891216 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.891198    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"]
Sep 10 20:23:14.894880 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:14.894860    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-591d7c-openshift-default-64898f848b-vqcbq"]
Sep 10 20:23:16.850088 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:16.850055    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5eef44d1-6da0-4116-8e48-f84c2c1cc13e" path="/var/lib/kubelet/pods/5eef44d1-6da0-4116-8e48-f84c2c1cc13e/volumes"
Sep 10 20:23:17.217119 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:17.217039    2561 scope.go:117] "RemoveContainer" containerID="b96c6360f5497e0592a905ada28be7c5f2f7a0235f14ba955c77ab2878629473"
Sep 10 20:23:19.577629 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:19.577594    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-6550b4-29817855-crxkg"]
Sep 10 20:23:19.580226 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:19.580197    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-6550b4-29817855-crxkg"]
Sep 10 20:23:19.597983 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:19.597952    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94"]
Sep 10 20:23:19.598457 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:19.598382    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94" podUID="009c2b9c-1b11-406f-92ed-5845a8775388" containerName="payload-processing" containerID="cri-o://f1e496c9783b84168aaa249412a12637bcea42899e29b6d6598ad21d3cdda784" gracePeriod=30
Sep 10 20:23:19.901609 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:19.901519    2561 generic.go:356] "Generic (PLEG): container finished" podID="009c2b9c-1b11-406f-92ed-5845a8775388" containerID="f1e496c9783b84168aaa249412a12637bcea42899e29b6d6598ad21d3cdda784" exitCode=0
Sep 10 20:23:19.901776 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:19.901643    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94" event={"ID":"009c2b9c-1b11-406f-92ed-5845a8775388","Type":"ContainerDied","Data":"f1e496c9783b84168aaa249412a12637bcea42899e29b6d6598ad21d3cdda784"}
Sep 10 20:23:20.191281 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:20.191251    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94"
Sep 10 20:23:20.375255 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:20.375224    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6g27p\" (UniqueName: \"kubernetes.io/projected/009c2b9c-1b11-406f-92ed-5845a8775388-kube-api-access-6g27p\") pod \"009c2b9c-1b11-406f-92ed-5845a8775388\" (UID: \"009c2b9c-1b11-406f-92ed-5845a8775388\") "
Sep 10 20:23:20.375504 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:20.375275    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/009c2b9c-1b11-406f-92ed-5845a8775388-plugins-config-volume\") pod \"009c2b9c-1b11-406f-92ed-5845a8775388\" (UID: \"009c2b9c-1b11-406f-92ed-5845a8775388\") "
Sep 10 20:23:20.375653 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:20.375622    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/009c2b9c-1b11-406f-92ed-5845a8775388-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "009c2b9c-1b11-406f-92ed-5845a8775388" (UID: "009c2b9c-1b11-406f-92ed-5845a8775388"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:23:20.377294 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:20.377269    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/009c2b9c-1b11-406f-92ed-5845a8775388-kube-api-access-6g27p" (OuterVolumeSpecName: "kube-api-access-6g27p") pod "009c2b9c-1b11-406f-92ed-5845a8775388" (UID: "009c2b9c-1b11-406f-92ed-5845a8775388"). InnerVolumeSpecName "kube-api-access-6g27p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:23:20.476832 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:20.476744    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6g27p\" (UniqueName: \"kubernetes.io/projected/009c2b9c-1b11-406f-92ed-5845a8775388-kube-api-access-6g27p\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:23:20.476832 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:20.476772    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/009c2b9c-1b11-406f-92ed-5845a8775388-plugins-config-volume\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\""
Sep 10 20:23:20.850807 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:20.850770    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55786e1b-9d92-47e4-9bdd-8af4427948b7" path="/var/lib/kubelet/pods/55786e1b-9d92-47e4-9bdd-8af4427948b7/volumes"
Sep 10 20:23:20.907565 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:20.907537    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94"
Sep 10 20:23:20.907732 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:20.907568    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94" event={"ID":"009c2b9c-1b11-406f-92ed-5845a8775388","Type":"ContainerDied","Data":"7f06d50538526811bfc1715df6f8ac0e80c0c710e3eb2fa43b4ef42f00ddd245"}
Sep 10 20:23:20.907732 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:20.907627    2561 scope.go:117] "RemoveContainer" containerID="f1e496c9783b84168aaa249412a12637bcea42899e29b6d6598ad21d3cdda784"
Sep 10 20:23:20.923899 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:20.923875    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94"]
Sep 10 20:23:20.929202 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:20.929180    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-6550b4-866cb9d88f-brp94"]
Sep 10 20:23:21.194166 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:21.194091    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:23:22.850909 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:22.850871    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="009c2b9c-1b11-406f-92ed-5845a8775388" path="/var/lib/kubelet/pods/009c2b9c-1b11-406f-92ed-5845a8775388/volumes"
Sep 10 20:23:30.594103 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:23:30.594067    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:24:17.243860 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:24:17.243832    2561 scope.go:117] "RemoveContainer" containerID="b86e65ac8254dd38232654e16cc3fee2f8d2765da00007b683af73b720a771a1"
Sep 10 20:24:17.252176 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:24:17.252150    2561 scope.go:117] "RemoveContainer" containerID="4e34f6c539a27df0d160905f4b1a484c51250b03a8d1275a43bea733b5b16d12"
Sep 10 20:24:51.600047 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:24:51.600014    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:25:17.897060 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:25:17.897029    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:25:25.599582 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:25:25.599549    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:25:33.194246 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:25:33.194208    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:25:40.390578 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:25:40.390505    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:25:48.489358 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:25:48.489322    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:25:56.094286 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:25:56.094253    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:26:03.497239 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:26:03.497202    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:26:11.403325 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:26:11.403291    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:27:17.302222 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:27:17.302184    2561 scope.go:117] "RemoveContainer" containerID="e5993410da8f01d46a300991a455dd09e58943ac4c00656ac2734f0158d952c4"
Sep 10 20:27:39.601541 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:27:39.601501    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:27:47.699029 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:27:47.698989    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:27:54.402381 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:27:54.402337    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:28:11.301094 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:28:11.301055    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:28:17.323736 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:28:17.323704    2561 scope.go:117] "RemoveContainer" containerID="3ae818623fd92515f442563d0e66d54edef3e15e977b017f5bf5faed96c41b61"
Sep 10 20:28:31.796697 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:28:31.796652    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:28:39.798283 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:28:39.798198    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:28:45.491149 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:28:45.491115    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:28:53.090949 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:28:53.090912    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:29:00.703807 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:00.703771    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:29:07.491549 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:07.491515    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:29:13.398205 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:13.398164    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:29:17.344744 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:17.344708    2561 scope.go:117] "RemoveContainer" containerID="bc50edb5dd296970a6377ffd948be906380551a897942096225c5d424866fb4e"
Sep 10 20:29:17.355275 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:17.355244    2561 scope.go:117] "RemoveContainer" containerID="aa8fc0aa63d4bcdaa6355881ce0379f6e54df7fadb2bf18670081e1786cc2ac7"
Sep 10 20:29:20.492467 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:20.492425    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6kjgx"]
Sep 10 20:29:22.974116 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:22.974088    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68bf5ff85c-mpfk9_43842a1c-65cd-460c-bf44-320746fd2662/authorino/0.log"
Sep 10 20:29:28.428734 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:28.428703    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-wgrsm_750ad70e-5da8-416f-aa61-2f6f6f3e7ddc/manager/0.log"
Sep 10 20:29:28.557669 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:28.557642    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9wxh9_8f7d4043-c58c-462f-a9a1-a0471d473dac/manager/0.log"
Sep 10 20:29:29.205590 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:29.205565    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5678c4c4c5-qn2wd_78c874eb-d8ad-47be-81df-b50bf33f11ca/copy-manifests/0.log"
Sep 10 20:29:29.219956 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:29.219933    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5678c4c4c5-qn2wd_78c874eb-d8ad-47be-81df-b50bf33f11ca/manager/0.log"
Sep 10 20:29:30.054778 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:30.054751    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-dkw5x_b3346029-ff0f-486e-8bcb-110eefd6a7ed/postgres/0.log"
Sep 10 20:29:30.877697 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:30.877671    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68bf5ff85c-mpfk9_43842a1c-65cd-460c-bf44-320746fd2662/authorino/0.log"
Sep 10 20:29:30.997965 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:30.997940    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-85k6c_358c0815-6d65-410c-91ab-94835fb83e36/manager/0.log"
Sep 10 20:29:31.114719 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:31.114695    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-t562c_f4fe97cb-8360-4fcb-b584-f5b1ced2c755/manager/0.log"
Sep 10 20:29:31.222881 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:31.222813    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-45rrs_30f0e8a7-c487-4887-9e39-6484080fd3be/kuadrant-console-plugin/0.log"
Sep 10 20:29:31.458430 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:31.458381    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-6kjgx_1f8f5ee0-0be9-4379-934c-8067bfa6315c/limitador/0.log"
Sep 10 20:29:31.580788 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:31.580762    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-b7hvp_cc8fae29-e3c1-4b1f-95d8-e24f8288fc4c/manager/0.log"
Sep 10 20:29:32.291772 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:32.291744    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576c9858ff-jvpgj_267713b8-71c6-4962-a12c-63bca79dc657/kube-auth-proxy/0.log"
Sep 10 20:29:32.416821 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:32.416788    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-2d2hl_608dc0a9-91cf-4679-a99d-6b2e04d7cbef/istio-proxy/1.log"
Sep 10 20:29:32.535912 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:32.535880    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-285zb_610beaf4-64cc-4802-9ad3-3bb86b55f884/payload-pre-processing/0.log"
Sep 10 20:29:32.777294 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:32.777270    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66dcf9c45b-792j7_5d01e644-3fdb-48d6-91a4-b67b53b1a804/router/0.log"
Sep 10 20:29:33.267170 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:33.267141    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-v9f9x_943c089a-e449-4431-8b07-88877d567dec/main/0.log"
Sep 10 20:29:33.506474 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:33.506449    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-vbczg_a4272939-57da-468e-9896-f07e2617b5ec/main/0.log"
Sep 10 20:29:33.745982 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:33.745953    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-gd9lh_a9d36a2b-7fdb-49f1-ad3f-859a95377cb6/main/0.log"
Sep 10 20:29:43.091496 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:43.091465    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-klxsb_91e2acc4-0716-4fcb-95ee-32d1668449e7/global-pull-secret-syncer/0.log"
Sep 10 20:29:43.307943 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:43.307914    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-shxth_bf92bb85-73f0-46a4-b32e-b83f8d56ac82/konnectivity-agent/0.log"
Sep 10 20:29:43.375045 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:43.374972    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-162.ec2.internal_2bed3b36dfff37d8ae39ecb426eba237/haproxy/0.log"
Sep 10 20:29:48.398449 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:48.398388    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68bf5ff85c-mpfk9_43842a1c-65cd-460c-bf44-320746fd2662/authorino/0.log"
Sep 10 20:29:48.432907 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:48.432878    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-85k6c_358c0815-6d65-410c-91ab-94835fb83e36/manager/0.log"
Sep 10 20:29:48.473213 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:48.473187    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-t562c_f4fe97cb-8360-4fcb-b584-f5b1ced2c755/manager/0.log"
Sep 10 20:29:48.511597 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:48.511575    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-45rrs_30f0e8a7-c487-4887-9e39-6484080fd3be/kuadrant-console-plugin/0.log"
Sep 10 20:29:48.603536 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:48.603510    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-6kjgx_1f8f5ee0-0be9-4379-934c-8067bfa6315c/limitador/0.log"
Sep 10 20:29:48.671619 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:48.671536    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-b7hvp_cc8fae29-e3c1-4b1f-95d8-e24f8288fc4c/manager/0.log"
Sep 10 20:29:50.698022 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:50.697992    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-78bd9bbf89-2dwq6_d1e2e487-7073-411c-9994-b7de15777c99/metrics-server/0.log"
Sep 10 20:29:50.947532 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:50.947509    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q5blr_7ac5e386-7d56-4201-8f44-6e605d6ba083/node-exporter/0.log"
Sep 10 20:29:50.971285 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:50.971213    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q5blr_7ac5e386-7d56-4201-8f44-6e605d6ba083/kube-rbac-proxy/0.log"
Sep 10 20:29:50.996032 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:50.996009    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q5blr_7ac5e386-7d56-4201-8f44-6e605d6ba083/init-textfile/0.log"
Sep 10 20:29:53.091964 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.091924    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75"]
Sep 10 20:29:53.092448 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.092431    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfcbb74c-2b5e-4c1b-b9f5-ab3056d40876" containerName="revoke-keys"
Sep 10 20:29:53.092532 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.092451    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfcbb74c-2b5e-4c1b-b9f5-ab3056d40876" containerName="revoke-keys"
Sep 10 20:29:53.092532 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.092469    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eef44d1-6da0-4116-8e48-f84c2c1cc13e" containerName="istio-proxy"
Sep 10 20:29:53.092532 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.092479    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eef44d1-6da0-4116-8e48-f84c2c1cc13e" containerName="istio-proxy"
Sep 10 20:29:53.092532 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.092489    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eef44d1-6da0-4116-8e48-f84c2c1cc13e" containerName="istio-proxy"
Sep 10 20:29:53.092532 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.092498    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eef44d1-6da0-4116-8e48-f84c2c1cc13e" containerName="istio-proxy"
Sep 10 20:29:53.092532 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.092528    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="009c2b9c-1b11-406f-92ed-5845a8775388" containerName="payload-processing"
Sep 10 20:29:53.092834 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.092537    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="009c2b9c-1b11-406f-92ed-5845a8775388" containerName="payload-processing"
Sep 10 20:29:53.092834 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.092625    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfcbb74c-2b5e-4c1b-b9f5-ab3056d40876" containerName="revoke-keys"
Sep 10 20:29:53.092834 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.092641    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="009c2b9c-1b11-406f-92ed-5845a8775388" containerName="payload-processing"
Sep 10 20:29:53.092834 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.092652    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5eef44d1-6da0-4116-8e48-f84c2c1cc13e" containerName="istio-proxy"
Sep 10 20:29:53.092834 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.092669    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5eef44d1-6da0-4116-8e48-f84c2c1cc13e" containerName="istio-proxy"
Sep 10 20:29:53.095597 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.095576    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75"
Sep 10 20:29:53.098222 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.098203    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g28c4\"/\"kube-root-ca.crt\""
Sep 10 20:29:53.099192 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.099173    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g28c4\"/\"openshift-service-ca.crt\""
Sep 10 20:29:53.099291 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.099178    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g28c4\"/\"default-dockercfg-qnx6f\""
Sep 10 20:29:53.110530 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.110505    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75"]
Sep 10 20:29:53.120927 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.120896    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbc8m\" (UniqueName: \"kubernetes.io/projected/92b30aa7-3882-4954-a736-340dd7544c3d-kube-api-access-qbc8m\") pod \"perf-node-gather-daemonset-xtb75\" (UID: \"92b30aa7-3882-4954-a736-340dd7544c3d\") " pod="openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75"
Sep 10 20:29:53.121032 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.120950    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92b30aa7-3882-4954-a736-340dd7544c3d-podres\") pod \"perf-node-gather-daemonset-xtb75\" (UID: \"92b30aa7-3882-4954-a736-340dd7544c3d\") " pod="openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75"
Sep 10 20:29:53.121032 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.120979    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92b30aa7-3882-4954-a736-340dd7544c3d-sys\") pod \"perf-node-gather-daemonset-xtb75\" (UID: \"92b30aa7-3882-4954-a736-340dd7544c3d\") " pod="openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75"
Sep 10 20:29:53.121105 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.121060    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92b30aa7-3882-4954-a736-340dd7544c3d-lib-modules\") pod \"perf-node-gather-daemonset-xtb75\" (UID: \"92b30aa7-3882-4954-a736-340dd7544c3d\") " pod="openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75"
Sep 10 20:29:53.121190 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.121172    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92b30aa7-3882-4954-a736-340dd7544c3d-proc\") pod \"perf-node-gather-daemonset-xtb75\" (UID: \"92b30aa7-3882-4954-a736-340dd7544c3d\") " pod="openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75"
Sep 10 20:29:53.221994 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.221963    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92b30aa7-3882-4954-a736-340dd7544c3d-lib-modules\") pod \"perf-node-gather-daemonset-xtb75\" (UID: \"92b30aa7-3882-4954-a736-340dd7544c3d\") " pod="openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75"
Sep 10 20:29:53.222158 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.222038    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92b30aa7-3882-4954-a736-340dd7544c3d-proc\") pod \"perf-node-gather-daemonset-xtb75\" (UID: \"92b30aa7-3882-4954-a736-340dd7544c3d\") " pod="openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75"
Sep 10 20:29:53.222158 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.222073    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbc8m\" (UniqueName: \"kubernetes.io/projected/92b30aa7-3882-4954-a736-340dd7544c3d-kube-api-access-qbc8m\") pod \"perf-node-gather-daemonset-xtb75\" (UID: \"92b30aa7-3882-4954-a736-340dd7544c3d\") " pod="openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75"
Sep 10 20:29:53.222158 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.222104    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92b30aa7-3882-4954-a736-340dd7544c3d-podres\") pod \"perf-node-gather-daemonset-xtb75\" (UID: \"92b30aa7-3882-4954-a736-340dd7544c3d\") " pod="openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75"
Sep 10 20:29:53.222158 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.222128    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92b30aa7-3882-4954-a736-340dd7544c3d-sys\") pod \"perf-node-gather-daemonset-xtb75\" (UID: \"92b30aa7-3882-4954-a736-340dd7544c3d\") " pod="openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75"
Sep 10 20:29:53.222158 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.222141    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92b30aa7-3882-4954-a736-340dd7544c3d-lib-modules\") pod \"perf-node-gather-daemonset-xtb75\" (UID: \"92b30aa7-3882-4954-a736-340dd7544c3d\") " pod="openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75"
Sep 10 20:29:53.222384 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.222149    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92b30aa7-3882-4954-a736-340dd7544c3d-proc\") pod \"perf-node-gather-daemonset-xtb75\" (UID: \"92b30aa7-3882-4954-a736-340dd7544c3d\") " pod="openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75"
Sep 10 20:29:53.222384 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.222199    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92b30aa7-3882-4954-a736-340dd7544c3d-podres\") pod \"perf-node-gather-daemonset-xtb75\" (UID: \"92b30aa7-3882-4954-a736-340dd7544c3d\") " pod="openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75"
Sep 10 20:29:53.222384 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.222232    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92b30aa7-3882-4954-a736-340dd7544c3d-sys\") pod \"perf-node-gather-daemonset-xtb75\" (UID: \"92b30aa7-3882-4954-a736-340dd7544c3d\") " pod="openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75"
Sep 10 20:29:53.231670 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.231651    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbc8m\" (UniqueName: \"kubernetes.io/projected/92b30aa7-3882-4954-a736-340dd7544c3d-kube-api-access-qbc8m\") pod \"perf-node-gather-daemonset-xtb75\" (UID: \"92b30aa7-3882-4954-a736-340dd7544c3d\") " pod="openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75"
Sep 10 20:29:53.405430 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.405344    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75"
Sep 10 20:29:53.681531 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.681504    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75"]
Sep 10 20:29:53.683534 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:29:53.683505    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod92b30aa7_3882_4954_a736_340dd7544c3d.slice/crio-c8e2ba9e97dd485aa62636d6ad821b44542f71412881daca3121eb2d5943b7bb WatchSource:0}: Error finding container c8e2ba9e97dd485aa62636d6ad821b44542f71412881daca3121eb2d5943b7bb: Status 404 returned error can't find the container with id c8e2ba9e97dd485aa62636d6ad821b44542f71412881daca3121eb2d5943b7bb
Sep 10 20:29:53.869690 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.869658    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75" event={"ID":"92b30aa7-3882-4954-a736-340dd7544c3d","Type":"ContainerStarted","Data":"6a3249185c83c00bc3b10b90f6a0dea0056900be7ce79ad3f3d2d0416e232cb8"}
Sep 10 20:29:53.869851 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.869715    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75"
Sep 10 20:29:53.869851 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.869732    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75" event={"ID":"92b30aa7-3882-4954-a736-340dd7544c3d","Type":"ContainerStarted","Data":"c8e2ba9e97dd485aa62636d6ad821b44542f71412881daca3121eb2d5943b7bb"}
Sep 10 20:29:53.889305 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:53.889266    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75" podStartSLOduration=0.88924989 podStartE2EDuration="889.24989ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:29:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:29:53.888069905 +0000 UTC m=+2137.553174151" watchObservedRunningTime="2026-09-10 20:29:53.88924989 +0000 UTC m=+2137.554354138"
Sep 10 20:29:54.143711 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:54.143687    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-784bf5967-mtz67_b74c81d3-ad49-4af8-a2e2-d597541b6d1a/console/0.log"
Sep 10 20:29:56.204055 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:56.204026    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zln5l_c63240bf-c37d-4515-83ce-231154951432/dns/0.log"
Sep 10 20:29:56.224867 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:56.224848    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zln5l_c63240bf-c37d-4515-83ce-231154951432/kube-rbac-proxy/0.log"
Sep 10 20:29:56.248991 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:56.248974    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lqn7b_b1686c34-4f9d-424e-9b3b-9daf34983519/dns-node-resolver/0.log"
Sep 10 20:29:56.949764 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:56.949734    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vrgkq_ee70731d-0545-406f-bc04-c0589d986e18/node-ca/0.log"
Sep 10 20:29:58.379615 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:58.379587    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576c9858ff-jvpgj_267713b8-71c6-4962-a12c-63bca79dc657/kube-auth-proxy/0.log"
Sep 10 20:29:58.407248 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:58.407223    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-2d2hl_608dc0a9-91cf-4679-a99d-6b2e04d7cbef/istio-proxy/0.log"
Sep 10 20:29:58.415658 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:58.415636    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-2d2hl_608dc0a9-91cf-4679-a99d-6b2e04d7cbef/istio-proxy/1.log"
Sep 10 20:29:58.448352 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:58.448329    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-285zb_610beaf4-64cc-4802-9ad3-3bb86b55f884/payload-pre-processing/0.log"
Sep 10 20:29:58.522382 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:58.522356    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66dcf9c45b-792j7_5d01e644-3fdb-48d6-91a4-b67b53b1a804/router/0.log"
Sep 10 20:29:59.470111 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:59.470083    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-srpmn_0992094b-05c3-47cf-977f-bbcbfa0f813d/serve-healthcheck-canary/0.log"
Sep 10 20:29:59.884732 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:29:59.884707    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g28c4/perf-node-gather-daemonset-xtb75"
Sep 10 20:30:00.107759 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:00.107734    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nhrt9_4cb38969-93c6-40c9-acea-ba93e00d8485/kube-rbac-proxy/0.log"
Sep 10 20:30:00.135161 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:00.135087    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nhrt9_4cb38969-93c6-40c9-acea-ba93e00d8485/exporter/0.log"
Sep 10 20:30:00.144588 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:00.144566    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817870-859bs"]
Sep 10 20:30:00.147940 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:00.147924    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817870-859bs"
Sep 10 20:30:00.150547 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:00.150529    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zdpml\""
Sep 10 20:30:00.156224 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:00.156203    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817870-859bs"]
Sep 10 20:30:00.158409 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:00.158376    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817870-859bs"
Sep 10 20:30:00.162438 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:00.162421    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nhrt9_4cb38969-93c6-40c9-acea-ba93e00d8485/extractor/0.log"
Sep 10 20:30:00.434958 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:00.434933    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817870-859bs"]
Sep 10 20:30:00.437497 ip-10-0-133-162 kubenswrapper[2561]: W0910 20:30:00.437470    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae30716e_366b_4140_911d_6e04457645b6.slice/crio-7b7c82c69b30d8f418ee27eceec219d38b451a93870f99204e8754b2bcf48a00 WatchSource:0}: Error finding container 7b7c82c69b30d8f418ee27eceec219d38b451a93870f99204e8754b2bcf48a00: Status 404 returned error can't find the container with id 7b7c82c69b30d8f418ee27eceec219d38b451a93870f99204e8754b2bcf48a00
Sep 10 20:30:00.909121 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:00.909090    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817870-859bs" event={"ID":"ae30716e-366b-4140-911d-6e04457645b6","Type":"ContainerStarted","Data":"9b7be7eb12cc55468e039e37ee9e8eb0c18c3dd810a11c8c32d20e2b326a6cf1"}
Sep 10 20:30:00.909615 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:00.909152    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817870-859bs" event={"ID":"ae30716e-366b-4140-911d-6e04457645b6","Type":"ContainerStarted","Data":"7b7c82c69b30d8f418ee27eceec219d38b451a93870f99204e8754b2bcf48a00"}
Sep 10 20:30:00.932582 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:00.932521    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817870-859bs" podStartSLOduration=0.932502355 podStartE2EDuration="932.502355ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:30:00.92907043 +0000 UTC m=+2144.594174676" watchObservedRunningTime="2026-09-10 20:30:00.932502355 +0000 UTC m=+2144.597606612"
Sep 10 20:30:01.914640 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:01.914609    2561 generic.go:356] "Generic (PLEG): container finished" podID="ae30716e-366b-4140-911d-6e04457645b6" containerID="9b7be7eb12cc55468e039e37ee9e8eb0c18c3dd810a11c8c32d20e2b326a6cf1" exitCode=0
Sep 10 20:30:01.914982 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:01.914663    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817870-859bs" event={"ID":"ae30716e-366b-4140-911d-6e04457645b6","Type":"ContainerDied","Data":"9b7be7eb12cc55468e039e37ee9e8eb0c18c3dd810a11c8c32d20e2b326a6cf1"}
Sep 10 20:30:02.767211 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:02.767187    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-wgrsm_750ad70e-5da8-416f-aa61-2f6f6f3e7ddc/manager/0.log"
Sep 10 20:30:02.974568 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:02.974544    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9wxh9_8f7d4043-c58c-462f-a9a1-a0471d473dac/manager/0.log"
Sep 10 20:30:03.388099 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:03.388073    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817870-859bs"
Sep 10 20:30:03.533914 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:03.533886    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5678c4c4c5-qn2wd_78c874eb-d8ad-47be-81df-b50bf33f11ca/manager/0.log"
Sep 10 20:30:03.599797 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:03.599717    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5678c4c4c5-qn2wd_78c874eb-d8ad-47be-81df-b50bf33f11ca/copy-manifests/0.log"
Sep 10 20:30:03.925410 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:03.925320    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817870-859bs"
Sep 10 20:30:03.925410 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:03.925355    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817870-859bs" event={"ID":"ae30716e-366b-4140-911d-6e04457645b6","Type":"ContainerDied","Data":"7b7c82c69b30d8f418ee27eceec219d38b451a93870f99204e8754b2bcf48a00"}
Sep 10 20:30:03.925586 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:03.925418    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b7c82c69b30d8f418ee27eceec219d38b451a93870f99204e8754b2bcf48a00"
Sep 10 20:30:04.721587 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:04.721563    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576c9858ff-jvpgj_267713b8-71c6-4962-a12c-63bca79dc657/kube-auth-proxy/0.log"
Sep 10 20:30:04.747824 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:04.747790    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-2d2hl_608dc0a9-91cf-4679-a99d-6b2e04d7cbef/istio-proxy/0.log"
Sep 10 20:30:04.755361 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:04.755338    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-2d2hl_608dc0a9-91cf-4679-a99d-6b2e04d7cbef/istio-proxy/1.log"
Sep 10 20:30:04.784385 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:04.784361    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-285zb_610beaf4-64cc-4802-9ad3-3bb86b55f884/payload-pre-processing/0.log"
Sep 10 20:30:04.846749 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:04.846726    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66dcf9c45b-792j7_5d01e644-3fdb-48d6-91a4-b67b53b1a804/router/0.log"
Sep 10 20:30:06.856354 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:06.856325    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576c9858ff-jvpgj_267713b8-71c6-4962-a12c-63bca79dc657/kube-auth-proxy/0.log"
Sep 10 20:30:06.882407 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:06.882371    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-2d2hl_608dc0a9-91cf-4679-a99d-6b2e04d7cbef/istio-proxy/0.log"
Sep 10 20:30:06.890918 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:06.890894    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-2d2hl_608dc0a9-91cf-4679-a99d-6b2e04d7cbef/istio-proxy/1.log"
Sep 10 20:30:06.917827 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:06.917801    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-285zb_610beaf4-64cc-4802-9ad3-3bb86b55f884/payload-pre-processing/0.log"
Sep 10 20:30:06.977943 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:06.977923    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66dcf9c45b-792j7_5d01e644-3fdb-48d6-91a4-b67b53b1a804/router/0.log"
Sep 10 20:30:10.990187 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:10.990158    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-bf98q_253acc31-66e4-4ec2-8dc3-445ffc402492/kube-storage-version-migrator-operator/1.log"
Sep 10 20:30:10.991161 ip-10-0-133-162 kubenswrapper[2561]: I0910 20:30:10.991142    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-bf98q_253acc31-66e4-4ec2-8dc3-445ffc402492/kube-storage-version-migrator-operator/0.log"