Sep 15 11:37:03.161542 ip-10-0-129-183 systemd[1]: Starting Kubernetes Kubelet...
Sep 15 11:37:03.582272 ip-10-0-129-183 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 11:37:03.582272 ip-10-0-129-183 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 15 11:37:03.582272 ip-10-0-129-183 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 11:37:03.582272 ip-10-0-129-183 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 15 11:37:03.582272 ip-10-0-129-183 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 11:37:03.584144 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.584053    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 15 11:37:03.588140 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588125    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:37:03.588140 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588141    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:37:03.588205 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588144    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:37:03.588205 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588148    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:37:03.588205 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588158    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:37:03.588205 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588162    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:37:03.588205 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588164    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:37:03.588205 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588169    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:37:03.588205 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588173    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:37:03.588205 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588177    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:37:03.588205 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588181    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:37:03.588205 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588184    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:37:03.588205 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588188    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:37:03.588205 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588192    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:37:03.588205 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588195    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:37:03.588205 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588198    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:37:03.588205 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588206    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:37:03.588205 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588209    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:37:03.588205 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588212    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:37:03.588205 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588214    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:37:03.588652 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588217    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:37:03.588652 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588220    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:37:03.588652 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588223    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:37:03.588652 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588225    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:37:03.588652 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588228    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:37:03.588652 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588231    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:37:03.588652 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588234    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:37:03.588652 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588236    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:37:03.588652 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588239    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:37:03.588652 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588242    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:37:03.588652 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588244    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:37:03.588652 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588247    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:37:03.588652 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588249    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:37:03.588652 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588252    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:37:03.588652 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588254    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:37:03.588652 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588257    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:37:03.588652 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588274    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:37:03.588652 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588277    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:37:03.588652 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588279    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:37:03.588652 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588282    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:37:03.589131 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588284    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:37:03.589131 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588287    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:37:03.589131 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588289    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:37:03.589131 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588292    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:37:03.589131 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588294    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:37:03.589131 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588297    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:37:03.589131 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588300    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:37:03.589131 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588303    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:37:03.589131 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588305    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:37:03.589131 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588307    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:37:03.589131 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588310    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:37:03.589131 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588314    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:37:03.589131 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588317    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:37:03.589131 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588320    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:37:03.589131 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588323    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:37:03.589131 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588326    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:37:03.589131 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588329    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:37:03.589131 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588331    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:37:03.589131 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588334    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:37:03.589131 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588336    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:37:03.589643 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588339    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:37:03.589643 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588342    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:37:03.589643 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588344    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:37:03.589643 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588347    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:37:03.589643 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588349    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:37:03.589643 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588351    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:37:03.589643 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588354    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:37:03.589643 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588357    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:37:03.589643 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588359    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:37:03.589643 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588362    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:37:03.589643 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588364    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:37:03.589643 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588367    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:37:03.589643 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588370    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:37:03.589643 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588373    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:37:03.589643 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588378    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:37:03.589643 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588381    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:37:03.589643 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588384    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:37:03.589643 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588387    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:37:03.589643 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588390    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:37:03.589643 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588392    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:37:03.590127 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588395    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:37:03.590127 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588398    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:37:03.590127 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588401    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:37:03.590127 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588403    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:37:03.590127 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588406    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:37:03.590127 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588409    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:37:03.590127 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588412    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:37:03.590127 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588415    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:37:03.590127 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588417    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:37:03.590127 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588420    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:37:03.590127 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588423    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:37:03.590127 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588426    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:37:03.590127 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588428    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:37:03.590127 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588431    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:37:03.590127 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588434    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:37:03.590127 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588436    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:37:03.590127 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588439    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:37:03.590127 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588441    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:37:03.590127 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.588443    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:37:03.590610 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589142    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:37:03.590610 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589149    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:37:03.590610 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589152    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:37:03.590610 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589156    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:37:03.590610 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589159    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:37:03.590610 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589162    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:37:03.590610 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589165    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:37:03.590610 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589168    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:37:03.590610 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589171    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:37:03.590610 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589175    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:37:03.590610 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589179    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:37:03.590610 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589182    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:37:03.590610 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589184    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:37:03.590610 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589187    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:37:03.590610 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589189    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:37:03.590610 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589193    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:37:03.590610 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589197    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:37:03.590610 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589200    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:37:03.590610 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589203    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:37:03.591088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589207    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:37:03.591088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589209    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:37:03.591088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589212    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:37:03.591088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589215    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:37:03.591088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589218    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:37:03.591088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589221    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:37:03.591088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589223    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:37:03.591088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589226    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:37:03.591088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589229    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:37:03.591088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589231    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:37:03.591088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589234    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:37:03.591088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589237    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:37:03.591088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589240    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:37:03.591088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589243    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:37:03.591088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589246    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:37:03.591088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589249    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:37:03.591088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589251    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:37:03.591088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589254    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:37:03.591088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589257    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:37:03.591573 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589278    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:37:03.591573 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589281    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:37:03.591573 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589283    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:37:03.591573 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589286    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:37:03.591573 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589289    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:37:03.591573 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589291    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:37:03.591573 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589294    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:37:03.591573 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589296    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:37:03.591573 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589299    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:37:03.591573 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589302    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:37:03.591573 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589304    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:37:03.591573 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589307    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:37:03.591573 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589310    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:37:03.591573 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589313    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:37:03.591573 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589316    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:37:03.591573 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589319    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:37:03.591573 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589322    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:37:03.591573 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589325    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:37:03.591573 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589328    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:37:03.591573 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589331    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:37:03.592062 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589333    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:37:03.592062 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589336    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:37:03.592062 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589338    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:37:03.592062 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589341    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:37:03.592062 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589343    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:37:03.592062 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589346    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:37:03.592062 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589349    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:37:03.592062 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589351    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:37:03.592062 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589355    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:37:03.592062 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589357    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:37:03.592062 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589361    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:37:03.592062 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589363    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:37:03.592062 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589366    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:37:03.592062 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589368    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:37:03.592062 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589371    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:37:03.592062 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589374    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:37:03.592062 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589376    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:37:03.592062 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589379    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:37:03.592062 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589381    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:37:03.592062 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589384    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:37:03.592062 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589387    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:37:03.592671 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589389    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:37:03.592671 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589392    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:37:03.592671 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589395    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:37:03.592671 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589399    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:37:03.592671 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589404    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:37:03.592671 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589407    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:37:03.592671 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589410    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:37:03.592671 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589413    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:37:03.592671 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589416    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:37:03.592671 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589418    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:37:03.592671 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589422    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:37:03.592671 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589424    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:37:03.592671 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589427    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:37:03.592671 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589429    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:37:03.592671 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589432    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:37:03.592671 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589435    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:37:03.592671 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589437    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:37:03.592671 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589440    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:37:03.592671 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589443    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:37:03.593140 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589445    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:37:03.593140 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589862    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:37:03.593140 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589867    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:37:03.593140 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589871    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:37:03.593140 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589874    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:37:03.593140 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589882    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:37:03.593140 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589887    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:37:03.593140 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589891    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:37:03.593140 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589893    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:37:03.593140 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589896    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:37:03.593140 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589899    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:37:03.593140 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589902    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:37:03.593140 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589905    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:37:03.593140 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589908    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:37:03.593140 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589911    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:37:03.593140 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589913    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:37:03.593140 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589917    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:37:03.593140 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589920    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:37:03.593140 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589922    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:37:03.593638 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589925    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:37:03.593638 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589928    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:37:03.593638 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589930    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:37:03.593638 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589933    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:37:03.593638 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589935    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:37:03.593638 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589938    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:37:03.593638 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589940    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:37:03.593638 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589943    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:37:03.593638 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589946    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:37:03.593638 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589949    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:37:03.593638 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589952    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:37:03.593638 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589955    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:37:03.593638 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589957    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:37:03.593638 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589960    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:37:03.593638 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589962    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:37:03.593638 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589965    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:37:03.593638 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589968    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:37:03.593638 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589971    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:37:03.593638 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589973    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:37:03.594096 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589981    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:37:03.594096 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589984    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:37:03.594096 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589986    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:37:03.594096 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589989    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:37:03.594096 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589991    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:37:03.594096 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589994    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:37:03.594096 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589997    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:37:03.594096 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.589999    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:37:03.594096 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590002    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:37:03.594096 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590004    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:37:03.594096 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590007    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:37:03.594096 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590010    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:37:03.594096 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590012    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:37:03.594096 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590015    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:37:03.594096 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590017    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:37:03.594096 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590020    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:37:03.594096 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590023    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:37:03.594096 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590025    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:37:03.594096 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590028    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:37:03.594096 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590030    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:37:03.594613 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590033    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:37:03.594613 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590035    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:37:03.594613 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590038    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:37:03.594613 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590040    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:37:03.594613 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590042    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:37:03.594613 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590045    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:37:03.594613 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590047    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:37:03.594613 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590050    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:37:03.594613 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590052    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:37:03.594613 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590055    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:37:03.594613 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590058    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:37:03.594613 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590060    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:37:03.594613 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590063    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:37:03.594613 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590071    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:37:03.594613 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590073    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:37:03.594613 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590076    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:37:03.594613 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590079    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:37:03.594613 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590081    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:37:03.594613 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590083    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:37:03.594613 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590086    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:37:03.595129 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590090    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:37:03.595129 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590094    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:37:03.595129 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590098    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:37:03.595129 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590101    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:37:03.595129 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590104    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:37:03.595129 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590107    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:37:03.595129 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590110    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:37:03.595129 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590112    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:37:03.595129 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590115    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:37:03.595129 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590125    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:37:03.595129 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590127    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:37:03.595129 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590130    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:37:03.595129 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590133    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:37:03.595129 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590136    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:37:03.595129 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590138    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:37:03.595129 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590141    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:37:03.595129 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590143    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:37:03.595129 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590146    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:37:03.595129 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590148    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590151    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590153    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590156    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590242    2564 flags.go:64] FLAG: --address="0.0.0.0"
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590302    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590309    2564 flags.go:64] FLAG: --anonymous-auth="true"
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590314    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590325    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590328    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590333    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590337    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590340    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590343    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590346    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590350    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590354    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590357    2564 flags.go:64] FLAG: --cgroup-root=""
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590360    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590363    2564 flags.go:64] FLAG: --client-ca-file=""
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590366    2564 flags.go:64] FLAG: --cloud-provider="external"
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590369    2564 flags.go:64] FLAG: --cluster-dns="[]"
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590377    2564 flags.go:64] FLAG: --cluster-domain=""
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590380    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 15 11:37:03.595614 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590383    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590387    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590390    2564 flags.go:64] FLAG: --container-log-max-files="5"
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590393    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590396    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590399    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590403    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590406    2564 flags.go:64] FLAG: --contention-profiling="false"
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590409    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590412    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590415    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590421    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590425    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590428    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590431    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590434    2564 flags.go:64] FLAG: --enable-load-reader="false"
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590437    2564 flags.go:64] FLAG: --enable-server="true"
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590445    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590459    2564 flags.go:64] FLAG: --event-burst="100"
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590462    2564 flags.go:64] FLAG: --event-qps="50"
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590465    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590468    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590471    2564 flags.go:64] FLAG: --eviction-hard=""
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590475    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 15 11:37:03.596221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590481    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 15 11:37:03.596805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590484    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 15 11:37:03.596805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590487    2564 flags.go:64] FLAG: --eviction-soft=""
Sep 15 11:37:03.596805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590490    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 15 11:37:03.596805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590493    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 15 11:37:03.596805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590497    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 15 11:37:03.596805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590499    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 15 11:37:03.596805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590502    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 15 11:37:03.596805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590505    2564 flags.go:64] FLAG: --fail-swap-on="true"
Sep 15 11:37:03.596805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590508    2564 flags.go:64] FLAG: --feature-gates=""
Sep 15 11:37:03.596805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590512    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 15 11:37:03.596805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590515    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 15 11:37:03.596805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590518    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 15 11:37:03.596805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590521    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 15 11:37:03.596805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590524    2564 flags.go:64] FLAG: --healthz-port="10248"
Sep 15 11:37:03.596805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590527    2564 flags.go:64] FLAG: --help="false"
Sep 15 11:37:03.596805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590531    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-129-183.ec2.internal"
Sep 15 11:37:03.596805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590535    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 15 11:37:03.596805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590538    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 15 11:37:03.596805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590541    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 15 11:37:03.596805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590544    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 15 11:37:03.596805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590547    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 15 11:37:03.596805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590550    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 15 11:37:03.596805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590553    2564 flags.go:64] FLAG: --image-service-endpoint=""
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590556    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590559    2564 flags.go:64] FLAG: --kube-api-burst="100"
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590567    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590570    2564 flags.go:64] FLAG: --kube-api-qps="50"
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590573    2564 flags.go:64] FLAG: --kube-reserved=""
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590577    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590580    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590583    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590586    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590589    2564 flags.go:64] FLAG: --lock-file=""
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590592    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590595    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590598    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590603    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590606    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590609    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590612    2564 flags.go:64] FLAG: --logging-format="text"
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590615    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590618    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590621    2564 flags.go:64] FLAG: --manifest-url=""
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590624    2564 flags.go:64] FLAG: --manifest-url-header=""
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590629    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590632    2564 flags.go:64] FLAG: --max-open-files="1000000"
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590636    2564 flags.go:64] FLAG: --max-pods="110"
Sep 15 11:37:03.597457 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590639    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590642    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590645    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590648    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590651    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590654    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590657    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590664    2564 flags.go:64] FLAG: --node-status-max-images="50"
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590667    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590670    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590673    2564 flags.go:64] FLAG: --pod-cidr=""
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590682    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590687    2564 flags.go:64] FLAG: --pod-manifest-path=""
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590690    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590693    2564 flags.go:64] FLAG: --pods-per-core="0"
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590696    2564 flags.go:64] FLAG: --port="10250"
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590699    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590703    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e363c8320a9c4f14"
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590706    2564 flags.go:64] FLAG: --qos-reserved=""
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590709    2564 flags.go:64] FLAG: --read-only-port="10255"
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590712    2564 flags.go:64] FLAG: --register-node="true"
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590715    2564 flags.go:64] FLAG: --register-with-taints=""
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590719    2564 flags.go:64] FLAG: --registry-burst="10"
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590722    2564 flags.go:64] FLAG: --registry-qps="5"
Sep 15 11:37:03.598070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590725    2564 flags.go:64] FLAG: --reserved-cpus=""
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590727    2564 flags.go:64] FLAG: --reserved-memory=""
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590731    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590734    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590737    2564 flags.go:64] FLAG: --rotate-certificates="false"
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590740    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590743    2564 flags.go:64] FLAG: --runonce="false"
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590746    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590749    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590753    2564 flags.go:64] FLAG: --seccomp-default="false"
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590756    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590758    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590761    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590764    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590768    2564 flags.go:64] FLAG: --storage-driver-password="root"
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590770    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590773    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590777    2564 flags.go:64] FLAG: --storage-driver-user="root"
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590779    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590783    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590791    2564 flags.go:64] FLAG: --system-cgroups=""
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590794    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590799    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590802    2564 flags.go:64] FLAG: --tls-cert-file=""
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590805    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 15 11:37:03.598694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590813    2564 flags.go:64] FLAG: --tls-min-version=""
Sep 15 11:37:03.599312 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590816    2564 flags.go:64] FLAG: --tls-private-key-file=""
Sep 15 11:37:03.599312 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590819    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 15 11:37:03.599312 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590822    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 15 11:37:03.599312 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590825    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 15 11:37:03.599312 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590828    2564 flags.go:64] FLAG: --v="2"
Sep 15 11:37:03.599312 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590832    2564 flags.go:64] FLAG: --version="false"
Sep 15 11:37:03.599312 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590836    2564 flags.go:64] FLAG: --vmodule=""
Sep 15 11:37:03.599312 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590840    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 15 11:37:03.599312 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.590843    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 15 11:37:03.599312 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590975    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:37:03.599312 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590979    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:37:03.599312 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590982    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:37:03.599312 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590985    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:37:03.599312 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590988    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:37:03.599312 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590991    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:37:03.599312 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590994    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:37:03.599312 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.590998    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:37:03.599312 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591000    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:37:03.599312 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591003    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:37:03.599312 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591006    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:37:03.599312 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591009    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:37:03.599312 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591012    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:37:03.599891 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591015    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:37:03.599891 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591018    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:37:03.599891 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591021    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:37:03.599891 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591024    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:37:03.599891 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591027    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:37:03.599891 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591036    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:37:03.599891 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591038    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:37:03.599891 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591041    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:37:03.599891 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591044    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:37:03.599891 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591048    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:37:03.599891 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591052    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:37:03.599891 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591056    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:37:03.599891 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591058    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:37:03.599891 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591061    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:37:03.599891 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591064    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:37:03.599891 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591066    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:37:03.599891 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591069    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:37:03.599891 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591072    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:37:03.599891 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591074    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:37:03.600393 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591077    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:37:03.600393 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591079    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:37:03.600393 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591082    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:37:03.600393 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591084    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:37:03.600393 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591087    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:37:03.600393 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591090    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:37:03.600393 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591093    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:37:03.600393 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591096    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:37:03.600393 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591098    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:37:03.600393 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591101    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:37:03.600393 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591104    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:37:03.600393 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591106    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:37:03.600393 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591109    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:37:03.600393 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591112    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:37:03.600393 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591115    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:37:03.600393 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591117    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:37:03.600393 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591120    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:37:03.600393 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591122    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:37:03.600393 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591125    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:37:03.600393 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591140    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:37:03.600893 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591143    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:37:03.600893 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591146    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:37:03.600893 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591150    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:37:03.600893 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591154    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:37:03.600893 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591157    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:37:03.600893 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591160    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:37:03.600893 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591163    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:37:03.600893 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591165    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:37:03.600893 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591168    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:37:03.600893 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591171    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:37:03.600893 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591174    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:37:03.600893 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591177    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:37:03.600893 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591179    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:37:03.600893 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591182    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:37:03.600893 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591184    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:37:03.600893 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591187    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:37:03.600893 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591190    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:37:03.600893 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591196    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:37:03.600893 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591199    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:37:03.601389 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591202    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:37:03.601389 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591205    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:37:03.601389 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591209    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:37:03.601389 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591212    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:37:03.601389 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591215    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:37:03.601389 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591218    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:37:03.601389 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591221    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:37:03.601389 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591223    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:37:03.601389 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591226    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:37:03.601389 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591229    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:37:03.601389 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591231    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:37:03.601389 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591234    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:37:03.601389 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591237    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:37:03.601389 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591245    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:37:03.601389 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591248    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:37:03.601389 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591252    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:37:03.601389 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591254    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:37:03.601389 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591257    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:37:03.601389 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591275    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:37:03.601389 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591279    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:37:03.601875 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591283    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:37:03.601875 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591287    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:37:03.601875 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591290    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:37:03.601875 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591293    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:37:03.601875 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591295    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:37:03.601875 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591298    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:37:03.601875 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591301    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:37:03.601875 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.591303    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:37:03.601875 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.591938    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 11:37:03.601875 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.599473    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 15 11:37:03.601875 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.599487    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 15 11:37:03.601875 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.599505    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 15 11:37:03.601875 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.599511    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 15 11:37:03.601875 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599577    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:37:03.602230 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599583    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:37:03.602230 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599587    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:37:03.602230 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599590    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:37:03.602230 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599594    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:37:03.602230 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599597    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:37:03.602230 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599600    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:37:03.602230 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599603    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:37:03.602230 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599606    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:37:03.602230 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599608    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:37:03.602230 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599611    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:37:03.602230 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599614    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:37:03.602230 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599617    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:37:03.602230 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599620    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:37:03.602230 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599623    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:37:03.602230 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599625    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:37:03.602230 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599628    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:37:03.602230 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599631    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:37:03.602230 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599633    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:37:03.602230 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599636    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:37:03.602230 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599638    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:37:03.602743 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599642    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:37:03.602743 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599646    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:37:03.602743 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599649    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:37:03.602743 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599652    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:37:03.602743 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599654    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:37:03.602743 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599657    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:37:03.602743 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599660    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:37:03.602743 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599662    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:37:03.602743 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599666    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:37:03.602743 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599669    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:37:03.602743 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599672    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:37:03.602743 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599674    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:37:03.602743 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599677    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:37:03.602743 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599680    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:37:03.602743 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599682    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:37:03.602743 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599685    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:37:03.602743 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599688    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:37:03.602743 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599690    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:37:03.602743 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599693    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:37:03.603254 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599696    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:37:03.603254 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599698    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:37:03.603254 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599701    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:37:03.603254 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599703    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:37:03.603254 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599706    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:37:03.603254 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599709    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:37:03.603254 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599712    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:37:03.603254 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599714    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:37:03.603254 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599717    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:37:03.603254 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599719    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:37:03.603254 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599722    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:37:03.603254 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599726    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:37:03.603254 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599729    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:37:03.603254 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599732    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:37:03.603254 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599735    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:37:03.603254 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599737    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:37:03.603254 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599740    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:37:03.603254 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599743    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:37:03.603254 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599746    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:37:03.603740 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599748    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:37:03.603740 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599751    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:37:03.603740 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599755    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:37:03.603740 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599758    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:37:03.603740 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599760    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:37:03.603740 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599763    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:37:03.603740 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599765    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:37:03.603740 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599768    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:37:03.603740 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599770    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:37:03.603740 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599773    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:37:03.603740 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599775    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:37:03.603740 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599778    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:37:03.603740 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599780    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:37:03.603740 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599783    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:37:03.603740 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599785    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:37:03.603740 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599788    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:37:03.603740 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599791    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:37:03.603740 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599793    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:37:03.603740 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599796    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:37:03.603740 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599799    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:37:03.604210 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599803    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:37:03.604210 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599806    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:37:03.604210 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599809    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:37:03.604210 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599811    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:37:03.604210 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599814    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:37:03.604210 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599817    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:37:03.604210 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599820    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:37:03.604210 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599823    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:37:03.604210 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599825    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:37:03.604210 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599828    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:37:03.604210 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599830    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:37:03.604210 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599833    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:37:03.604210 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599835    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:37:03.604210 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599838    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:37:03.604210 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599841    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:37:03.604210 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599844    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:37:03.604210 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599847    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:37:03.604210 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599849    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:37:03.604210 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599852    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:37:03.604210 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599855    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:37:03.604718 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.599860    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 11:37:03.604718 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599974    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:37:03.604718 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599979    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:37:03.604718 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599982    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:37:03.604718 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599985    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:37:03.604718 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599988    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:37:03.604718 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599991    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:37:03.604718 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599994    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:37:03.604718 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.599997    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:37:03.604718 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600000    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:37:03.604718 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600002    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:37:03.604718 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600005    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:37:03.604718 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600012    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:37:03.604718 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600015    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:37:03.604718 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600018    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:37:03.605088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600021    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:37:03.605088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600023    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:37:03.605088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600026    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:37:03.605088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600029    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:37:03.605088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600031    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:37:03.605088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600034    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:37:03.605088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600037    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:37:03.605088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600041    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:37:03.605088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600044    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:37:03.605088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600047    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:37:03.605088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600049    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:37:03.605088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600052    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:37:03.605088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600056    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:37:03.605088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600059    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:37:03.605088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600061    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:37:03.605088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600064    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:37:03.605088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600066    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:37:03.605088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600069    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:37:03.605088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600071    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:37:03.605088 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600074    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:37:03.605605 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600076    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:37:03.605605 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600079    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:37:03.605605 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600082    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:37:03.605605 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600084    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:37:03.605605 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600087    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:37:03.605605 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600090    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:37:03.605605 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600092    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:37:03.605605 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600095    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:37:03.605605 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600097    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:37:03.605605 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600100    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:37:03.605605 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600103    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:37:03.605605 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600105    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:37:03.605605 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600108    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:37:03.605605 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600110    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:37:03.605605 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600113    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:37:03.605605 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600115    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:37:03.605605 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600118    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:37:03.605605 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600120    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:37:03.605605 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600123    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:37:03.605605 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600125    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:37:03.606094 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600128    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:37:03.606094 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600130    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:37:03.606094 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600133    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:37:03.606094 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600136    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:37:03.606094 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600138    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:37:03.606094 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600141    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:37:03.606094 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600143    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:37:03.606094 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600146    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:37:03.606094 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600149    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:37:03.606094 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600151    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:37:03.606094 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600154    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:37:03.606094 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600156    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:37:03.606094 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600159    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:37:03.606094 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600162    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:37:03.606094 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600164    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:37:03.606094 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600167    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:37:03.606094 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600171    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:37:03.606094 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600174    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:37:03.606094 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600177    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:37:03.606574 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600179    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:37:03.606574 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600182    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:37:03.606574 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600184    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:37:03.606574 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600187    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:37:03.606574 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600191    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:37:03.606574 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600193    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:37:03.606574 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600196    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:37:03.606574 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600200    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:37:03.606574 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600203    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:37:03.606574 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600206    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:37:03.606574 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600209    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:37:03.606574 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600211    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:37:03.606574 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600214    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:37:03.606574 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600216    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:37:03.606574 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600219    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:37:03.606574 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600222    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:37:03.606574 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600225    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:37:03.606574 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600228    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:37:03.606574 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600233    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:37:03.606574 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600236    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:37:03.607056 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600238    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:37:03.607056 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600241    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:37:03.607056 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600243    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:37:03.607056 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600246    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:37:03.607056 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600248    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:37:03.607056 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:03.600251    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:37:03.607056 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.600256    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 11:37:03.607056 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.600376    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 15 11:37:03.607056 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.602616    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 15 11:37:03.607056 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.603602    2564 server.go:1019] "Starting client certificate rotation"
Sep 15 11:37:03.607056 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.603698    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 11:37:03.607056 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.603768    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 11:37:03.609321 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.609285    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 11:37:03.613060 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.613040    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 11:37:03.628272 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.628237    2564 log.go:25] "Validated CRI v1 runtime API"
Sep 15 11:37:03.631102 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.631083    2564 log.go:25] "Validated CRI v1 image API"
Sep 15 11:37:03.632402 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.632381    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 15 11:37:03.634231 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.634217    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 11:37:03.636337 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.636308    2564 fs.go:135] Filesystem UUIDs: map[2cdcb4a8-179c-4a49-b4da-625d335ffe0c:/dev/nvme0n1p3 5b3b71bf-260c-4473-9544-a789dd7c8b26:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 15 11:37:03.636409 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.636336    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 15 11:37:03.642518 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.642399    2564 manager.go:216] Machine: {Timestamp:2026-09-15 11:37:03.640065662 +0000 UTC m=+0.356939837 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3123668 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d797b69c5a456958549be29d759ef SystemUUID:ec2d797b-69c5-a456-9585-49be29d759ef BootID:3a35a685-0265-494a-8baf-ce7ff6a0a9a1 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c3:8b:dd:f5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c3:8b:dd:f5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:cc:72:c2:c2:23 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 15 11:37:03.642518 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.642511    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 15 11:37:03.642624 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.642598    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 15 11:37:03.645644 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.645615    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 15 11:37:03.645794 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.645646    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-183.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 15 11:37:03.646335 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.646325    2564 topology_manager.go:138] "Creating topology manager with none policy"
Sep 15 11:37:03.646379 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.646339    2564 container_manager_linux.go:309] "Creating device plugin manager"
Sep 15 11:37:03.646379 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.646346    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 11:37:03.647090 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.647079    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 11:37:03.647885 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.647875    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 15 11:37:03.651709 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.651698    2564 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 11:37:03.651821 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.651812    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 15 11:37:03.651865 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.651840    2564 kubelet.go:486] "Attempting to sync node with API server"
Sep 15 11:37:03.651865 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.651850    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 15 11:37:03.651865 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.651863    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 15 11:37:03.651970 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.651872    2564 kubelet.go:398] "Adding apiserver pod source"
Sep 15 11:37:03.651970 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.651884    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 15 11:37:03.652295 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.652283    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 11:37:03.652330 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.652307    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 11:37:03.654607 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.654590    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 15 11:37:03.656308 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.656293    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 15 11:37:03.656371 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.656324    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 15 11:37:03.658175 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.658151    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 15 11:37:03.658175 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.658167    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 15 11:37:03.658175 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.658173    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 15 11:37:03.658383 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.658187    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 15 11:37:03.658383 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.658196    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 15 11:37:03.658383 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.658202    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 15 11:37:03.658383 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.658215    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 15 11:37:03.658383 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.658221    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 15 11:37:03.658383 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.658227    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 15 11:37:03.658383 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.658232    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 15 11:37:03.658383 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.658244    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 15 11:37:03.658383 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.658249    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 15 11:37:03.659138 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.659116    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 15 11:37:03.659302 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.659283    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 15 11:37:03.659778 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.659301    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zvj58"
Sep 15 11:37:03.661798 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:03.661769    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-183.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 15 11:37:03.661798 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.661777    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-183.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 15 11:37:03.661925 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:03.661855    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 15 11:37:03.664056 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.664041    2564 server.go:1268] "Started kubelet"
Sep 15 11:37:03.664139 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.664101    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 15 11:37:03.664291 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.664120    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 15 11:37:03.664409 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.664306    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 15 11:37:03.664987 ip-10-0-129-183 systemd[1]: Started Kubernetes Kubelet.
Sep 15 11:37:03.666229 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.666213    2564 server.go:310] "Adding debug handlers to kubelet server"
Sep 15 11:37:03.666366 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.666344    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zvj58"
Sep 15 11:37:03.667503 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.667043    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 15 11:37:03.668963 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:03.668941    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 15 11:37:03.672413 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:03.671450    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-183.ec2.internal.18d57b81a2ebf43a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-183.ec2.internal,UID:ip-10-0-129-183.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-183.ec2.internal,},FirstTimestamp:2026-09-15 11:37:03.664010298 +0000 UTC m=+0.380884474,LastTimestamp:2026-09-15 11:37:03.664010298 +0000 UTC m=+0.380884474,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-183.ec2.internal,}"
Sep 15 11:37:03.673045 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.673029    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 15 11:37:03.673605 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.673583    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 15 11:37:03.673904 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:03.673726    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found"
Sep 15 11:37:03.674098 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.674081    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 15 11:37:03.674178 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.674138    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 15 11:37:03.674178 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.674154    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 15 11:37:03.674307 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.674284    2564 reconstruct.go:97] "Volume reconstruction finished"
Sep 15 11:37:03.674307 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.674294    2564 reconciler.go:29] "Reconciler: start to sync state"
Sep 15 11:37:03.674442 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.674368    2564 factory.go:55] Registering systemd factory
Sep 15 11:37:03.674442 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.674384    2564 factory.go:223] Registration of the systemd container factory successfully
Sep 15 11:37:03.674644 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.674629    2564 factory.go:153] Registering CRI-O factory
Sep 15 11:37:03.674707 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.674647    2564 factory.go:223] Registration of the crio container factory successfully
Sep 15 11:37:03.674707 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.674697    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 15 11:37:03.674807 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.674716    2564 factory.go:103] Registering Raw factory
Sep 15 11:37:03.674807 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.674730    2564 manager.go:1196] Started watching for new ooms in manager
Sep 15 11:37:03.675068 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.675055    2564 manager.go:349] Starting recovery of all containers
Sep 15 11:37:03.681208 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.681023    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:37:03.685662 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:03.685633    2564 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-183.ec2.internal\" not found" node="ip-10-0-129-183.ec2.internal"
Sep 15 11:37:03.690062 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.690042    2564 manager.go:354] Recovery completed
Sep 15 11:37:03.694669 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.694653    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:37:03.696553 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.696538    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:37:03.696626 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.696569    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:37:03.696626 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.696582    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:37:03.697282 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.697247    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 15 11:37:03.697282 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.697274    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 15 11:37:03.697418 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.697296    2564 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 11:37:03.697418 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.697254    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:37:03.698593 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.698577    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:37:03.698673 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.698606    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:37:03.698673 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.698616    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:37:03.699574 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.699559    2564 policy_none.go:49] "None policy: Start"
Sep 15 11:37:03.699628 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.699580    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 15 11:37:03.699628 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.699593    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 15 11:37:03.701591 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.701579    2564 policy_none.go:47] "Start"
Sep 15 11:37:03.750794 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.734823    2564 manager.go:337] "Starting Device Plugin manager"
Sep 15 11:37:03.750794 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:03.734863    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 15 11:37:03.750794 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.734875    2564 server.go:87] "Starting device plugin registration server"
Sep 15 11:37:03.750794 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.735292    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 15 11:37:03.750794 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.735307    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 15 11:37:03.750794 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.735415    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 15 11:37:03.750794 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.735505    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 15 11:37:03.750794 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.735517    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 15 11:37:03.750794 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:03.736118    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 15 11:37:03.750794 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:03.736156    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-183.ec2.internal\" not found"
Sep 15 11:37:03.770786 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.770746    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 15 11:37:03.772118 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.772095    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 15 11:37:03.772227 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.772157    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 15 11:37:03.772227 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.772210    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 15 11:37:03.772329 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:03.772277    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 15 11:37:03.774678 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.774658    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:37:03.836582 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.836446    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:37:03.837479 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.837461    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:37:03.837578 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.837498    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:37:03.837578 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.837516    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:37:03.837578 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.837542    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-183.ec2.internal"
Sep 15 11:37:03.845477 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.845458    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-183.ec2.internal"
Sep 15 11:37:03.845477 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:03.845477    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-183.ec2.internal\": node \"ip-10-0-129-183.ec2.internal\" not found"
Sep 15 11:37:03.861615 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:03.861585    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found"
Sep 15 11:37:03.872691 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.872641    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-183.ec2.internal"]
Sep 15 11:37:03.872762 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.872742    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:37:03.873718 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.873693    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:37:03.873822 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.873723    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:37:03.873822 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.873734    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:37:03.875969 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.875956    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:37:03.876110 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.876095    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal"
Sep 15 11:37:03.876167 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.876132    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:37:03.876691 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.876674    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:37:03.876771 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.876701    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:37:03.876771 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.876711    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:37:03.876771 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.876675    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:37:03.876866 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.876776    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:37:03.876866 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.876789    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:37:03.878980 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.878966    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-183.ec2.internal"
Sep 15 11:37:03.879027 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.878994    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:37:03.879743 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.879729    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:37:03.879824 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.879762    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:37:03.879824 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.879792    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:37:03.911995 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:03.911976    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-183.ec2.internal\" not found" node="ip-10-0-129-183.ec2.internal"
Sep 15 11:37:03.916353 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:03.916338    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-183.ec2.internal\" not found" node="ip-10-0-129-183.ec2.internal"
Sep 15 11:37:03.962115 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:03.962087    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found"
Sep 15 11:37:03.975622 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.975589    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/46104ccc950d3257016d51b21f9001fa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal\" (UID: \"46104ccc950d3257016d51b21f9001fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal"
Sep 15 11:37:03.975622 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.975616    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46104ccc950d3257016d51b21f9001fa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal\" (UID: \"46104ccc950d3257016d51b21f9001fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal"
Sep 15 11:37:03.975723 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:03.975634    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b39c0b37c0c33603dd2e1954df67bc7d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-183.ec2.internal\" (UID: \"b39c0b37c0c33603dd2e1954df67bc7d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-183.ec2.internal"
Sep 15 11:37:04.062464 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:04.062431    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found"
Sep 15 11:37:04.076795 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:04.076756    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b39c0b37c0c33603dd2e1954df67bc7d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-183.ec2.internal\" (UID: \"b39c0b37c0c33603dd2e1954df67bc7d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-183.ec2.internal"
Sep 15 11:37:04.076795 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:04.076799    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/46104ccc950d3257016d51b21f9001fa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal\" (UID: \"46104ccc950d3257016d51b21f9001fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal"
Sep 15 11:37:04.076900 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:04.076814    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46104ccc950d3257016d51b21f9001fa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal\" (UID: \"46104ccc950d3257016d51b21f9001fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal"
Sep 15 11:37:04.076900 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:04.076840    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46104ccc950d3257016d51b21f9001fa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal\" (UID: \"46104ccc950d3257016d51b21f9001fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal"
Sep 15 11:37:04.076900 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:04.076824    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b39c0b37c0c33603dd2e1954df67bc7d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-183.ec2.internal\" (UID: \"b39c0b37c0c33603dd2e1954df67bc7d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-183.ec2.internal"
Sep 15 11:37:04.076900 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:04.076866    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/46104ccc950d3257016d51b21f9001fa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal\" (UID: \"46104ccc950d3257016d51b21f9001fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal"
Sep 15 11:37:04.163294 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:04.163194    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found"
Sep 15 11:37:04.214680 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:04.214642    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal"
Sep 15 11:37:04.220499 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:04.219438    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-183.ec2.internal"
Sep 15 11:37:04.264107 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:04.264073    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found"
Sep 15 11:37:04.370459 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:04.370417    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found"
Sep 15 11:37:04.476876 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:04.476781    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found"
Sep 15 11:37:04.578016 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:04.577982    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found"
Sep 15 11:37:04.603750 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:04.603706    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 15 11:37:04.604203 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:04.603882    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 11:37:04.604203 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:04.603929    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 11:37:04.673749 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:04.673711    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 11:32:04 +0000 UTC" deadline="2028-02-12 05:25:50.694488541 +0000 UTC"
Sep 15 11:37:04.673749 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:04.673739    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12353h48m46.020752575s"
Sep 15 11:37:04.679211 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:04.679145    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found"
Sep 15 11:37:04.743497 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:04.743431    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:37:04.779612 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:04.779577    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found"
Sep 15 11:37:04.879846 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:04.879804    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found"
Sep 15 11:37:04.965752 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:04.965711    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46104ccc950d3257016d51b21f9001fa.slice/crio-a34abb0a98ab7a4d1363535e55113527a0c248888577268484beb91262b97ae3 WatchSource:0}: Error finding container a34abb0a98ab7a4d1363535e55113527a0c248888577268484beb91262b97ae3: Status 404 returned error can't find the container with id a34abb0a98ab7a4d1363535e55113527a0c248888577268484beb91262b97ae3
Sep 15 11:37:04.971422 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:04.971401    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:37:04.980507 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:04.980488    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found"
Sep 15 11:37:04.996815 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:04.996765    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:37:05.029560 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:05.029532    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb39c0b37c0c33603dd2e1954df67bc7d.slice/crio-eeb88f5d73c4774722ec8e266f5d6a7412d7796dc08cb70557bff2bb9f6f97f3 WatchSource:0}: Error finding container eeb88f5d73c4774722ec8e266f5d6a7412d7796dc08cb70557bff2bb9f6f97f3: Status 404 returned error can't find the container with id eeb88f5d73c4774722ec8e266f5d6a7412d7796dc08cb70557bff2bb9f6f97f3
Sep 15 11:37:05.075836 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.075808    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal"
Sep 15 11:37:05.091732 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.091711    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 11:37:05.093256 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.093242    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-183.ec2.internal"
Sep 15 11:37:05.105892 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.105877    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 11:37:05.652924 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.652888    2564 apiserver.go:52] "Watching apiserver"
Sep 15 11:37:05.662984 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.662957    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 15 11:37:05.663467 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.663445    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-hrgfl","openshift-multus/network-metrics-daemon-4jmmn","openshift-network-operator/iptables-alerter-kgrfq","openshift-ovn-kubernetes/ovnkube-node-mpzzv","kube-system/global-pull-secret-syncer-cjpd7","kube-system/konnectivity-agent-lpbsr","kube-system/kube-apiserver-proxy-ip-10-0-129-183.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq","openshift-cluster-node-tuning-operator/tuned-84rjs","openshift-dns/node-resolver-vhq54","openshift-multus/multus-additional-cni-plugins-h6ldt","openshift-network-diagnostics/network-check-target-45rvn","openshift-image-registry/node-ca-f6lmr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal"]
Sep 15 11:37:05.666175 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.666147    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vhq54"
Sep 15 11:37:05.668436 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.668415    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f6lmr"
Sep 15 11:37:05.669071 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.669048    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 15 11:37:05.669170 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.669150    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p9zkp\""
Sep 15 11:37:05.669260 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.669054    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 15 11:37:05.670767 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.670745    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kgrfq"
Sep 15 11:37:05.670858 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.670785    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 15 11:37:05.671561 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.671130    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 15 11:37:05.671561 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.671387    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 15 11:37:05.671561 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.671557    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-582qp\""
Sep 15 11:37:05.673023 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.672978    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:37:05.673490 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.673280    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 15 11:37:05.673490 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.673445    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 15 11:37:05.673710 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.673688    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.673822 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.673780    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 15 11:37:05.674017 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.673992    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tjsrz\""
Sep 15 11:37:05.676270 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.676244    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 15 11:37:05.676422 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.676404    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 15 11:37:05.676503 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.676486    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:05.676605 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:05.676571    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjpd7" podUID="5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3"
Sep 15 11:37:05.677446 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.677413    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 15 11:37:05.677550 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.677451    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 15 11:37:05.677620 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.677552    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 15 11:37:05.677678 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.677662    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 15 11:37:05.677736 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.677701    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6vm9r\""
Sep 15 11:37:05.678991 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.678946    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lpbsr"
Sep 15 11:37:05.681374 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.681352    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 15 11:37:05.681565 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.681539    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 15 11:37:05.681670 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.681572    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.681670 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.681604    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2dlgm\""
Sep 15 11:37:05.684029 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.684007    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:37:05.684188 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.684016    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nmnlp\""
Sep 15 11:37:05.684261 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.684197    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 15 11:37:05.684414 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.684392    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq"
Sep 15 11:37:05.684663 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.684555    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.684663 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.684593    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret\") pod \"global-pull-secret-syncer-cjpd7\" (UID: \"5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3\") " pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:05.684663 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.684621    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c23245d8-99eb-454d-8be3-d1f6c79c29cd-hosts-file\") pod \"node-resolver-vhq54\" (UID: \"c23245d8-99eb-454d-8be3-d1f6c79c29cd\") " pod="openshift-dns/node-resolver-vhq54"
Sep 15 11:37:05.684663 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.684645    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/349601b9-3ea8-4c18-b77c-b90cfd48d1e5-host\") pod \"node-ca-f6lmr\" (UID: \"349601b9-3ea8-4c18-b77c-b90cfd48d1e5\") " pod="openshift-image-registry/node-ca-f6lmr"
Sep 15 11:37:05.684982 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.684678    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-host-slash\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.684982 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.684703    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-host-run-netns\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.684982 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.684726    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-run-ovn\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.684982 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.684750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f111f931-1044-45df-a721-bcf424d77367-host-slash\") pod \"iptables-alerter-kgrfq\" (UID: \"f111f931-1044-45df-a721-bcf424d77367\") " pod="openshift-network-operator/iptables-alerter-kgrfq"
Sep 15 11:37:05.684982 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.684793    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-run-systemd\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.684982 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.684819    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-log-socket\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.684982 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.684846    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-host-run-ovn-kubernetes\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.684982 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.684890    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-host-cni-bin\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.684982 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.684921    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px94f\" (UniqueName: \"kubernetes.io/projected/f111f931-1044-45df-a721-bcf424d77367-kube-api-access-px94f\") pod \"iptables-alerter-kgrfq\" (UID: \"f111f931-1044-45df-a721-bcf424d77367\") " pod="openshift-network-operator/iptables-alerter-kgrfq"
Sep 15 11:37:05.684982 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.684964    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1902b56e-9967-454a-bf3d-b1c11111f5ec-env-overrides\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.685500 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.685001    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-kubelet-config\") pod \"global-pull-secret-syncer-cjpd7\" (UID: \"5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3\") " pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:05.685500 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.685053    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdpdg\" (UniqueName: \"kubernetes.io/projected/c23245d8-99eb-454d-8be3-d1f6c79c29cd-kube-api-access-hdpdg\") pod \"node-resolver-vhq54\" (UID: \"c23245d8-99eb-454d-8be3-d1f6c79c29cd\") " pod="openshift-dns/node-resolver-vhq54"
Sep 15 11:37:05.685500 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.685070    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1902b56e-9967-454a-bf3d-b1c11111f5ec-ovn-node-metrics-cert\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.685500 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.685089    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6rpx\" (UniqueName: \"kubernetes.io/projected/1902b56e-9967-454a-bf3d-b1c11111f5ec-kube-api-access-c6rpx\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.685500 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.685112    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-dbus\") pod \"global-pull-secret-syncer-cjpd7\" (UID: \"5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3\") " pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:05.685500 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.685159    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f111f931-1044-45df-a721-bcf424d77367-iptables-alerter-script\") pod \"iptables-alerter-kgrfq\" (UID: \"f111f931-1044-45df-a721-bcf424d77367\") " pod="openshift-network-operator/iptables-alerter-kgrfq"
Sep 15 11:37:05.686248 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.685192    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c23245d8-99eb-454d-8be3-d1f6c79c29cd-tmp-dir\") pod \"node-resolver-vhq54\" (UID: \"c23245d8-99eb-454d-8be3-d1f6c79c29cd\") " pod="openshift-dns/node-resolver-vhq54"
Sep 15 11:37:05.686352 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.686297    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxj4z\" (UniqueName: \"kubernetes.io/projected/349601b9-3ea8-4c18-b77c-b90cfd48d1e5-kube-api-access-sxj4z\") pod \"node-ca-f6lmr\" (UID: \"349601b9-3ea8-4c18-b77c-b90cfd48d1e5\") " pod="openshift-image-registry/node-ca-f6lmr"
Sep 15 11:37:05.686417 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.686358    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-host-kubelet\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.686417 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.686391    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-var-lib-openvswitch\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.686516 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.686426    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-etc-openvswitch\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.686516 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.686464    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-node-log\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.686625 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.686513    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-host-cni-netd\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.686625 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.686546    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1902b56e-9967-454a-bf3d-b1c11111f5ec-ovnkube-script-lib\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.686625 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.686571    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/349601b9-3ea8-4c18-b77c-b90cfd48d1e5-serviceca\") pod \"node-ca-f6lmr\" (UID: \"349601b9-3ea8-4c18-b77c-b90cfd48d1e5\") " pod="openshift-image-registry/node-ca-f6lmr"
Sep 15 11:37:05.686765 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.686609    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-systemd-units\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.686765 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.686664    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-run-openvswitch\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.686765 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.686726    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1902b56e-9967-454a-bf3d-b1c11111f5ec-ovnkube-config\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.687558 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.687531    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 15 11:37:05.687649 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.687568    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 15 11:37:05.687740 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.687717    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cwj6n\""
Sep 15 11:37:05.688105 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.688081    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:05.688230 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:05.688202    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jmmn" podUID="fd41f61a-cfbe-43f3-bc25-be3037a81bf2"
Sep 15 11:37:05.688453 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.688089    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 15 11:37:05.689990 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.689772    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 11:37:05.691594 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.691574    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.694043 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.694019    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 15 11:37:05.694147 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.694074    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h6ldt"
Sep 15 11:37:05.694781 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.694245    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 15 11:37:05.694781 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.694266    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 15 11:37:05.694781 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.694424    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 15 11:37:05.694781 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.694630    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sqfw4\""
Sep 15 11:37:05.696586 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.696565    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 15 11:37:05.696703 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.696609    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-trg4l\""
Sep 15 11:37:05.696771 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.696750    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:05.696847 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:05.696812    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45rvn" podUID="20669eed-9c6c-4432-af7e-27e3a2136cd9"
Sep 15 11:37:05.696930 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.696854    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 15 11:37:05.702850 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.702831    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:37:05.709429 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.709376    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wn7hx"
Sep 15 11:37:05.716315 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.716292    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wn7hx"
Sep 15 11:37:05.775583 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.775557    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 15 11:37:05.778190 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.778141    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-183.ec2.internal" event={"ID":"b39c0b37c0c33603dd2e1954df67bc7d","Type":"ContainerStarted","Data":"eeb88f5d73c4774722ec8e266f5d6a7412d7796dc08cb70557bff2bb9f6f97f3"}
Sep 15 11:37:05.779709 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.779676    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal" event={"ID":"46104ccc950d3257016d51b21f9001fa","Type":"ContainerStarted","Data":"a34abb0a98ab7a4d1363535e55113527a0c248888577268484beb91262b97ae3"}
Sep 15 11:37:05.787366 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.787318    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c23245d8-99eb-454d-8be3-d1f6c79c29cd-tmp-dir\") pod \"node-resolver-vhq54\" (UID: \"c23245d8-99eb-454d-8be3-d1f6c79c29cd\") " pod="openshift-dns/node-resolver-vhq54"
Sep 15 11:37:05.787480 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.787457    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxj4z\" (UniqueName: \"kubernetes.io/projected/349601b9-3ea8-4c18-b77c-b90cfd48d1e5-kube-api-access-sxj4z\") pod \"node-ca-f6lmr\" (UID: \"349601b9-3ea8-4c18-b77c-b90cfd48d1e5\") " pod="openshift-image-registry/node-ca-f6lmr"
Sep 15 11:37:05.787538 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.787493    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-lib-modules\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.787538 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.787520    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-multus-socket-dir-parent\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.787688 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.787546    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-host-run-multus-certs\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.787688 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.787576    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-var-lib-openvswitch\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.787688 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.787637    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1902b56e-9967-454a-bf3d-b1c11111f5ec-ovnkube-script-lib\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.787688 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.787650    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-var-lib-openvswitch\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.787688 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.787675    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c23245d8-99eb-454d-8be3-d1f6c79c29cd-tmp-dir\") pod \"node-resolver-vhq54\" (UID: \"c23245d8-99eb-454d-8be3-d1f6c79c29cd\") " pod="openshift-dns/node-resolver-vhq54"
Sep 15 11:37:05.787938 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.787779    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/349601b9-3ea8-4c18-b77c-b90cfd48d1e5-serviceca\") pod \"node-ca-f6lmr\" (UID: \"349601b9-3ea8-4c18-b77c-b90cfd48d1e5\") " pod="openshift-image-registry/node-ca-f6lmr"
Sep 15 11:37:05.787938 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.787824    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-etc-kubernetes\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.787938 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.787872    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/375b0b55-766a-483e-b6a9-63a28036c6b2-device-dir\") pod \"aws-ebs-csi-driver-node-8bjpq\" (UID: \"375b0b55-766a-483e-b6a9-63a28036c6b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq"
Sep 15 11:37:05.787938 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.787901    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/403278f4-8eb0-41c6-a45c-1442c188ecd3-system-cni-dir\") pod \"multus-additional-cni-plugins-h6ldt\" (UID: \"403278f4-8eb0-41c6-a45c-1442c188ecd3\") " pod="openshift-multus/multus-additional-cni-plugins-h6ldt"
Sep 15 11:37:05.788138 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.787959    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/403278f4-8eb0-41c6-a45c-1442c188ecd3-cnibin\") pod \"multus-additional-cni-plugins-h6ldt\" (UID: \"403278f4-8eb0-41c6-a45c-1442c188ecd3\") " pod="openshift-multus/multus-additional-cni-plugins-h6ldt"
Sep 15 11:37:05.788138 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.787995    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/403278f4-8eb0-41c6-a45c-1442c188ecd3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h6ldt\" (UID: \"403278f4-8eb0-41c6-a45c-1442c188ecd3\") " pod="openshift-multus/multus-additional-cni-plugins-h6ldt"
Sep 15 11:37:05.788138 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.788033    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1902b56e-9967-454a-bf3d-b1c11111f5ec-ovnkube-config\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.788138 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.788059    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3d23fee-843a-44e5-af4f-692b3efd8f03-agent-certs\") pod \"konnectivity-agent-lpbsr\" (UID: \"a3d23fee-843a-44e5-af4f-692b3efd8f03\") " pod="kube-system/konnectivity-agent-lpbsr"
Sep 15 11:37:05.788138 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.788094    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-host-var-lib-cni-bin\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.788138 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.788131    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2brk9\" (UniqueName: \"kubernetes.io/projected/403278f4-8eb0-41c6-a45c-1442c188ecd3-kube-api-access-2brk9\") pod \"multus-additional-cni-plugins-h6ldt\" (UID: \"403278f4-8eb0-41c6-a45c-1442c188ecd3\") " pod="openshift-multus/multus-additional-cni-plugins-h6ldt"
Sep 15 11:37:05.788459 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.788160    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32822a8f-c68a-4cc5-8afd-50a0620f04a2-etc-tuned\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.788459 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.788201    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/375b0b55-766a-483e-b6a9-63a28036c6b2-sys-fs\") pod \"aws-ebs-csi-driver-node-8bjpq\" (UID: \"375b0b55-766a-483e-b6a9-63a28036c6b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq"
Sep 15 11:37:05.788459 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.788252    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-system-cni-dir\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.788459 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.788279    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-hostroot\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.788459 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.788326    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-etc-kubernetes\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.788459 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.788359    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-run-ovn\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.788459 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.788393    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-sys\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.788826 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.788413    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/349601b9-3ea8-4c18-b77c-b90cfd48d1e5-serviceca\") pod \"node-ca-f6lmr\" (UID: \"349601b9-3ea8-4c18-b77c-b90cfd48d1e5\") " pod="openshift-image-registry/node-ca-f6lmr"
Sep 15 11:37:05.788826 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.788421    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-var-lib-kubelet\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.788826 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.788704    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1902b56e-9967-454a-bf3d-b1c11111f5ec-ovnkube-script-lib\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.789055 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.789035    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-run-systemd\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.789120 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.789083    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-log-socket\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.789176 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.789121    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-host-cni-bin\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.789232 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.789181    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-run-systemd\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.789308 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.789281    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-host-cni-bin\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.789395 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.789367    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px94f\" (UniqueName: \"kubernetes.io/projected/f111f931-1044-45df-a721-bcf424d77367-kube-api-access-px94f\") pod \"iptables-alerter-kgrfq\" (UID: \"f111f931-1044-45df-a721-bcf424d77367\") " pod="openshift-network-operator/iptables-alerter-kgrfq"
Sep 15 11:37:05.791427 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.791397    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-etc-sysctl-d\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.791543 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.791449    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/375b0b55-766a-483e-b6a9-63a28036c6b2-socket-dir\") pod \"aws-ebs-csi-driver-node-8bjpq\" (UID: \"375b0b55-766a-483e-b6a9-63a28036c6b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq"
Sep 15 11:37:05.791543 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.791485    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3d23fee-843a-44e5-af4f-692b3efd8f03-konnectivity-ca\") pod \"konnectivity-agent-lpbsr\" (UID: \"a3d23fee-843a-44e5-af4f-692b3efd8f03\") " pod="kube-system/konnectivity-agent-lpbsr"
Sep 15 11:37:05.791543 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.791521    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-host-run-k8s-cni-cncf-io\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.791701 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.791559    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdpdg\" (UniqueName: \"kubernetes.io/projected/c23245d8-99eb-454d-8be3-d1f6c79c29cd-kube-api-access-hdpdg\") pod \"node-resolver-vhq54\" (UID: \"c23245d8-99eb-454d-8be3-d1f6c79c29cd\") " pod="openshift-dns/node-resolver-vhq54"
Sep 15 11:37:05.791701 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.791584    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-run\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.791701 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.791615    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-host-var-lib-cni-multus\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.791701 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.791663    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-host-var-lib-kubelet\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.791897 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.791706    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/403278f4-8eb0-41c6-a45c-1442c188ecd3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h6ldt\" (UID: \"403278f4-8eb0-41c6-a45c-1442c188ecd3\") " pod="openshift-multus/multus-additional-cni-plugins-h6ldt"
Sep 15 11:37:05.791897 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.791741    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6rpx\" (UniqueName: \"kubernetes.io/projected/1902b56e-9967-454a-bf3d-b1c11111f5ec-kube-api-access-c6rpx\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.791897 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.791768    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-dbus\") pod \"global-pull-secret-syncer-cjpd7\" (UID: \"5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3\") " pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:05.791897 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.791800    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f111f931-1044-45df-a721-bcf424d77367-iptables-alerter-script\") pod \"iptables-alerter-kgrfq\" (UID: \"f111f931-1044-45df-a721-bcf424d77367\") " pod="openshift-network-operator/iptables-alerter-kgrfq"
Sep 15 11:37:05.791897 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.791830    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32822a8f-c68a-4cc5-8afd-50a0620f04a2-tmp\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.791897 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.791860    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-cnibin\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.791897 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.791890    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-multus-conf-dir\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.792229 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.791914    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/403278f4-8eb0-41c6-a45c-1442c188ecd3-cni-binary-copy\") pod \"multus-additional-cni-plugins-h6ldt\" (UID: \"403278f4-8eb0-41c6-a45c-1442c188ecd3\") " pod="openshift-multus/multus-additional-cni-plugins-h6ldt"
Sep 15 11:37:05.792229 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.791945    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/375b0b55-766a-483e-b6a9-63a28036c6b2-registration-dir\") pod \"aws-ebs-csi-driver-node-8bjpq\" (UID: \"375b0b55-766a-483e-b6a9-63a28036c6b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq"
Sep 15 11:37:05.792229 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.791977    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-host-kubelet\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.792229 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792026    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-etc-openvswitch\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.792229 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792053    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-node-log\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.792229 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792085    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-host-cni-netd\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.792229 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792114    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-etc-sysctl-conf\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.792229 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792145    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs9q6\" (UniqueName: \"kubernetes.io/projected/808cf550-98e0-4b24-b17e-466044b2221b-kube-api-access-zs9q6\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.792229 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792176    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/403278f4-8eb0-41c6-a45c-1442c188ecd3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h6ldt\" (UID: \"403278f4-8eb0-41c6-a45c-1442c188ecd3\") " pod="openshift-multus/multus-additional-cni-plugins-h6ldt"
Sep 15 11:37:05.792229 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792206    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-systemd-units\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.792720 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792238    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-run-openvswitch\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.792720 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792268    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/808cf550-98e0-4b24-b17e-466044b2221b-cni-binary-copy\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.792720 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792300    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.792720 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792333    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret\") pod \"global-pull-secret-syncer-cjpd7\" (UID: \"5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3\") " pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:05.792720 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792385    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c23245d8-99eb-454d-8be3-d1f6c79c29cd-hosts-file\") pod \"node-resolver-vhq54\" (UID: \"c23245d8-99eb-454d-8be3-d1f6c79c29cd\") " pod="openshift-dns/node-resolver-vhq54"
Sep 15 11:37:05.792720 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792414    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/349601b9-3ea8-4c18-b77c-b90cfd48d1e5-host\") pod \"node-ca-f6lmr\" (UID: \"349601b9-3ea8-4c18-b77c-b90cfd48d1e5\") " pod="openshift-image-registry/node-ca-f6lmr"
Sep 15 11:37:05.792720 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792439    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sf4m\" (UniqueName: \"kubernetes.io/projected/32822a8f-c68a-4cc5-8afd-50a0620f04a2-kube-api-access-5sf4m\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.792720 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.789697    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1902b56e-9967-454a-bf3d-b1c11111f5ec-ovnkube-config\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.792720 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792473    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46qzh\" (UniqueName: \"kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh\") pod \"network-check-target-45rvn\" (UID: \"20669eed-9c6c-4432-af7e-27e3a2136cd9\") " pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:05.792720 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.790060    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-run-ovn\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.792720 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.789741    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-log-socket\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.792720 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792560    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-host-slash\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.792720 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792634    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-etc-openvswitch\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.792720 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792643    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-host-run-netns\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.792720 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792678    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c23245d8-99eb-454d-8be3-d1f6c79c29cd-hosts-file\") pod \"node-resolver-vhq54\" (UID: \"c23245d8-99eb-454d-8be3-d1f6c79c29cd\") " pod="openshift-dns/node-resolver-vhq54"
Sep 15 11:37:05.792720 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792695    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-host-run-netns\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.793557 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792740    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/349601b9-3ea8-4c18-b77c-b90cfd48d1e5-host\") pod \"node-ca-f6lmr\" (UID: \"349601b9-3ea8-4c18-b77c-b90cfd48d1e5\") " pod="openshift-image-registry/node-ca-f6lmr"
Sep 15 11:37:05.793557 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792775    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f111f931-1044-45df-a721-bcf424d77367-host-slash\") pod \"iptables-alerter-kgrfq\" (UID: \"f111f931-1044-45df-a721-bcf424d77367\") " pod="openshift-network-operator/iptables-alerter-kgrfq"
Sep 15 11:37:05.793557 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792799    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.793557 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792863    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-systemd-units\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.793557 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792912    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-dbus\") pod \"global-pull-secret-syncer-cjpd7\" (UID: \"5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3\") " pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:05.793557 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792916    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-host-slash\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.793557 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.792966    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-node-log\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.793557 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.793062    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-host-kubelet\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.793557 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.793108    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-etc-systemd\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.793557 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.793105    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-host-cni-netd\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.793557 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.793110    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f111f931-1044-45df-a721-bcf424d77367-host-slash\") pod \"iptables-alerter-kgrfq\" (UID: \"f111f931-1044-45df-a721-bcf424d77367\") " pod="openshift-network-operator/iptables-alerter-kgrfq"
Sep 15 11:37:05.793557 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.793151    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-run-openvswitch\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.793557 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:05.793201    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:05.793557 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.793217    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-host\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.793557 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:05.793354    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret podName:5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:06.293275798 +0000 UTC m=+3.010149971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret") pod "global-pull-secret-syncer-cjpd7" (UID: "5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:05.793557 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.793379    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/375b0b55-766a-483e-b6a9-63a28036c6b2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8bjpq\" (UID: \"375b0b55-766a-483e-b6a9-63a28036c6b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq"
Sep 15 11:37:05.793557 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.793402    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f111f931-1044-45df-a721-bcf424d77367-iptables-alerter-script\") pod \"iptables-alerter-kgrfq\" (UID: \"f111f931-1044-45df-a721-bcf424d77367\") " pod="openshift-network-operator/iptables-alerter-kgrfq"
Sep 15 11:37:05.794474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.793418    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7gm4\" (UniqueName: \"kubernetes.io/projected/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-kube-api-access-c7gm4\") pod \"network-metrics-daemon-4jmmn\" (UID: \"fd41f61a-cfbe-43f3-bc25-be3037a81bf2\") " pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:05.794474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.793482    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-multus-cni-dir\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.794474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.793582    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-host-run-ovn-kubernetes\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.794474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.793630    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-etc-modprobe-d\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.794474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.793660    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6btq\" (UniqueName: \"kubernetes.io/projected/375b0b55-766a-483e-b6a9-63a28036c6b2-kube-api-access-w6btq\") pod \"aws-ebs-csi-driver-node-8bjpq\" (UID: \"375b0b55-766a-483e-b6a9-63a28036c6b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq"
Sep 15 11:37:05.794474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.793685    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1902b56e-9967-454a-bf3d-b1c11111f5ec-host-run-ovn-kubernetes\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.794474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.793722    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-host-run-netns\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.794474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.793800    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1902b56e-9967-454a-bf3d-b1c11111f5ec-env-overrides\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.794474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.793852    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-kubelet-config\") pod \"global-pull-secret-syncer-cjpd7\" (UID: \"5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3\") " pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:05.794474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.793923    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-etc-sysconfig\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.794474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.793942    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-kubelet-config\") pod \"global-pull-secret-syncer-cjpd7\" (UID: \"5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3\") " pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:05.794474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.793960    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1902b56e-9967-454a-bf3d-b1c11111f5ec-ovn-node-metrics-cert\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.794474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.793992    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/375b0b55-766a-483e-b6a9-63a28036c6b2-etc-selinux\") pod \"aws-ebs-csi-driver-node-8bjpq\" (UID: \"375b0b55-766a-483e-b6a9-63a28036c6b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq"
Sep 15 11:37:05.794474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.794028    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs\") pod \"network-metrics-daemon-4jmmn\" (UID: \"fd41f61a-cfbe-43f3-bc25-be3037a81bf2\") " pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:05.794474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.794061    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/808cf550-98e0-4b24-b17e-466044b2221b-multus-daemon-config\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.794474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.794246    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1902b56e-9967-454a-bf3d-b1c11111f5ec-env-overrides\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.795466 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.795428    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 15 11:37:05.801812 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.801782    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxj4z\" (UniqueName: \"kubernetes.io/projected/349601b9-3ea8-4c18-b77c-b90cfd48d1e5-kube-api-access-sxj4z\") pod \"node-ca-f6lmr\" (UID: \"349601b9-3ea8-4c18-b77c-b90cfd48d1e5\") " pod="openshift-image-registry/node-ca-f6lmr"
Sep 15 11:37:05.803638 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.803610    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdpdg\" (UniqueName: \"kubernetes.io/projected/c23245d8-99eb-454d-8be3-d1f6c79c29cd-kube-api-access-hdpdg\") pod \"node-resolver-vhq54\" (UID: \"c23245d8-99eb-454d-8be3-d1f6c79c29cd\") " pod="openshift-dns/node-resolver-vhq54"
Sep 15 11:37:05.803962 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.803940    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1902b56e-9967-454a-bf3d-b1c11111f5ec-ovn-node-metrics-cert\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.804611 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.804584    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px94f\" (UniqueName: \"kubernetes.io/projected/f111f931-1044-45df-a721-bcf424d77367-kube-api-access-px94f\") pod \"iptables-alerter-kgrfq\" (UID: \"f111f931-1044-45df-a721-bcf424d77367\") " pod="openshift-network-operator/iptables-alerter-kgrfq"
Sep 15 11:37:05.805455 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.805434    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6rpx\" (UniqueName: \"kubernetes.io/projected/1902b56e-9967-454a-bf3d-b1c11111f5ec-kube-api-access-c6rpx\") pod \"ovnkube-node-mpzzv\" (UID: \"1902b56e-9967-454a-bf3d-b1c11111f5ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:05.894647 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.894607    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-etc-sysconfig\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.894842 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.894657    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/375b0b55-766a-483e-b6a9-63a28036c6b2-etc-selinux\") pod \"aws-ebs-csi-driver-node-8bjpq\" (UID: \"375b0b55-766a-483e-b6a9-63a28036c6b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq"
Sep 15 11:37:05.894842 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.894686    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs\") pod \"network-metrics-daemon-4jmmn\" (UID: \"fd41f61a-cfbe-43f3-bc25-be3037a81bf2\") " pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:05.894842 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.894711    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/808cf550-98e0-4b24-b17e-466044b2221b-multus-daemon-config\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.894842 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.894737    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-lib-modules\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.894842 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.894763    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-multus-socket-dir-parent\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.894842 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.894787    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-host-run-multus-certs\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.894842 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.894813    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-etc-kubernetes\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.894842 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.894836    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/375b0b55-766a-483e-b6a9-63a28036c6b2-device-dir\") pod \"aws-ebs-csi-driver-node-8bjpq\" (UID: \"375b0b55-766a-483e-b6a9-63a28036c6b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq"
Sep 15 11:37:05.895272 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.894861    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/403278f4-8eb0-41c6-a45c-1442c188ecd3-system-cni-dir\") pod \"multus-additional-cni-plugins-h6ldt\" (UID: \"403278f4-8eb0-41c6-a45c-1442c188ecd3\") " pod="openshift-multus/multus-additional-cni-plugins-h6ldt"
Sep 15 11:37:05.895272 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.894885    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/403278f4-8eb0-41c6-a45c-1442c188ecd3-cnibin\") pod \"multus-additional-cni-plugins-h6ldt\" (UID: \"403278f4-8eb0-41c6-a45c-1442c188ecd3\") " pod="openshift-multus/multus-additional-cni-plugins-h6ldt"
Sep 15 11:37:05.895272 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.894913    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/403278f4-8eb0-41c6-a45c-1442c188ecd3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h6ldt\" (UID: \"403278f4-8eb0-41c6-a45c-1442c188ecd3\") " pod="openshift-multus/multus-additional-cni-plugins-h6ldt"
Sep 15 11:37:05.895272 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.894940    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3d23fee-843a-44e5-af4f-692b3efd8f03-agent-certs\") pod \"konnectivity-agent-lpbsr\" (UID: \"a3d23fee-843a-44e5-af4f-692b3efd8f03\") " pod="kube-system/konnectivity-agent-lpbsr"
Sep 15 11:37:05.895272 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.894973    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-host-var-lib-cni-bin\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.895272 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.894998    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2brk9\" (UniqueName: \"kubernetes.io/projected/403278f4-8eb0-41c6-a45c-1442c188ecd3-kube-api-access-2brk9\") pod \"multus-additional-cni-plugins-h6ldt\" (UID: \"403278f4-8eb0-41c6-a45c-1442c188ecd3\") " pod="openshift-multus/multus-additional-cni-plugins-h6ldt"
Sep 15 11:37:05.895272 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.895022    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32822a8f-c68a-4cc5-8afd-50a0620f04a2-etc-tuned\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.895272 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.895046    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/375b0b55-766a-483e-b6a9-63a28036c6b2-sys-fs\") pod \"aws-ebs-csi-driver-node-8bjpq\" (UID: \"375b0b55-766a-483e-b6a9-63a28036c6b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq"
Sep 15 11:37:05.895272 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.895063    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-host-run-multus-certs\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.895272 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.895128    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-host-var-lib-cni-bin\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.895272 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.895248    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-system-cni-dir\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.895910 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.895337    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-etc-sysconfig\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.895910 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.895432    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/375b0b55-766a-483e-b6a9-63a28036c6b2-etc-selinux\") pod \"aws-ebs-csi-driver-node-8bjpq\" (UID: \"375b0b55-766a-483e-b6a9-63a28036c6b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq"
Sep 15 11:37:05.895910 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:05.895512    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:05.895910 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:05.895585    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs podName:fd41f61a-cfbe-43f3-bc25-be3037a81bf2 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:06.395565418 +0000 UTC m=+3.112439587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs") pod "network-metrics-daemon-4jmmn" (UID: "fd41f61a-cfbe-43f3-bc25-be3037a81bf2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:05.895910 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.895764    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/403278f4-8eb0-41c6-a45c-1442c188ecd3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h6ldt\" (UID: \"403278f4-8eb0-41c6-a45c-1442c188ecd3\") " pod="openshift-multus/multus-additional-cni-plugins-h6ldt"
Sep 15 11:37:05.896301 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.896275    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/808cf550-98e0-4b24-b17e-466044b2221b-multus-daemon-config\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.896439 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.896421    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-lib-modules\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.896496 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.896482    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-multus-socket-dir-parent\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.896548 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.895069    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-system-cni-dir\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.896548 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.896524    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-hostroot\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.896654 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.896550    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-etc-kubernetes\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.896654 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.896577    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-sys\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.896654 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.896601    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-var-lib-kubelet\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.896654 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.896634    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-etc-sysctl-d\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.896847 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.896660    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/375b0b55-766a-483e-b6a9-63a28036c6b2-socket-dir\") pod \"aws-ebs-csi-driver-node-8bjpq\" (UID: \"375b0b55-766a-483e-b6a9-63a28036c6b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq"
Sep 15 11:37:05.896847 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.896686    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3d23fee-843a-44e5-af4f-692b3efd8f03-konnectivity-ca\") pod \"konnectivity-agent-lpbsr\" (UID: \"a3d23fee-843a-44e5-af4f-692b3efd8f03\") " pod="kube-system/konnectivity-agent-lpbsr"
Sep 15 11:37:05.896847 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.896711    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-host-run-k8s-cni-cncf-io\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.896847 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.896737    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-run\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.896847 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.896772    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-host-var-lib-cni-multus\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.896847 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.896801    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-host-var-lib-kubelet\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.896847 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.896826    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/403278f4-8eb0-41c6-a45c-1442c188ecd3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h6ldt\" (UID: \"403278f4-8eb0-41c6-a45c-1442c188ecd3\") " pod="openshift-multus/multus-additional-cni-plugins-h6ldt"
Sep 15 11:37:05.897192 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.896853    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32822a8f-c68a-4cc5-8afd-50a0620f04a2-tmp\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.897192 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.896876    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-cnibin\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.897192 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.896900    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-multus-conf-dir\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.897192 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.896926    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/403278f4-8eb0-41c6-a45c-1442c188ecd3-cni-binary-copy\") pod \"multus-additional-cni-plugins-h6ldt\" (UID: \"403278f4-8eb0-41c6-a45c-1442c188ecd3\") " pod="openshift-multus/multus-additional-cni-plugins-h6ldt"
Sep 15 11:37:05.897192 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.896963    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/375b0b55-766a-483e-b6a9-63a28036c6b2-registration-dir\") pod \"aws-ebs-csi-driver-node-8bjpq\" (UID: \"375b0b55-766a-483e-b6a9-63a28036c6b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq"
Sep 15 11:37:05.897192 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.896992    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-etc-sysctl-conf\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.897192 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897017    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs9q6\" (UniqueName: \"kubernetes.io/projected/808cf550-98e0-4b24-b17e-466044b2221b-kube-api-access-zs9q6\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.897192 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897045    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/403278f4-8eb0-41c6-a45c-1442c188ecd3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h6ldt\" (UID: \"403278f4-8eb0-41c6-a45c-1442c188ecd3\") " pod="openshift-multus/multus-additional-cni-plugins-h6ldt"
Sep 15 11:37:05.897192 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897077    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/808cf550-98e0-4b24-b17e-466044b2221b-cni-binary-copy\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.897192 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897123    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sf4m\" (UniqueName: \"kubernetes.io/projected/32822a8f-c68a-4cc5-8afd-50a0620f04a2-kube-api-access-5sf4m\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.897192 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897157    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46qzh\" (UniqueName: \"kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh\") pod \"network-check-target-45rvn\" (UID: \"20669eed-9c6c-4432-af7e-27e3a2136cd9\") " pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:05.897192 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897186    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-etc-systemd\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.897891 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897216    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-host\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.897891 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897241    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/375b0b55-766a-483e-b6a9-63a28036c6b2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8bjpq\" (UID: \"375b0b55-766a-483e-b6a9-63a28036c6b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq"
Sep 15 11:37:05.897891 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897269    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7gm4\" (UniqueName: \"kubernetes.io/projected/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-kube-api-access-c7gm4\") pod \"network-metrics-daemon-4jmmn\" (UID: \"fd41f61a-cfbe-43f3-bc25-be3037a81bf2\") " pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:05.897891 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897294    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-multus-cni-dir\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.897891 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897324    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-etc-modprobe-d\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.897891 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6btq\" (UniqueName: \"kubernetes.io/projected/375b0b55-766a-483e-b6a9-63a28036c6b2-kube-api-access-w6btq\") pod \"aws-ebs-csi-driver-node-8bjpq\" (UID: \"375b0b55-766a-483e-b6a9-63a28036c6b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq"
Sep 15 11:37:05.897891 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897394    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-host-run-netns\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.897891 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897507    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-host-run-netns\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.897891 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897511    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-multus-conf-dir\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.897891 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897505    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-etc-kubernetes\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.897891 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897550    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/375b0b55-766a-483e-b6a9-63a28036c6b2-device-dir\") pod \"aws-ebs-csi-driver-node-8bjpq\" (UID: \"375b0b55-766a-483e-b6a9-63a28036c6b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq"
Sep 15 11:37:05.897891 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897552    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-host-var-lib-kubelet\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.897891 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897585    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-var-lib-kubelet\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.897891 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897587    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-host-run-k8s-cni-cncf-io\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.897891 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897660    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/375b0b55-766a-483e-b6a9-63a28036c6b2-socket-dir\") pod \"aws-ebs-csi-driver-node-8bjpq\" (UID: \"375b0b55-766a-483e-b6a9-63a28036c6b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq"
Sep 15 11:37:05.897891 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897657    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-etc-sysctl-d\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.897891 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897660    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-hostroot\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.897891 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897717    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-run\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.898823 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897744    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-host-var-lib-cni-multus\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.898823 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897767    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-etc-systemd\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.898823 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897775    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-etc-sysctl-conf\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.898823 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897809    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-sys\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.898823 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.897505    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/375b0b55-766a-483e-b6a9-63a28036c6b2-sys-fs\") pod \"aws-ebs-csi-driver-node-8bjpq\" (UID: \"375b0b55-766a-483e-b6a9-63a28036c6b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq"
Sep 15 11:37:05.898823 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.898083    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-cnibin\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.898823 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.898089    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3d23fee-843a-44e5-af4f-692b3efd8f03-konnectivity-ca\") pod \"konnectivity-agent-lpbsr\" (UID: \"a3d23fee-843a-44e5-af4f-692b3efd8f03\") " pod="kube-system/konnectivity-agent-lpbsr"
Sep 15 11:37:05.898823 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.898139    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-etc-kubernetes\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.898823 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.898244    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-etc-modprobe-d\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.898823 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.898278    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/403278f4-8eb0-41c6-a45c-1442c188ecd3-cni-binary-copy\") pod \"multus-additional-cni-plugins-h6ldt\" (UID: \"403278f4-8eb0-41c6-a45c-1442c188ecd3\") " pod="openshift-multus/multus-additional-cni-plugins-h6ldt"
Sep 15 11:37:05.898823 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.898291    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/403278f4-8eb0-41c6-a45c-1442c188ecd3-system-cni-dir\") pod \"multus-additional-cni-plugins-h6ldt\" (UID: \"403278f4-8eb0-41c6-a45c-1442c188ecd3\") " pod="openshift-multus/multus-additional-cni-plugins-h6ldt"
Sep 15 11:37:05.898823 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.898331    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/403278f4-8eb0-41c6-a45c-1442c188ecd3-cnibin\") pod \"multus-additional-cni-plugins-h6ldt\" (UID: \"403278f4-8eb0-41c6-a45c-1442c188ecd3\") " pod="openshift-multus/multus-additional-cni-plugins-h6ldt"
Sep 15 11:37:05.898823 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.898402    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32822a8f-c68a-4cc5-8afd-50a0620f04a2-host\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.898823 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.898502    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/403278f4-8eb0-41c6-a45c-1442c188ecd3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h6ldt\" (UID: \"403278f4-8eb0-41c6-a45c-1442c188ecd3\") " pod="openshift-multus/multus-additional-cni-plugins-h6ldt"
Sep 15 11:37:05.898823 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.898506    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/808cf550-98e0-4b24-b17e-466044b2221b-multus-cni-dir\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.898823 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.898549    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/375b0b55-766a-483e-b6a9-63a28036c6b2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8bjpq\" (UID: \"375b0b55-766a-483e-b6a9-63a28036c6b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq"
Sep 15 11:37:05.898823 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.898581    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/403278f4-8eb0-41c6-a45c-1442c188ecd3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h6ldt\" (UID: \"403278f4-8eb0-41c6-a45c-1442c188ecd3\") " pod="openshift-multus/multus-additional-cni-plugins-h6ldt"
Sep 15 11:37:05.899697 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.898563    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/375b0b55-766a-483e-b6a9-63a28036c6b2-registration-dir\") pod \"aws-ebs-csi-driver-node-8bjpq\" (UID: \"375b0b55-766a-483e-b6a9-63a28036c6b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq"
Sep 15 11:37:05.899759 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.899713    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/808cf550-98e0-4b24-b17e-466044b2221b-cni-binary-copy\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.902394 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.902328    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32822a8f-c68a-4cc5-8afd-50a0620f04a2-tmp\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.903033 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.902983    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32822a8f-c68a-4cc5-8afd-50a0620f04a2-etc-tuned\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.906796 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.906767    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3d23fee-843a-44e5-af4f-692b3efd8f03-agent-certs\") pod \"konnectivity-agent-lpbsr\" (UID: \"a3d23fee-843a-44e5-af4f-692b3efd8f03\") " pod="kube-system/konnectivity-agent-lpbsr"
Sep 15 11:37:05.906911 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.906807    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2brk9\" (UniqueName: \"kubernetes.io/projected/403278f4-8eb0-41c6-a45c-1442c188ecd3-kube-api-access-2brk9\") pod \"multus-additional-cni-plugins-h6ldt\" (UID: \"403278f4-8eb0-41c6-a45c-1442c188ecd3\") " pod="openshift-multus/multus-additional-cni-plugins-h6ldt"
Sep 15 11:37:05.908081 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:05.907754    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:37:05.908081 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:05.907777    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:37:05.908081 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:05.907791    2564 projected.go:196] Error preparing data for projected volume kube-api-access-46qzh for pod openshift-network-diagnostics/network-check-target-45rvn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:05.908081 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:05.907855    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh podName:20669eed-9c6c-4432-af7e-27e3a2136cd9 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:06.40783367 +0000 UTC m=+3.124707839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-46qzh" (UniqueName: "kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh") pod "network-check-target-45rvn" (UID: "20669eed-9c6c-4432-af7e-27e3a2136cd9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:05.909729 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.909679    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6btq\" (UniqueName: \"kubernetes.io/projected/375b0b55-766a-483e-b6a9-63a28036c6b2-kube-api-access-w6btq\") pod \"aws-ebs-csi-driver-node-8bjpq\" (UID: \"375b0b55-766a-483e-b6a9-63a28036c6b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq"
Sep 15 11:37:05.910309 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.910285    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7gm4\" (UniqueName: \"kubernetes.io/projected/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-kube-api-access-c7gm4\") pod \"network-metrics-daemon-4jmmn\" (UID: \"fd41f61a-cfbe-43f3-bc25-be3037a81bf2\") " pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:05.911454 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.911422    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sf4m\" (UniqueName: \"kubernetes.io/projected/32822a8f-c68a-4cc5-8afd-50a0620f04a2-kube-api-access-5sf4m\") pod \"tuned-84rjs\" (UID: \"32822a8f-c68a-4cc5-8afd-50a0620f04a2\") " pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:05.913385 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.913363    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs9q6\" (UniqueName: \"kubernetes.io/projected/808cf550-98e0-4b24-b17e-466044b2221b-kube-api-access-zs9q6\") pod \"multus-hrgfl\" (UID: \"808cf550-98e0-4b24-b17e-466044b2221b\") " pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:05.979149 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.979109    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vhq54"
Sep 15 11:37:05.989688 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:05.989640    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f6lmr"
Sep 15 11:37:06.000468 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:06.000442    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kgrfq"
Sep 15 11:37:06.005610 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:06.005590    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:06.013028 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:06.013010    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lpbsr"
Sep 15 11:37:06.021279 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:06.021136    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-84rjs"
Sep 15 11:37:06.028195 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:06.028172    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq"
Sep 15 11:37:06.036454 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:06.036432    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hrgfl"
Sep 15 11:37:06.041672 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:06.041647    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h6ldt"
Sep 15 11:37:06.094645 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:06.094615    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:37:06.301488 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:06.301447    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret\") pod \"global-pull-secret-syncer-cjpd7\" (UID: \"5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3\") " pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:06.301685 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:06.301582    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:06.301685 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:06.301671    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret podName:5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:07.301647145 +0000 UTC m=+4.018521311 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret") pod "global-pull-secret-syncer-cjpd7" (UID: "5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:06.402502 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:06.402466    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs\") pod \"network-metrics-daemon-4jmmn\" (UID: \"fd41f61a-cfbe-43f3-bc25-be3037a81bf2\") " pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:06.402676 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:06.402654    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:06.402746 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:06.402732    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs podName:fd41f61a-cfbe-43f3-bc25-be3037a81bf2 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:07.402711668 +0000 UTC m=+4.119585859 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs") pod "network-metrics-daemon-4jmmn" (UID: "fd41f61a-cfbe-43f3-bc25-be3037a81bf2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:06.503234 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:06.503195    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46qzh\" (UniqueName: \"kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh\") pod \"network-check-target-45rvn\" (UID: \"20669eed-9c6c-4432-af7e-27e3a2136cd9\") " pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:06.503452 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:06.503427    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:37:06.503519 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:06.503455    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:37:06.503519 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:06.503469    2564 projected.go:196] Error preparing data for projected volume kube-api-access-46qzh for pod openshift-network-diagnostics/network-check-target-45rvn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:06.503622 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:06.503544    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh podName:20669eed-9c6c-4432-af7e-27e3a2136cd9 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:07.503525022 +0000 UTC m=+4.220399203 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-46qzh" (UniqueName: "kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh") pod "network-check-target-45rvn" (UID: "20669eed-9c6c-4432-af7e-27e3a2136cd9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:06.719931 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:06.719849    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 11:32:06 +0000 UTC" deadline="2028-06-10 05:12:10.817453704 +0000 UTC"
Sep 15 11:37:06.719931 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:06.719879    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15209h35m4.097577664s"
Sep 15 11:37:07.036891 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:07.036693    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc23245d8_99eb_454d_8be3_d1f6c79c29cd.slice/crio-0bacd208da463a2b2236e1f16360dec7e02ab468c4297ea8050251e79a3444d1 WatchSource:0}: Error finding container 0bacd208da463a2b2236e1f16360dec7e02ab468c4297ea8050251e79a3444d1: Status 404 returned error can't find the container with id 0bacd208da463a2b2236e1f16360dec7e02ab468c4297ea8050251e79a3444d1
Sep 15 11:37:07.062330 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:07.062304    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3d23fee_843a_44e5_af4f_692b3efd8f03.slice/crio-ca0b1691c4ce40a17af8aeafff232d87f5ca38a0822e335aa084b0e7c40ac247 WatchSource:0}: Error finding container ca0b1691c4ce40a17af8aeafff232d87f5ca38a0822e335aa084b0e7c40ac247: Status 404 returned error can't find the container with id ca0b1691c4ce40a17af8aeafff232d87f5ca38a0822e335aa084b0e7c40ac247
Sep 15 11:37:07.063610 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:07.063579    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf111f931_1044_45df_a721_bcf424d77367.slice/crio-dbd61705225afd9fc54c873017861cf12fadc984e4fad94ed3ec0225cd10e35d WatchSource:0}: Error finding container dbd61705225afd9fc54c873017861cf12fadc984e4fad94ed3ec0225cd10e35d: Status 404 returned error can't find the container with id dbd61705225afd9fc54c873017861cf12fadc984e4fad94ed3ec0225cd10e35d
Sep 15 11:37:07.064268 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:07.064245    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod403278f4_8eb0_41c6_a45c_1442c188ecd3.slice/crio-b058548cf0211e6c15118a23669ad6347962abdcd711a39f5f3221fbf98240de WatchSource:0}: Error finding container b058548cf0211e6c15118a23669ad6347962abdcd711a39f5f3221fbf98240de: Status 404 returned error can't find the container with id b058548cf0211e6c15118a23669ad6347962abdcd711a39f5f3221fbf98240de
Sep 15 11:37:07.072909 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:07.072820    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod349601b9_3ea8_4c18_b77c_b90cfd48d1e5.slice/crio-ef4a8164334eda588f8b630f56575456bec4a2689c0c23391f7c9664faffa1d2 WatchSource:0}: Error finding container ef4a8164334eda588f8b630f56575456bec4a2689c0c23391f7c9664faffa1d2: Status 404 returned error can't find the container with id ef4a8164334eda588f8b630f56575456bec4a2689c0c23391f7c9664faffa1d2
Sep 15 11:37:07.074330 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:07.074309    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1902b56e_9967_454a_bf3d_b1c11111f5ec.slice/crio-a7db3b299622797f1f83d45648108662b4fbdedef3932619d17a3cbfc0a98359 WatchSource:0}: Error finding container a7db3b299622797f1f83d45648108662b4fbdedef3932619d17a3cbfc0a98359: Status 404 returned error can't find the container with id a7db3b299622797f1f83d45648108662b4fbdedef3932619d17a3cbfc0a98359
Sep 15 11:37:07.075225 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:07.075130    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32822a8f_c68a_4cc5_8afd_50a0620f04a2.slice/crio-a46321d7ae0cebff2a400d62ccafe4128fc6f8b93ed04eff2bf091472a48fc08 WatchSource:0}: Error finding container a46321d7ae0cebff2a400d62ccafe4128fc6f8b93ed04eff2bf091472a48fc08: Status 404 returned error can't find the container with id a46321d7ae0cebff2a400d62ccafe4128fc6f8b93ed04eff2bf091472a48fc08
Sep 15 11:37:07.076636 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:07.076615    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod808cf550_98e0_4b24_b17e_466044b2221b.slice/crio-bf28537247f70ca152dc706d49a865962ecc91a0f8e0c3c9b13a1dc57b492390 WatchSource:0}: Error finding container bf28537247f70ca152dc706d49a865962ecc91a0f8e0c3c9b13a1dc57b492390: Status 404 returned error can't find the container with id bf28537247f70ca152dc706d49a865962ecc91a0f8e0c3c9b13a1dc57b492390
Sep 15 11:37:07.077723 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:07.077611    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod375b0b55_766a_483e_b6a9_63a28036c6b2.slice/crio-4423006c8daeb37a17cffbd203ebad173bcb0f34ff16cb8f51e9ff7772fde35f WatchSource:0}: Error finding container 4423006c8daeb37a17cffbd203ebad173bcb0f34ff16cb8f51e9ff7772fde35f: Status 404 returned error can't find the container with id 4423006c8daeb37a17cffbd203ebad173bcb0f34ff16cb8f51e9ff7772fde35f
Sep 15 11:37:07.308766 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:07.308716    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret\") pod \"global-pull-secret-syncer-cjpd7\" (UID: \"5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3\") " pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:07.308894 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:07.308874    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:07.308948 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:07.308937    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret podName:5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:09.308921219 +0000 UTC m=+6.025795387 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret") pod "global-pull-secret-syncer-cjpd7" (UID: "5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:07.410110 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:07.410079    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs\") pod \"network-metrics-daemon-4jmmn\" (UID: \"fd41f61a-cfbe-43f3-bc25-be3037a81bf2\") " pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:07.410265 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:07.410189    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:07.410265 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:07.410245    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs podName:fd41f61a-cfbe-43f3-bc25-be3037a81bf2 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:09.410229922 +0000 UTC m=+6.127104086 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs") pod "network-metrics-daemon-4jmmn" (UID: "fd41f61a-cfbe-43f3-bc25-be3037a81bf2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:07.510928 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:07.510842    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46qzh\" (UniqueName: \"kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh\") pod \"network-check-target-45rvn\" (UID: \"20669eed-9c6c-4432-af7e-27e3a2136cd9\") " pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:07.511257 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:07.511235    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:37:07.511375 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:07.511266    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:37:07.511375 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:07.511282    2564 projected.go:196] Error preparing data for projected volume kube-api-access-46qzh for pod openshift-network-diagnostics/network-check-target-45rvn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:07.511490 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:07.511412    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh podName:20669eed-9c6c-4432-af7e-27e3a2136cd9 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:09.511392026 +0000 UTC m=+6.228266192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-46qzh" (UniqueName: "kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh") pod "network-check-target-45rvn" (UID: "20669eed-9c6c-4432-af7e-27e3a2136cd9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:07.721433 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:07.720390    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 11:32:06 +0000 UTC" deadline="2028-02-20 03:48:08.506132008 +0000 UTC"
Sep 15 11:37:07.721433 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:07.720456    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12544h11m0.785681079s"
Sep 15 11:37:07.775116 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:07.775083    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:07.775287 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:07.775219    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45rvn" podUID="20669eed-9c6c-4432-af7e-27e3a2136cd9"
Sep 15 11:37:07.775375 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:07.775305    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:07.775433 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:07.775404    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjpd7" podUID="5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3"
Sep 15 11:37:07.775489 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:07.775475    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:07.775581 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:07.775562    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jmmn" podUID="fd41f61a-cfbe-43f3-bc25-be3037a81bf2"
Sep 15 11:37:07.792729 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:07.792695    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-183.ec2.internal" event={"ID":"b39c0b37c0c33603dd2e1954df67bc7d","Type":"ContainerStarted","Data":"6b92f232f1bff206c4afa2b689eb3716c7a57f59d98ce3da4292811db908607c"}
Sep 15 11:37:07.799198 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:07.799147    2564 generic.go:356] "Generic (PLEG): container finished" podID="46104ccc950d3257016d51b21f9001fa" containerID="6adf9b4b6b1bbc19b35089b33356692d612934366805515c3ec5d2b83acaf5d9" exitCode=0
Sep 15 11:37:07.799350 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:07.799230    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal" event={"ID":"46104ccc950d3257016d51b21f9001fa","Type":"ContainerDied","Data":"6adf9b4b6b1bbc19b35089b33356692d612934366805515c3ec5d2b83acaf5d9"}
Sep 15 11:37:07.805005 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:07.804939    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hrgfl" event={"ID":"808cf550-98e0-4b24-b17e-466044b2221b","Type":"ContainerStarted","Data":"bf28537247f70ca152dc706d49a865962ecc91a0f8e0c3c9b13a1dc57b492390"}
Sep 15 11:37:07.810915 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:07.810465    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-84rjs" event={"ID":"32822a8f-c68a-4cc5-8afd-50a0620f04a2","Type":"ContainerStarted","Data":"a46321d7ae0cebff2a400d62ccafe4128fc6f8b93ed04eff2bf091472a48fc08"}
Sep 15 11:37:07.816495 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:07.816451    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv" event={"ID":"1902b56e-9967-454a-bf3d-b1c11111f5ec","Type":"ContainerStarted","Data":"a7db3b299622797f1f83d45648108662b4fbdedef3932619d17a3cbfc0a98359"}
Sep 15 11:37:07.821393 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:07.821366    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6ldt" event={"ID":"403278f4-8eb0-41c6-a45c-1442c188ecd3","Type":"ContainerStarted","Data":"b058548cf0211e6c15118a23669ad6347962abdcd711a39f5f3221fbf98240de"}
Sep 15 11:37:07.826157 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:07.826125    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kgrfq" event={"ID":"f111f931-1044-45df-a721-bcf424d77367","Type":"ContainerStarted","Data":"dbd61705225afd9fc54c873017861cf12fadc984e4fad94ed3ec0225cd10e35d"}
Sep 15 11:37:07.831710 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:07.831518    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-183.ec2.internal" podStartSLOduration=2.831500266 podStartE2EDuration="2.831500266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:37:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:07.810613936 +0000 UTC m=+4.527488126" watchObservedRunningTime="2026-09-15 11:37:07.831500266 +0000 UTC m=+4.548374443"
Sep 15 11:37:07.834419 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:07.834393    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq" event={"ID":"375b0b55-766a-483e-b6a9-63a28036c6b2","Type":"ContainerStarted","Data":"4423006c8daeb37a17cffbd203ebad173bcb0f34ff16cb8f51e9ff7772fde35f"}
Sep 15 11:37:07.838318 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:07.838224    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f6lmr" event={"ID":"349601b9-3ea8-4c18-b77c-b90cfd48d1e5","Type":"ContainerStarted","Data":"ef4a8164334eda588f8b630f56575456bec4a2689c0c23391f7c9664faffa1d2"}
Sep 15 11:37:07.847438 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:07.847411    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lpbsr" event={"ID":"a3d23fee-843a-44e5-af4f-692b3efd8f03","Type":"ContainerStarted","Data":"ca0b1691c4ce40a17af8aeafff232d87f5ca38a0822e335aa084b0e7c40ac247"}
Sep 15 11:37:07.856315 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:07.856289    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vhq54" event={"ID":"c23245d8-99eb-454d-8be3-d1f6c79c29cd","Type":"ContainerStarted","Data":"0bacd208da463a2b2236e1f16360dec7e02ab468c4297ea8050251e79a3444d1"}
Sep 15 11:37:08.898321 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:08.897893    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal" event={"ID":"46104ccc950d3257016d51b21f9001fa","Type":"ContainerStarted","Data":"3972732b5c63e89f29d93db346aade9e7f4c3e1fed3af180b7357e9bfd050f76"}
Sep 15 11:37:09.326651 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:09.326551    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:09.326831 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:09.326661    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret podName:5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:13.326639623 +0000 UTC m=+10.043513792 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret") pod "global-pull-secret-syncer-cjpd7" (UID: "5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:09.326831 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:09.326705    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret\") pod \"global-pull-secret-syncer-cjpd7\" (UID: \"5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3\") " pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:09.427275 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:09.427234    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs\") pod \"network-metrics-daemon-4jmmn\" (UID: \"fd41f61a-cfbe-43f3-bc25-be3037a81bf2\") " pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:09.427495 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:09.427437    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:09.427572 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:09.427509    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs podName:fd41f61a-cfbe-43f3-bc25-be3037a81bf2 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:13.427489005 +0000 UTC m=+10.144363180 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs") pod "network-metrics-daemon-4jmmn" (UID: "fd41f61a-cfbe-43f3-bc25-be3037a81bf2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:09.528761 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:09.528066    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46qzh\" (UniqueName: \"kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh\") pod \"network-check-target-45rvn\" (UID: \"20669eed-9c6c-4432-af7e-27e3a2136cd9\") " pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:09.528761 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:09.528267    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:37:09.528761 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:09.528295    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:37:09.528761 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:09.528325    2564 projected.go:196] Error preparing data for projected volume kube-api-access-46qzh for pod openshift-network-diagnostics/network-check-target-45rvn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:09.528761 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:09.528386    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh podName:20669eed-9c6c-4432-af7e-27e3a2136cd9 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:13.52836764 +0000 UTC m=+10.245241810 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-46qzh" (UniqueName: "kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh") pod "network-check-target-45rvn" (UID: "20669eed-9c6c-4432-af7e-27e3a2136cd9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:09.775012 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:09.774457    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:09.775012 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:09.774593    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjpd7" podUID="5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3"
Sep 15 11:37:09.775012 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:09.774660    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:09.775012 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:09.774735    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:09.775012 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:09.774833    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45rvn" podUID="20669eed-9c6c-4432-af7e-27e3a2136cd9"
Sep 15 11:37:09.775012 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:09.774928    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jmmn" podUID="fd41f61a-cfbe-43f3-bc25-be3037a81bf2"
Sep 15 11:37:11.773239 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:11.772487    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:11.773239 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:11.772532    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:11.773239 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:11.772650    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jmmn" podUID="fd41f61a-cfbe-43f3-bc25-be3037a81bf2"
Sep 15 11:37:11.773239 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:11.773080    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjpd7" podUID="5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3"
Sep 15 11:37:11.773239 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:11.773129    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:11.773239 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:11.773203    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45rvn" podUID="20669eed-9c6c-4432-af7e-27e3a2136cd9"
Sep 15 11:37:13.361764 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:13.361725    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret\") pod \"global-pull-secret-syncer-cjpd7\" (UID: \"5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3\") " pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:13.362194 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:13.361938    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:13.362194 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:13.362058    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret podName:5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:21.362009515 +0000 UTC m=+18.078883704 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret") pod "global-pull-secret-syncer-cjpd7" (UID: "5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:13.462771 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:13.462734    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs\") pod \"network-metrics-daemon-4jmmn\" (UID: \"fd41f61a-cfbe-43f3-bc25-be3037a81bf2\") " pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:13.462937 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:13.462907    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:13.463021 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:13.462982    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs podName:fd41f61a-cfbe-43f3-bc25-be3037a81bf2 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:21.462959229 +0000 UTC m=+18.179833414 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs") pod "network-metrics-daemon-4jmmn" (UID: "fd41f61a-cfbe-43f3-bc25-be3037a81bf2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:13.563528 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:13.563486    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46qzh\" (UniqueName: \"kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh\") pod \"network-check-target-45rvn\" (UID: \"20669eed-9c6c-4432-af7e-27e3a2136cd9\") " pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:13.563678 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:13.563633    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:37:13.563678 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:13.563659    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:37:13.563678 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:13.563669    2564 projected.go:196] Error preparing data for projected volume kube-api-access-46qzh for pod openshift-network-diagnostics/network-check-target-45rvn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:13.563861 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:13.563719    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh podName:20669eed-9c6c-4432-af7e-27e3a2136cd9 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:21.563705787 +0000 UTC m=+18.280579956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-46qzh" (UniqueName: "kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh") pod "network-check-target-45rvn" (UID: "20669eed-9c6c-4432-af7e-27e3a2136cd9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:13.779698 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:13.779614    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:13.779698 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:13.779633    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:13.779920 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:13.779739    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjpd7" podUID="5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3"
Sep 15 11:37:13.779974 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:13.779852    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jmmn" podUID="fd41f61a-cfbe-43f3-bc25-be3037a81bf2"
Sep 15 11:37:13.779974 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:13.779907    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:13.780145 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:13.780122    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45rvn" podUID="20669eed-9c6c-4432-af7e-27e3a2136cd9"
Sep 15 11:37:15.773826 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:15.772972    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:15.773826 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:15.773053    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:15.773826 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:15.773422    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjpd7" podUID="5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3"
Sep 15 11:37:15.773826 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:15.773079    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:15.773826 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:15.773501    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jmmn" podUID="fd41f61a-cfbe-43f3-bc25-be3037a81bf2"
Sep 15 11:37:15.773826 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:15.773658    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45rvn" podUID="20669eed-9c6c-4432-af7e-27e3a2136cd9"
Sep 15 11:37:17.773007 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:17.772977    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:17.773483 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:17.772981    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:17.773483 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:17.773083    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jmmn" podUID="fd41f61a-cfbe-43f3-bc25-be3037a81bf2"
Sep 15 11:37:17.773483 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:17.772984    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:17.773483 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:17.773152    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45rvn" podUID="20669eed-9c6c-4432-af7e-27e3a2136cd9"
Sep 15 11:37:17.773483 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:17.773257    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjpd7" podUID="5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3"
Sep 15 11:37:19.772984 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:19.772773    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:19.773417 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:19.772774    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:19.773417 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:19.773062    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjpd7" podUID="5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3"
Sep 15 11:37:19.773417 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:19.773144    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jmmn" podUID="fd41f61a-cfbe-43f3-bc25-be3037a81bf2"
Sep 15 11:37:19.773417 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:19.772792    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:19.773417 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:19.773243    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45rvn" podUID="20669eed-9c6c-4432-af7e-27e3a2136cd9"
Sep 15 11:37:21.423973 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:21.423937    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret\") pod \"global-pull-secret-syncer-cjpd7\" (UID: \"5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3\") " pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:21.424460 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:21.424050    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:21.424460 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:21.424099    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret podName:5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:37.424086766 +0000 UTC m=+34.140960928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret") pod "global-pull-secret-syncer-cjpd7" (UID: "5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:21.525223 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:21.525190    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs\") pod \"network-metrics-daemon-4jmmn\" (UID: \"fd41f61a-cfbe-43f3-bc25-be3037a81bf2\") " pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:21.525376 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:21.525307    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:21.525376 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:21.525354    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs podName:fd41f61a-cfbe-43f3-bc25-be3037a81bf2 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:37.525340694 +0000 UTC m=+34.242214855 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs") pod "network-metrics-daemon-4jmmn" (UID: "fd41f61a-cfbe-43f3-bc25-be3037a81bf2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:21.625903 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:21.625870    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46qzh\" (UniqueName: \"kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh\") pod \"network-check-target-45rvn\" (UID: \"20669eed-9c6c-4432-af7e-27e3a2136cd9\") " pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:21.626073 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:21.626054    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:37:21.626118 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:21.626078    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:37:21.626118 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:21.626088    2564 projected.go:196] Error preparing data for projected volume kube-api-access-46qzh for pod openshift-network-diagnostics/network-check-target-45rvn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:21.626206 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:21.626135    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh podName:20669eed-9c6c-4432-af7e-27e3a2136cd9 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:37.626121065 +0000 UTC m=+34.342995226 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-46qzh" (UniqueName: "kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh") pod "network-check-target-45rvn" (UID: "20669eed-9c6c-4432-af7e-27e3a2136cd9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:21.773536 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:21.773419    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:21.773536 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:21.773447    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:21.773745 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:21.773570    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jmmn" podUID="fd41f61a-cfbe-43f3-bc25-be3037a81bf2"
Sep 15 11:37:21.773745 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:21.773678    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45rvn" podUID="20669eed-9c6c-4432-af7e-27e3a2136cd9"
Sep 15 11:37:21.773745 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:21.773729    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:21.773894 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:21.773796    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjpd7" podUID="5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3"
Sep 15 11:37:23.774149 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:23.774112    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:23.774589 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:23.774213    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:23.774589 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:23.774253    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:23.774589 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:23.774279    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jmmn" podUID="fd41f61a-cfbe-43f3-bc25-be3037a81bf2"
Sep 15 11:37:23.774589 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:23.774363    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45rvn" podUID="20669eed-9c6c-4432-af7e-27e3a2136cd9"
Sep 15 11:37:23.774589 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:23.774440    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjpd7" podUID="5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3"
Sep 15 11:37:25.772974 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:25.772812    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:25.773696 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:25.772813    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:25.773696 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:25.773069    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjpd7" podUID="5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3"
Sep 15 11:37:25.773696 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:25.772821    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:25.773696 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:25.773203    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45rvn" podUID="20669eed-9c6c-4432-af7e-27e3a2136cd9"
Sep 15 11:37:25.773696 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:25.773318    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jmmn" podUID="fd41f61a-cfbe-43f3-bc25-be3037a81bf2"
Sep 15 11:37:25.935717 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:25.935675    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-84rjs" event={"ID":"32822a8f-c68a-4cc5-8afd-50a0620f04a2","Type":"ContainerStarted","Data":"9ca85cd7f4302d38ef234e81934c9ff3da68a015247aa9b043ba1316d2c0993a"}
Sep 15 11:37:25.939650 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:25.939623    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv" event={"ID":"1902b56e-9967-454a-bf3d-b1c11111f5ec","Type":"ContainerStarted","Data":"a53fde9faee7d0fad9b54d84a781b33fa819ab12067548c1112c367dbccfec5b"}
Sep 15 11:37:25.939794 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:25.939708    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv" event={"ID":"1902b56e-9967-454a-bf3d-b1c11111f5ec","Type":"ContainerStarted","Data":"bd04955b266ec44cad37617369294fb4c6e155cd6c80f3cd7876d583d0ec5828"}
Sep 15 11:37:25.939794 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:25.939760    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv" event={"ID":"1902b56e-9967-454a-bf3d-b1c11111f5ec","Type":"ContainerStarted","Data":"f82f96179e36ccb004fdfcd3dd077c5a677ba123319dc508a2e7946dd0aca410"}
Sep 15 11:37:25.939904 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:25.939807    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv" event={"ID":"1902b56e-9967-454a-bf3d-b1c11111f5ec","Type":"ContainerStarted","Data":"2fb9e66f7c13d9e796970eb4e4fd200fbba04fa7bc3e07250f4f612256b22772"}
Sep 15 11:37:25.939904 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:25.939856    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv" event={"ID":"1902b56e-9967-454a-bf3d-b1c11111f5ec","Type":"ContainerStarted","Data":"f0cc1ace40b4f214ac6cef8f7815befe1f4eb4c4b4ed1c56764e5d7557918148"}
Sep 15 11:37:25.939970 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:25.939902    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv" event={"ID":"1902b56e-9967-454a-bf3d-b1c11111f5ec","Type":"ContainerStarted","Data":"9ccdcd95d22a7b2d5d0e077d1f4c29f17a6693a2c841ba77972493100ae38803"}
Sep 15 11:37:25.941386 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:25.941362    2564 generic.go:356] "Generic (PLEG): container finished" podID="403278f4-8eb0-41c6-a45c-1442c188ecd3" containerID="21ed3337539bb1e7f303759cec7983d578463b2a26f5684d67aecb03be076ea2" exitCode=0
Sep 15 11:37:25.941465 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:25.941449    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6ldt" event={"ID":"403278f4-8eb0-41c6-a45c-1442c188ecd3","Type":"ContainerDied","Data":"21ed3337539bb1e7f303759cec7983d578463b2a26f5684d67aecb03be076ea2"}
Sep 15 11:37:25.943230 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:25.943208    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq" event={"ID":"375b0b55-766a-483e-b6a9-63a28036c6b2","Type":"ContainerStarted","Data":"b3d7e73c25b827173d8a4a4d7e8e31230fc908468b5d35a4ac03aea6da436449"}
Sep 15 11:37:25.944990 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:25.944967    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f6lmr" event={"ID":"349601b9-3ea8-4c18-b77c-b90cfd48d1e5","Type":"ContainerStarted","Data":"f0fc9ae6f15bb5eb5b171d7075bd2d11d6ca704c968f50891885f2f85df9ac5f"}
Sep 15 11:37:25.946627 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:25.946538    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lpbsr" event={"ID":"a3d23fee-843a-44e5-af4f-692b3efd8f03","Type":"ContainerStarted","Data":"6aba55c6640c425d123809a540ac4073eda16b002b74990b0a3c9628fd2fcc2e"}
Sep 15 11:37:25.948548 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:25.948524    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vhq54" event={"ID":"c23245d8-99eb-454d-8be3-d1f6c79c29cd","Type":"ContainerStarted","Data":"e6647ba255a803a2e0fe5c69cb6b80e1a5262772630b7f1d79c1905f5dee61ee"}
Sep 15 11:37:25.950108 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:25.950083    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hrgfl" event={"ID":"808cf550-98e0-4b24-b17e-466044b2221b","Type":"ContainerStarted","Data":"f45d8139eae1e6b9d82589fb70b0f3aa4a1d4e9047fd50b7323cd32a4cbf6623"}
Sep 15 11:37:25.953756 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:25.953710    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-84rjs" podStartSLOduration=3.8076589739999998 podStartE2EDuration="21.953694659s" totalImagesPullingTime="18.146035685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:25.953472136 +0000 UTC m=+22.670346322" watchObservedRunningTime="2026-09-15 11:37:25.953694659 +0000 UTC m=+22.670568866"
Sep 15 11:37:25.954101 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:25.954065    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal" podStartSLOduration=20.954052021 podStartE2EDuration="20.954052021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:37:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:08.915990051 +0000 UTC m=+5.632864239" watchObservedRunningTime="2026-09-15 11:37:25.954052021 +0000 UTC m=+22.670926206"
Sep 15 11:37:25.970633 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:25.970596    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hrgfl" podStartSLOduration=3.790349896 podStartE2EDuration="21.970583938s" totalImagesPullingTime="18.180234042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:25.970523462 +0000 UTC m=+22.687397646" watchObservedRunningTime="2026-09-15 11:37:25.970583938 +0000 UTC m=+22.687458123"
Sep 15 11:37:26.007275 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:26.007209    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vhq54" podStartSLOduration=3.864968357 podStartE2EDuration="22.007190111s" totalImagesPullingTime="18.142221754s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:26.00650981 +0000 UTC m=+22.723383995" watchObservedRunningTime="2026-09-15 11:37:26.007190111 +0000 UTC m=+22.724064296"
Sep 15 11:37:26.025002 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:26.024952    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f6lmr" podStartSLOduration=3.89189191 podStartE2EDuration="22.024939274s" totalImagesPullingTime="18.133047364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:26.024278428 +0000 UTC m=+22.741152611" watchObservedRunningTime="2026-09-15 11:37:26.024939274 +0000 UTC m=+22.741813459"
Sep 15 11:37:26.039702 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:26.039659    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lpbsr" podStartSLOduration=7.547626646 podStartE2EDuration="22.039646116s" totalImagesPullingTime="14.49201947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:26.039347996 +0000 UTC m=+22.756222179" watchObservedRunningTime="2026-09-15 11:37:26.039646116 +0000 UTC m=+22.756520299"
Sep 15 11:37:26.712475 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:26.712443    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 15 11:37:26.747957 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:26.747858    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T11:37:26.7124708Z","UUID":"534ed6aa-4e02-4083-a058-de61034d0688","Handler":null,"Name":"","Endpoint":""}
Sep 15 11:37:26.750776 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:26.750755    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 15 11:37:26.750881 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:26.750790    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 15 11:37:26.954848 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:26.954738    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq" event={"ID":"375b0b55-766a-483e-b6a9-63a28036c6b2","Type":"ContainerStarted","Data":"0c8d9be7895b102fda5d897b0d6e79326f249f3105541d1e9e01147725910ab8"}
Sep 15 11:37:26.956636 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:26.956583    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kgrfq" event={"ID":"f111f931-1044-45df-a721-bcf424d77367","Type":"ContainerStarted","Data":"f912029590b0096cad609cd5373f2ab737ac586a518d3413b300088c9dac8924"}
Sep 15 11:37:26.976627 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:26.976585    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kgrfq" podStartSLOduration=4.840804086 podStartE2EDuration="22.976573037s" totalImagesPullingTime="18.135768951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:26.976010744 +0000 UTC m=+23.692885003" watchObservedRunningTime="2026-09-15 11:37:26.976573037 +0000 UTC m=+23.693447220"
Sep 15 11:37:27.773489 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:27.773461    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:27.773602 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:27.773468    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:27.773602 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:27.773577    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjpd7" podUID="5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3"
Sep 15 11:37:27.773602 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:27.773585    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:27.773706 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:27.773670    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jmmn" podUID="fd41f61a-cfbe-43f3-bc25-be3037a81bf2"
Sep 15 11:37:27.773773 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:27.773751    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45rvn" podUID="20669eed-9c6c-4432-af7e-27e3a2136cd9"
Sep 15 11:37:27.962172 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:27.962091    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq" event={"ID":"375b0b55-766a-483e-b6a9-63a28036c6b2","Type":"ContainerStarted","Data":"bb4be1a8bc0cd8ca95a1edc6cba8d78230c36d572f2fd542969cdef2e215ee25"}
Sep 15 11:37:27.966632 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:27.966606    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv" event={"ID":"1902b56e-9967-454a-bf3d-b1c11111f5ec","Type":"ContainerStarted","Data":"232b592376293de5c36aab5ad042bd8b792718377c2954fc6c0d67d8d11ad670"}
Sep 15 11:37:27.983656 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:27.983607    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bjpq" podStartSLOduration=3.739779167 podStartE2EDuration="23.983586966s" totalImagesPullingTime="20.243807799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:37:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:27.983444924 +0000 UTC m=+24.700319108" watchObservedRunningTime="2026-09-15 11:37:27.983586966 +0000 UTC m=+24.700461150"
Sep 15 11:37:28.414092 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:28.414058    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lpbsr_a3d23fee-843a-44e5-af4f-692b3efd8f03/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:28.510161 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:28.510130    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lpbsr_a3d23fee-843a-44e5-af4f-692b3efd8f03/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:29.775990 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:29.775958    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:29.775990 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:29.775987    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:29.776589 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:29.775958    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:29.776589 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:29.776087    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45rvn" podUID="20669eed-9c6c-4432-af7e-27e3a2136cd9"
Sep 15 11:37:29.776589 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:29.776136    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjpd7" podUID="5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3"
Sep 15 11:37:29.776589 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:29.776252    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jmmn" podUID="fd41f61a-cfbe-43f3-bc25-be3037a81bf2"
Sep 15 11:37:30.217303 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:30.217253    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lpbsr"
Sep 15 11:37:30.217900 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:30.217880    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lpbsr"
Sep 15 11:37:30.977009 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:30.976780    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv" event={"ID":"1902b56e-9967-454a-bf3d-b1c11111f5ec","Type":"ContainerStarted","Data":"490398fccdd225cc771a34f65118f4cad408d828e29eabbea5c03f3595afd488"}
Sep 15 11:37:30.977501 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:30.977030    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:30.977501 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:30.977081    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:30.977501 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:30.977125    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:30.978877 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:30.978850    2564 generic.go:356] "Generic (PLEG): container finished" podID="403278f4-8eb0-41c6-a45c-1442c188ecd3" containerID="cc3d6c7707c79717891a1e3987bee4f1b79d0222e7e747bc5fe3dd7905a34236" exitCode=0
Sep 15 11:37:30.978959 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:30.978918    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6ldt" event={"ID":"403278f4-8eb0-41c6-a45c-1442c188ecd3","Type":"ContainerDied","Data":"cc3d6c7707c79717891a1e3987bee4f1b79d0222e7e747bc5fe3dd7905a34236"}
Sep 15 11:37:30.979172 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:30.979156    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lpbsr"
Sep 15 11:37:30.980024 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:30.979637    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lpbsr"
Sep 15 11:37:30.991883 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:30.991864    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:30.992080 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:30.992066    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:37:31.003005 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:31.002968    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv" podStartSLOduration=8.800233223 podStartE2EDuration="27.002955035s" totalImagesPullingTime="18.202721812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:31.001166605 +0000 UTC m=+27.718040813" watchObservedRunningTime="2026-09-15 11:37:31.002955035 +0000 UTC m=+27.719829218"
Sep 15 11:37:31.116714 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:31.116685    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lpbsr_a3d23fee-843a-44e5-af4f-692b3efd8f03/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:31.773131 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:31.773101    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:31.773407 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:31.773099    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:31.773407 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:31.773229    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45rvn" podUID="20669eed-9c6c-4432-af7e-27e3a2136cd9"
Sep 15 11:37:31.773407 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:31.773101    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:31.773407 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:31.773325    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjpd7" podUID="5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3"
Sep 15 11:37:31.773407 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:31.773375    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jmmn" podUID="fd41f61a-cfbe-43f3-bc25-be3037a81bf2"
Sep 15 11:37:32.413794 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:32.413592    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cjpd7"]
Sep 15 11:37:32.414337 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:32.413866    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:32.414337 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:32.413963    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjpd7" podUID="5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3"
Sep 15 11:37:32.417463 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:32.417367    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-45rvn"]
Sep 15 11:37:32.417463 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:32.417456    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:32.417615 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:32.417556    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45rvn" podUID="20669eed-9c6c-4432-af7e-27e3a2136cd9"
Sep 15 11:37:32.418063 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:32.418042    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4jmmn"]
Sep 15 11:37:32.418143 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:32.418123    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:32.418235 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:32.418215    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jmmn" podUID="fd41f61a-cfbe-43f3-bc25-be3037a81bf2"
Sep 15 11:37:32.985850 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:32.985815    2564 generic.go:356] "Generic (PLEG): container finished" podID="403278f4-8eb0-41c6-a45c-1442c188ecd3" containerID="8d29393380427e129ff14930ac89d4a6b7efc2270c93b8f0965bcacd77918e6f" exitCode=0
Sep 15 11:37:32.986017 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:32.985890    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6ldt" event={"ID":"403278f4-8eb0-41c6-a45c-1442c188ecd3","Type":"ContainerDied","Data":"8d29393380427e129ff14930ac89d4a6b7efc2270c93b8f0965bcacd77918e6f"}
Sep 15 11:37:33.616870 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:33.616839    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lpbsr_a3d23fee-843a-44e5-af4f-692b3efd8f03/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:33.677810 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:33.677775    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lpbsr_a3d23fee-843a-44e5-af4f-692b3efd8f03/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:33.774599 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:33.774569    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:33.774776 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:33.774710    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjpd7" podUID="5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3"
Sep 15 11:37:34.773073 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:34.773047    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:34.773443 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:34.773047    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:34.773443 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:34.773162    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jmmn" podUID="fd41f61a-cfbe-43f3-bc25-be3037a81bf2"
Sep 15 11:37:34.773443 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:34.773213    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45rvn" podUID="20669eed-9c6c-4432-af7e-27e3a2136cd9"
Sep 15 11:37:34.991913 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:34.991832    2564 generic.go:356] "Generic (PLEG): container finished" podID="403278f4-8eb0-41c6-a45c-1442c188ecd3" containerID="9a7baf3b9b59812cb7ffe1ea2ef0244336a3a00711215adb18ccd3aaaadb2e3e" exitCode=0
Sep 15 11:37:34.991913 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:34.991875    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6ldt" event={"ID":"403278f4-8eb0-41c6-a45c-1442c188ecd3","Type":"ContainerDied","Data":"9a7baf3b9b59812cb7ffe1ea2ef0244336a3a00711215adb18ccd3aaaadb2e3e"}
Sep 15 11:37:35.531822 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:35.531790    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lpbsr_a3d23fee-843a-44e5-af4f-692b3efd8f03/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:35.632401 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:35.632369    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lpbsr_a3d23fee-843a-44e5-af4f-692b3efd8f03/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:35.697700 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:35.697669    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lpbsr_a3d23fee-843a-44e5-af4f-692b3efd8f03/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:35.773146 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:35.773113    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:35.773585 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:35.773224    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjpd7" podUID="5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3"
Sep 15 11:37:36.423959 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:36.423932    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lpbsr_a3d23fee-843a-44e5-af4f-692b3efd8f03/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:36.485066 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:36.485038    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lpbsr_a3d23fee-843a-44e5-af4f-692b3efd8f03/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:36.773012 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:36.772941    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:36.773012 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:36.772976    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:36.773482 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:36.773087    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jmmn" podUID="fd41f61a-cfbe-43f3-bc25-be3037a81bf2"
Sep 15 11:37:36.773482 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:36.773229    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45rvn" podUID="20669eed-9c6c-4432-af7e-27e3a2136cd9"
Sep 15 11:37:37.435283 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:37.435236    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret\") pod \"global-pull-secret-syncer-cjpd7\" (UID: \"5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3\") " pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:37.435464 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:37.435394    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:37.435464 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:37.435463    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret podName:5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:09.435446983 +0000 UTC m=+66.152321145 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret") pod "global-pull-secret-syncer-cjpd7" (UID: "5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:37.536465 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:37.536422    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs\") pod \"network-metrics-daemon-4jmmn\" (UID: \"fd41f61a-cfbe-43f3-bc25-be3037a81bf2\") " pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:37.536659 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:37.536565    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:37.536659 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:37.536654    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs podName:fd41f61a-cfbe-43f3-bc25-be3037a81bf2 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:09.536632477 +0000 UTC m=+66.253506661 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs") pod "network-metrics-daemon-4jmmn" (UID: "fd41f61a-cfbe-43f3-bc25-be3037a81bf2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:37.637712 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:37.637656    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46qzh\" (UniqueName: \"kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh\") pod \"network-check-target-45rvn\" (UID: \"20669eed-9c6c-4432-af7e-27e3a2136cd9\") " pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:37.637876 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:37.637815    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:37:37.637876 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:37.637845    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:37:37.637876 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:37.637860    2564 projected.go:196] Error preparing data for projected volume kube-api-access-46qzh for pod openshift-network-diagnostics/network-check-target-45rvn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:37.638031 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:37.637926    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh podName:20669eed-9c6c-4432-af7e-27e3a2136cd9 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:09.637907656 +0000 UTC m=+66.354781825 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-46qzh" (UniqueName: "kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh") pod "network-check-target-45rvn" (UID: "20669eed-9c6c-4432-af7e-27e3a2136cd9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:37.772748 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:37.772668    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:37.772895 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:37.772772    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjpd7" podUID="5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3"
Sep 15 11:37:38.748859 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:38.748661    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lpbsr_a3d23fee-843a-44e5-af4f-692b3efd8f03/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:38.772509 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:38.772484    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:38.772627 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:38.772484    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:38.772680 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:38.772622    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45rvn" podUID="20669eed-9c6c-4432-af7e-27e3a2136cd9"
Sep 15 11:37:38.772734 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:38.772673    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jmmn" podUID="fd41f61a-cfbe-43f3-bc25-be3037a81bf2"
Sep 15 11:37:38.848706 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:38.848645    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lpbsr_a3d23fee-843a-44e5-af4f-692b3efd8f03/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:39.060819 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.060796    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeReady"
Sep 15 11:37:39.060950 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.060922    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 15 11:37:39.100677 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.100646    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-866bfd4fdf-tdc9z"]
Sep 15 11:37:39.103232 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.103207    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.106561 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.106536    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 15 11:37:39.106710 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.106560    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 15 11:37:39.107741 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.107699    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 15 11:37:39.107943 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.107928    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ctgh2\""
Sep 15 11:37:39.114181 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.114161    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 15 11:37:39.122038 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.122020    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4fnpc"]
Sep 15 11:37:39.123814 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.123792    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4fnpc"
Sep 15 11:37:39.125775 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.125754    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-866bfd4fdf-tdc9z"]
Sep 15 11:37:39.126862 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.126846    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qkkmw\""
Sep 15 11:37:39.127133 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.127115    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 15 11:37:39.127539 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.127521    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 15 11:37:39.137692 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.137673    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-whvhb"]
Sep 15 11:37:39.139472 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.139454    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-whvhb"
Sep 15 11:37:39.142571 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.142123    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t7jqq\""
Sep 15 11:37:39.142571 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.142276    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 15 11:37:39.142571 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.142424    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 15 11:37:39.142571 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.142542    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 15 11:37:39.144671 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.144311    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4fnpc"]
Sep 15 11:37:39.157624 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.157600    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-whvhb"]
Sep 15 11:37:39.247026 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.246991    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lpbsr_a3d23fee-843a-44e5-af4f-692b3efd8f03/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:39.248910 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.248887    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-certificates\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.249057 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.248921    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9b4p\" (UniqueName: \"kubernetes.io/projected/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-kube-api-access-d9b4p\") pod \"dns-default-4fnpc\" (UID: \"e75d7d12-1d20-4bb8-8ce9-06c56d243f6f\") " pod="openshift-dns/dns-default-4fnpc"
Sep 15 11:37:39.249057 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.248956    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-bound-sa-token\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.249057 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.248977    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-config-volume\") pod \"dns-default-4fnpc\" (UID: \"e75d7d12-1d20-4bb8-8ce9-06c56d243f6f\") " pod="openshift-dns/dns-default-4fnpc"
Sep 15 11:37:39.249057 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.249049    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-tls\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.249247 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.249083    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt8r9\" (UniqueName: \"kubernetes.io/projected/f7f4d9c5-2ad7-42e9-a43b-4fc2fc50b942-kube-api-access-nt8r9\") pod \"ingress-canary-whvhb\" (UID: \"f7f4d9c5-2ad7-42e9-a43b-4fc2fc50b942\") " pod="openshift-ingress-canary/ingress-canary-whvhb"
Sep 15 11:37:39.249247 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.249130    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0db43767-318f-4b71-ae79-3e2c873c4a01-ca-trust-extracted\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.249247 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.249160    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0db43767-318f-4b71-ae79-3e2c873c4a01-trusted-ca\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.249247 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.249218    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0db43767-318f-4b71-ae79-3e2c873c4a01-installation-pull-secrets\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.249247 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.249244    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqbgz\" (UniqueName: \"kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-kube-api-access-sqbgz\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.249496 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.249301    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7f4d9c5-2ad7-42e9-a43b-4fc2fc50b942-cert\") pod \"ingress-canary-whvhb\" (UID: \"f7f4d9c5-2ad7-42e9-a43b-4fc2fc50b942\") " pod="openshift-ingress-canary/ingress-canary-whvhb"
Sep 15 11:37:39.249496 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.249330    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-tmp-dir\") pod \"dns-default-4fnpc\" (UID: \"e75d7d12-1d20-4bb8-8ce9-06c56d243f6f\") " pod="openshift-dns/dns-default-4fnpc"
Sep 15 11:37:39.249496 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.249368    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0db43767-318f-4b71-ae79-3e2c873c4a01-image-registry-private-configuration\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.249496 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.249419    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-metrics-tls\") pod \"dns-default-4fnpc\" (UID: \"e75d7d12-1d20-4bb8-8ce9-06c56d243f6f\") " pod="openshift-dns/dns-default-4fnpc"
Sep 15 11:37:39.314119 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.314038    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lpbsr_a3d23fee-843a-44e5-af4f-692b3efd8f03/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:39.350553 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.350517    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-metrics-tls\") pod \"dns-default-4fnpc\" (UID: \"e75d7d12-1d20-4bb8-8ce9-06c56d243f6f\") " pod="openshift-dns/dns-default-4fnpc"
Sep 15 11:37:39.350553 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.350566    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-certificates\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.350798 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.350593    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9b4p\" (UniqueName: \"kubernetes.io/projected/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-kube-api-access-d9b4p\") pod \"dns-default-4fnpc\" (UID: \"e75d7d12-1d20-4bb8-8ce9-06c56d243f6f\") " pod="openshift-dns/dns-default-4fnpc"
Sep 15 11:37:39.350798 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.350623    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-bound-sa-token\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.350798 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.350638    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-config-volume\") pod \"dns-default-4fnpc\" (UID: \"e75d7d12-1d20-4bb8-8ce9-06c56d243f6f\") " pod="openshift-dns/dns-default-4fnpc"
Sep 15 11:37:39.350798 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.350684    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-tls\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.350798 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:39.350700    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 11:37:39.350798 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.350718    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt8r9\" (UniqueName: \"kubernetes.io/projected/f7f4d9c5-2ad7-42e9-a43b-4fc2fc50b942-kube-api-access-nt8r9\") pod \"ingress-canary-whvhb\" (UID: \"f7f4d9c5-2ad7-42e9-a43b-4fc2fc50b942\") " pod="openshift-ingress-canary/ingress-canary-whvhb"
Sep 15 11:37:39.350798 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.350745    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0db43767-318f-4b71-ae79-3e2c873c4a01-ca-trust-extracted\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.350798 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:39.350769    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-metrics-tls podName:e75d7d12-1d20-4bb8-8ce9-06c56d243f6f nodeName:}" failed. No retries permitted until 2026-09-15 11:37:39.850750392 +0000 UTC m=+36.567624554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-metrics-tls") pod "dns-default-4fnpc" (UID: "e75d7d12-1d20-4bb8-8ce9-06c56d243f6f") : secret "dns-default-metrics-tls" not found
Sep 15 11:37:39.351185 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.350806    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0db43767-318f-4b71-ae79-3e2c873c4a01-trusted-ca\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.351185 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.350841    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0db43767-318f-4b71-ae79-3e2c873c4a01-installation-pull-secrets\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.351185 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.350871    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqbgz\" (UniqueName: \"kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-kube-api-access-sqbgz\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.351185 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.350916    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7f4d9c5-2ad7-42e9-a43b-4fc2fc50b942-cert\") pod \"ingress-canary-whvhb\" (UID: \"f7f4d9c5-2ad7-42e9-a43b-4fc2fc50b942\") " pod="openshift-ingress-canary/ingress-canary-whvhb"
Sep 15 11:37:39.351185 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.350935    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-tmp-dir\") pod \"dns-default-4fnpc\" (UID: \"e75d7d12-1d20-4bb8-8ce9-06c56d243f6f\") " pod="openshift-dns/dns-default-4fnpc"
Sep 15 11:37:39.351185 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.350968    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0db43767-318f-4b71-ae79-3e2c873c4a01-image-registry-private-configuration\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.351185 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.351101    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0db43767-318f-4b71-ae79-3e2c873c4a01-ca-trust-extracted\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.351591 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.351567    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-certificates\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.352077 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.352052    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-tmp-dir\") pod \"dns-default-4fnpc\" (UID: \"e75d7d12-1d20-4bb8-8ce9-06c56d243f6f\") " pod="openshift-dns/dns-default-4fnpc"
Sep 15 11:37:39.352077 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:39.352068    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 11:37:39.352242 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:39.352087    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-866bfd4fdf-tdc9z: secret "image-registry-tls" not found
Sep 15 11:37:39.352242 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:39.352140    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-tls podName:0db43767-318f-4b71-ae79-3e2c873c4a01 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:39.852126084 +0000 UTC m=+36.569000246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-tls") pod "image-registry-866bfd4fdf-tdc9z" (UID: "0db43767-318f-4b71-ae79-3e2c873c4a01") : secret "image-registry-tls" not found
Sep 15 11:37:39.352242 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.352227    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-config-volume\") pod \"dns-default-4fnpc\" (UID: \"e75d7d12-1d20-4bb8-8ce9-06c56d243f6f\") " pod="openshift-dns/dns-default-4fnpc"
Sep 15 11:37:39.352616 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.352588    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0db43767-318f-4b71-ae79-3e2c873c4a01-trusted-ca\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.356055 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.356032    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0db43767-318f-4b71-ae79-3e2c873c4a01-image-registry-private-configuration\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.356055 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.356045    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7f4d9c5-2ad7-42e9-a43b-4fc2fc50b942-cert\") pod \"ingress-canary-whvhb\" (UID: \"f7f4d9c5-2ad7-42e9-a43b-4fc2fc50b942\") " pod="openshift-ingress-canary/ingress-canary-whvhb"
Sep 15 11:37:39.356234 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.356051    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0db43767-318f-4b71-ae79-3e2c873c4a01-installation-pull-secrets\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.359680 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.359639    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9b4p\" (UniqueName: \"kubernetes.io/projected/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-kube-api-access-d9b4p\") pod \"dns-default-4fnpc\" (UID: \"e75d7d12-1d20-4bb8-8ce9-06c56d243f6f\") " pod="openshift-dns/dns-default-4fnpc"
Sep 15 11:37:39.360764 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.360726    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqbgz\" (UniqueName: \"kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-kube-api-access-sqbgz\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.360901 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.360881    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-bound-sa-token\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.361195 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.361171    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt8r9\" (UniqueName: \"kubernetes.io/projected/f7f4d9c5-2ad7-42e9-a43b-4fc2fc50b942-kube-api-access-nt8r9\") pod \"ingress-canary-whvhb\" (UID: \"f7f4d9c5-2ad7-42e9-a43b-4fc2fc50b942\") " pod="openshift-ingress-canary/ingress-canary-whvhb"
Sep 15 11:37:39.450834 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.450795    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-whvhb"
Sep 15 11:37:39.773679 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.773655    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:37:39.776499 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.776476    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 11:37:39.803132 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.803106    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tztbn"]
Sep 15 11:37:39.806856 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.806835    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:39.811496 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.811472    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6nc5j\""
Sep 15 11:37:39.811936 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.811913    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 15 11:37:39.812639 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.812620    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 15 11:37:39.812820 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.812803    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 15 11:37:39.813161 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.813139    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 15 11:37:39.819641 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.819620    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tztbn"]
Sep 15 11:37:39.855723 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.855636    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-metrics-tls\") pod \"dns-default-4fnpc\" (UID: \"e75d7d12-1d20-4bb8-8ce9-06c56d243f6f\") " pod="openshift-dns/dns-default-4fnpc"
Sep 15 11:37:39.855723 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.855683    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-tls\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:39.855843 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:39.855788    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 11:37:39.855843 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:39.855794    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 11:37:39.855843 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:39.855801    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-866bfd4fdf-tdc9z: secret "image-registry-tls" not found
Sep 15 11:37:39.855979 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:39.855867    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-metrics-tls podName:e75d7d12-1d20-4bb8-8ce9-06c56d243f6f nodeName:}" failed. No retries permitted until 2026-09-15 11:37:40.855843869 +0000 UTC m=+37.572718045 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-metrics-tls") pod "dns-default-4fnpc" (UID: "e75d7d12-1d20-4bb8-8ce9-06c56d243f6f") : secret "dns-default-metrics-tls" not found
Sep 15 11:37:39.855979 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:39.855888    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-tls podName:0db43767-318f-4b71-ae79-3e2c873c4a01 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:40.855875949 +0000 UTC m=+37.572750111 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-tls") pod "image-registry-866bfd4fdf-tdc9z" (UID: "0db43767-318f-4b71-ae79-3e2c873c4a01") : secret "image-registry-tls" not found
Sep 15 11:37:39.957003 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.956976    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3a391f87-ec3b-410a-be2c-c50acfa599cc-data-volume\") pod \"insights-runtime-extractor-tztbn\" (UID: \"3a391f87-ec3b-410a-be2c-c50acfa599cc\") " pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:39.957103 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.957013    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3a391f87-ec3b-410a-be2c-c50acfa599cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tztbn\" (UID: \"3a391f87-ec3b-410a-be2c-c50acfa599cc\") " pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:39.957103 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.957055    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3a391f87-ec3b-410a-be2c-c50acfa599cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tztbn\" (UID: \"3a391f87-ec3b-410a-be2c-c50acfa599cc\") " pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:39.957176 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.957100    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3a391f87-ec3b-410a-be2c-c50acfa599cc-crio-socket\") pod \"insights-runtime-extractor-tztbn\" (UID: \"3a391f87-ec3b-410a-be2c-c50acfa599cc\") " pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:39.957176 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.957126    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nb2q\" (UniqueName: \"kubernetes.io/projected/3a391f87-ec3b-410a-be2c-c50acfa599cc-kube-api-access-8nb2q\") pod \"insights-runtime-extractor-tztbn\" (UID: \"3a391f87-ec3b-410a-be2c-c50acfa599cc\") " pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:39.994948 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:39.994892    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-whvhb"]
Sep 15 11:37:39.998644 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:39.998619    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7f4d9c5_2ad7_42e9_a43b_4fc2fc50b942.slice/crio-00ed2c17f68621b6ccf25739f8c2b7be920907c300b19cab4065ca7677eb00b2 WatchSource:0}: Error finding container 00ed2c17f68621b6ccf25739f8c2b7be920907c300b19cab4065ca7677eb00b2: Status 404 returned error can't find the container with id 00ed2c17f68621b6ccf25739f8c2b7be920907c300b19cab4065ca7677eb00b2
Sep 15 11:37:40.005376 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.005353    2564 generic.go:356] "Generic (PLEG): container finished" podID="403278f4-8eb0-41c6-a45c-1442c188ecd3" containerID="c1829f0ca0e594c350427389633f326d449e00e936b750f5066cb9ee8f53b760" exitCode=0
Sep 15 11:37:40.005475 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.005438    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6ldt" event={"ID":"403278f4-8eb0-41c6-a45c-1442c188ecd3","Type":"ContainerDied","Data":"c1829f0ca0e594c350427389633f326d449e00e936b750f5066cb9ee8f53b760"}
Sep 15 11:37:40.006474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.006454    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-whvhb" event={"ID":"f7f4d9c5-2ad7-42e9-a43b-4fc2fc50b942","Type":"ContainerStarted","Data":"00ed2c17f68621b6ccf25739f8c2b7be920907c300b19cab4065ca7677eb00b2"}
Sep 15 11:37:40.058375 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.058348    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3a391f87-ec3b-410a-be2c-c50acfa599cc-data-volume\") pod \"insights-runtime-extractor-tztbn\" (UID: \"3a391f87-ec3b-410a-be2c-c50acfa599cc\") " pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:40.058469 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.058379    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3a391f87-ec3b-410a-be2c-c50acfa599cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tztbn\" (UID: \"3a391f87-ec3b-410a-be2c-c50acfa599cc\") " pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:40.058469 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.058395    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3a391f87-ec3b-410a-be2c-c50acfa599cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tztbn\" (UID: \"3a391f87-ec3b-410a-be2c-c50acfa599cc\") " pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:40.058469 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.058415    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3a391f87-ec3b-410a-be2c-c50acfa599cc-crio-socket\") pod \"insights-runtime-extractor-tztbn\" (UID: \"3a391f87-ec3b-410a-be2c-c50acfa599cc\") " pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:40.058469 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.058431    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nb2q\" (UniqueName: \"kubernetes.io/projected/3a391f87-ec3b-410a-be2c-c50acfa599cc-kube-api-access-8nb2q\") pod \"insights-runtime-extractor-tztbn\" (UID: \"3a391f87-ec3b-410a-be2c-c50acfa599cc\") " pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:40.058643 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:40.058479    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 11:37:40.058643 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:40.058531    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 11:37:40.058643 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:40.058560    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a391f87-ec3b-410a-be2c-c50acfa599cc-kube-rbac-proxy-cm podName:3a391f87-ec3b-410a-be2c-c50acfa599cc nodeName:}" failed. No retries permitted until 2026-09-15 11:37:40.558540665 +0000 UTC m=+37.275414847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3a391f87-ec3b-410a-be2c-c50acfa599cc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tztbn" (UID: "3a391f87-ec3b-410a-be2c-c50acfa599cc") : configmap "kube-rbac-proxy" not found
Sep 15 11:37:40.058643 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:40.058586    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a391f87-ec3b-410a-be2c-c50acfa599cc-insights-runtime-extractor-tls podName:3a391f87-ec3b-410a-be2c-c50acfa599cc nodeName:}" failed. No retries permitted until 2026-09-15 11:37:40.55857054 +0000 UTC m=+37.275444715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3a391f87-ec3b-410a-be2c-c50acfa599cc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tztbn" (UID: "3a391f87-ec3b-410a-be2c-c50acfa599cc") : secret "insights-runtime-extractor-tls" not found
Sep 15 11:37:40.058643 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.058631    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3a391f87-ec3b-410a-be2c-c50acfa599cc-crio-socket\") pod \"insights-runtime-extractor-tztbn\" (UID: \"3a391f87-ec3b-410a-be2c-c50acfa599cc\") " pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:40.058849 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.058699    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3a391f87-ec3b-410a-be2c-c50acfa599cc-data-volume\") pod \"insights-runtime-extractor-tztbn\" (UID: \"3a391f87-ec3b-410a-be2c-c50acfa599cc\") " pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:40.070898 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.070761    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nb2q\" (UniqueName: \"kubernetes.io/projected/3a391f87-ec3b-410a-be2c-c50acfa599cc-kube-api-access-8nb2q\") pod \"insights-runtime-extractor-tztbn\" (UID: \"3a391f87-ec3b-410a-be2c-c50acfa599cc\") " pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:40.373566 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.373537    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-t5m5q"]
Sep 15 11:37:40.377508 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.377482    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-t5m5q"
Sep 15 11:37:40.381171 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.381136    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 15 11:37:40.381327 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.381300    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-s4vcq\""
Sep 15 11:37:40.381439 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.381336    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 15 11:37:40.393434 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.393414    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-t5m5q"]
Sep 15 11:37:40.461773 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.461747    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq4ls\" (UniqueName: \"kubernetes.io/projected/cd26dc75-00ec-41c7-b33a-9e011324e20c-kube-api-access-dq4ls\") pod \"migrator-8b4d697c5-t5m5q\" (UID: \"cd26dc75-00ec-41c7-b33a-9e011324e20c\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-t5m5q"
Sep 15 11:37:40.562586 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.562555    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq4ls\" (UniqueName: \"kubernetes.io/projected/cd26dc75-00ec-41c7-b33a-9e011324e20c-kube-api-access-dq4ls\") pod \"migrator-8b4d697c5-t5m5q\" (UID: \"cd26dc75-00ec-41c7-b33a-9e011324e20c\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-t5m5q"
Sep 15 11:37:40.562733 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.562654    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3a391f87-ec3b-410a-be2c-c50acfa599cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tztbn\" (UID: \"3a391f87-ec3b-410a-be2c-c50acfa599cc\") " pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:40.562733 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.562674    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3a391f87-ec3b-410a-be2c-c50acfa599cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tztbn\" (UID: \"3a391f87-ec3b-410a-be2c-c50acfa599cc\") " pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:40.562812 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:40.562761    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 11:37:40.562812 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:40.562769    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 11:37:40.562812 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:40.562807    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a391f87-ec3b-410a-be2c-c50acfa599cc-insights-runtime-extractor-tls podName:3a391f87-ec3b-410a-be2c-c50acfa599cc nodeName:}" failed. No retries permitted until 2026-09-15 11:37:41.562794326 +0000 UTC m=+38.279668487 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3a391f87-ec3b-410a-be2c-c50acfa599cc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tztbn" (UID: "3a391f87-ec3b-410a-be2c-c50acfa599cc") : secret "insights-runtime-extractor-tls" not found
Sep 15 11:37:40.562917 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:40.562820    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a391f87-ec3b-410a-be2c-c50acfa599cc-kube-rbac-proxy-cm podName:3a391f87-ec3b-410a-be2c-c50acfa599cc nodeName:}" failed. No retries permitted until 2026-09-15 11:37:41.562813373 +0000 UTC m=+38.279687536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3a391f87-ec3b-410a-be2c-c50acfa599cc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tztbn" (UID: "3a391f87-ec3b-410a-be2c-c50acfa599cc") : configmap "kube-rbac-proxy" not found
Sep 15 11:37:40.570967 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.570936    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq4ls\" (UniqueName: \"kubernetes.io/projected/cd26dc75-00ec-41c7-b33a-9e011324e20c-kube-api-access-dq4ls\") pod \"migrator-8b4d697c5-t5m5q\" (UID: \"cd26dc75-00ec-41c7-b33a-9e011324e20c\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-t5m5q"
Sep 15 11:37:40.685500 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.685430    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-t5m5q"
Sep 15 11:37:40.773108 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.773001    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:37:40.773108 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.773001    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:37:40.776085 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.776060    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 11:37:40.776452 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.776315    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w6k5p\""
Sep 15 11:37:40.776574 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.776461    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 11:37:40.776667 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.776573    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 11:37:40.776667 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.776579    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-72bfh\""
Sep 15 11:37:40.865153 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.865125    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-metrics-tls\") pod \"dns-default-4fnpc\" (UID: \"e75d7d12-1d20-4bb8-8ce9-06c56d243f6f\") " pod="openshift-dns/dns-default-4fnpc"
Sep 15 11:37:40.865337 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.865292    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-tls\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:40.865337 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:40.865327    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 11:37:40.865470 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:40.865396    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 11:37:40.865470 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:40.865406    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-metrics-tls podName:e75d7d12-1d20-4bb8-8ce9-06c56d243f6f nodeName:}" failed. No retries permitted until 2026-09-15 11:37:42.865384853 +0000 UTC m=+39.582259019 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-metrics-tls") pod "dns-default-4fnpc" (UID: "e75d7d12-1d20-4bb8-8ce9-06c56d243f6f") : secret "dns-default-metrics-tls" not found
Sep 15 11:37:40.865470 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:40.865408    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-866bfd4fdf-tdc9z: secret "image-registry-tls" not found
Sep 15 11:37:40.865470 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:40.865446    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-tls podName:0db43767-318f-4b71-ae79-3e2c873c4a01 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:42.865436128 +0000 UTC m=+39.582310295 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-tls") pod "image-registry-866bfd4fdf-tdc9z" (UID: "0db43767-318f-4b71-ae79-3e2c873c4a01") : secret "image-registry-tls" not found
Sep 15 11:37:40.957969 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:40.957888    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-t5m5q"]
Sep 15 11:37:40.961010 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:40.960979    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd26dc75_00ec_41c7_b33a_9e011324e20c.slice/crio-1c5037417609951de925ad7c8d5f8c56a79a55c1ea542efd3f82fe82d348d87d WatchSource:0}: Error finding container 1c5037417609951de925ad7c8d5f8c56a79a55c1ea542efd3f82fe82d348d87d: Status 404 returned error can't find the container with id 1c5037417609951de925ad7c8d5f8c56a79a55c1ea542efd3f82fe82d348d87d
Sep 15 11:37:41.012807 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:41.012765    2564 generic.go:356] "Generic (PLEG): container finished" podID="403278f4-8eb0-41c6-a45c-1442c188ecd3" containerID="bbd3c4cee382b48425e9233f36e3822acb413d4ae7d19ea1d32f947560f9667b" exitCode=0
Sep 15 11:37:41.013028 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:41.012845    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6ldt" event={"ID":"403278f4-8eb0-41c6-a45c-1442c188ecd3","Type":"ContainerDied","Data":"bbd3c4cee382b48425e9233f36e3822acb413d4ae7d19ea1d32f947560f9667b"}
Sep 15 11:37:41.014118 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:41.014089    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-t5m5q" event={"ID":"cd26dc75-00ec-41c7-b33a-9e011324e20c","Type":"ContainerStarted","Data":"1c5037417609951de925ad7c8d5f8c56a79a55c1ea542efd3f82fe82d348d87d"}
Sep 15 11:37:41.171476 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:41.171456    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vhq54_c23245d8-99eb-454d-8be3-d1f6c79c29cd/dns-node-resolver/0.log"
Sep 15 11:37:41.571884 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:41.571848    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3a391f87-ec3b-410a-be2c-c50acfa599cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tztbn\" (UID: \"3a391f87-ec3b-410a-be2c-c50acfa599cc\") " pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:41.571884 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:41.571886    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3a391f87-ec3b-410a-be2c-c50acfa599cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tztbn\" (UID: \"3a391f87-ec3b-410a-be2c-c50acfa599cc\") " pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:41.572092 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:41.571955    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 11:37:41.572092 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:41.572027    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a391f87-ec3b-410a-be2c-c50acfa599cc-kube-rbac-proxy-cm podName:3a391f87-ec3b-410a-be2c-c50acfa599cc nodeName:}" failed. No retries permitted until 2026-09-15 11:37:43.572010528 +0000 UTC m=+40.288884690 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3a391f87-ec3b-410a-be2c-c50acfa599cc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tztbn" (UID: "3a391f87-ec3b-410a-be2c-c50acfa599cc") : configmap "kube-rbac-proxy" not found
Sep 15 11:37:41.572092 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:41.572038    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 11:37:41.572228 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:41.572096    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a391f87-ec3b-410a-be2c-c50acfa599cc-insights-runtime-extractor-tls podName:3a391f87-ec3b-410a-be2c-c50acfa599cc nodeName:}" failed. No retries permitted until 2026-09-15 11:37:43.572082172 +0000 UTC m=+40.288956336 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3a391f87-ec3b-410a-be2c-c50acfa599cc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tztbn" (UID: "3a391f87-ec3b-410a-be2c-c50acfa599cc") : secret "insights-runtime-extractor-tls" not found
Sep 15 11:37:41.798165 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:41.798127    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-lvpm7"]
Sep 15 11:37:41.816291 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:41.816181    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-lvpm7"]
Sep 15 11:37:41.816461 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:41.816320    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-lvpm7"
Sep 15 11:37:41.819337 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:41.819312    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 15 11:37:41.819443 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:41.819378    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 15 11:37:41.819443 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:41.819397    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 15 11:37:41.820758 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:41.820556    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 15 11:37:41.820758 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:41.820556    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vklqz\""
Sep 15 11:37:41.975435 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:41.975394    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsrfz\" (UniqueName: \"kubernetes.io/projected/d03a1acd-fc4b-4b39-ba5b-4358872e4fa8-kube-api-access-rsrfz\") pod \"service-ca-568869fdc5-lvpm7\" (UID: \"d03a1acd-fc4b-4b39-ba5b-4358872e4fa8\") " pod="openshift-service-ca/service-ca-568869fdc5-lvpm7"
Sep 15 11:37:41.975435 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:41.975442    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d03a1acd-fc4b-4b39-ba5b-4358872e4fa8-signing-key\") pod \"service-ca-568869fdc5-lvpm7\" (UID: \"d03a1acd-fc4b-4b39-ba5b-4358872e4fa8\") " pod="openshift-service-ca/service-ca-568869fdc5-lvpm7"
Sep 15 11:37:41.975653 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:41.975530    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d03a1acd-fc4b-4b39-ba5b-4358872e4fa8-signing-cabundle\") pod \"service-ca-568869fdc5-lvpm7\" (UID: \"d03a1acd-fc4b-4b39-ba5b-4358872e4fa8\") " pod="openshift-service-ca/service-ca-568869fdc5-lvpm7"
Sep 15 11:37:42.020451 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:42.020415    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6ldt" event={"ID":"403278f4-8eb0-41c6-a45c-1442c188ecd3","Type":"ContainerStarted","Data":"6ae8ebfcfcb81c4a4571c01cdf04d1531fc76ecf9c0ff108a566d7e788f5373c"}
Sep 15 11:37:42.043147 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:42.043095    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h6ldt" podStartSLOduration=7.784742218 podStartE2EDuration="38.043077865s" totalImagesPullingTime="30.258335647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:37:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:42.04144967 +0000 UTC m=+38.758323852" watchObservedRunningTime="2026-09-15 11:37:42.043077865 +0000 UTC m=+38.759952049"
Sep 15 11:37:42.076827 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:42.076746    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsrfz\" (UniqueName: \"kubernetes.io/projected/d03a1acd-fc4b-4b39-ba5b-4358872e4fa8-kube-api-access-rsrfz\") pod \"service-ca-568869fdc5-lvpm7\" (UID: \"d03a1acd-fc4b-4b39-ba5b-4358872e4fa8\") " pod="openshift-service-ca/service-ca-568869fdc5-lvpm7"
Sep 15 11:37:42.076827 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:42.076794    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d03a1acd-fc4b-4b39-ba5b-4358872e4fa8-signing-key\") pod \"service-ca-568869fdc5-lvpm7\" (UID: \"d03a1acd-fc4b-4b39-ba5b-4358872e4fa8\") " pod="openshift-service-ca/service-ca-568869fdc5-lvpm7"
Sep 15 11:37:42.077061 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:42.076871    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d03a1acd-fc4b-4b39-ba5b-4358872e4fa8-signing-cabundle\") pod \"service-ca-568869fdc5-lvpm7\" (UID: \"d03a1acd-fc4b-4b39-ba5b-4358872e4fa8\") " pod="openshift-service-ca/service-ca-568869fdc5-lvpm7"
Sep 15 11:37:42.078002 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:42.077976    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d03a1acd-fc4b-4b39-ba5b-4358872e4fa8-signing-cabundle\") pod \"service-ca-568869fdc5-lvpm7\" (UID: \"d03a1acd-fc4b-4b39-ba5b-4358872e4fa8\") " pod="openshift-service-ca/service-ca-568869fdc5-lvpm7"
Sep 15 11:37:42.081295 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:42.081251    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d03a1acd-fc4b-4b39-ba5b-4358872e4fa8-signing-key\") pod \"service-ca-568869fdc5-lvpm7\" (UID: \"d03a1acd-fc4b-4b39-ba5b-4358872e4fa8\") " pod="openshift-service-ca/service-ca-568869fdc5-lvpm7"
Sep 15 11:37:42.094583 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:42.094558    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsrfz\" (UniqueName: \"kubernetes.io/projected/d03a1acd-fc4b-4b39-ba5b-4358872e4fa8-kube-api-access-rsrfz\") pod \"service-ca-568869fdc5-lvpm7\" (UID: \"d03a1acd-fc4b-4b39-ba5b-4358872e4fa8\") " pod="openshift-service-ca/service-ca-568869fdc5-lvpm7"
Sep 15 11:37:42.127543 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:42.127509    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-lvpm7"
Sep 15 11:37:42.372324 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:42.372236    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f6lmr_349601b9-3ea8-4c18-b77c-b90cfd48d1e5/node-ca/0.log"
Sep 15 11:37:42.883441 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:42.883317    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-tls\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:42.883441 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:42.883397    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-metrics-tls\") pod \"dns-default-4fnpc\" (UID: \"e75d7d12-1d20-4bb8-8ce9-06c56d243f6f\") " pod="openshift-dns/dns-default-4fnpc"
Sep 15 11:37:42.883807 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:42.883503    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 11:37:42.883807 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:42.883526    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-866bfd4fdf-tdc9z: secret "image-registry-tls" not found
Sep 15 11:37:42.883807 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:42.883607    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-tls podName:0db43767-318f-4b71-ae79-3e2c873c4a01 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:46.883585539 +0000 UTC m=+43.600459725 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-tls") pod "image-registry-866bfd4fdf-tdc9z" (UID: "0db43767-318f-4b71-ae79-3e2c873c4a01") : secret "image-registry-tls" not found
Sep 15 11:37:42.883807 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:42.883640    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 11:37:42.883807 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:42.883722    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-metrics-tls podName:e75d7d12-1d20-4bb8-8ce9-06c56d243f6f nodeName:}" failed. No retries permitted until 2026-09-15 11:37:46.883704649 +0000 UTC m=+43.600578815 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-metrics-tls") pod "dns-default-4fnpc" (UID: "e75d7d12-1d20-4bb8-8ce9-06c56d243f6f") : secret "dns-default-metrics-tls" not found
Sep 15 11:37:43.025152 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:43.025126    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-t5m5q" event={"ID":"cd26dc75-00ec-41c7-b33a-9e011324e20c","Type":"ContainerStarted","Data":"33f610e4745875a9b5f504a3649c763bb7a11b1e178bfac72fdbfdfc402ff8e3"}
Sep 15 11:37:43.026685 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:43.026661    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-whvhb" event={"ID":"f7f4d9c5-2ad7-42e9-a43b-4fc2fc50b942","Type":"ContainerStarted","Data":"ce08e60ea78e74daeb8def1ba0ef93fe4299f0da2efb059a4f5d7ed0ab5fd54c"}
Sep 15 11:37:43.045678 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:43.045636    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-whvhb" podStartSLOduration=1.2295583429999999 podStartE2EDuration="4.045622625s" totalImagesPullingTime="2.816064282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:37:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:43.044882212 +0000 UTC m=+39.761756397" watchObservedRunningTime="2026-09-15 11:37:43.045622625 +0000 UTC m=+39.762496808"
Sep 15 11:37:43.082940 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:43.082866    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-lvpm7"]
Sep 15 11:37:43.085919 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:43.085897    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd03a1acd_fc4b_4b39_ba5b_4358872e4fa8.slice/crio-8b4a5d4c3fb51898573f6a3c671c075c4f39cd1925b56b4ddb13f7e0a5949db0 WatchSource:0}: Error finding container 8b4a5d4c3fb51898573f6a3c671c075c4f39cd1925b56b4ddb13f7e0a5949db0: Status 404 returned error can't find the container with id 8b4a5d4c3fb51898573f6a3c671c075c4f39cd1925b56b4ddb13f7e0a5949db0
Sep 15 11:37:43.172005 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:43.171973    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-whvhb_f7f4d9c5-2ad7-42e9-a43b-4fc2fc50b942/serve-healthcheck-canary/0.log"
Sep 15 11:37:43.587770 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:43.587726    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3a391f87-ec3b-410a-be2c-c50acfa599cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tztbn\" (UID: \"3a391f87-ec3b-410a-be2c-c50acfa599cc\") " pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:43.587770 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:43.587769    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3a391f87-ec3b-410a-be2c-c50acfa599cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tztbn\" (UID: \"3a391f87-ec3b-410a-be2c-c50acfa599cc\") " pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:43.588033 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:43.587922    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 11:37:43.588033 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:43.587991    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a391f87-ec3b-410a-be2c-c50acfa599cc-insights-runtime-extractor-tls podName:3a391f87-ec3b-410a-be2c-c50acfa599cc nodeName:}" failed. No retries permitted until 2026-09-15 11:37:47.587972234 +0000 UTC m=+44.304846413 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3a391f87-ec3b-410a-be2c-c50acfa599cc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tztbn" (UID: "3a391f87-ec3b-410a-be2c-c50acfa599cc") : secret "insights-runtime-extractor-tls" not found
Sep 15 11:37:43.588387 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:43.588367    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3a391f87-ec3b-410a-be2c-c50acfa599cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tztbn\" (UID: \"3a391f87-ec3b-410a-be2c-c50acfa599cc\") " pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:44.032031 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:44.031944    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-t5m5q" event={"ID":"cd26dc75-00ec-41c7-b33a-9e011324e20c","Type":"ContainerStarted","Data":"f21c97638ab810fb4de6d856f9d5a487d1cac7ba291368b0e77386883d2caed0"}
Sep 15 11:37:44.033589 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:44.033548    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-lvpm7" event={"ID":"d03a1acd-fc4b-4b39-ba5b-4358872e4fa8","Type":"ContainerStarted","Data":"8b4a5d4c3fb51898573f6a3c671c075c4f39cd1925b56b4ddb13f7e0a5949db0"}
Sep 15 11:37:44.050511 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:44.050469    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-t5m5q" podStartSLOduration=2.193946453 podStartE2EDuration="4.050455185s" totalImagesPullingTime="1.856508732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:37:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:44.049245485 +0000 UTC m=+40.766119679" watchObservedRunningTime="2026-09-15 11:37:44.050455185 +0000 UTC m=+40.767329369"
Sep 15 11:37:46.040467 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:46.040425    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-lvpm7" event={"ID":"d03a1acd-fc4b-4b39-ba5b-4358872e4fa8","Type":"ContainerStarted","Data":"71c4cd2d71fae12922252fc8f13d884173bc2680cb52a48763a968457ff4830f"}
Sep 15 11:37:46.057853 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:46.057803    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-lvpm7" podStartSLOduration=3.019635248 podStartE2EDuration="5.057788902s" totalImagesPullingTime="2.038153654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:37:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:46.055939454 +0000 UTC m=+42.772813639" watchObservedRunningTime="2026-09-15 11:37:46.057788902 +0000 UTC m=+42.774663135"
Sep 15 11:37:46.913969 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:46.913931    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-metrics-tls\") pod \"dns-default-4fnpc\" (UID: \"e75d7d12-1d20-4bb8-8ce9-06c56d243f6f\") " pod="openshift-dns/dns-default-4fnpc"
Sep 15 11:37:46.914140 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:46.914012    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-tls\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:46.914140 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:46.914078    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 11:37:46.914140 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:46.914118    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 11:37:46.914140 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:46.914131    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-866bfd4fdf-tdc9z: secret "image-registry-tls" not found
Sep 15 11:37:46.914140 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:46.914142    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-metrics-tls podName:e75d7d12-1d20-4bb8-8ce9-06c56d243f6f nodeName:}" failed. No retries permitted until 2026-09-15 11:37:54.91412755 +0000 UTC m=+51.631001713 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-metrics-tls") pod "dns-default-4fnpc" (UID: "e75d7d12-1d20-4bb8-8ce9-06c56d243f6f") : secret "dns-default-metrics-tls" not found
Sep 15 11:37:46.914400 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:46.914178    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-tls podName:0db43767-318f-4b71-ae79-3e2c873c4a01 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:54.914163682 +0000 UTC m=+51.631037850 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-tls") pod "image-registry-866bfd4fdf-tdc9z" (UID: "0db43767-318f-4b71-ae79-3e2c873c4a01") : secret "image-registry-tls" not found
Sep 15 11:37:47.619864 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:47.619824    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3a391f87-ec3b-410a-be2c-c50acfa599cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tztbn\" (UID: \"3a391f87-ec3b-410a-be2c-c50acfa599cc\") " pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:47.620315 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:47.619975    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 11:37:47.620315 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:37:47.620057    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a391f87-ec3b-410a-be2c-c50acfa599cc-insights-runtime-extractor-tls podName:3a391f87-ec3b-410a-be2c-c50acfa599cc nodeName:}" failed. No retries permitted until 2026-09-15 11:37:55.620040528 +0000 UTC m=+52.336914690 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3a391f87-ec3b-410a-be2c-c50acfa599cc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tztbn" (UID: "3a391f87-ec3b-410a-be2c-c50acfa599cc") : secret "insights-runtime-extractor-tls" not found
Sep 15 11:37:54.977057 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:54.977019    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-metrics-tls\") pod \"dns-default-4fnpc\" (UID: \"e75d7d12-1d20-4bb8-8ce9-06c56d243f6f\") " pod="openshift-dns/dns-default-4fnpc"
Sep 15 11:37:54.977503 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:54.977089    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-tls\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:54.979546 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:54.979521    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e75d7d12-1d20-4bb8-8ce9-06c56d243f6f-metrics-tls\") pod \"dns-default-4fnpc\" (UID: \"e75d7d12-1d20-4bb8-8ce9-06c56d243f6f\") " pod="openshift-dns/dns-default-4fnpc"
Sep 15 11:37:54.979626 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:54.979571    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-tls\") pod \"image-registry-866bfd4fdf-tdc9z\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") " pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:55.014489 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:55.014460    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:55.034354 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:55.034334    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4fnpc"
Sep 15 11:37:55.301163 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:55.301137    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-866bfd4fdf-tdc9z"]
Sep 15 11:37:55.304354 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:55.304328    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0db43767_318f_4b71_ae79_3e2c873c4a01.slice/crio-bc3c95df46ff6836e1664f40e7c7c2fbbe44baee1b3faa4ccedf8e444d36cf1a WatchSource:0}: Error finding container bc3c95df46ff6836e1664f40e7c7c2fbbe44baee1b3faa4ccedf8e444d36cf1a: Status 404 returned error can't find the container with id bc3c95df46ff6836e1664f40e7c7c2fbbe44baee1b3faa4ccedf8e444d36cf1a
Sep 15 11:37:55.320531 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:55.320505    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4fnpc"]
Sep 15 11:37:55.322520 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:55.322486    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode75d7d12_1d20_4bb8_8ce9_06c56d243f6f.slice/crio-bb03d92675a5f9727b0a0705d8b0f45c45429dfd1347be74cd0e3460757e3447 WatchSource:0}: Error finding container bb03d92675a5f9727b0a0705d8b0f45c45429dfd1347be74cd0e3460757e3447: Status 404 returned error can't find the container with id bb03d92675a5f9727b0a0705d8b0f45c45429dfd1347be74cd0e3460757e3447
Sep 15 11:37:55.681447 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:55.681353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3a391f87-ec3b-410a-be2c-c50acfa599cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tztbn\" (UID: \"3a391f87-ec3b-410a-be2c-c50acfa599cc\") " pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:55.683625 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:55.683596    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3a391f87-ec3b-410a-be2c-c50acfa599cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tztbn\" (UID: \"3a391f87-ec3b-410a-be2c-c50acfa599cc\") " pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:55.717327 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:55.717300    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tztbn"
Sep 15 11:37:56.009908 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:56.009836    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tztbn"]
Sep 15 11:37:56.013518 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:37:56.013474    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a391f87_ec3b_410a_be2c_c50acfa599cc.slice/crio-03a2961ef071b7aeb46ac77d107e6e1355efd91009089f7a87897cbab40ff95a WatchSource:0}: Error finding container 03a2961ef071b7aeb46ac77d107e6e1355efd91009089f7a87897cbab40ff95a: Status 404 returned error can't find the container with id 03a2961ef071b7aeb46ac77d107e6e1355efd91009089f7a87897cbab40ff95a
Sep 15 11:37:56.068733 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:56.068693    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tztbn" event={"ID":"3a391f87-ec3b-410a-be2c-c50acfa599cc","Type":"ContainerStarted","Data":"03a2961ef071b7aeb46ac77d107e6e1355efd91009089f7a87897cbab40ff95a"}
Sep 15 11:37:56.070683 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:56.070653    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z" event={"ID":"0db43767-318f-4b71-ae79-3e2c873c4a01","Type":"ContainerStarted","Data":"eb8a54f046b453a3d5a78528036ab09b10394e4cc9a4f0047403bcedbd589483"}
Sep 15 11:37:56.070809 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:56.070704    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z" event={"ID":"0db43767-318f-4b71-ae79-3e2c873c4a01","Type":"ContainerStarted","Data":"bc3c95df46ff6836e1664f40e7c7c2fbbe44baee1b3faa4ccedf8e444d36cf1a"}
Sep 15 11:37:56.070809 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:56.070766    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:37:56.071994 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:56.071970    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4fnpc" event={"ID":"e75d7d12-1d20-4bb8-8ce9-06c56d243f6f","Type":"ContainerStarted","Data":"bb03d92675a5f9727b0a0705d8b0f45c45429dfd1347be74cd0e3460757e3447"}
Sep 15 11:37:56.092197 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:56.092146    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z" podStartSLOduration=50.092132537 podStartE2EDuration="50.092132537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:37:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:56.090832705 +0000 UTC m=+52.807706890" watchObservedRunningTime="2026-09-15 11:37:56.092132537 +0000 UTC m=+52.809006715"
Sep 15 11:37:57.077764 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:57.077730    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tztbn" event={"ID":"3a391f87-ec3b-410a-be2c-c50acfa599cc","Type":"ContainerStarted","Data":"f87cae6b2f4f420f8d00f5b32d3dadd1f5d8e6f4e5e56b41f93d9e972127cbcd"}
Sep 15 11:37:58.084082 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:58.084036    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tztbn" event={"ID":"3a391f87-ec3b-410a-be2c-c50acfa599cc","Type":"ContainerStarted","Data":"658a4bcc082177e259747533b79d1bc66c2af87b90850955b6e3639fb340c5b1"}
Sep 15 11:37:58.086098 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:58.086063    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4fnpc" event={"ID":"e75d7d12-1d20-4bb8-8ce9-06c56d243f6f","Type":"ContainerStarted","Data":"71dc26a03e779443a5870f677547bb958da6184c49097b51df79a69c29e64092"}
Sep 15 11:37:58.086202 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:58.086107    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4fnpc" event={"ID":"e75d7d12-1d20-4bb8-8ce9-06c56d243f6f","Type":"ContainerStarted","Data":"1444c7b1670303b71ae7447ac00b1d3084fb293a82bcda70bb1c327d3254ac69"}
Sep 15 11:37:58.086307 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:58.086288    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4fnpc"
Sep 15 11:37:58.104045 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:58.103999    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4fnpc" podStartSLOduration=17.330955672 podStartE2EDuration="19.103982203s" totalImagesPullingTime="1.773026531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:37:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:58.10300009 +0000 UTC m=+54.819874273" watchObservedRunningTime="2026-09-15 11:37:58.103982203 +0000 UTC m=+54.820856391"
Sep 15 11:37:59.091534 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:59.091488    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tztbn" event={"ID":"3a391f87-ec3b-410a-be2c-c50acfa599cc","Type":"ContainerStarted","Data":"ea52ed05dd92f646080b1383726612f011104c00960ca69a05e9d42b08c15cbb"}
Sep 15 11:37:59.112526 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:37:59.112482    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tztbn" podStartSLOduration=18.021783311 podStartE2EDuration="20.112467783s" totalImagesPullingTime="2.090684472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:37:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:59.110864485 +0000 UTC m=+55.827738670" watchObservedRunningTime="2026-09-15 11:37:59.112467783 +0000 UTC m=+55.829341967"
Sep 15 11:38:03.004827 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.004792    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mpzzv"
Sep 15 11:38:03.727504 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.727464    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99db98b5d-89wkh"]
Sep 15 11:38:03.730568 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.730550    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-db778994f-c6zct"]
Sep 15 11:38:03.730750 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.730732    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99db98b5d-89wkh"
Sep 15 11:38:03.732448 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.732430    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-db778994f-c6zct"
Sep 15 11:38:03.734632 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.734616    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 15 11:38:03.735067 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.735050    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-hbnmv\""
Sep 15 11:38:03.735127 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.735112    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 15 11:38:03.735682 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.735659    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 15 11:38:03.735731 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.735681    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 15 11:38:03.735990 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.735977    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 15 11:38:03.752195 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.752159    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-db778994f-c6zct"]
Sep 15 11:38:03.753127 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.753103    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99db98b5d-89wkh"]
Sep 15 11:38:03.776448 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.776422    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-g8h6x"]
Sep 15 11:38:03.778470 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.778453    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-g8h6x"
Sep 15 11:38:03.781761 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.781743    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 15 11:38:03.781883 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.781833    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-m2rgh\""
Sep 15 11:38:03.782036 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.782020    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 15 11:38:03.792069 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.792046    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-866bfd4fdf-tdc9z"]
Sep 15 11:38:03.799348 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.799314    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-g8h6x"]
Sep 15 11:38:03.833254 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.833220    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d387a394-edfe-4c21-a2df-6c3038c4c9a7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-99db98b5d-89wkh\" (UID: \"d387a394-edfe-4c21-a2df-6c3038c4c9a7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99db98b5d-89wkh"
Sep 15 11:38:03.833254 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.833254    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh8gt\" (UniqueName: \"kubernetes.io/projected/d387a394-edfe-4c21-a2df-6c3038c4c9a7-kube-api-access-qh8gt\") pod \"managed-serviceaccount-addon-agent-99db98b5d-89wkh\" (UID: \"d387a394-edfe-4c21-a2df-6c3038c4c9a7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99db98b5d-89wkh"
Sep 15 11:38:03.833504 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.833303    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bvst\" (UniqueName: \"kubernetes.io/projected/3203bc5f-50f2-4e46-8781-f67e43ca3120-kube-api-access-6bvst\") pod \"downloads-76f99584f4-g8h6x\" (UID: \"3203bc5f-50f2-4e46-8781-f67e43ca3120\") " pod="openshift-console/downloads-76f99584f4-g8h6x"
Sep 15 11:38:03.833504 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.833321    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05ea8f6e-70f0-453a-8dad-efc4db79048a-tmp\") pod \"klusterlet-addon-workmgr-db778994f-c6zct\" (UID: \"05ea8f6e-70f0-453a-8dad-efc4db79048a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-db778994f-c6zct"
Sep 15 11:38:03.833504 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.833352    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/05ea8f6e-70f0-453a-8dad-efc4db79048a-klusterlet-config\") pod \"klusterlet-addon-workmgr-db778994f-c6zct\" (UID: \"05ea8f6e-70f0-453a-8dad-efc4db79048a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-db778994f-c6zct"
Sep 15 11:38:03.833504 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.833382    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8v8t\" (UniqueName: \"kubernetes.io/projected/05ea8f6e-70f0-453a-8dad-efc4db79048a-kube-api-access-j8v8t\") pod \"klusterlet-addon-workmgr-db778994f-c6zct\" (UID: \"05ea8f6e-70f0-453a-8dad-efc4db79048a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-db778994f-c6zct"
Sep 15 11:38:03.858399 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.858366    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9474f8bd6-jrsfw"]
Sep 15 11:38:03.860336 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.860313    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:03.880372 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.880340    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9474f8bd6-jrsfw"]
Sep 15 11:38:03.934331 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.934284    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de4f62c6-2da2-42c4-be64-fb64756499ce-bound-sa-token\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:03.934519 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.934342    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/05ea8f6e-70f0-453a-8dad-efc4db79048a-klusterlet-config\") pod \"klusterlet-addon-workmgr-db778994f-c6zct\" (UID: \"05ea8f6e-70f0-453a-8dad-efc4db79048a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-db778994f-c6zct"
Sep 15 11:38:03.934519 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.934366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8v8t\" (UniqueName: \"kubernetes.io/projected/05ea8f6e-70f0-453a-8dad-efc4db79048a-kube-api-access-j8v8t\") pod \"klusterlet-addon-workmgr-db778994f-c6zct\" (UID: \"05ea8f6e-70f0-453a-8dad-efc4db79048a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-db778994f-c6zct"
Sep 15 11:38:03.934519 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.934382    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de4f62c6-2da2-42c4-be64-fb64756499ce-image-registry-private-configuration\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:03.934519 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.934429    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de4f62c6-2da2-42c4-be64-fb64756499ce-installation-pull-secrets\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:03.934762 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.934591    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pppp2\" (UniqueName: \"kubernetes.io/projected/de4f62c6-2da2-42c4-be64-fb64756499ce-kube-api-access-pppp2\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:03.934762 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.934633    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de4f62c6-2da2-42c4-be64-fb64756499ce-ca-trust-extracted\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:03.934762 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.934652    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de4f62c6-2da2-42c4-be64-fb64756499ce-registry-tls\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:03.934762 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.934734    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d387a394-edfe-4c21-a2df-6c3038c4c9a7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-99db98b5d-89wkh\" (UID: \"d387a394-edfe-4c21-a2df-6c3038c4c9a7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99db98b5d-89wkh"
Sep 15 11:38:03.934925 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.934772    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh8gt\" (UniqueName: \"kubernetes.io/projected/d387a394-edfe-4c21-a2df-6c3038c4c9a7-kube-api-access-qh8gt\") pod \"managed-serviceaccount-addon-agent-99db98b5d-89wkh\" (UID: \"d387a394-edfe-4c21-a2df-6c3038c4c9a7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99db98b5d-89wkh"
Sep 15 11:38:03.934925 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.934807    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bvst\" (UniqueName: \"kubernetes.io/projected/3203bc5f-50f2-4e46-8781-f67e43ca3120-kube-api-access-6bvst\") pod \"downloads-76f99584f4-g8h6x\" (UID: \"3203bc5f-50f2-4e46-8781-f67e43ca3120\") " pod="openshift-console/downloads-76f99584f4-g8h6x"
Sep 15 11:38:03.934925 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.934829    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05ea8f6e-70f0-453a-8dad-efc4db79048a-tmp\") pod \"klusterlet-addon-workmgr-db778994f-c6zct\" (UID: \"05ea8f6e-70f0-453a-8dad-efc4db79048a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-db778994f-c6zct"
Sep 15 11:38:03.934925 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.934860    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de4f62c6-2da2-42c4-be64-fb64756499ce-registry-certificates\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:03.934925 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.934878    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de4f62c6-2da2-42c4-be64-fb64756499ce-trusted-ca\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:03.935238 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.935217    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05ea8f6e-70f0-453a-8dad-efc4db79048a-tmp\") pod \"klusterlet-addon-workmgr-db778994f-c6zct\" (UID: \"05ea8f6e-70f0-453a-8dad-efc4db79048a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-db778994f-c6zct"
Sep 15 11:38:03.937029 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.937006    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/05ea8f6e-70f0-453a-8dad-efc4db79048a-klusterlet-config\") pod \"klusterlet-addon-workmgr-db778994f-c6zct\" (UID: \"05ea8f6e-70f0-453a-8dad-efc4db79048a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-db778994f-c6zct"
Sep 15 11:38:03.937141 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.937058    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d387a394-edfe-4c21-a2df-6c3038c4c9a7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-99db98b5d-89wkh\" (UID: \"d387a394-edfe-4c21-a2df-6c3038c4c9a7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99db98b5d-89wkh"
Sep 15 11:38:03.944714 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.944691    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8v8t\" (UniqueName: \"kubernetes.io/projected/05ea8f6e-70f0-453a-8dad-efc4db79048a-kube-api-access-j8v8t\") pod \"klusterlet-addon-workmgr-db778994f-c6zct\" (UID: \"05ea8f6e-70f0-453a-8dad-efc4db79048a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-db778994f-c6zct"
Sep 15 11:38:03.947130 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.947111    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh8gt\" (UniqueName: \"kubernetes.io/projected/d387a394-edfe-4c21-a2df-6c3038c4c9a7-kube-api-access-qh8gt\") pod \"managed-serviceaccount-addon-agent-99db98b5d-89wkh\" (UID: \"d387a394-edfe-4c21-a2df-6c3038c4c9a7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99db98b5d-89wkh"
Sep 15 11:38:03.948482 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:03.948464    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bvst\" (UniqueName: \"kubernetes.io/projected/3203bc5f-50f2-4e46-8781-f67e43ca3120-kube-api-access-6bvst\") pod \"downloads-76f99584f4-g8h6x\" (UID: \"3203bc5f-50f2-4e46-8781-f67e43ca3120\") " pod="openshift-console/downloads-76f99584f4-g8h6x"
Sep 15 11:38:04.036006 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.035903    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de4f62c6-2da2-42c4-be64-fb64756499ce-installation-pull-secrets\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:04.036006 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.035951    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pppp2\" (UniqueName: \"kubernetes.io/projected/de4f62c6-2da2-42c4-be64-fb64756499ce-kube-api-access-pppp2\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:04.036006 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.035977    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de4f62c6-2da2-42c4-be64-fb64756499ce-ca-trust-extracted\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:04.036006 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.036000    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de4f62c6-2da2-42c4-be64-fb64756499ce-registry-tls\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:04.036684 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.036056    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de4f62c6-2da2-42c4-be64-fb64756499ce-registry-certificates\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:04.036684 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.036081    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de4f62c6-2da2-42c4-be64-fb64756499ce-trusted-ca\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:04.036684 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.036116    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de4f62c6-2da2-42c4-be64-fb64756499ce-bound-sa-token\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:04.036684 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.036158    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de4f62c6-2da2-42c4-be64-fb64756499ce-image-registry-private-configuration\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:04.036684 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.036499    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de4f62c6-2da2-42c4-be64-fb64756499ce-ca-trust-extracted\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:04.036952 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.036924    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de4f62c6-2da2-42c4-be64-fb64756499ce-registry-certificates\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:04.037063 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.037040    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de4f62c6-2da2-42c4-be64-fb64756499ce-trusted-ca\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:04.038461 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.038442    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de4f62c6-2da2-42c4-be64-fb64756499ce-image-registry-private-configuration\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:04.038902 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.038882    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de4f62c6-2da2-42c4-be64-fb64756499ce-installation-pull-secrets\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:04.038982 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.038902    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de4f62c6-2da2-42c4-be64-fb64756499ce-registry-tls\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:04.050980 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.050953    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pppp2\" (UniqueName: \"kubernetes.io/projected/de4f62c6-2da2-42c4-be64-fb64756499ce-kube-api-access-pppp2\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:04.051928 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.051909    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de4f62c6-2da2-42c4-be64-fb64756499ce-bound-sa-token\") pod \"image-registry-9474f8bd6-jrsfw\" (UID: \"de4f62c6-2da2-42c4-be64-fb64756499ce\") " pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:04.057843 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.057824    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99db98b5d-89wkh"
Sep 15 11:38:04.064378 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.064362    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-db778994f-c6zct"
Sep 15 11:38:04.086034 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.086001    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-g8h6x"
Sep 15 11:38:04.169697 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.169669    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:04.331106 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.331074    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99db98b5d-89wkh"]
Sep 15 11:38:04.333803 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:38:04.333780    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd387a394_edfe_4c21_a2df_6c3038c4c9a7.slice/crio-8748dfcb38e54ae21db83012f1c2d4a18cfdde3a2a010b3a1aec39133163419e WatchSource:0}: Error finding container 8748dfcb38e54ae21db83012f1c2d4a18cfdde3a2a010b3a1aec39133163419e: Status 404 returned error can't find the container with id 8748dfcb38e54ae21db83012f1c2d4a18cfdde3a2a010b3a1aec39133163419e
Sep 15 11:38:04.339223 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.339200    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-db778994f-c6zct"]
Sep 15 11:38:04.341892 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:38:04.341871    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05ea8f6e_70f0_453a_8dad_efc4db79048a.slice/crio-5d37bce92b63acb509ba7fffdd3a2a13247ccae8af1ef43b3e592c9743c529aa WatchSource:0}: Error finding container 5d37bce92b63acb509ba7fffdd3a2a13247ccae8af1ef43b3e592c9743c529aa: Status 404 returned error can't find the container with id 5d37bce92b63acb509ba7fffdd3a2a13247ccae8af1ef43b3e592c9743c529aa
Sep 15 11:38:04.395724 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.395570    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-g8h6x"]
Sep 15 11:38:04.398148 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:38:04.398121    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3203bc5f_50f2_4e46_8781_f67e43ca3120.slice/crio-2407a09b696333b8a6d876c5fc4df0ade8842d45982da5ab6e7a63e9e3a443c6 WatchSource:0}: Error finding container 2407a09b696333b8a6d876c5fc4df0ade8842d45982da5ab6e7a63e9e3a443c6: Status 404 returned error can't find the container with id 2407a09b696333b8a6d876c5fc4df0ade8842d45982da5ab6e7a63e9e3a443c6
Sep 15 11:38:04.438823 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:04.438788    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9474f8bd6-jrsfw"]
Sep 15 11:38:04.441449 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:38:04.441422    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde4f62c6_2da2_42c4_be64_fb64756499ce.slice/crio-2d82544d64925721b6676ecc048bd89b724cad1a46b449acb39f205034900fe3 WatchSource:0}: Error finding container 2d82544d64925721b6676ecc048bd89b724cad1a46b449acb39f205034900fe3: Status 404 returned error can't find the container with id 2d82544d64925721b6676ecc048bd89b724cad1a46b449acb39f205034900fe3
Sep 15 11:38:05.115411 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:05.115330    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-g8h6x" event={"ID":"3203bc5f-50f2-4e46-8781-f67e43ca3120","Type":"ContainerStarted","Data":"2407a09b696333b8a6d876c5fc4df0ade8842d45982da5ab6e7a63e9e3a443c6"}
Sep 15 11:38:05.117597 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:05.117568    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-db778994f-c6zct" event={"ID":"05ea8f6e-70f0-453a-8dad-efc4db79048a","Type":"ContainerStarted","Data":"5d37bce92b63acb509ba7fffdd3a2a13247ccae8af1ef43b3e592c9743c529aa"}
Sep 15 11:38:05.120302 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:05.120257    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw" event={"ID":"de4f62c6-2da2-42c4-be64-fb64756499ce","Type":"ContainerStarted","Data":"938bc9b8c9a0ea1b379e4ea9b35e04a286b39f384b980cf4f0599cafa8c1344d"}
Sep 15 11:38:05.120563 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:05.120420    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw" event={"ID":"de4f62c6-2da2-42c4-be64-fb64756499ce","Type":"ContainerStarted","Data":"2d82544d64925721b6676ecc048bd89b724cad1a46b449acb39f205034900fe3"}
Sep 15 11:38:05.120563 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:05.120528    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:05.122884 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:05.122856    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99db98b5d-89wkh" event={"ID":"d387a394-edfe-4c21-a2df-6c3038c4c9a7","Type":"ContainerStarted","Data":"8748dfcb38e54ae21db83012f1c2d4a18cfdde3a2a010b3a1aec39133163419e"}
Sep 15 11:38:05.144473 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:05.144417    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw" podStartSLOduration=2.1443968939999998 podStartE2EDuration="2.144396894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:05.144080806 +0000 UTC m=+61.860954995" watchObservedRunningTime="2026-09-15 11:38:05.144396894 +0000 UTC m=+61.861271076"
Sep 15 11:38:05.818881 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:05.817568    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bskmn"]
Sep 15 11:38:05.820715 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:05.820049    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bskmn"
Sep 15 11:38:05.824099 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:05.824068    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 15 11:38:05.825888 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:05.824154    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-r5j9w\""
Sep 15 11:38:05.835679 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:05.835620    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bskmn"]
Sep 15 11:38:05.956980 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:05.956787    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/559d18ca-4c8d-4037-ad0a-ec7aeacaeafc-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-bskmn\" (UID: \"559d18ca-4c8d-4037-ad0a-ec7aeacaeafc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bskmn"
Sep 15 11:38:06.057826 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:06.057257    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/559d18ca-4c8d-4037-ad0a-ec7aeacaeafc-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-bskmn\" (UID: \"559d18ca-4c8d-4037-ad0a-ec7aeacaeafc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bskmn"
Sep 15 11:38:06.057826 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:38:06.057417    2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 15 11:38:06.057826 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:38:06.057480    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/559d18ca-4c8d-4037-ad0a-ec7aeacaeafc-tls-certificates podName:559d18ca-4c8d-4037-ad0a-ec7aeacaeafc nodeName:}" failed. No retries permitted until 2026-09-15 11:38:06.557461091 +0000 UTC m=+63.274335258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/559d18ca-4c8d-4037-ad0a-ec7aeacaeafc-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-bskmn" (UID: "559d18ca-4c8d-4037-ad0a-ec7aeacaeafc") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 15 11:38:06.562941 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:06.562353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/559d18ca-4c8d-4037-ad0a-ec7aeacaeafc-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-bskmn\" (UID: \"559d18ca-4c8d-4037-ad0a-ec7aeacaeafc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bskmn"
Sep 15 11:38:06.562941 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:38:06.562525    2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 15 11:38:06.562941 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:38:06.562590    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/559d18ca-4c8d-4037-ad0a-ec7aeacaeafc-tls-certificates podName:559d18ca-4c8d-4037-ad0a-ec7aeacaeafc nodeName:}" failed. No retries permitted until 2026-09-15 11:38:07.562570599 +0000 UTC m=+64.279444766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/559d18ca-4c8d-4037-ad0a-ec7aeacaeafc-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-bskmn" (UID: "559d18ca-4c8d-4037-ad0a-ec7aeacaeafc") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 15 11:38:07.575787 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:07.575747    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/559d18ca-4c8d-4037-ad0a-ec7aeacaeafc-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-bskmn\" (UID: \"559d18ca-4c8d-4037-ad0a-ec7aeacaeafc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bskmn"
Sep 15 11:38:07.578690 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:07.578635    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/559d18ca-4c8d-4037-ad0a-ec7aeacaeafc-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-bskmn\" (UID: \"559d18ca-4c8d-4037-ad0a-ec7aeacaeafc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bskmn"
Sep 15 11:38:07.645880 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:07.645581    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bskmn"
Sep 15 11:38:08.093706 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:08.093673    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4fnpc"
Sep 15 11:38:09.491500 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:09.491453    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret\") pod \"global-pull-secret-syncer-cjpd7\" (UID: \"5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3\") " pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:38:09.494498 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:09.494474    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 11:38:09.505377 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:09.505349    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3-original-pull-secret\") pod \"global-pull-secret-syncer-cjpd7\" (UID: \"5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3\") " pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:38:09.592409 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:09.592372    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs\") pod \"network-metrics-daemon-4jmmn\" (UID: \"fd41f61a-cfbe-43f3-bc25-be3037a81bf2\") " pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:38:09.595080 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:09.595059    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 11:38:09.606071 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:09.606021    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd41f61a-cfbe-43f3-bc25-be3037a81bf2-metrics-certs\") pod \"network-metrics-daemon-4jmmn\" (UID: \"fd41f61a-cfbe-43f3-bc25-be3037a81bf2\") " pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:38:09.693623 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:09.693584    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46qzh\" (UniqueName: \"kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh\") pod \"network-check-target-45rvn\" (UID: \"20669eed-9c6c-4432-af7e-27e3a2136cd9\") " pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:38:09.696553 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:09.696530    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 11:38:09.706807 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:09.706785    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 11:38:09.718255 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:09.718229    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46qzh\" (UniqueName: \"kubernetes.io/projected/20669eed-9c6c-4432-af7e-27e3a2136cd9-kube-api-access-46qzh\") pod \"network-check-target-45rvn\" (UID: \"20669eed-9c6c-4432-af7e-27e3a2136cd9\") " pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:38:09.787694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:09.787622    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjpd7"
Sep 15 11:38:09.888050 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:09.888016    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w6k5p\""
Sep 15 11:38:09.894574 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:09.894553    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-72bfh\""
Sep 15 11:38:09.895630 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:09.895585    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jmmn"
Sep 15 11:38:09.902787 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:09.902762    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:38:10.154156 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:10.154122    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99db98b5d-89wkh" event={"ID":"d387a394-edfe-4c21-a2df-6c3038c4c9a7","Type":"ContainerStarted","Data":"35d58da316be3d7ba192d0dace439a2a52297a67fce6f41407bf7045fb392192"}
Sep 15 11:38:10.176979 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:10.176917    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99db98b5d-89wkh" podStartSLOduration=1.600007847 podStartE2EDuration="7.176896294s" totalImagesPullingTime="5.576888447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:10.176342817 +0000 UTC m=+66.893217001" watchObservedRunningTime="2026-09-15 11:38:10.176896294 +0000 UTC m=+66.893770479"
Sep 15 11:38:10.195752 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:10.195588    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cjpd7"]
Sep 15 11:38:10.196626 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:10.196529    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bskmn"]
Sep 15 11:38:10.220581 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:10.220552    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4jmmn"]
Sep 15 11:38:10.252006 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:38:10.251967    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a85e4fe_60c0_4f4e_8d1f_1e3ebe1a7be3.slice/crio-04ada8b2f038959e20d2fe359d74a33ac2c5a218dc1ff4781bf549753a5195cf WatchSource:0}: Error finding container 04ada8b2f038959e20d2fe359d74a33ac2c5a218dc1ff4781bf549753a5195cf: Status 404 returned error can't find the container with id 04ada8b2f038959e20d2fe359d74a33ac2c5a218dc1ff4781bf549753a5195cf
Sep 15 11:38:10.253439 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:38:10.253374    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod559d18ca_4c8d_4037_ad0a_ec7aeacaeafc.slice/crio-f682f2028cb0fa0ad8cc7bee45d8220113330836b74997bb878e428d8cd24544 WatchSource:0}: Error finding container f682f2028cb0fa0ad8cc7bee45d8220113330836b74997bb878e428d8cd24544: Status 404 returned error can't find the container with id f682f2028cb0fa0ad8cc7bee45d8220113330836b74997bb878e428d8cd24544
Sep 15 11:38:10.254023 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:38:10.254000    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd41f61a_cfbe_43f3_bc25_be3037a81bf2.slice/crio-f45ddc6dde9b53994260cbc30fdb1ec879fb1576a30dc135c8fe47a0661a8a08 WatchSource:0}: Error finding container f45ddc6dde9b53994260cbc30fdb1ec879fb1576a30dc135c8fe47a0661a8a08: Status 404 returned error can't find the container with id f45ddc6dde9b53994260cbc30fdb1ec879fb1576a30dc135c8fe47a0661a8a08
Sep 15 11:38:10.266308 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:10.266280    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-45rvn"]
Sep 15 11:38:10.269413 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:38:10.269387    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20669eed_9c6c_4432_af7e_27e3a2136cd9.slice/crio-bd61b195c9a746ee30633e9822e4551e8dee2d8c886eb96cb38204c0df2f51ff WatchSource:0}: Error finding container bd61b195c9a746ee30633e9822e4551e8dee2d8c886eb96cb38204c0df2f51ff: Status 404 returned error can't find the container with id bd61b195c9a746ee30633e9822e4551e8dee2d8c886eb96cb38204c0df2f51ff
Sep 15 11:38:11.166924 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:11.164608    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-db778994f-c6zct" event={"ID":"05ea8f6e-70f0-453a-8dad-efc4db79048a","Type":"ContainerStarted","Data":"4a4f6d7910e6a682fd3021dc8cd2369646a800c8ea3ab05e8359f82d32438402"}
Sep 15 11:38:11.166924 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:11.166858    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-db778994f-c6zct"
Sep 15 11:38:11.168494 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:11.168206    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-db778994f-c6zct"
Sep 15 11:38:11.170640 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:11.170546    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-45rvn" event={"ID":"20669eed-9c6c-4432-af7e-27e3a2136cd9","Type":"ContainerStarted","Data":"bd61b195c9a746ee30633e9822e4551e8dee2d8c886eb96cb38204c0df2f51ff"}
Sep 15 11:38:11.172159 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:11.172090    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cjpd7" event={"ID":"5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3","Type":"ContainerStarted","Data":"04ada8b2f038959e20d2fe359d74a33ac2c5a218dc1ff4781bf549753a5195cf"}
Sep 15 11:38:11.174600 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:11.174527    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bskmn" event={"ID":"559d18ca-4c8d-4037-ad0a-ec7aeacaeafc","Type":"ContainerStarted","Data":"f682f2028cb0fa0ad8cc7bee45d8220113330836b74997bb878e428d8cd24544"}
Sep 15 11:38:11.180340 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:11.180314    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4jmmn" event={"ID":"fd41f61a-cfbe-43f3-bc25-be3037a81bf2","Type":"ContainerStarted","Data":"f45ddc6dde9b53994260cbc30fdb1ec879fb1576a30dc135c8fe47a0661a8a08"}
Sep 15 11:38:11.184137 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:11.184087    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-db778994f-c6zct" podStartSLOduration=2.227538257 podStartE2EDuration="8.184069674s" totalImagesPullingTime="5.956531417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:11.18229373 +0000 UTC m=+67.899167910" watchObservedRunningTime="2026-09-15 11:38:11.184069674 +0000 UTC m=+67.900943859"
Sep 15 11:38:12.187072 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:12.187040    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bskmn" event={"ID":"559d18ca-4c8d-4037-ad0a-ec7aeacaeafc","Type":"ContainerStarted","Data":"224bdd770ce558b6de222d15d7f75155025a93576f34713e6f954ef49f8e8457"}
Sep 15 11:38:12.188399 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:12.188340    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bskmn"
Sep 15 11:38:12.194208 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:12.193904    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bskmn"
Sep 15 11:38:12.206203 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:12.205051    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bskmn" podStartSLOduration=5.428381328 podStartE2EDuration="7.205033079s" totalImagesPullingTime="1.776651751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:12.204970627 +0000 UTC m=+68.921844812" watchObservedRunningTime="2026-09-15 11:38:12.205033079 +0000 UTC m=+68.921907263"
Sep 15 11:38:13.198874 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:13.198311    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4jmmn" event={"ID":"fd41f61a-cfbe-43f3-bc25-be3037a81bf2","Type":"ContainerStarted","Data":"46f984274912593a38d20a89ac735e7744766c42d268f0ddf093f445874f291e"}
Sep 15 11:38:13.198874 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:13.198378    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4jmmn" event={"ID":"fd41f61a-cfbe-43f3-bc25-be3037a81bf2","Type":"ContainerStarted","Data":"b5bb4b2985664cc9ba9424a55100e39a539215f4e0faa6b562465a467dd5dba2"}
Sep 15 11:38:13.219296 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:13.218988    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4jmmn" podStartSLOduration=67.438571962 podStartE2EDuration="1m9.218964756s" totalImagesPullingTime="1.780392794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:13.216337469 +0000 UTC m=+69.933211657" watchObservedRunningTime="2026-09-15 11:38:13.218964756 +0000 UTC m=+69.935838940"
Sep 15 11:38:13.799979 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:13.799941    2564 patch_prober.go:28] interesting pod/image-registry-866bfd4fdf-tdc9z container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 15 11:38:13.800169 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:13.800003    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z" podUID="0db43767-318f-4b71-ae79-3e2c873c4a01" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 11:38:19.529196 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.529154    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5q5vj"]
Sep 15 11:38:19.533871 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.533288    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.536680 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.536650    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 15 11:38:19.536928 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.536900    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 15 11:38:19.537364 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.537284    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 15 11:38:19.537495 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.537381    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 15 11:38:19.541377 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.541034    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 15 11:38:19.541377 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.541339    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-842fw\""
Sep 15 11:38:19.541377 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.541374    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 15 11:38:19.577131 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.577093    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a283a2fb-9b1e-43bb-bc46-6af3dceea706-metrics-client-ca\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.577250 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.577193    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a283a2fb-9b1e-43bb-bc46-6af3dceea706-sys\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.577250 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.577230    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a283a2fb-9b1e-43bb-bc46-6af3dceea706-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.577351 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.577273    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4qcv\" (UniqueName: \"kubernetes.io/projected/a283a2fb-9b1e-43bb-bc46-6af3dceea706-kube-api-access-c4qcv\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.577351 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.577310    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a283a2fb-9b1e-43bb-bc46-6af3dceea706-root\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.577351 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.577334    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a283a2fb-9b1e-43bb-bc46-6af3dceea706-node-exporter-wtmp\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.577459 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.577373    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a283a2fb-9b1e-43bb-bc46-6af3dceea706-node-exporter-textfile\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.577459 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.577411    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a283a2fb-9b1e-43bb-bc46-6af3dceea706-node-exporter-tls\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.577537 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.577453    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a283a2fb-9b1e-43bb-bc46-6af3dceea706-node-exporter-accelerators-collector-config\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.678794 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.678756    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a283a2fb-9b1e-43bb-bc46-6af3dceea706-sys\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.678984 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.678811    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a283a2fb-9b1e-43bb-bc46-6af3dceea706-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.678984 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.678877    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4qcv\" (UniqueName: \"kubernetes.io/projected/a283a2fb-9b1e-43bb-bc46-6af3dceea706-kube-api-access-c4qcv\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.678984 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.678912    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a283a2fb-9b1e-43bb-bc46-6af3dceea706-root\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.678984 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.678928    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a283a2fb-9b1e-43bb-bc46-6af3dceea706-node-exporter-wtmp\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.678984 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.678956    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a283a2fb-9b1e-43bb-bc46-6af3dceea706-node-exporter-textfile\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.678984 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.678982    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a283a2fb-9b1e-43bb-bc46-6af3dceea706-node-exporter-tls\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.679296 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.679008    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a283a2fb-9b1e-43bb-bc46-6af3dceea706-node-exporter-accelerators-collector-config\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.679296 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.679034    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a283a2fb-9b1e-43bb-bc46-6af3dceea706-metrics-client-ca\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.679399 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.679368    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a283a2fb-9b1e-43bb-bc46-6af3dceea706-root\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.679452 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.679433    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a283a2fb-9b1e-43bb-bc46-6af3dceea706-sys\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.679614 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.679595    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a283a2fb-9b1e-43bb-bc46-6af3dceea706-node-exporter-textfile\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.679675 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.679651    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a283a2fb-9b1e-43bb-bc46-6af3dceea706-metrics-client-ca\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.679946 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.679735    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a283a2fb-9b1e-43bb-bc46-6af3dceea706-node-exporter-wtmp\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.679946 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:38:19.679755    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 15 11:38:19.679946 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:38:19.679816    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a283a2fb-9b1e-43bb-bc46-6af3dceea706-node-exporter-tls podName:a283a2fb-9b1e-43bb-bc46-6af3dceea706 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:20.179796332 +0000 UTC m=+76.896670496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a283a2fb-9b1e-43bb-bc46-6af3dceea706-node-exporter-tls") pod "node-exporter-5q5vj" (UID: "a283a2fb-9b1e-43bb-bc46-6af3dceea706") : secret "node-exporter-tls" not found
Sep 15 11:38:19.680181 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.680154    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a283a2fb-9b1e-43bb-bc46-6af3dceea706-node-exporter-accelerators-collector-config\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.681832 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.681809    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a283a2fb-9b1e-43bb-bc46-6af3dceea706-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:19.691249 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:19.691220    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4qcv\" (UniqueName: \"kubernetes.io/projected/a283a2fb-9b1e-43bb-bc46-6af3dceea706-kube-api-access-c4qcv\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:20.182968 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:20.182928    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a283a2fb-9b1e-43bb-bc46-6af3dceea706-node-exporter-tls\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:20.185615 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:20.185584    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a283a2fb-9b1e-43bb-bc46-6af3dceea706-node-exporter-tls\") pod \"node-exporter-5q5vj\" (UID: \"a283a2fb-9b1e-43bb-bc46-6af3dceea706\") " pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:20.449361 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:20.449280    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5q5vj"
Sep 15 11:38:23.647900 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:38:23.647867    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda283a2fb_9b1e_43bb_bc46_6af3dceea706.slice/crio-9a155df166761766c7b1321b912633aef5e7f6191030a389ccddedf96bf716cb WatchSource:0}: Error finding container 9a155df166761766c7b1321b912633aef5e7f6191030a389ccddedf96bf716cb: Status 404 returned error can't find the container with id 9a155df166761766c7b1321b912633aef5e7f6191030a389ccddedf96bf716cb
Sep 15 11:38:23.796493 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:23.796471    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:38:24.243154 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:24.243077    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5q5vj" event={"ID":"a283a2fb-9b1e-43bb-bc46-6af3dceea706","Type":"ContainerStarted","Data":"9a155df166761766c7b1321b912633aef5e7f6191030a389ccddedf96bf716cb"}
Sep 15 11:38:24.245745 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:24.245669    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-g8h6x" event={"ID":"3203bc5f-50f2-4e46-8781-f67e43ca3120","Type":"ContainerStarted","Data":"61205b32279d206b0741951ed700bbe1d6600109f7267e1cc9296ff4f6816f20"}
Sep 15 11:38:24.245963 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:24.245896    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-g8h6x"
Sep 15 11:38:24.249327 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:24.249305    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-45rvn" event={"ID":"20669eed-9c6c-4432-af7e-27e3a2136cd9","Type":"ContainerStarted","Data":"6a9562602322347eb82edaacf2e436a683eb86e45ba80647e530f4bd2bb866dd"}
Sep 15 11:38:24.249417 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:24.249353    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:38:24.251300 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:24.251232    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cjpd7" event={"ID":"5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3","Type":"ContainerStarted","Data":"8e29d677efc5ca2062907b52b122d41dfc3b3544dcc1741875c45e76c8dbdc62"}
Sep 15 11:38:24.261427 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:24.261388    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-g8h6x"
Sep 15 11:38:24.266207 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:24.266160    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-g8h6x" podStartSLOduration=1.9786026909999999 podStartE2EDuration="21.26614206s" totalImagesPullingTime="19.287539369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:24.264297213 +0000 UTC m=+80.981171397" watchObservedRunningTime="2026-09-15 11:38:24.26614206 +0000 UTC m=+80.983016247"
Sep 15 11:38:24.304580 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:24.304515    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cjpd7" podStartSLOduration=66.549740932 podStartE2EDuration="1m20.304492718s" totalImagesPullingTime="13.754751786s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:24.300954348 +0000 UTC m=+81.017828567" watchObservedRunningTime="2026-09-15 11:38:24.304492718 +0000 UTC m=+81.021366905"
Sep 15 11:38:24.341837 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:24.341777    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-45rvn" podStartSLOduration=66.976398528 podStartE2EDuration="1m20.341759078s" totalImagesPullingTime="13.36536055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:24.327914763 +0000 UTC m=+81.044788948" watchObservedRunningTime="2026-09-15 11:38:24.341759078 +0000 UTC m=+81.058633263"
Sep 15 11:38:25.258123 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:25.258038    2564 generic.go:356] "Generic (PLEG): container finished" podID="a283a2fb-9b1e-43bb-bc46-6af3dceea706" containerID="7452550ee60aff6fa3134c5026c7fcb10f07ce83d29a8cf76602a48f8c4f8227" exitCode=0
Sep 15 11:38:25.258587 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:25.258129    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5q5vj" event={"ID":"a283a2fb-9b1e-43bb-bc46-6af3dceea706","Type":"ContainerDied","Data":"7452550ee60aff6fa3134c5026c7fcb10f07ce83d29a8cf76602a48f8c4f8227"}
Sep 15 11:38:26.265482 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:26.265333    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5q5vj" event={"ID":"a283a2fb-9b1e-43bb-bc46-6af3dceea706","Type":"ContainerStarted","Data":"197c2ca3cc692fa3a3e7e980b4ab76a35941bbe2db1a2900ecdbeeff70579aff"}
Sep 15 11:38:26.265482 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:26.265412    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5q5vj" event={"ID":"a283a2fb-9b1e-43bb-bc46-6af3dceea706","Type":"ContainerStarted","Data":"930a3f85070dffff27c24604c8f8ee49492cfcdd911b960e0854ceb859564b2c"}
Sep 15 11:38:26.291749 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:26.291696    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5q5vj" podStartSLOduration=5.90549781 podStartE2EDuration="7.291678787s" totalImagesPullingTime="1.304573823s" totalInitContainerRuntime="81.607154ms" isStatefulPod=true podCreationTimestamp="2026-09-15 11:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:26.2912938 +0000 UTC m=+83.008167985" watchObservedRunningTime="2026-09-15 11:38:26.291678787 +0000 UTC m=+83.008552971"
Sep 15 11:38:27.145333 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:27.145303    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-9474f8bd6-jrsfw"
Sep 15 11:38:28.817639 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:28.817573    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z" podUID="0db43767-318f-4b71-ae79-3e2c873c4a01" containerName="registry" containerID="cri-o://eb8a54f046b453a3d5a78528036ab09b10394e4cc9a4f0047403bcedbd589483" gracePeriod=30
Sep 15 11:38:29.116005 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.115973    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:38:29.258275 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.258239    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0db43767-318f-4b71-ae79-3e2c873c4a01-image-registry-private-configuration\") pod \"0db43767-318f-4b71-ae79-3e2c873c4a01\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") "
Sep 15 11:38:29.258467 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.258312    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-certificates\") pod \"0db43767-318f-4b71-ae79-3e2c873c4a01\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") "
Sep 15 11:38:29.258467 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.258357    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-bound-sa-token\") pod \"0db43767-318f-4b71-ae79-3e2c873c4a01\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") "
Sep 15 11:38:29.258467 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.258400    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0db43767-318f-4b71-ae79-3e2c873c4a01-installation-pull-secrets\") pod \"0db43767-318f-4b71-ae79-3e2c873c4a01\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") "
Sep 15 11:38:29.258467 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.258428    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqbgz\" (UniqueName: \"kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-kube-api-access-sqbgz\") pod \"0db43767-318f-4b71-ae79-3e2c873c4a01\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") "
Sep 15 11:38:29.258689 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.258486    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0db43767-318f-4b71-ae79-3e2c873c4a01-ca-trust-extracted\") pod \"0db43767-318f-4b71-ae79-3e2c873c4a01\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") "
Sep 15 11:38:29.258689 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.258515    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-tls\") pod \"0db43767-318f-4b71-ae79-3e2c873c4a01\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") "
Sep 15 11:38:29.258689 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.258540    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0db43767-318f-4b71-ae79-3e2c873c4a01-trusted-ca\") pod \"0db43767-318f-4b71-ae79-3e2c873c4a01\" (UID: \"0db43767-318f-4b71-ae79-3e2c873c4a01\") "
Sep 15 11:38:29.258838 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.258720    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0db43767-318f-4b71-ae79-3e2c873c4a01" (UID: "0db43767-318f-4b71-ae79-3e2c873c4a01"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:38:29.259088 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.259060    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0db43767-318f-4b71-ae79-3e2c873c4a01-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0db43767-318f-4b71-ae79-3e2c873c4a01" (UID: "0db43767-318f-4b71-ae79-3e2c873c4a01"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:38:29.261507 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.261470    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-kube-api-access-sqbgz" (OuterVolumeSpecName: "kube-api-access-sqbgz") pod "0db43767-318f-4b71-ae79-3e2c873c4a01" (UID: "0db43767-318f-4b71-ae79-3e2c873c4a01"). InnerVolumeSpecName "kube-api-access-sqbgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:38:29.261766 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.261736    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0db43767-318f-4b71-ae79-3e2c873c4a01-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0db43767-318f-4b71-ae79-3e2c873c4a01" (UID: "0db43767-318f-4b71-ae79-3e2c873c4a01"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:38:29.261857 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.261776    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0db43767-318f-4b71-ae79-3e2c873c4a01" (UID: "0db43767-318f-4b71-ae79-3e2c873c4a01"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:38:29.262414 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.262377    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0db43767-318f-4b71-ae79-3e2c873c4a01-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0db43767-318f-4b71-ae79-3e2c873c4a01" (UID: "0db43767-318f-4b71-ae79-3e2c873c4a01"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:38:29.262862 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.262830    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0db43767-318f-4b71-ae79-3e2c873c4a01" (UID: "0db43767-318f-4b71-ae79-3e2c873c4a01"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:38:29.272391 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.272358    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0db43767-318f-4b71-ae79-3e2c873c4a01-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0db43767-318f-4b71-ae79-3e2c873c4a01" (UID: "0db43767-318f-4b71-ae79-3e2c873c4a01"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:38:29.283825 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.283794    2564 generic.go:356] "Generic (PLEG): container finished" podID="0db43767-318f-4b71-ae79-3e2c873c4a01" containerID="eb8a54f046b453a3d5a78528036ab09b10394e4cc9a4f0047403bcedbd589483" exitCode=0
Sep 15 11:38:29.283932 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.283857    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z"
Sep 15 11:38:29.283932 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.283891    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z" event={"ID":"0db43767-318f-4b71-ae79-3e2c873c4a01","Type":"ContainerDied","Data":"eb8a54f046b453a3d5a78528036ab09b10394e4cc9a4f0047403bcedbd589483"}
Sep 15 11:38:29.284054 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.283980    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-866bfd4fdf-tdc9z" event={"ID":"0db43767-318f-4b71-ae79-3e2c873c4a01","Type":"ContainerDied","Data":"bc3c95df46ff6836e1664f40e7c7c2fbbe44baee1b3faa4ccedf8e444d36cf1a"}
Sep 15 11:38:29.284054 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.284023    2564 scope.go:117] "RemoveContainer" containerID="eb8a54f046b453a3d5a78528036ab09b10394e4cc9a4f0047403bcedbd589483"
Sep 15 11:38:29.302627 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.302574    2564 scope.go:117] "RemoveContainer" containerID="eb8a54f046b453a3d5a78528036ab09b10394e4cc9a4f0047403bcedbd589483"
Sep 15 11:38:29.302969 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:38:29.302939    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb8a54f046b453a3d5a78528036ab09b10394e4cc9a4f0047403bcedbd589483\": container with ID starting with eb8a54f046b453a3d5a78528036ab09b10394e4cc9a4f0047403bcedbd589483 not found: ID does not exist" containerID="eb8a54f046b453a3d5a78528036ab09b10394e4cc9a4f0047403bcedbd589483"
Sep 15 11:38:29.303052 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.302973    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb8a54f046b453a3d5a78528036ab09b10394e4cc9a4f0047403bcedbd589483"} err="failed to get container status \"eb8a54f046b453a3d5a78528036ab09b10394e4cc9a4f0047403bcedbd589483\": rpc error: code = NotFound desc = could not find container \"eb8a54f046b453a3d5a78528036ab09b10394e4cc9a4f0047403bcedbd589483\": container with ID starting with eb8a54f046b453a3d5a78528036ab09b10394e4cc9a4f0047403bcedbd589483 not found: ID does not exist"
Sep 15 11:38:29.313976 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.313952    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-866bfd4fdf-tdc9z"]
Sep 15 11:38:29.317169 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.317148    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-866bfd4fdf-tdc9z"]
Sep 15 11:38:29.359781 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.359711    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0db43767-318f-4b71-ae79-3e2c873c4a01-ca-trust-extracted\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:38:29.359781 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.359740    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-tls\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:38:29.359781 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.359755    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0db43767-318f-4b71-ae79-3e2c873c4a01-trusted-ca\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:38:29.359781 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.359767    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0db43767-318f-4b71-ae79-3e2c873c4a01-image-registry-private-configuration\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:38:29.359781 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.359780    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0db43767-318f-4b71-ae79-3e2c873c4a01-registry-certificates\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:38:29.360035 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.359794    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-bound-sa-token\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:38:29.360035 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.359806    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0db43767-318f-4b71-ae79-3e2c873c4a01-installation-pull-secrets\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:38:29.360035 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.359817    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqbgz\" (UniqueName: \"kubernetes.io/projected/0db43767-318f-4b71-ae79-3e2c873c4a01-kube-api-access-sqbgz\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:38:29.778394 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:29.778316    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0db43767-318f-4b71-ae79-3e2c873c4a01" path="/var/lib/kubelet/pods/0db43767-318f-4b71-ae79-3e2c873c4a01/volumes"
Sep 15 11:38:55.260520 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:38:55.260487    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-45rvn"
Sep 15 11:40:38.306244 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:38.306154    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz"]
Sep 15 11:40:38.306837 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:38.306504    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0db43767-318f-4b71-ae79-3e2c873c4a01" containerName="registry"
Sep 15 11:40:38.306837 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:38.306522    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0db43767-318f-4b71-ae79-3e2c873c4a01" containerName="registry"
Sep 15 11:40:38.306837 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:38.306602    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0db43767-318f-4b71-ae79-3e2c873c4a01" containerName="registry"
Sep 15 11:40:38.308568 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:38.308545    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz"
Sep 15 11:40:38.311231 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:38.311212    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hgd6q\""
Sep 15 11:40:38.311352 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:38.311211    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 11:40:38.312379 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:38.312363    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 11:40:38.319417 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:38.319396    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz"]
Sep 15 11:40:38.447296 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:38.447236    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c614ed5c-d596-4279-9e4b-05330299aa9a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz\" (UID: \"c614ed5c-d596-4279-9e4b-05330299aa9a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz"
Sep 15 11:40:38.447468 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:38.447358    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5769x\" (UniqueName: \"kubernetes.io/projected/c614ed5c-d596-4279-9e4b-05330299aa9a-kube-api-access-5769x\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz\" (UID: \"c614ed5c-d596-4279-9e4b-05330299aa9a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz"
Sep 15 11:40:38.447468 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:38.447396    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c614ed5c-d596-4279-9e4b-05330299aa9a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz\" (UID: \"c614ed5c-d596-4279-9e4b-05330299aa9a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz"
Sep 15 11:40:38.547868 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:38.547833    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5769x\" (UniqueName: \"kubernetes.io/projected/c614ed5c-d596-4279-9e4b-05330299aa9a-kube-api-access-5769x\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz\" (UID: \"c614ed5c-d596-4279-9e4b-05330299aa9a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz"
Sep 15 11:40:38.547868 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:38.547874    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c614ed5c-d596-4279-9e4b-05330299aa9a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz\" (UID: \"c614ed5c-d596-4279-9e4b-05330299aa9a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz"
Sep 15 11:40:38.548054 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:38.547898    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c614ed5c-d596-4279-9e4b-05330299aa9a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz\" (UID: \"c614ed5c-d596-4279-9e4b-05330299aa9a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz"
Sep 15 11:40:38.548217 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:38.548197    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c614ed5c-d596-4279-9e4b-05330299aa9a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz\" (UID: \"c614ed5c-d596-4279-9e4b-05330299aa9a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz"
Sep 15 11:40:38.548256 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:38.548232    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c614ed5c-d596-4279-9e4b-05330299aa9a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz\" (UID: \"c614ed5c-d596-4279-9e4b-05330299aa9a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz"
Sep 15 11:40:38.555872 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:38.555853    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5769x\" (UniqueName: \"kubernetes.io/projected/c614ed5c-d596-4279-9e4b-05330299aa9a-kube-api-access-5769x\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz\" (UID: \"c614ed5c-d596-4279-9e4b-05330299aa9a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz"
Sep 15 11:40:38.616831 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:38.616764    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz"
Sep 15 11:40:38.885641 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:38.885570    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz"]
Sep 15 11:40:38.891155 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:40:38.891112    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc614ed5c_d596_4279_9e4b_05330299aa9a.slice/crio-ec8fdbf7327abe624eb7545383087576ce9702f97108215708865487b846e105 WatchSource:0}: Error finding container ec8fdbf7327abe624eb7545383087576ce9702f97108215708865487b846e105: Status 404 returned error can't find the container with id ec8fdbf7327abe624eb7545383087576ce9702f97108215708865487b846e105
Sep 15 11:40:39.713167 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:39.713133    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz" event={"ID":"c614ed5c-d596-4279-9e4b-05330299aa9a","Type":"ContainerStarted","Data":"ec8fdbf7327abe624eb7545383087576ce9702f97108215708865487b846e105"}
Sep 15 11:40:45.735789 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:45.735752    2564 generic.go:356] "Generic (PLEG): container finished" podID="c614ed5c-d596-4279-9e4b-05330299aa9a" containerID="6631265d31ac649bed18290c4b8fcbab1bd4107dbb02683b269c5709aaa9ea29" exitCode=0
Sep 15 11:40:45.735789 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:45.735791    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz" event={"ID":"c614ed5c-d596-4279-9e4b-05330299aa9a","Type":"ContainerDied","Data":"6631265d31ac649bed18290c4b8fcbab1bd4107dbb02683b269c5709aaa9ea29"}
Sep 15 11:40:48.748969 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:48.748931    2564 generic.go:356] "Generic (PLEG): container finished" podID="c614ed5c-d596-4279-9e4b-05330299aa9a" containerID="c69b72f787291387c75ecd660623f7bd4c77d0fbce88d3c7bc2ac03d5e724bd9" exitCode=0
Sep 15 11:40:48.749426 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:48.749021    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz" event={"ID":"c614ed5c-d596-4279-9e4b-05330299aa9a","Type":"ContainerDied","Data":"c69b72f787291387c75ecd660623f7bd4c77d0fbce88d3c7bc2ac03d5e724bd9"}
Sep 15 11:40:55.778035 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:55.778006    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz" event={"ID":"c614ed5c-d596-4279-9e4b-05330299aa9a","Type":"ContainerStarted","Data":"076180a4255a8353a349cbe2aed6678b66066d8fba63d5fb681f30e8063bf540"}
Sep 15 11:40:55.795530 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:55.795477    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz" podStartSLOduration=2.83789005 podStartE2EDuration="17.795463234s" totalImagesPullingTime="14.957573184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:40:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:55.794575347 +0000 UTC m=+232.511449542" watchObservedRunningTime="2026-09-15 11:40:55.795463234 +0000 UTC m=+232.512337417"
Sep 15 11:40:56.782903 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:56.782863    2564 generic.go:356] "Generic (PLEG): container finished" podID="c614ed5c-d596-4279-9e4b-05330299aa9a" containerID="076180a4255a8353a349cbe2aed6678b66066d8fba63d5fb681f30e8063bf540" exitCode=0
Sep 15 11:40:56.783296 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:56.782917    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz" event={"ID":"c614ed5c-d596-4279-9e4b-05330299aa9a","Type":"ContainerDied","Data":"076180a4255a8353a349cbe2aed6678b66066d8fba63d5fb681f30e8063bf540"}
Sep 15 11:40:57.906791 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:57.906761    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz"
Sep 15 11:40:58.093781 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:58.093750    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c614ed5c-d596-4279-9e4b-05330299aa9a-bundle\") pod \"c614ed5c-d596-4279-9e4b-05330299aa9a\" (UID: \"c614ed5c-d596-4279-9e4b-05330299aa9a\") "
Sep 15 11:40:58.093913 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:58.093831    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5769x\" (UniqueName: \"kubernetes.io/projected/c614ed5c-d596-4279-9e4b-05330299aa9a-kube-api-access-5769x\") pod \"c614ed5c-d596-4279-9e4b-05330299aa9a\" (UID: \"c614ed5c-d596-4279-9e4b-05330299aa9a\") "
Sep 15 11:40:58.093913 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:58.093865    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c614ed5c-d596-4279-9e4b-05330299aa9a-util\") pod \"c614ed5c-d596-4279-9e4b-05330299aa9a\" (UID: \"c614ed5c-d596-4279-9e4b-05330299aa9a\") "
Sep 15 11:40:58.094449 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:58.094412    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c614ed5c-d596-4279-9e4b-05330299aa9a-bundle" (OuterVolumeSpecName: "bundle") pod "c614ed5c-d596-4279-9e4b-05330299aa9a" (UID: "c614ed5c-d596-4279-9e4b-05330299aa9a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:40:58.096055 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:58.096025    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c614ed5c-d596-4279-9e4b-05330299aa9a-kube-api-access-5769x" (OuterVolumeSpecName: "kube-api-access-5769x") pod "c614ed5c-d596-4279-9e4b-05330299aa9a" (UID: "c614ed5c-d596-4279-9e4b-05330299aa9a"). InnerVolumeSpecName "kube-api-access-5769x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:40:58.097989 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:58.097962    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c614ed5c-d596-4279-9e4b-05330299aa9a-util" (OuterVolumeSpecName: "util") pod "c614ed5c-d596-4279-9e4b-05330299aa9a" (UID: "c614ed5c-d596-4279-9e4b-05330299aa9a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:40:58.194880 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:58.194836    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5769x\" (UniqueName: \"kubernetes.io/projected/c614ed5c-d596-4279-9e4b-05330299aa9a-kube-api-access-5769x\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:40:58.194880 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:58.194873    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c614ed5c-d596-4279-9e4b-05330299aa9a-util\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:40:58.194880 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:58.194883    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c614ed5c-d596-4279-9e4b-05330299aa9a-bundle\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:40:58.792080 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:58.792047    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz" event={"ID":"c614ed5c-d596-4279-9e4b-05330299aa9a","Type":"ContainerDied","Data":"ec8fdbf7327abe624eb7545383087576ce9702f97108215708865487b846e105"}
Sep 15 11:40:58.792220 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:58.792091    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec8fdbf7327abe624eb7545383087576ce9702f97108215708865487b846e105"
Sep 15 11:40:58.792220 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:40:58.792097    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r79lz"
Sep 15 11:41:06.118972 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:06.118935    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8zx2"]
Sep 15 11:41:06.119374 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:06.119163    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c614ed5c-d596-4279-9e4b-05330299aa9a" containerName="util"
Sep 15 11:41:06.119374 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:06.119173    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c614ed5c-d596-4279-9e4b-05330299aa9a" containerName="util"
Sep 15 11:41:06.119374 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:06.119195    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c614ed5c-d596-4279-9e4b-05330299aa9a" containerName="pull"
Sep 15 11:41:06.119374 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:06.119200    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c614ed5c-d596-4279-9e4b-05330299aa9a" containerName="pull"
Sep 15 11:41:06.119374 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:06.119205    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c614ed5c-d596-4279-9e4b-05330299aa9a" containerName="extract"
Sep 15 11:41:06.119374 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:06.119211    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c614ed5c-d596-4279-9e4b-05330299aa9a" containerName="extract"
Sep 15 11:41:06.119374 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:06.119249    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c614ed5c-d596-4279-9e4b-05330299aa9a" containerName="extract"
Sep 15 11:41:06.122384 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:06.122368    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8zx2"
Sep 15 11:41:06.124858 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:06.124831    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:41:06.124992 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:06.124857    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-d8php\""
Sep 15 11:41:06.124992 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:06.124924    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 15 11:41:06.133881 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:06.133860    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8zx2"]
Sep 15 11:41:06.155846 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:06.155818    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f95km\" (UniqueName: \"kubernetes.io/projected/bd2ebd5b-8c30-45e8-9443-6b16c91c6053-kube-api-access-f95km\") pod \"cert-manager-operator-controller-manager-55c444bf86-f8zx2\" (UID: \"bd2ebd5b-8c30-45e8-9443-6b16c91c6053\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8zx2"
Sep 15 11:41:06.155970 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:06.155850    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd2ebd5b-8c30-45e8-9443-6b16c91c6053-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f8zx2\" (UID: \"bd2ebd5b-8c30-45e8-9443-6b16c91c6053\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8zx2"
Sep 15 11:41:06.256446 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:06.256405    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f95km\" (UniqueName: \"kubernetes.io/projected/bd2ebd5b-8c30-45e8-9443-6b16c91c6053-kube-api-access-f95km\") pod \"cert-manager-operator-controller-manager-55c444bf86-f8zx2\" (UID: \"bd2ebd5b-8c30-45e8-9443-6b16c91c6053\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8zx2"
Sep 15 11:41:06.256639 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:06.256450    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd2ebd5b-8c30-45e8-9443-6b16c91c6053-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f8zx2\" (UID: \"bd2ebd5b-8c30-45e8-9443-6b16c91c6053\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8zx2"
Sep 15 11:41:06.256860 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:06.256838    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd2ebd5b-8c30-45e8-9443-6b16c91c6053-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f8zx2\" (UID: \"bd2ebd5b-8c30-45e8-9443-6b16c91c6053\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8zx2"
Sep 15 11:41:06.268199 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:06.268170    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f95km\" (UniqueName: \"kubernetes.io/projected/bd2ebd5b-8c30-45e8-9443-6b16c91c6053-kube-api-access-f95km\") pod \"cert-manager-operator-controller-manager-55c444bf86-f8zx2\" (UID: \"bd2ebd5b-8c30-45e8-9443-6b16c91c6053\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8zx2"
Sep 15 11:41:06.431587 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:06.431498    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8zx2"
Sep 15 11:41:06.709377 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:06.709303    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8zx2"]
Sep 15 11:41:06.712420 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:41:06.712392    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd2ebd5b_8c30_45e8_9443_6b16c91c6053.slice/crio-dead1f7a78f459d210773cc1ed3b9001f66987b656409a2b311a098a0e6bf3bc WatchSource:0}: Error finding container dead1f7a78f459d210773cc1ed3b9001f66987b656409a2b311a098a0e6bf3bc: Status 404 returned error can't find the container with id dead1f7a78f459d210773cc1ed3b9001f66987b656409a2b311a098a0e6bf3bc
Sep 15 11:41:06.825169 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:06.825136    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8zx2" event={"ID":"bd2ebd5b-8c30-45e8-9443-6b16c91c6053","Type":"ContainerStarted","Data":"dead1f7a78f459d210773cc1ed3b9001f66987b656409a2b311a098a0e6bf3bc"}
Sep 15 11:41:08.835051 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:08.835013    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8zx2" event={"ID":"bd2ebd5b-8c30-45e8-9443-6b16c91c6053","Type":"ContainerStarted","Data":"f10e093f53393acabda0c99ad8e88fca0950084356afaed76a9d243f904f9812"}
Sep 15 11:41:08.860568 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:08.860517    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8zx2" podStartSLOduration=1.236981972 podStartE2EDuration="2.860501988s" totalImagesPullingTime="1.623520016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:41:08.858125336 +0000 UTC m=+245.574999521" watchObservedRunningTime="2026-09-15 11:41:08.860501988 +0000 UTC m=+245.577376171"
Sep 15 11:41:10.437530 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:10.437494    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw"]
Sep 15 11:41:10.440950 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:10.440932    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw"
Sep 15 11:41:10.443468 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:10.443449    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 11:41:10.444574 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:10.444548    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 11:41:10.444574 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:10.444557    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hgd6q\""
Sep 15 11:41:10.449597 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:10.449572    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw"]
Sep 15 11:41:10.490454 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:10.490421    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83696e43-7ba1-41a2-806b-00b8d518d4c1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw\" (UID: \"83696e43-7ba1-41a2-806b-00b8d518d4c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw"
Sep 15 11:41:10.490593 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:10.490461    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9msm8\" (UniqueName: \"kubernetes.io/projected/83696e43-7ba1-41a2-806b-00b8d518d4c1-kube-api-access-9msm8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw\" (UID: \"83696e43-7ba1-41a2-806b-00b8d518d4c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw"
Sep 15 11:41:10.490593 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:10.490502    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83696e43-7ba1-41a2-806b-00b8d518d4c1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw\" (UID: \"83696e43-7ba1-41a2-806b-00b8d518d4c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw"
Sep 15 11:41:10.591818 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:10.591756    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9msm8\" (UniqueName: \"kubernetes.io/projected/83696e43-7ba1-41a2-806b-00b8d518d4c1-kube-api-access-9msm8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw\" (UID: \"83696e43-7ba1-41a2-806b-00b8d518d4c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw"
Sep 15 11:41:10.591818 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:10.591834    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83696e43-7ba1-41a2-806b-00b8d518d4c1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw\" (UID: \"83696e43-7ba1-41a2-806b-00b8d518d4c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw"
Sep 15 11:41:10.592081 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:10.591982    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83696e43-7ba1-41a2-806b-00b8d518d4c1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw\" (UID: \"83696e43-7ba1-41a2-806b-00b8d518d4c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw"
Sep 15 11:41:10.592227 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:10.592211    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83696e43-7ba1-41a2-806b-00b8d518d4c1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw\" (UID: \"83696e43-7ba1-41a2-806b-00b8d518d4c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw"
Sep 15 11:41:10.592318 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:10.592236    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83696e43-7ba1-41a2-806b-00b8d518d4c1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw\" (UID: \"83696e43-7ba1-41a2-806b-00b8d518d4c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw"
Sep 15 11:41:10.600432 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:10.600411    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9msm8\" (UniqueName: \"kubernetes.io/projected/83696e43-7ba1-41a2-806b-00b8d518d4c1-kube-api-access-9msm8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw\" (UID: \"83696e43-7ba1-41a2-806b-00b8d518d4c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw"
Sep 15 11:41:10.750223 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:10.750129    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw"
Sep 15 11:41:11.017005 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:11.016928    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw"]
Sep 15 11:41:11.020002 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:41:11.019972    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83696e43_7ba1_41a2_806b_00b8d518d4c1.slice/crio-067d14cea87eaca73c679b6f5828067ff9fd7a1257c15a70d83794e5dd596102 WatchSource:0}: Error finding container 067d14cea87eaca73c679b6f5828067ff9fd7a1257c15a70d83794e5dd596102: Status 404 returned error can't find the container with id 067d14cea87eaca73c679b6f5828067ff9fd7a1257c15a70d83794e5dd596102
Sep 15 11:41:11.849385 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:11.849351    2564 generic.go:356] "Generic (PLEG): container finished" podID="83696e43-7ba1-41a2-806b-00b8d518d4c1" containerID="bf890da6f94ce794b0a3fa1369a6d49be36ad1a522725f714e900c8f420da4b9" exitCode=0
Sep 15 11:41:11.849782 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:11.849394    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw" event={"ID":"83696e43-7ba1-41a2-806b-00b8d518d4c1","Type":"ContainerDied","Data":"bf890da6f94ce794b0a3fa1369a6d49be36ad1a522725f714e900c8f420da4b9"}
Sep 15 11:41:11.849782 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:11.849428    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw" event={"ID":"83696e43-7ba1-41a2-806b-00b8d518d4c1","Type":"ContainerStarted","Data":"067d14cea87eaca73c679b6f5828067ff9fd7a1257c15a70d83794e5dd596102"}
Sep 15 11:41:12.218885 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:12.218848    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-96dqq"]
Sep 15 11:41:12.221912 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:12.221895    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-96dqq"
Sep 15 11:41:12.224373 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:12.224342    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 15 11:41:12.224373 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:12.224366    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4pvck\""
Sep 15 11:41:12.224555 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:12.224351    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 15 11:41:12.230508 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:12.230479    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-96dqq"]
Sep 15 11:41:12.304611 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:12.304574    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwxsw\" (UniqueName: \"kubernetes.io/projected/e0aab0d1-f480-4ed7-9096-8805f0055e4b-kube-api-access-zwxsw\") pod \"cert-manager-cainjector-559cdd8c87-96dqq\" (UID: \"e0aab0d1-f480-4ed7-9096-8805f0055e4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-96dqq"
Sep 15 11:41:12.304611 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:12.304617    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0aab0d1-f480-4ed7-9096-8805f0055e4b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-96dqq\" (UID: \"e0aab0d1-f480-4ed7-9096-8805f0055e4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-96dqq"
Sep 15 11:41:12.405134 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:12.405098    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwxsw\" (UniqueName: \"kubernetes.io/projected/e0aab0d1-f480-4ed7-9096-8805f0055e4b-kube-api-access-zwxsw\") pod \"cert-manager-cainjector-559cdd8c87-96dqq\" (UID: \"e0aab0d1-f480-4ed7-9096-8805f0055e4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-96dqq"
Sep 15 11:41:12.405318 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:12.405141    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0aab0d1-f480-4ed7-9096-8805f0055e4b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-96dqq\" (UID: \"e0aab0d1-f480-4ed7-9096-8805f0055e4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-96dqq"
Sep 15 11:41:12.413756 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:12.413725    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0aab0d1-f480-4ed7-9096-8805f0055e4b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-96dqq\" (UID: \"e0aab0d1-f480-4ed7-9096-8805f0055e4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-96dqq"
Sep 15 11:41:12.413897 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:12.413877    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwxsw\" (UniqueName: \"kubernetes.io/projected/e0aab0d1-f480-4ed7-9096-8805f0055e4b-kube-api-access-zwxsw\") pod \"cert-manager-cainjector-559cdd8c87-96dqq\" (UID: \"e0aab0d1-f480-4ed7-9096-8805f0055e4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-96dqq"
Sep 15 11:41:12.531082 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:12.530995    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-96dqq"
Sep 15 11:41:12.801953 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:12.797958    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-96dqq"]
Sep 15 11:41:12.803065 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:41:12.803030    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0aab0d1_f480_4ed7_9096_8805f0055e4b.slice/crio-f06633c0fc4733f938071ba07db7bda90ad810c0fd1bc55fc2f7d9d00dc610c9 WatchSource:0}: Error finding container f06633c0fc4733f938071ba07db7bda90ad810c0fd1bc55fc2f7d9d00dc610c9: Status 404 returned error can't find the container with id f06633c0fc4733f938071ba07db7bda90ad810c0fd1bc55fc2f7d9d00dc610c9
Sep 15 11:41:12.854234 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:12.854198    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-96dqq" event={"ID":"e0aab0d1-f480-4ed7-9096-8805f0055e4b","Type":"ContainerStarted","Data":"f06633c0fc4733f938071ba07db7bda90ad810c0fd1bc55fc2f7d9d00dc610c9"}
Sep 15 11:41:15.867522 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:15.867481    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-96dqq" event={"ID":"e0aab0d1-f480-4ed7-9096-8805f0055e4b","Type":"ContainerStarted","Data":"c3385cea4e3330feca8e16ff9e68aa3fb56005cf42120e583d29e3f8ebb76563"}
Sep 15 11:41:15.884776 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:15.884729    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-96dqq" podStartSLOduration=1.488594888 podStartE2EDuration="3.88471388s" totalImagesPullingTime="2.396118992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:41:15.883282545 +0000 UTC m=+252.600156730" watchObservedRunningTime="2026-09-15 11:41:15.88471388 +0000 UTC m=+252.601588063"
Sep 15 11:41:18.885982 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:18.885942    2564 generic.go:356] "Generic (PLEG): container finished" podID="83696e43-7ba1-41a2-806b-00b8d518d4c1" containerID="6342118307a376a0b8264dc0355df63bdf019209b09756b0cdfc9def2567004d" exitCode=0
Sep 15 11:41:18.886446 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:18.886003    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw" event={"ID":"83696e43-7ba1-41a2-806b-00b8d518d4c1","Type":"ContainerDied","Data":"6342118307a376a0b8264dc0355df63bdf019209b09756b0cdfc9def2567004d"}
Sep 15 11:41:19.892278 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:19.892224    2564 generic.go:356] "Generic (PLEG): container finished" podID="83696e43-7ba1-41a2-806b-00b8d518d4c1" containerID="2e044c817cafd5286d71ca1adb5292004436e43d9833e86a618f0d5b6d129adb" exitCode=0
Sep 15 11:41:19.892659 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:19.892303    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw" event={"ID":"83696e43-7ba1-41a2-806b-00b8d518d4c1","Type":"ContainerDied","Data":"2e044c817cafd5286d71ca1adb5292004436e43d9833e86a618f0d5b6d129adb"}
Sep 15 11:41:21.017430 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:21.017406    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw"
Sep 15 11:41:21.071156 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:21.071120    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83696e43-7ba1-41a2-806b-00b8d518d4c1-util\") pod \"83696e43-7ba1-41a2-806b-00b8d518d4c1\" (UID: \"83696e43-7ba1-41a2-806b-00b8d518d4c1\") "
Sep 15 11:41:21.071344 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:21.071195    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83696e43-7ba1-41a2-806b-00b8d518d4c1-bundle\") pod \"83696e43-7ba1-41a2-806b-00b8d518d4c1\" (UID: \"83696e43-7ba1-41a2-806b-00b8d518d4c1\") "
Sep 15 11:41:21.071344 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:21.071223    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9msm8\" (UniqueName: \"kubernetes.io/projected/83696e43-7ba1-41a2-806b-00b8d518d4c1-kube-api-access-9msm8\") pod \"83696e43-7ba1-41a2-806b-00b8d518d4c1\" (UID: \"83696e43-7ba1-41a2-806b-00b8d518d4c1\") "
Sep 15 11:41:21.071587 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:21.071551    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83696e43-7ba1-41a2-806b-00b8d518d4c1-bundle" (OuterVolumeSpecName: "bundle") pod "83696e43-7ba1-41a2-806b-00b8d518d4c1" (UID: "83696e43-7ba1-41a2-806b-00b8d518d4c1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:21.073214 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:21.073179    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83696e43-7ba1-41a2-806b-00b8d518d4c1-kube-api-access-9msm8" (OuterVolumeSpecName: "kube-api-access-9msm8") pod "83696e43-7ba1-41a2-806b-00b8d518d4c1" (UID: "83696e43-7ba1-41a2-806b-00b8d518d4c1"). InnerVolumeSpecName "kube-api-access-9msm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:41:21.076549 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:21.076514    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83696e43-7ba1-41a2-806b-00b8d518d4c1-util" (OuterVolumeSpecName: "util") pod "83696e43-7ba1-41a2-806b-00b8d518d4c1" (UID: "83696e43-7ba1-41a2-806b-00b8d518d4c1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:21.172558 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:21.172464    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9msm8\" (UniqueName: \"kubernetes.io/projected/83696e43-7ba1-41a2-806b-00b8d518d4c1-kube-api-access-9msm8\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:41:21.172558 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:21.172503    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83696e43-7ba1-41a2-806b-00b8d518d4c1-util\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:41:21.172558 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:21.172514    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83696e43-7ba1-41a2-806b-00b8d518d4c1-bundle\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:41:21.902793 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:21.902765    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw"
Sep 15 11:41:21.902934 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:21.902753    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvp5pw" event={"ID":"83696e43-7ba1-41a2-806b-00b8d518d4c1","Type":"ContainerDied","Data":"067d14cea87eaca73c679b6f5828067ff9fd7a1257c15a70d83794e5dd596102"}
Sep 15 11:41:21.902934 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:21.902885    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="067d14cea87eaca73c679b6f5828067ff9fd7a1257c15a70d83794e5dd596102"
Sep 15 11:41:28.195987 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:28.195902    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c2m4b"]
Sep 15 11:41:28.196360 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:28.196164    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83696e43-7ba1-41a2-806b-00b8d518d4c1" containerName="extract"
Sep 15 11:41:28.196360 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:28.196179    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="83696e43-7ba1-41a2-806b-00b8d518d4c1" containerName="extract"
Sep 15 11:41:28.196360 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:28.196195    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83696e43-7ba1-41a2-806b-00b8d518d4c1" containerName="util"
Sep 15 11:41:28.196360 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:28.196201    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="83696e43-7ba1-41a2-806b-00b8d518d4c1" containerName="util"
Sep 15 11:41:28.196360 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:28.196207    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83696e43-7ba1-41a2-806b-00b8d518d4c1" containerName="pull"
Sep 15 11:41:28.196360 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:28.196213    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="83696e43-7ba1-41a2-806b-00b8d518d4c1" containerName="pull"
Sep 15 11:41:28.196360 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:28.196273    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="83696e43-7ba1-41a2-806b-00b8d518d4c1" containerName="extract"
Sep 15 11:41:28.199528 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:28.199512    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c2m4b"
Sep 15 11:41:28.202140 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:28.202112    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 15 11:41:28.202305 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:28.202151    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:41:28.202305 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:28.202161    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-ls4hr\""
Sep 15 11:41:28.207074 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:28.207053    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c2m4b"]
Sep 15 11:41:28.215875 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:28.215853    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhtbd\" (UniqueName: \"kubernetes.io/projected/fa1c6ba8-e0ae-4703-9117-e390963be26d-kube-api-access-dhtbd\") pod \"openshift-lws-operator-fd8ccff4c-c2m4b\" (UID: \"fa1c6ba8-e0ae-4703-9117-e390963be26d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c2m4b"
Sep 15 11:41:28.215989 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:28.215897    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa1c6ba8-e0ae-4703-9117-e390963be26d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-c2m4b\" (UID: \"fa1c6ba8-e0ae-4703-9117-e390963be26d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c2m4b"
Sep 15 11:41:28.316713 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:28.316685    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhtbd\" (UniqueName: \"kubernetes.io/projected/fa1c6ba8-e0ae-4703-9117-e390963be26d-kube-api-access-dhtbd\") pod \"openshift-lws-operator-fd8ccff4c-c2m4b\" (UID: \"fa1c6ba8-e0ae-4703-9117-e390963be26d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c2m4b"
Sep 15 11:41:28.316847 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:28.316736    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa1c6ba8-e0ae-4703-9117-e390963be26d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-c2m4b\" (UID: \"fa1c6ba8-e0ae-4703-9117-e390963be26d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c2m4b"
Sep 15 11:41:28.317108 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:28.317090    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa1c6ba8-e0ae-4703-9117-e390963be26d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-c2m4b\" (UID: \"fa1c6ba8-e0ae-4703-9117-e390963be26d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c2m4b"
Sep 15 11:41:28.325595 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:28.325575    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhtbd\" (UniqueName: \"kubernetes.io/projected/fa1c6ba8-e0ae-4703-9117-e390963be26d-kube-api-access-dhtbd\") pod \"openshift-lws-operator-fd8ccff4c-c2m4b\" (UID: \"fa1c6ba8-e0ae-4703-9117-e390963be26d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c2m4b"
Sep 15 11:41:28.509387 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:28.509316    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c2m4b"
Sep 15 11:41:28.798754 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:28.798686    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c2m4b"]
Sep 15 11:41:28.800771 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:41:28.800743    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa1c6ba8_e0ae_4703_9117_e390963be26d.slice/crio-f792104795bea3612dfc7779f36547d6d88cb1d4773098b31bb881cf89aa8e36 WatchSource:0}: Error finding container f792104795bea3612dfc7779f36547d6d88cb1d4773098b31bb881cf89aa8e36: Status 404 returned error can't find the container with id f792104795bea3612dfc7779f36547d6d88cb1d4773098b31bb881cf89aa8e36
Sep 15 11:41:28.931141 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:28.931101    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c2m4b" event={"ID":"fa1c6ba8-e0ae-4703-9117-e390963be26d","Type":"ContainerStarted","Data":"f792104795bea3612dfc7779f36547d6d88cb1d4773098b31bb881cf89aa8e36"}
Sep 15 11:41:31.945755 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:31.945711    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c2m4b" event={"ID":"fa1c6ba8-e0ae-4703-9117-e390963be26d","Type":"ContainerStarted","Data":"d93634da7944b113b84a6b3828a6b712aeea4995492b99ab925660fbdb137e4b"}
Sep 15 11:41:31.964810 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:31.964750    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c2m4b" podStartSLOduration=1.6886659480000001 podStartE2EDuration="3.964730263s" totalImagesPullingTime="2.276064315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:41:31.962247527 +0000 UTC m=+268.679121736" watchObservedRunningTime="2026-09-15 11:41:31.964730263 +0000 UTC m=+268.681604449"
Sep 15 11:41:35.983709 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:35.983676    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k"]
Sep 15 11:41:35.985975 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:35.985960    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k"
Sep 15 11:41:35.988708 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:35.988681    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 11:41:35.988841 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:35.988780    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 11:41:35.989887 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:35.989868    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hgd6q\""
Sep 15 11:41:35.996665 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:35.996644    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k"]
Sep 15 11:41:36.071532 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:36.071506    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6wfw\" (UniqueName: \"kubernetes.io/projected/c7c69cdc-a363-45cb-a730-76f96816ca22-kube-api-access-f6wfw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k\" (UID: \"c7c69cdc-a363-45cb-a730-76f96816ca22\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k"
Sep 15 11:41:36.071675 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:36.071543    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7c69cdc-a363-45cb-a730-76f96816ca22-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k\" (UID: \"c7c69cdc-a363-45cb-a730-76f96816ca22\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k"
Sep 15 11:41:36.071675 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:36.071571    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7c69cdc-a363-45cb-a730-76f96816ca22-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k\" (UID: \"c7c69cdc-a363-45cb-a730-76f96816ca22\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k"
Sep 15 11:41:36.172472 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:36.172431    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7c69cdc-a363-45cb-a730-76f96816ca22-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k\" (UID: \"c7c69cdc-a363-45cb-a730-76f96816ca22\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k"
Sep 15 11:41:36.172658 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:36.172484    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7c69cdc-a363-45cb-a730-76f96816ca22-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k\" (UID: \"c7c69cdc-a363-45cb-a730-76f96816ca22\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k"
Sep 15 11:41:36.172658 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:36.172529    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6wfw\" (UniqueName: \"kubernetes.io/projected/c7c69cdc-a363-45cb-a730-76f96816ca22-kube-api-access-f6wfw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k\" (UID: \"c7c69cdc-a363-45cb-a730-76f96816ca22\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k"
Sep 15 11:41:36.172833 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:36.172811    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7c69cdc-a363-45cb-a730-76f96816ca22-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k\" (UID: \"c7c69cdc-a363-45cb-a730-76f96816ca22\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k"
Sep 15 11:41:36.172905 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:36.172864    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7c69cdc-a363-45cb-a730-76f96816ca22-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k\" (UID: \"c7c69cdc-a363-45cb-a730-76f96816ca22\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k"
Sep 15 11:41:36.182308 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:36.182286    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6wfw\" (UniqueName: \"kubernetes.io/projected/c7c69cdc-a363-45cb-a730-76f96816ca22-kube-api-access-f6wfw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k\" (UID: \"c7c69cdc-a363-45cb-a730-76f96816ca22\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k"
Sep 15 11:41:36.295513 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:36.295419    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k"
Sep 15 11:41:36.564787 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:36.564708    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k"]
Sep 15 11:41:36.566892 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:41:36.566864    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7c69cdc_a363_45cb_a730_76f96816ca22.slice/crio-8b49515bd84ce4fe0f488df391fb2647264eb616e42c0e169ee0d8a4446b1313 WatchSource:0}: Error finding container 8b49515bd84ce4fe0f488df391fb2647264eb616e42c0e169ee0d8a4446b1313: Status 404 returned error can't find the container with id 8b49515bd84ce4fe0f488df391fb2647264eb616e42c0e169ee0d8a4446b1313
Sep 15 11:41:36.971027 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:36.970932    2564 generic.go:356] "Generic (PLEG): container finished" podID="c7c69cdc-a363-45cb-a730-76f96816ca22" containerID="57468a04be8660d8359ffb2112f461ae5e7cbe0c82b4e473ae892b971ec96d6d" exitCode=0
Sep 15 11:41:36.971200 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:36.971016    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k" event={"ID":"c7c69cdc-a363-45cb-a730-76f96816ca22","Type":"ContainerDied","Data":"57468a04be8660d8359ffb2112f461ae5e7cbe0c82b4e473ae892b971ec96d6d"}
Sep 15 11:41:36.971200 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:36.971091    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k" event={"ID":"c7c69cdc-a363-45cb-a730-76f96816ca22","Type":"ContainerStarted","Data":"8b49515bd84ce4fe0f488df391fb2647264eb616e42c0e169ee0d8a4446b1313"}
Sep 15 11:41:37.977047 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:37.976958    2564 generic.go:356] "Generic (PLEG): container finished" podID="c7c69cdc-a363-45cb-a730-76f96816ca22" containerID="17c85a124c7eba488cb3a83a9eb9a739d288017ff78e067a2d8e9a055783f59a" exitCode=0
Sep 15 11:41:37.977047 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:37.977000    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k" event={"ID":"c7c69cdc-a363-45cb-a730-76f96816ca22","Type":"ContainerDied","Data":"17c85a124c7eba488cb3a83a9eb9a739d288017ff78e067a2d8e9a055783f59a"}
Sep 15 11:41:38.983639 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:38.983608    2564 generic.go:356] "Generic (PLEG): container finished" podID="c7c69cdc-a363-45cb-a730-76f96816ca22" containerID="76cb8f872d1c7e7df705f4a4e62051e1c4a97e29764d640fd4d1b77d9644a378" exitCode=0
Sep 15 11:41:38.984125 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:38.983680    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k" event={"ID":"c7c69cdc-a363-45cb-a730-76f96816ca22","Type":"ContainerDied","Data":"76cb8f872d1c7e7df705f4a4e62051e1c4a97e29764d640fd4d1b77d9644a378"}
Sep 15 11:41:40.112775 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:40.112750    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k"
Sep 15 11:41:40.199923 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:40.199892    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7c69cdc-a363-45cb-a730-76f96816ca22-bundle\") pod \"c7c69cdc-a363-45cb-a730-76f96816ca22\" (UID: \"c7c69cdc-a363-45cb-a730-76f96816ca22\") "
Sep 15 11:41:40.200093 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:40.199941    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6wfw\" (UniqueName: \"kubernetes.io/projected/c7c69cdc-a363-45cb-a730-76f96816ca22-kube-api-access-f6wfw\") pod \"c7c69cdc-a363-45cb-a730-76f96816ca22\" (UID: \"c7c69cdc-a363-45cb-a730-76f96816ca22\") "
Sep 15 11:41:40.200093 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:40.199981    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7c69cdc-a363-45cb-a730-76f96816ca22-util\") pod \"c7c69cdc-a363-45cb-a730-76f96816ca22\" (UID: \"c7c69cdc-a363-45cb-a730-76f96816ca22\") "
Sep 15 11:41:40.200652 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:40.200624    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7c69cdc-a363-45cb-a730-76f96816ca22-bundle" (OuterVolumeSpecName: "bundle") pod "c7c69cdc-a363-45cb-a730-76f96816ca22" (UID: "c7c69cdc-a363-45cb-a730-76f96816ca22"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:40.202043 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:40.202014    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7c69cdc-a363-45cb-a730-76f96816ca22-kube-api-access-f6wfw" (OuterVolumeSpecName: "kube-api-access-f6wfw") pod "c7c69cdc-a363-45cb-a730-76f96816ca22" (UID: "c7c69cdc-a363-45cb-a730-76f96816ca22"). InnerVolumeSpecName "kube-api-access-f6wfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:41:40.205658 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:40.205635    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7c69cdc-a363-45cb-a730-76f96816ca22-util" (OuterVolumeSpecName: "util") pod "c7c69cdc-a363-45cb-a730-76f96816ca22" (UID: "c7c69cdc-a363-45cb-a730-76f96816ca22"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:40.300671 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:40.300609    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7c69cdc-a363-45cb-a730-76f96816ca22-util\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:41:40.300671 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:40.300636    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7c69cdc-a363-45cb-a730-76f96816ca22-bundle\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:41:40.300671 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:40.300646    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6wfw\" (UniqueName: \"kubernetes.io/projected/c7c69cdc-a363-45cb-a730-76f96816ca22-kube-api-access-f6wfw\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:41:40.994562 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:40.994534    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k"
Sep 15 11:41:40.994712 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:40.994533    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72r7k" event={"ID":"c7c69cdc-a363-45cb-a730-76f96816ca22","Type":"ContainerDied","Data":"8b49515bd84ce4fe0f488df391fb2647264eb616e42c0e169ee0d8a4446b1313"}
Sep 15 11:41:40.994712 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:40.994661    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b49515bd84ce4fe0f488df391fb2647264eb616e42c0e169ee0d8a4446b1313"
Sep 15 11:41:45.185924 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.185891    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7"]
Sep 15 11:41:45.186304 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.186132    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7c69cdc-a363-45cb-a730-76f96816ca22" containerName="pull"
Sep 15 11:41:45.186304 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.186143    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7c69cdc-a363-45cb-a730-76f96816ca22" containerName="pull"
Sep 15 11:41:45.186304 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.186160    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7c69cdc-a363-45cb-a730-76f96816ca22" containerName="util"
Sep 15 11:41:45.186304 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.186166    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7c69cdc-a363-45cb-a730-76f96816ca22" containerName="util"
Sep 15 11:41:45.186304 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.186172    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7c69cdc-a363-45cb-a730-76f96816ca22" containerName="extract"
Sep 15 11:41:45.186304 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.186177    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7c69cdc-a363-45cb-a730-76f96816ca22" containerName="extract"
Sep 15 11:41:45.186304 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.186229    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7c69cdc-a363-45cb-a730-76f96816ca22" containerName="extract"
Sep 15 11:41:45.191816 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.191796    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7"
Sep 15 11:41:45.194381 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.194359    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 11:41:45.194381 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.194369    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 11:41:45.194547 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.194469    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hgd6q\""
Sep 15 11:41:45.197512 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.197487    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7"]
Sep 15 11:41:45.236117 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.236084    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rhb5\" (UniqueName: \"kubernetes.io/projected/37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7-kube-api-access-6rhb5\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7\" (UID: \"37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7"
Sep 15 11:41:45.236282 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.236137    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7\" (UID: \"37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7"
Sep 15 11:41:45.236282 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.236223    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7\" (UID: \"37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7"
Sep 15 11:41:45.337496 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.337460    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rhb5\" (UniqueName: \"kubernetes.io/projected/37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7-kube-api-access-6rhb5\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7\" (UID: \"37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7"
Sep 15 11:41:45.337649 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.337512    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7\" (UID: \"37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7"
Sep 15 11:41:45.337649 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.337552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7\" (UID: \"37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7"
Sep 15 11:41:45.337945 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.337922    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7\" (UID: \"37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7"
Sep 15 11:41:45.337981 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.337948    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7\" (UID: \"37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7"
Sep 15 11:41:45.345660 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.345629    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rhb5\" (UniqueName: \"kubernetes.io/projected/37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7-kube-api-access-6rhb5\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7\" (UID: \"37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7"
Sep 15 11:41:45.501519 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.501434    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7"
Sep 15 11:41:45.772563 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:45.772487    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7"]
Sep 15 11:41:45.775251 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:41:45.775217    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e7282e_7c6f_4ed8_b95d_655b3e2ba0e7.slice/crio-b23268864e605b4018806896d4bce4f4307c8cebe2f3af0ecec1e2308bbfd349 WatchSource:0}: Error finding container b23268864e605b4018806896d4bce4f4307c8cebe2f3af0ecec1e2308bbfd349: Status 404 returned error can't find the container with id b23268864e605b4018806896d4bce4f4307c8cebe2f3af0ecec1e2308bbfd349
Sep 15 11:41:46.015157 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:46.015118    2564 generic.go:356] "Generic (PLEG): container finished" podID="37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7" containerID="ade9d524e149a123553bef32509a5bf31a75395a4a17a5735ed36baeddfc4225" exitCode=0
Sep 15 11:41:46.015348 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:46.015211    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7" event={"ID":"37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7","Type":"ContainerDied","Data":"ade9d524e149a123553bef32509a5bf31a75395a4a17a5735ed36baeddfc4225"}
Sep 15 11:41:46.015348 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:46.015270    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7" event={"ID":"37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7","Type":"ContainerStarted","Data":"b23268864e605b4018806896d4bce4f4307c8cebe2f3af0ecec1e2308bbfd349"}
Sep 15 11:41:47.021276 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.021186    2564 generic.go:356] "Generic (PLEG): container finished" podID="37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7" containerID="471484f6fda4ff1f0ca114aa83f1495b3af173ea2790f78d7f25a40b31d34905" exitCode=0
Sep 15 11:41:47.021716 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.021292    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7" event={"ID":"37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7","Type":"ContainerDied","Data":"471484f6fda4ff1f0ca114aa83f1495b3af173ea2790f78d7f25a40b31d34905"}
Sep 15 11:41:47.322130 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.322095    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5"]
Sep 15 11:41:47.325714 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.325693    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5"
Sep 15 11:41:47.329415 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.329391    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 15 11:41:47.329548 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.329496    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 15 11:41:47.329616 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.329544    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cpjxd\""
Sep 15 11:41:47.329745 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.329729    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 15 11:41:47.329878 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.329859    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 15 11:41:47.358334 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.358310    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5"]
Sep 15 11:41:47.455996 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.455966    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/050dd032-d747-420a-a6cc-000e17a82e06-tmp\") pod \"opendatahub-operator-controller-manager-74bdb8b799-q8pl5\" (UID: \"050dd032-d747-420a-a6cc-000e17a82e06\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5"
Sep 15 11:41:47.455996 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.455998    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/050dd032-d747-420a-a6cc-000e17a82e06-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74bdb8b799-q8pl5\" (UID: \"050dd032-d747-420a-a6cc-000e17a82e06\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5"
Sep 15 11:41:47.456201 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.456016    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwps6\" (UniqueName: \"kubernetes.io/projected/050dd032-d747-420a-a6cc-000e17a82e06-kube-api-access-lwps6\") pod \"opendatahub-operator-controller-manager-74bdb8b799-q8pl5\" (UID: \"050dd032-d747-420a-a6cc-000e17a82e06\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5"
Sep 15 11:41:47.456201 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.456063    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/050dd032-d747-420a-a6cc-000e17a82e06-manifests\") pod \"opendatahub-operator-controller-manager-74bdb8b799-q8pl5\" (UID: \"050dd032-d747-420a-a6cc-000e17a82e06\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5"
Sep 15 11:41:47.456201 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.456129    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/050dd032-d747-420a-a6cc-000e17a82e06-webhook-cert\") pod \"opendatahub-operator-controller-manager-74bdb8b799-q8pl5\" (UID: \"050dd032-d747-420a-a6cc-000e17a82e06\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5"
Sep 15 11:41:47.557348 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.557305    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/050dd032-d747-420a-a6cc-000e17a82e06-webhook-cert\") pod \"opendatahub-operator-controller-manager-74bdb8b799-q8pl5\" (UID: \"050dd032-d747-420a-a6cc-000e17a82e06\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5"
Sep 15 11:41:47.557530 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.557380    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/050dd032-d747-420a-a6cc-000e17a82e06-tmp\") pod \"opendatahub-operator-controller-manager-74bdb8b799-q8pl5\" (UID: \"050dd032-d747-420a-a6cc-000e17a82e06\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5"
Sep 15 11:41:47.557530 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.557407    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/050dd032-d747-420a-a6cc-000e17a82e06-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74bdb8b799-q8pl5\" (UID: \"050dd032-d747-420a-a6cc-000e17a82e06\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5"
Sep 15 11:41:47.557530 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.557430    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwps6\" (UniqueName: \"kubernetes.io/projected/050dd032-d747-420a-a6cc-000e17a82e06-kube-api-access-lwps6\") pod \"opendatahub-operator-controller-manager-74bdb8b799-q8pl5\" (UID: \"050dd032-d747-420a-a6cc-000e17a82e06\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5"
Sep 15 11:41:47.557530 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.557460    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/050dd032-d747-420a-a6cc-000e17a82e06-manifests\") pod \"opendatahub-operator-controller-manager-74bdb8b799-q8pl5\" (UID: \"050dd032-d747-420a-a6cc-000e17a82e06\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5"
Sep 15 11:41:47.557858 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.557834    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/050dd032-d747-420a-a6cc-000e17a82e06-manifests\") pod \"opendatahub-operator-controller-manager-74bdb8b799-q8pl5\" (UID: \"050dd032-d747-420a-a6cc-000e17a82e06\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5"
Sep 15 11:41:47.559743 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.559715    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/050dd032-d747-420a-a6cc-000e17a82e06-tmp\") pod \"opendatahub-operator-controller-manager-74bdb8b799-q8pl5\" (UID: \"050dd032-d747-420a-a6cc-000e17a82e06\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5"
Sep 15 11:41:47.559899 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.559884    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/050dd032-d747-420a-a6cc-000e17a82e06-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74bdb8b799-q8pl5\" (UID: \"050dd032-d747-420a-a6cc-000e17a82e06\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5"
Sep 15 11:41:47.559980 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.559921    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/050dd032-d747-420a-a6cc-000e17a82e06-webhook-cert\") pod \"opendatahub-operator-controller-manager-74bdb8b799-q8pl5\" (UID: \"050dd032-d747-420a-a6cc-000e17a82e06\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5"
Sep 15 11:41:47.567048 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.567026    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwps6\" (UniqueName: \"kubernetes.io/projected/050dd032-d747-420a-a6cc-000e17a82e06-kube-api-access-lwps6\") pod \"opendatahub-operator-controller-manager-74bdb8b799-q8pl5\" (UID: \"050dd032-d747-420a-a6cc-000e17a82e06\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5"
Sep 15 11:41:47.635398 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.635325    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5"
Sep 15 11:41:47.914631 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:47.914606    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5"]
Sep 15 11:41:47.916891 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:41:47.916865    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod050dd032_d747_420a_a6cc_000e17a82e06.slice/crio-67bba3472dcc870d0a831cf85ab89225569d4a6a3b3bba266a9b4aac08a50a50 WatchSource:0}: Error finding container 67bba3472dcc870d0a831cf85ab89225569d4a6a3b3bba266a9b4aac08a50a50: Status 404 returned error can't find the container with id 67bba3472dcc870d0a831cf85ab89225569d4a6a3b3bba266a9b4aac08a50a50
Sep 15 11:41:48.027836 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:48.027795    2564 generic.go:356] "Generic (PLEG): container finished" podID="37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7" containerID="e329fab0232ff725ccd10f1a98f9066e36bdeb04954040d9b16e8b1a6e98d61e" exitCode=0
Sep 15 11:41:48.028284 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:48.027874    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7" event={"ID":"37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7","Type":"ContainerDied","Data":"e329fab0232ff725ccd10f1a98f9066e36bdeb04954040d9b16e8b1a6e98d61e"}
Sep 15 11:41:48.029361 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:48.029337    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5" event={"ID":"050dd032-d747-420a-a6cc-000e17a82e06","Type":"ContainerStarted","Data":"67bba3472dcc870d0a831cf85ab89225569d4a6a3b3bba266a9b4aac08a50a50"}
Sep 15 11:41:49.197632 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:49.197607    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7"
Sep 15 11:41:49.270951 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:49.270914    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7-bundle\") pod \"37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7\" (UID: \"37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7\") "
Sep 15 11:41:49.271106 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:49.271023    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rhb5\" (UniqueName: \"kubernetes.io/projected/37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7-kube-api-access-6rhb5\") pod \"37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7\" (UID: \"37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7\") "
Sep 15 11:41:49.271106 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:49.271071    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7-util\") pod \"37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7\" (UID: \"37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7\") "
Sep 15 11:41:49.271792 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:49.271751    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7-bundle" (OuterVolumeSpecName: "bundle") pod "37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7" (UID: "37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:49.273662 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:49.273629    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7-kube-api-access-6rhb5" (OuterVolumeSpecName: "kube-api-access-6rhb5") pod "37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7" (UID: "37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7"). InnerVolumeSpecName "kube-api-access-6rhb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:41:49.279988 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:49.279962    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7-util" (OuterVolumeSpecName: "util") pod "37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7" (UID: "37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:49.372182 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:49.372142    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7-bundle\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:41:49.372182 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:49.372179    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rhb5\" (UniqueName: \"kubernetes.io/projected/37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7-kube-api-access-6rhb5\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:41:49.372182 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:49.372190    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7-util\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:41:50.042506 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:50.042414    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7" event={"ID":"37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7","Type":"ContainerDied","Data":"b23268864e605b4018806896d4bce4f4307c8cebe2f3af0ecec1e2308bbfd349"}
Sep 15 11:41:50.042506 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:50.042434    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02h4r7"
Sep 15 11:41:50.042506 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:50.042464    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b23268864e605b4018806896d4bce4f4307c8cebe2f3af0ecec1e2308bbfd349"
Sep 15 11:41:51.047608 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:51.047577    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5" event={"ID":"050dd032-d747-420a-a6cc-000e17a82e06","Type":"ContainerStarted","Data":"f7038bc7c8601bf272745f184eab9fe45cb7066f7ae52256cb5f34e76d446184"}
Sep 15 11:41:53.057864 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:53.057834    2564 generic.go:356] "Generic (PLEG): container finished" podID="050dd032-d747-420a-a6cc-000e17a82e06" containerID="f7038bc7c8601bf272745f184eab9fe45cb7066f7ae52256cb5f34e76d446184" exitCode=0
Sep 15 11:41:53.058221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:53.057881    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5" event={"ID":"050dd032-d747-420a-a6cc-000e17a82e06","Type":"ContainerDied","Data":"f7038bc7c8601bf272745f184eab9fe45cb7066f7ae52256cb5f34e76d446184"}
Sep 15 11:41:54.063468 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:54.063432    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5" event={"ID":"050dd032-d747-420a-a6cc-000e17a82e06","Type":"ContainerStarted","Data":"07936231997f2459a36aabf8a679b264ddb055fdd78b6314f12a372ecba16101"}
Sep 15 11:41:54.063858 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:54.063636    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5"
Sep 15 11:41:54.089475 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:41:54.089428    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5" podStartSLOduration=2.673388218 podStartE2EDuration="7.089415676s" totalImagesPullingTime="3.387048581s" totalInitContainerRuntime="1.028978877s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:41:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:41:54.087294701 +0000 UTC m=+290.804168884" watchObservedRunningTime="2026-09-15 11:41:54.089415676 +0000 UTC m=+290.806289859"
Sep 15 11:42:03.703883 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:03.703855    2564 kubelet.go:1648] "Image garbage collection succeeded"
Sep 15 11:42:05.069992 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:05.069962    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-q8pl5"
Sep 15 11:42:06.887029 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:06.886987    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-687d9c5d49-wjrp4"]
Sep 15 11:42:06.887488 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:06.887385    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7" containerName="extract"
Sep 15 11:42:06.887488 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:06.887400    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7" containerName="extract"
Sep 15 11:42:06.887488 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:06.887410    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7" containerName="pull"
Sep 15 11:42:06.887488 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:06.887415    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7" containerName="pull"
Sep 15 11:42:06.887488 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:06.887425    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7" containerName="util"
Sep 15 11:42:06.887488 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:06.887430    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7" containerName="util"
Sep 15 11:42:06.887488 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:06.887478    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="37e7282e-7c6f-4ed8-b95d-655b3e2ba0e7" containerName="extract"
Sep 15 11:42:06.896602 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:06.896583    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-687d9c5d49-wjrp4"
Sep 15 11:42:06.900308 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:06.900256    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 15 11:42:06.900308 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:06.900285    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dk24m\""
Sep 15 11:42:06.900474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:06.900314    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 15 11:42:06.900474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:06.900348    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 15 11:42:06.900474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:06.900286    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 15 11:42:06.904316 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:06.904285    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-687d9c5d49-wjrp4"]
Sep 15 11:42:07.001135 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:07.001105    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0eb32797-63a5-46e2-a2ff-ef5edaadfbd6-tls-certs\") pod \"kube-auth-proxy-687d9c5d49-wjrp4\" (UID: \"0eb32797-63a5-46e2-a2ff-ef5edaadfbd6\") " pod="openshift-ingress/kube-auth-proxy-687d9c5d49-wjrp4"
Sep 15 11:42:07.001135 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:07.001140    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0eb32797-63a5-46e2-a2ff-ef5edaadfbd6-tmp\") pod \"kube-auth-proxy-687d9c5d49-wjrp4\" (UID: \"0eb32797-63a5-46e2-a2ff-ef5edaadfbd6\") " pod="openshift-ingress/kube-auth-proxy-687d9c5d49-wjrp4"
Sep 15 11:42:07.001348 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:07.001163    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fdpg\" (UniqueName: \"kubernetes.io/projected/0eb32797-63a5-46e2-a2ff-ef5edaadfbd6-kube-api-access-6fdpg\") pod \"kube-auth-proxy-687d9c5d49-wjrp4\" (UID: \"0eb32797-63a5-46e2-a2ff-ef5edaadfbd6\") " pod="openshift-ingress/kube-auth-proxy-687d9c5d49-wjrp4"
Sep 15 11:42:07.101939 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:07.101908    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0eb32797-63a5-46e2-a2ff-ef5edaadfbd6-tls-certs\") pod \"kube-auth-proxy-687d9c5d49-wjrp4\" (UID: \"0eb32797-63a5-46e2-a2ff-ef5edaadfbd6\") " pod="openshift-ingress/kube-auth-proxy-687d9c5d49-wjrp4"
Sep 15 11:42:07.102063 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:07.101948    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0eb32797-63a5-46e2-a2ff-ef5edaadfbd6-tmp\") pod \"kube-auth-proxy-687d9c5d49-wjrp4\" (UID: \"0eb32797-63a5-46e2-a2ff-ef5edaadfbd6\") " pod="openshift-ingress/kube-auth-proxy-687d9c5d49-wjrp4"
Sep 15 11:42:07.102063 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:07.101986    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fdpg\" (UniqueName: \"kubernetes.io/projected/0eb32797-63a5-46e2-a2ff-ef5edaadfbd6-kube-api-access-6fdpg\") pod \"kube-auth-proxy-687d9c5d49-wjrp4\" (UID: \"0eb32797-63a5-46e2-a2ff-ef5edaadfbd6\") " pod="openshift-ingress/kube-auth-proxy-687d9c5d49-wjrp4"
Sep 15 11:42:07.104331 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:07.104305    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0eb32797-63a5-46e2-a2ff-ef5edaadfbd6-tmp\") pod \"kube-auth-proxy-687d9c5d49-wjrp4\" (UID: \"0eb32797-63a5-46e2-a2ff-ef5edaadfbd6\") " pod="openshift-ingress/kube-auth-proxy-687d9c5d49-wjrp4"
Sep 15 11:42:07.104493 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:07.104478    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0eb32797-63a5-46e2-a2ff-ef5edaadfbd6-tls-certs\") pod \"kube-auth-proxy-687d9c5d49-wjrp4\" (UID: \"0eb32797-63a5-46e2-a2ff-ef5edaadfbd6\") " pod="openshift-ingress/kube-auth-proxy-687d9c5d49-wjrp4"
Sep 15 11:42:07.115361 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:07.115331    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fdpg\" (UniqueName: \"kubernetes.io/projected/0eb32797-63a5-46e2-a2ff-ef5edaadfbd6-kube-api-access-6fdpg\") pod \"kube-auth-proxy-687d9c5d49-wjrp4\" (UID: \"0eb32797-63a5-46e2-a2ff-ef5edaadfbd6\") " pod="openshift-ingress/kube-auth-proxy-687d9c5d49-wjrp4"
Sep 15 11:42:07.206582 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:07.206497    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-687d9c5d49-wjrp4"
Sep 15 11:42:07.477605 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:07.477575    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-687d9c5d49-wjrp4"]
Sep 15 11:42:07.479983 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:42:07.479950    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb32797_63a5_46e2_a2ff_ef5edaadfbd6.slice/crio-bed89a03beece81b7a68efa06bb432bb6027d7840edba0d8058f54f9c0a67c1d WatchSource:0}: Error finding container bed89a03beece81b7a68efa06bb432bb6027d7840edba0d8058f54f9c0a67c1d: Status 404 returned error can't find the container with id bed89a03beece81b7a68efa06bb432bb6027d7840edba0d8058f54f9c0a67c1d
Sep 15 11:42:07.481907 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:07.481888    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:42:08.124453 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:08.124405    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-687d9c5d49-wjrp4" event={"ID":"0eb32797-63a5-46e2-a2ff-ef5edaadfbd6","Type":"ContainerStarted","Data":"bed89a03beece81b7a68efa06bb432bb6027d7840edba0d8058f54f9c0a67c1d"}
Sep 15 11:42:11.139331 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:11.139293    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-687d9c5d49-wjrp4" event={"ID":"0eb32797-63a5-46e2-a2ff-ef5edaadfbd6","Type":"ContainerStarted","Data":"1f90e1735cd47e87f54f0b379befc0410b285811d880a8593a60f9369b3167f0"}
Sep 15 11:42:11.155834 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:11.155790    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-687d9c5d49-wjrp4" podStartSLOduration=2.450686462 podStartE2EDuration="5.155775511s" totalImagesPullingTime="2.705089049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:42:11.155171879 +0000 UTC m=+307.872046064" watchObservedRunningTime="2026-09-15 11:42:11.155775511 +0000 UTC m=+307.872649695"
Sep 15 11:42:14.236548 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.236514    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"]
Sep 15 11:42:14.240443 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.240419    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.243101 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.243079    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 15 11:42:14.243101 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.243095    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-cpl9b\""
Sep 15 11:42:14.254159 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.254132    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"]
Sep 15 11:42:14.358345 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.358308    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33915edd-25ec-409a-8fb6-b72807523c29-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.358345 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.358343    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33915edd-25ec-409a-8fb6-b72807523c29-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.358539 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.358361    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33915edd-25ec-409a-8fb6-b72807523c29-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.358539 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.358381    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g775l\" (UniqueName: \"kubernetes.io/projected/33915edd-25ec-409a-8fb6-b72807523c29-kube-api-access-g775l\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.358539 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.358454    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33915edd-25ec-409a-8fb6-b72807523c29-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.358539 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.358499    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33915edd-25ec-409a-8fb6-b72807523c29-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.358539 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.358523    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33915edd-25ec-409a-8fb6-b72807523c29-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.358738 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.358587    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33915edd-25ec-409a-8fb6-b72807523c29-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.358738 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.358619    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33915edd-25ec-409a-8fb6-b72807523c29-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.459192 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.459152    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33915edd-25ec-409a-8fb6-b72807523c29-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.459192 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.459192    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33915edd-25ec-409a-8fb6-b72807523c29-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.459461 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.459221    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g775l\" (UniqueName: \"kubernetes.io/projected/33915edd-25ec-409a-8fb6-b72807523c29-kube-api-access-g775l\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.459461 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.459258    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33915edd-25ec-409a-8fb6-b72807523c29-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.459461 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.459316    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33915edd-25ec-409a-8fb6-b72807523c29-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.459461 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.459343    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33915edd-25ec-409a-8fb6-b72807523c29-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.459461 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.459374    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33915edd-25ec-409a-8fb6-b72807523c29-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.459461 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.459401    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33915edd-25ec-409a-8fb6-b72807523c29-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.459749 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.459471    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33915edd-25ec-409a-8fb6-b72807523c29-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.459749 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.459725    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33915edd-25ec-409a-8fb6-b72807523c29-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.459845 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.459750    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33915edd-25ec-409a-8fb6-b72807523c29-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.459845 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.459780    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33915edd-25ec-409a-8fb6-b72807523c29-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.459987 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.459966    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33915edd-25ec-409a-8fb6-b72807523c29-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.460292 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.460248    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33915edd-25ec-409a-8fb6-b72807523c29-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.461743 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.461710    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33915edd-25ec-409a-8fb6-b72807523c29-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.461829 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.461798    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33915edd-25ec-409a-8fb6-b72807523c29-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.468044 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.468007    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g775l\" (UniqueName: \"kubernetes.io/projected/33915edd-25ec-409a-8fb6-b72807523c29-kube-api-access-g775l\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.468218 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.468199    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33915edd-25ec-409a-8fb6-b72807523c29-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4\" (UID: \"33915edd-25ec-409a-8fb6-b72807523c29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.550638 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.550562    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:14.826434 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:14.826403    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"]
Sep 15 11:42:14.828925 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:42:14.828898    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33915edd_25ec_409a_8fb6_b72807523c29.slice/crio-929002e67c3bfc50148e45fa1c0ed6314826528577aa174586b0709354cb3654 WatchSource:0}: Error finding container 929002e67c3bfc50148e45fa1c0ed6314826528577aa174586b0709354cb3654: Status 404 returned error can't find the container with id 929002e67c3bfc50148e45fa1c0ed6314826528577aa174586b0709354cb3654
Sep 15 11:42:15.156280 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:15.156182    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4" event={"ID":"33915edd-25ec-409a-8fb6-b72807523c29","Type":"ContainerStarted","Data":"929002e67c3bfc50148e45fa1c0ed6314826528577aa174586b0709354cb3654"}
Sep 15 11:42:17.725136 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:17.725099    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lh6zp"]
Sep 15 11:42:17.732298 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:17.732123    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lh6zp"
Sep 15 11:42:17.736888 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:17.736367    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 15 11:42:17.736888 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:17.736435    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-h7qwk\""
Sep 15 11:42:17.737705 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:17.737679    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lh6zp"]
Sep 15 11:42:17.890511 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:17.890473    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/820182cd-1a7b-40b1-b5de-f7d7f94b798c-cert\") pod \"odh-model-controller-7998c67dc4-lh6zp\" (UID: \"820182cd-1a7b-40b1-b5de-f7d7f94b798c\") " pod="opendatahub/odh-model-controller-7998c67dc4-lh6zp"
Sep 15 11:42:17.890689 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:17.890526    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c765c\" (UniqueName: \"kubernetes.io/projected/820182cd-1a7b-40b1-b5de-f7d7f94b798c-kube-api-access-c765c\") pod \"odh-model-controller-7998c67dc4-lh6zp\" (UID: \"820182cd-1a7b-40b1-b5de-f7d7f94b798c\") " pod="opendatahub/odh-model-controller-7998c67dc4-lh6zp"
Sep 15 11:42:17.992033 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:17.991941    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/820182cd-1a7b-40b1-b5de-f7d7f94b798c-cert\") pod \"odh-model-controller-7998c67dc4-lh6zp\" (UID: \"820182cd-1a7b-40b1-b5de-f7d7f94b798c\") " pod="opendatahub/odh-model-controller-7998c67dc4-lh6zp"
Sep 15 11:42:17.992033 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:17.992003    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c765c\" (UniqueName: \"kubernetes.io/projected/820182cd-1a7b-40b1-b5de-f7d7f94b798c-kube-api-access-c765c\") pod \"odh-model-controller-7998c67dc4-lh6zp\" (UID: \"820182cd-1a7b-40b1-b5de-f7d7f94b798c\") " pod="opendatahub/odh-model-controller-7998c67dc4-lh6zp"
Sep 15 11:42:17.994980 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:17.994949    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/820182cd-1a7b-40b1-b5de-f7d7f94b798c-cert\") pod \"odh-model-controller-7998c67dc4-lh6zp\" (UID: \"820182cd-1a7b-40b1-b5de-f7d7f94b798c\") " pod="opendatahub/odh-model-controller-7998c67dc4-lh6zp"
Sep 15 11:42:18.002061 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:18.002034    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c765c\" (UniqueName: \"kubernetes.io/projected/820182cd-1a7b-40b1-b5de-f7d7f94b798c-kube-api-access-c765c\") pod \"odh-model-controller-7998c67dc4-lh6zp\" (UID: \"820182cd-1a7b-40b1-b5de-f7d7f94b798c\") " pod="opendatahub/odh-model-controller-7998c67dc4-lh6zp"
Sep 15 11:42:18.046935 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:18.046900    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lh6zp"
Sep 15 11:42:18.193150 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:18.193104    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:42:18.193249 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:18.193200    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:42:18.193325 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:18.193251    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:42:18.261778 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:18.261749    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bcbkp"]
Sep 15 11:42:18.265187 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:18.265164    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-bcbkp"
Sep 15 11:42:18.267451 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:18.267424    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 15 11:42:18.274296 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:18.274275    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bcbkp"]
Sep 15 11:42:18.377168 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:18.377132    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lh6zp"]
Sep 15 11:42:18.381307 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:42:18.381280    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod820182cd_1a7b_40b1_b5de_f7d7f94b798c.slice/crio-f7dd34176d5af9da095efded00a9001493bb2b3f262f4d98559d6358d654b914 WatchSource:0}: Error finding container f7dd34176d5af9da095efded00a9001493bb2b3f262f4d98559d6358d654b914: Status 404 returned error can't find the container with id f7dd34176d5af9da095efded00a9001493bb2b3f262f4d98559d6358d654b914
Sep 15 11:42:18.394680 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:18.394655    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szk6k\" (UniqueName: \"kubernetes.io/projected/d44225e9-8154-46c4-a23a-fac7b25977a4-kube-api-access-szk6k\") pod \"model-serving-api-54d89bd5fc-bcbkp\" (UID: \"d44225e9-8154-46c4-a23a-fac7b25977a4\") " pod="opendatahub/model-serving-api-54d89bd5fc-bcbkp"
Sep 15 11:42:18.394778 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:18.394688    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d44225e9-8154-46c4-a23a-fac7b25977a4-tls-certs\") pod \"model-serving-api-54d89bd5fc-bcbkp\" (UID: \"d44225e9-8154-46c4-a23a-fac7b25977a4\") " pod="opendatahub/model-serving-api-54d89bd5fc-bcbkp"
Sep 15 11:42:18.495781 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:18.495701    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szk6k\" (UniqueName: \"kubernetes.io/projected/d44225e9-8154-46c4-a23a-fac7b25977a4-kube-api-access-szk6k\") pod \"model-serving-api-54d89bd5fc-bcbkp\" (UID: \"d44225e9-8154-46c4-a23a-fac7b25977a4\") " pod="opendatahub/model-serving-api-54d89bd5fc-bcbkp"
Sep 15 11:42:18.495781 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:18.495741    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d44225e9-8154-46c4-a23a-fac7b25977a4-tls-certs\") pod \"model-serving-api-54d89bd5fc-bcbkp\" (UID: \"d44225e9-8154-46c4-a23a-fac7b25977a4\") " pod="opendatahub/model-serving-api-54d89bd5fc-bcbkp"
Sep 15 11:42:18.498082 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:18.498056    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d44225e9-8154-46c4-a23a-fac7b25977a4-tls-certs\") pod \"model-serving-api-54d89bd5fc-bcbkp\" (UID: \"d44225e9-8154-46c4-a23a-fac7b25977a4\") " pod="opendatahub/model-serving-api-54d89bd5fc-bcbkp"
Sep 15 11:42:18.503667 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:18.503641    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szk6k\" (UniqueName: \"kubernetes.io/projected/d44225e9-8154-46c4-a23a-fac7b25977a4-kube-api-access-szk6k\") pod \"model-serving-api-54d89bd5fc-bcbkp\" (UID: \"d44225e9-8154-46c4-a23a-fac7b25977a4\") " pod="opendatahub/model-serving-api-54d89bd5fc-bcbkp"
Sep 15 11:42:18.578552 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:18.578520    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-bcbkp"
Sep 15 11:42:18.846863 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:18.846820    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bcbkp"]
Sep 15 11:42:18.848877 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:42:18.848850    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd44225e9_8154_46c4_a23a_fac7b25977a4.slice/crio-d56917a14a7f5a71916b70390c841021f42b190b9127db73ba2c29d5d1b7440a WatchSource:0}: Error finding container d56917a14a7f5a71916b70390c841021f42b190b9127db73ba2c29d5d1b7440a: Status 404 returned error can't find the container with id d56917a14a7f5a71916b70390c841021f42b190b9127db73ba2c29d5d1b7440a
Sep 15 11:42:19.179997 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:19.179858    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lh6zp" event={"ID":"820182cd-1a7b-40b1-b5de-f7d7f94b798c","Type":"ContainerStarted","Data":"f7dd34176d5af9da095efded00a9001493bb2b3f262f4d98559d6358d654b914"}
Sep 15 11:42:19.181732 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:19.181696    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-bcbkp" event={"ID":"d44225e9-8154-46c4-a23a-fac7b25977a4","Type":"ContainerStarted","Data":"d56917a14a7f5a71916b70390c841021f42b190b9127db73ba2c29d5d1b7440a"}
Sep 15 11:42:19.183784 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:19.183755    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4" event={"ID":"33915edd-25ec-409a-8fb6-b72807523c29","Type":"ContainerStarted","Data":"5fbfdc5e371ca1e56a8bf3c752bc33563b4d845c80bef6e70a2afaf9294008cf"}
Sep 15 11:42:19.207620 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:19.207540    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4" podStartSLOduration=1.845883969 podStartE2EDuration="5.207520855s" totalImagesPullingTime="3.361636886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:42:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:42:19.204621826 +0000 UTC m=+315.921496013" watchObservedRunningTime="2026-09-15 11:42:19.207520855 +0000 UTC m=+315.924395041"
Sep 15 11:42:19.551717 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:19.551075    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:19.557769 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:19.557739    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:20.188589 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:20.188543    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:20.189705 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:20.189679    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4"
Sep 15 11:42:22.199494 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:22.199457    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lh6zp" event={"ID":"820182cd-1a7b-40b1-b5de-f7d7f94b798c","Type":"ContainerStarted","Data":"211f70bf868a406ff8ce089ab92e7dd901d157f18b9a1ff71c79ca9cf102786d"}
Sep 15 11:42:22.199947 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:22.199520    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-lh6zp"
Sep 15 11:42:22.200906 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:22.200874    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-bcbkp" event={"ID":"d44225e9-8154-46c4-a23a-fac7b25977a4","Type":"ContainerStarted","Data":"20e906a8d784f9e39b76d185476ac5811ee4b9107662ae9cba52f1577cc346d0"}
Sep 15 11:42:22.215719 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:22.215674    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-lh6zp" podStartSLOduration=2.025115772 podStartE2EDuration="5.215659189s" totalImagesPullingTime="3.190543417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:42:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:42:22.215192512 +0000 UTC m=+318.932066697" watchObservedRunningTime="2026-09-15 11:42:22.215659189 +0000 UTC m=+318.932533373"
Sep 15 11:42:22.230754 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:22.230710    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-bcbkp" podStartSLOduration=1.510046767 podStartE2EDuration="4.230698729s" totalImagesPullingTime="2.720651962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:42:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:42:22.230306502 +0000 UTC m=+318.947180686" watchObservedRunningTime="2026-09-15 11:42:22.230698729 +0000 UTC m=+318.947572925"
Sep 15 11:42:23.205459 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:23.205422    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-bcbkp"
Sep 15 11:42:24.028218 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.028183    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"]
Sep 15 11:42:24.031344 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.031329    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:24.034410 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.034393    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 15 11:42:24.034490 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.034469    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-b6dls\""
Sep 15 11:42:24.034851 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.034837    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 15 11:42:24.035176 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.035163    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 15 11:42:24.061373 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.060283    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"]
Sep 15 11:42:24.140199 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.140164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3070a8c-2f61-484e-adf8-6d0243ad51ea-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fkggk\" (UID: \"a3070a8c-2f61-484e-adf8-6d0243ad51ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:24.140199 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.140201    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw8g4\" (UniqueName: \"kubernetes.io/projected/a3070a8c-2f61-484e-adf8-6d0243ad51ea-kube-api-access-zw8g4\") pod \"istiod-openshift-gateway-5677ccb49b-fkggk\" (UID: \"a3070a8c-2f61-484e-adf8-6d0243ad51ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:24.140449 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.140222    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a3070a8c-2f61-484e-adf8-6d0243ad51ea-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fkggk\" (UID: \"a3070a8c-2f61-484e-adf8-6d0243ad51ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:24.140449 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.140348    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a3070a8c-2f61-484e-adf8-6d0243ad51ea-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fkggk\" (UID: \"a3070a8c-2f61-484e-adf8-6d0243ad51ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:24.140449 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.140381    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3070a8c-2f61-484e-adf8-6d0243ad51ea-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fkggk\" (UID: \"a3070a8c-2f61-484e-adf8-6d0243ad51ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:24.140449 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.140396    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a3070a8c-2f61-484e-adf8-6d0243ad51ea-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fkggk\" (UID: \"a3070a8c-2f61-484e-adf8-6d0243ad51ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:24.140576 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.140443    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a3070a8c-2f61-484e-adf8-6d0243ad51ea-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fkggk\" (UID: \"a3070a8c-2f61-484e-adf8-6d0243ad51ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:24.241294 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.241242    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3070a8c-2f61-484e-adf8-6d0243ad51ea-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fkggk\" (UID: \"a3070a8c-2f61-484e-adf8-6d0243ad51ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:24.241294 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.241295    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a3070a8c-2f61-484e-adf8-6d0243ad51ea-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fkggk\" (UID: \"a3070a8c-2f61-484e-adf8-6d0243ad51ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:24.241830 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.241429    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a3070a8c-2f61-484e-adf8-6d0243ad51ea-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fkggk\" (UID: \"a3070a8c-2f61-484e-adf8-6d0243ad51ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:24.241830 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.241528    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3070a8c-2f61-484e-adf8-6d0243ad51ea-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fkggk\" (UID: \"a3070a8c-2f61-484e-adf8-6d0243ad51ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:24.241830 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.241551    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw8g4\" (UniqueName: \"kubernetes.io/projected/a3070a8c-2f61-484e-adf8-6d0243ad51ea-kube-api-access-zw8g4\") pod \"istiod-openshift-gateway-5677ccb49b-fkggk\" (UID: \"a3070a8c-2f61-484e-adf8-6d0243ad51ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:24.241830 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.241568    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a3070a8c-2f61-484e-adf8-6d0243ad51ea-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fkggk\" (UID: \"a3070a8c-2f61-484e-adf8-6d0243ad51ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:24.241830 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.241606    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a3070a8c-2f61-484e-adf8-6d0243ad51ea-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fkggk\" (UID: \"a3070a8c-2f61-484e-adf8-6d0243ad51ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:24.242500 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.242469    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a3070a8c-2f61-484e-adf8-6d0243ad51ea-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fkggk\" (UID: \"a3070a8c-2f61-484e-adf8-6d0243ad51ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:24.243557 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.243526    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3070a8c-2f61-484e-adf8-6d0243ad51ea-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fkggk\" (UID: \"a3070a8c-2f61-484e-adf8-6d0243ad51ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:24.243753 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.243732    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a3070a8c-2f61-484e-adf8-6d0243ad51ea-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fkggk\" (UID: \"a3070a8c-2f61-484e-adf8-6d0243ad51ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:24.243818 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.243741    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a3070a8c-2f61-484e-adf8-6d0243ad51ea-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fkggk\" (UID: \"a3070a8c-2f61-484e-adf8-6d0243ad51ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:24.243818 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.243783    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a3070a8c-2f61-484e-adf8-6d0243ad51ea-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fkggk\" (UID: \"a3070a8c-2f61-484e-adf8-6d0243ad51ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:24.249127 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.249106    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3070a8c-2f61-484e-adf8-6d0243ad51ea-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fkggk\" (UID: \"a3070a8c-2f61-484e-adf8-6d0243ad51ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:24.249597 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.249575    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw8g4\" (UniqueName: \"kubernetes.io/projected/a3070a8c-2f61-484e-adf8-6d0243ad51ea-kube-api-access-zw8g4\") pod \"istiod-openshift-gateway-5677ccb49b-fkggk\" (UID: \"a3070a8c-2f61-484e-adf8-6d0243ad51ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:24.340395 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.340364    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:24.642197 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:24.642161    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"]
Sep 15 11:42:24.644051 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:42:24.644021    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3070a8c_2f61_484e_adf8_6d0243ad51ea.slice/crio-27b03d543dbc35e73eab46eabddc46f588cf850e1ff6fe43fb55f9ea7ef5fa1b WatchSource:0}: Error finding container 27b03d543dbc35e73eab46eabddc46f588cf850e1ff6fe43fb55f9ea7ef5fa1b: Status 404 returned error can't find the container with id 27b03d543dbc35e73eab46eabddc46f588cf850e1ff6fe43fb55f9ea7ef5fa1b
Sep 15 11:42:25.215126 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:25.215094    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk" event={"ID":"a3070a8c-2f61-484e-adf8-6d0243ad51ea","Type":"ContainerStarted","Data":"27b03d543dbc35e73eab46eabddc46f588cf850e1ff6fe43fb55f9ea7ef5fa1b"}
Sep 15 11:42:26.959563 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:26.959524    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:42:26.959974 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:26.959606    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:42:27.227328 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:27.227239    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk" event={"ID":"a3070a8c-2f61-484e-adf8-6d0243ad51ea","Type":"ContainerStarted","Data":"d70301e2f9089b8f9d21e88165950706803bada621ef424ec9b19c10523431b0"}
Sep 15 11:42:27.227518 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:27.227361    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:27.256890 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:27.256836    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk" podStartSLOduration=0.943752188 podStartE2EDuration="3.256815851s" totalImagesPullingTime="2.313063663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:42:27.255271241 +0000 UTC m=+323.972145418" watchObservedRunningTime="2026-09-15 11:42:27.256815851 +0000 UTC m=+323.973690037"
Sep 15 11:42:28.233914 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:28.233876    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkggk"
Sep 15 11:42:33.207473 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:33.207437    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-lh6zp"
Sep 15 11:42:34.213991 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:42:34.213957    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-bcbkp"
Sep 15 11:43:22.454103 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.454024    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h"]
Sep 15 11:43:22.459202 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.459185    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h"
Sep 15 11:43:22.462063 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.462038    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 11:43:22.462063 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.462061    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 11:43:22.463397 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.463377    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hgd6q\""
Sep 15 11:43:22.466547 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.466052    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h"]
Sep 15 11:43:22.556188 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.556159    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl"]
Sep 15 11:43:22.558459 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.558443    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl"
Sep 15 11:43:22.567492 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.567471    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl"]
Sep 15 11:43:22.611975 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.611951    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b66565ac-dce3-4615-898b-15dc352c2dbe-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h\" (UID: \"b66565ac-dce3-4615-898b-15dc352c2dbe\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h"
Sep 15 11:43:22.612103 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.611979    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98b2b127-12b4-4036-8b66-2e9657533393-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl\" (UID: \"98b2b127-12b4-4036-8b66-2e9657533393\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl"
Sep 15 11:43:22.612103 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.612031    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm7pb\" (UniqueName: \"kubernetes.io/projected/98b2b127-12b4-4036-8b66-2e9657533393-kube-api-access-pm7pb\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl\" (UID: \"98b2b127-12b4-4036-8b66-2e9657533393\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl"
Sep 15 11:43:22.612103 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.612049    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b66565ac-dce3-4615-898b-15dc352c2dbe-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h\" (UID: \"b66565ac-dce3-4615-898b-15dc352c2dbe\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h"
Sep 15 11:43:22.612103 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.612065    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgpfz\" (UniqueName: \"kubernetes.io/projected/b66565ac-dce3-4615-898b-15dc352c2dbe-kube-api-access-mgpfz\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h\" (UID: \"b66565ac-dce3-4615-898b-15dc352c2dbe\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h"
Sep 15 11:43:22.612103 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.612094    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98b2b127-12b4-4036-8b66-2e9657533393-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl\" (UID: \"98b2b127-12b4-4036-8b66-2e9657533393\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl"
Sep 15 11:43:22.655325 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.655299    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c"]
Sep 15 11:43:22.657539 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.657523    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c"
Sep 15 11:43:22.666440 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.666419    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c"]
Sep 15 11:43:22.712567 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.712505    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43c1cec5-e4f7-4fb3-b570-7312f1c4c09e-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c\" (UID: \"43c1cec5-e4f7-4fb3-b570-7312f1c4c09e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c"
Sep 15 11:43:22.712567 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.712536    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snkdv\" (UniqueName: \"kubernetes.io/projected/43c1cec5-e4f7-4fb3-b570-7312f1c4c09e-kube-api-access-snkdv\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c\" (UID: \"43c1cec5-e4f7-4fb3-b570-7312f1c4c09e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c"
Sep 15 11:43:22.712567 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.712564    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43c1cec5-e4f7-4fb3-b570-7312f1c4c09e-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c\" (UID: \"43c1cec5-e4f7-4fb3-b570-7312f1c4c09e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c"
Sep 15 11:43:22.712757 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.712641    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm7pb\" (UniqueName: \"kubernetes.io/projected/98b2b127-12b4-4036-8b66-2e9657533393-kube-api-access-pm7pb\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl\" (UID: \"98b2b127-12b4-4036-8b66-2e9657533393\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl"
Sep 15 11:43:22.712757 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.712668    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b66565ac-dce3-4615-898b-15dc352c2dbe-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h\" (UID: \"b66565ac-dce3-4615-898b-15dc352c2dbe\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h"
Sep 15 11:43:22.712757 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.712685    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgpfz\" (UniqueName: \"kubernetes.io/projected/b66565ac-dce3-4615-898b-15dc352c2dbe-kube-api-access-mgpfz\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h\" (UID: \"b66565ac-dce3-4615-898b-15dc352c2dbe\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h"
Sep 15 11:43:22.712757 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.712702    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98b2b127-12b4-4036-8b66-2e9657533393-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl\" (UID: \"98b2b127-12b4-4036-8b66-2e9657533393\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl"
Sep 15 11:43:22.712757 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.712742    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b66565ac-dce3-4615-898b-15dc352c2dbe-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h\" (UID: \"b66565ac-dce3-4615-898b-15dc352c2dbe\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h"
Sep 15 11:43:22.713029 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.712762    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98b2b127-12b4-4036-8b66-2e9657533393-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl\" (UID: \"98b2b127-12b4-4036-8b66-2e9657533393\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl"
Sep 15 11:43:22.713108 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.713088    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98b2b127-12b4-4036-8b66-2e9657533393-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl\" (UID: \"98b2b127-12b4-4036-8b66-2e9657533393\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl"
Sep 15 11:43:22.713154 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.713093    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b66565ac-dce3-4615-898b-15dc352c2dbe-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h\" (UID: \"b66565ac-dce3-4615-898b-15dc352c2dbe\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h"
Sep 15 11:43:22.713154 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.713128    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98b2b127-12b4-4036-8b66-2e9657533393-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl\" (UID: \"98b2b127-12b4-4036-8b66-2e9657533393\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl"
Sep 15 11:43:22.713224 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.713161    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b66565ac-dce3-4615-898b-15dc352c2dbe-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h\" (UID: \"b66565ac-dce3-4615-898b-15dc352c2dbe\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h"
Sep 15 11:43:22.720681 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.720661    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgpfz\" (UniqueName: \"kubernetes.io/projected/b66565ac-dce3-4615-898b-15dc352c2dbe-kube-api-access-mgpfz\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h\" (UID: \"b66565ac-dce3-4615-898b-15dc352c2dbe\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h"
Sep 15 11:43:22.720760 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.720737    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm7pb\" (UniqueName: \"kubernetes.io/projected/98b2b127-12b4-4036-8b66-2e9657533393-kube-api-access-pm7pb\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl\" (UID: \"98b2b127-12b4-4036-8b66-2e9657533393\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl"
Sep 15 11:43:22.750364 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.750340    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft"]
Sep 15 11:43:22.752767 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.752752    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft"
Sep 15 11:43:22.761809 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.761785    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft"]
Sep 15 11:43:22.769616 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.769595    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h"
Sep 15 11:43:22.814202 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.813973    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43c1cec5-e4f7-4fb3-b570-7312f1c4c09e-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c\" (UID: \"43c1cec5-e4f7-4fb3-b570-7312f1c4c09e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c"
Sep 15 11:43:22.814202 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.814075    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg875\" (UniqueName: \"kubernetes.io/projected/89012e13-bdf0-4f96-8779-703812d3b36c-kube-api-access-kg875\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft\" (UID: \"89012e13-bdf0-4f96-8779-703812d3b36c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft"
Sep 15 11:43:22.814202 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.814118    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89012e13-bdf0-4f96-8779-703812d3b36c-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft\" (UID: \"89012e13-bdf0-4f96-8779-703812d3b36c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft"
Sep 15 11:43:22.814202 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.814147    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89012e13-bdf0-4f96-8779-703812d3b36c-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft\" (UID: \"89012e13-bdf0-4f96-8779-703812d3b36c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft"
Sep 15 11:43:22.814551 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.814344    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43c1cec5-e4f7-4fb3-b570-7312f1c4c09e-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c\" (UID: \"43c1cec5-e4f7-4fb3-b570-7312f1c4c09e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c"
Sep 15 11:43:22.814551 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.814383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snkdv\" (UniqueName: \"kubernetes.io/projected/43c1cec5-e4f7-4fb3-b570-7312f1c4c09e-kube-api-access-snkdv\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c\" (UID: \"43c1cec5-e4f7-4fb3-b570-7312f1c4c09e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c"
Sep 15 11:43:22.814637 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.814546    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43c1cec5-e4f7-4fb3-b570-7312f1c4c09e-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c\" (UID: \"43c1cec5-e4f7-4fb3-b570-7312f1c4c09e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c"
Sep 15 11:43:22.814825 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.814802    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43c1cec5-e4f7-4fb3-b570-7312f1c4c09e-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c\" (UID: \"43c1cec5-e4f7-4fb3-b570-7312f1c4c09e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c"
Sep 15 11:43:22.823815 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.823783    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snkdv\" (UniqueName: \"kubernetes.io/projected/43c1cec5-e4f7-4fb3-b570-7312f1c4c09e-kube-api-access-snkdv\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c\" (UID: \"43c1cec5-e4f7-4fb3-b570-7312f1c4c09e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c"
Sep 15 11:43:22.867528 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.867501    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl"
Sep 15 11:43:22.915656 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.915623    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg875\" (UniqueName: \"kubernetes.io/projected/89012e13-bdf0-4f96-8779-703812d3b36c-kube-api-access-kg875\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft\" (UID: \"89012e13-bdf0-4f96-8779-703812d3b36c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft"
Sep 15 11:43:22.915782 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.915682    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89012e13-bdf0-4f96-8779-703812d3b36c-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft\" (UID: \"89012e13-bdf0-4f96-8779-703812d3b36c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft"
Sep 15 11:43:22.915782 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.915713    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89012e13-bdf0-4f96-8779-703812d3b36c-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft\" (UID: \"89012e13-bdf0-4f96-8779-703812d3b36c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft"
Sep 15 11:43:22.916220 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.916167    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89012e13-bdf0-4f96-8779-703812d3b36c-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft\" (UID: \"89012e13-bdf0-4f96-8779-703812d3b36c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft"
Sep 15 11:43:22.916220 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.916210    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89012e13-bdf0-4f96-8779-703812d3b36c-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft\" (UID: \"89012e13-bdf0-4f96-8779-703812d3b36c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft"
Sep 15 11:43:22.924796 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.924614    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg875\" (UniqueName: \"kubernetes.io/projected/89012e13-bdf0-4f96-8779-703812d3b36c-kube-api-access-kg875\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft\" (UID: \"89012e13-bdf0-4f96-8779-703812d3b36c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft"
Sep 15 11:43:22.967144 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:22.967084    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c"
Sep 15 11:43:23.041490 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:23.041466    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h"]
Sep 15 11:43:23.043597 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:43:23.043569    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb66565ac_dce3_4615_898b_15dc352c2dbe.slice/crio-ab38ab88a53a81f4bf3b93fa6eaf754ee9491732baf6ff05ab7cddd13ee2645f WatchSource:0}: Error finding container ab38ab88a53a81f4bf3b93fa6eaf754ee9491732baf6ff05ab7cddd13ee2645f: Status 404 returned error can't find the container with id ab38ab88a53a81f4bf3b93fa6eaf754ee9491732baf6ff05ab7cddd13ee2645f
Sep 15 11:43:23.061983 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:23.061964    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft"
Sep 15 11:43:23.140483 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:23.140455    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl"]
Sep 15 11:43:23.141574 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:43:23.141536    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98b2b127_12b4_4036_8b66_2e9657533393.slice/crio-735d651de1a71faa0c9b0e6408e9beb45da680a414a567d84b2164e7a5cd1e5b WatchSource:0}: Error finding container 735d651de1a71faa0c9b0e6408e9beb45da680a414a567d84b2164e7a5cd1e5b: Status 404 returned error can't find the container with id 735d651de1a71faa0c9b0e6408e9beb45da680a414a567d84b2164e7a5cd1e5b
Sep 15 11:43:23.236856 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:23.236831    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c"]
Sep 15 11:43:23.239122 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:43:23.239088    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c1cec5_e4f7_4fb3_b570_7312f1c4c09e.slice/crio-1d482c1b499948cc1c707cbb0c7b9b6f7d4d2b8df2104e33ceb17ff35fa92370 WatchSource:0}: Error finding container 1d482c1b499948cc1c707cbb0c7b9b6f7d4d2b8df2104e33ceb17ff35fa92370: Status 404 returned error can't find the container with id 1d482c1b499948cc1c707cbb0c7b9b6f7d4d2b8df2104e33ceb17ff35fa92370
Sep 15 11:43:23.331077 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:23.331054    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft"]
Sep 15 11:43:23.340377 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:43:23.340350    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89012e13_bdf0_4f96_8779_703812d3b36c.slice/crio-4759ce79b744cc0e77c8ae768057a9ac04b286789e2829eea50fea62f126844a WatchSource:0}: Error finding container 4759ce79b744cc0e77c8ae768057a9ac04b286789e2829eea50fea62f126844a: Status 404 returned error can't find the container with id 4759ce79b744cc0e77c8ae768057a9ac04b286789e2829eea50fea62f126844a
Sep 15 11:43:23.477037 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:23.476967    2564 generic.go:356] "Generic (PLEG): container finished" podID="89012e13-bdf0-4f96-8779-703812d3b36c" containerID="89ca7f1114420fda226109028d8c0b6bf967c001b7f7ed4e7ed40a350f4f1358" exitCode=0
Sep 15 11:43:23.477474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:23.477030    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft" event={"ID":"89012e13-bdf0-4f96-8779-703812d3b36c","Type":"ContainerDied","Data":"89ca7f1114420fda226109028d8c0b6bf967c001b7f7ed4e7ed40a350f4f1358"}
Sep 15 11:43:23.477474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:23.477078    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft" event={"ID":"89012e13-bdf0-4f96-8779-703812d3b36c","Type":"ContainerStarted","Data":"4759ce79b744cc0e77c8ae768057a9ac04b286789e2829eea50fea62f126844a"}
Sep 15 11:43:23.479065 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:23.479029    2564 generic.go:356] "Generic (PLEG): container finished" podID="98b2b127-12b4-4036-8b66-2e9657533393" containerID="705e882f6c3c5e507abb253e9ab76b000eaecb22787f575f3960723b44529bd9" exitCode=0
Sep 15 11:43:23.479341 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:23.479183    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl" event={"ID":"98b2b127-12b4-4036-8b66-2e9657533393","Type":"ContainerDied","Data":"705e882f6c3c5e507abb253e9ab76b000eaecb22787f575f3960723b44529bd9"}
Sep 15 11:43:23.479341 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:23.479256    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl" event={"ID":"98b2b127-12b4-4036-8b66-2e9657533393","Type":"ContainerStarted","Data":"735d651de1a71faa0c9b0e6408e9beb45da680a414a567d84b2164e7a5cd1e5b"}
Sep 15 11:43:23.486414 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:23.486393    2564 generic.go:356] "Generic (PLEG): container finished" podID="43c1cec5-e4f7-4fb3-b570-7312f1c4c09e" containerID="a939083d95dbc3cc017524cd45bc0370a13567255a0933871e1308480c844ba7" exitCode=0
Sep 15 11:43:23.486519 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:23.486457    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c" event={"ID":"43c1cec5-e4f7-4fb3-b570-7312f1c4c09e","Type":"ContainerDied","Data":"a939083d95dbc3cc017524cd45bc0370a13567255a0933871e1308480c844ba7"}
Sep 15 11:43:23.486519 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:23.486496    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c" event={"ID":"43c1cec5-e4f7-4fb3-b570-7312f1c4c09e","Type":"ContainerStarted","Data":"1d482c1b499948cc1c707cbb0c7b9b6f7d4d2b8df2104e33ceb17ff35fa92370"}
Sep 15 11:43:23.488129 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:23.488106    2564 generic.go:356] "Generic (PLEG): container finished" podID="b66565ac-dce3-4615-898b-15dc352c2dbe" containerID="488dfd7b986afcec18e80d90de6e4c368d3283fe70a1a757f9c6c419d0112bf9" exitCode=0
Sep 15 11:43:23.488203 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:23.488145    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h" event={"ID":"b66565ac-dce3-4615-898b-15dc352c2dbe","Type":"ContainerDied","Data":"488dfd7b986afcec18e80d90de6e4c368d3283fe70a1a757f9c6c419d0112bf9"}
Sep 15 11:43:23.488203 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:23.488184    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h" event={"ID":"b66565ac-dce3-4615-898b-15dc352c2dbe","Type":"ContainerStarted","Data":"ab38ab88a53a81f4bf3b93fa6eaf754ee9491732baf6ff05ab7cddd13ee2645f"}
Sep 15 11:43:25.499746 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:25.499713    2564 generic.go:356] "Generic (PLEG): container finished" podID="89012e13-bdf0-4f96-8779-703812d3b36c" containerID="62a4cc1d10b657a52ca40a56b7b539fadea50020f54f301390d93419e9895314" exitCode=0
Sep 15 11:43:25.500244 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:25.499801    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft" event={"ID":"89012e13-bdf0-4f96-8779-703812d3b36c","Type":"ContainerDied","Data":"62a4cc1d10b657a52ca40a56b7b539fadea50020f54f301390d93419e9895314"}
Sep 15 11:43:25.502050 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:25.502024    2564 generic.go:356] "Generic (PLEG): container finished" podID="98b2b127-12b4-4036-8b66-2e9657533393" containerID="96bc8954a48a0aec6aaa646f9ef74166da03f871881d9aa09b7402a7936d348a" exitCode=0
Sep 15 11:43:25.502139 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:25.502104    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl" event={"ID":"98b2b127-12b4-4036-8b66-2e9657533393","Type":"ContainerDied","Data":"96bc8954a48a0aec6aaa646f9ef74166da03f871881d9aa09b7402a7936d348a"}
Sep 15 11:43:25.504240 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:25.504216    2564 generic.go:356] "Generic (PLEG): container finished" podID="43c1cec5-e4f7-4fb3-b570-7312f1c4c09e" containerID="30669695dc49394df71f46c448f3985b40040d584fc56d2ae50ea0e30008b8f4" exitCode=0
Sep 15 11:43:25.504337 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:25.504298    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c" event={"ID":"43c1cec5-e4f7-4fb3-b570-7312f1c4c09e","Type":"ContainerDied","Data":"30669695dc49394df71f46c448f3985b40040d584fc56d2ae50ea0e30008b8f4"}
Sep 15 11:43:25.506514 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:25.506490    2564 generic.go:356] "Generic (PLEG): container finished" podID="b66565ac-dce3-4615-898b-15dc352c2dbe" containerID="2302b41fdeacb5f84e3aa5ca7272e43c990788c0d27eb2f10880fe11006f8f4e" exitCode=0
Sep 15 11:43:25.506603 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:25.506520    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h" event={"ID":"b66565ac-dce3-4615-898b-15dc352c2dbe","Type":"ContainerDied","Data":"2302b41fdeacb5f84e3aa5ca7272e43c990788c0d27eb2f10880fe11006f8f4e"}
Sep 15 11:43:26.517389 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:26.517349    2564 generic.go:356] "Generic (PLEG): container finished" podID="89012e13-bdf0-4f96-8779-703812d3b36c" containerID="03a40838d2d73b5ab1b7ac08f31cf9b9d66224d965410045d1bb47468a2cfd8b" exitCode=0
Sep 15 11:43:26.517858 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:26.517429    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft" event={"ID":"89012e13-bdf0-4f96-8779-703812d3b36c","Type":"ContainerDied","Data":"03a40838d2d73b5ab1b7ac08f31cf9b9d66224d965410045d1bb47468a2cfd8b"}
Sep 15 11:43:26.519803 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:26.519780    2564 generic.go:356] "Generic (PLEG): container finished" podID="98b2b127-12b4-4036-8b66-2e9657533393" containerID="a499cff4b8af4d1f5a021deae2626deb91a0aea17bfd9f60139cf42333685703" exitCode=0
Sep 15 11:43:26.519913 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:26.519860    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl" event={"ID":"98b2b127-12b4-4036-8b66-2e9657533393","Type":"ContainerDied","Data":"a499cff4b8af4d1f5a021deae2626deb91a0aea17bfd9f60139cf42333685703"}
Sep 15 11:43:26.521757 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:26.521738    2564 generic.go:356] "Generic (PLEG): container finished" podID="43c1cec5-e4f7-4fb3-b570-7312f1c4c09e" containerID="3d43bcf4169c9b769cdd5e299af3391ee6bc044e231251735738f839a9b6dd96" exitCode=0
Sep 15 11:43:26.521852 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:26.521801    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c" event={"ID":"43c1cec5-e4f7-4fb3-b570-7312f1c4c09e","Type":"ContainerDied","Data":"3d43bcf4169c9b769cdd5e299af3391ee6bc044e231251735738f839a9b6dd96"}
Sep 15 11:43:26.523776 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:26.523755    2564 generic.go:356] "Generic (PLEG): container finished" podID="b66565ac-dce3-4615-898b-15dc352c2dbe" containerID="876032e79c74c8295fc3e3a5566b1572c2338ef171eec42def0cfe3e954ade08" exitCode=0
Sep 15 11:43:26.523852 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:26.523811    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h" event={"ID":"b66565ac-dce3-4615-898b-15dc352c2dbe","Type":"ContainerDied","Data":"876032e79c74c8295fc3e3a5566b1572c2338ef171eec42def0cfe3e954ade08"}
Sep 15 11:43:27.698578 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.698556    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h"
Sep 15 11:43:27.701706 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.701687    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft"
Sep 15 11:43:27.734568 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.734541    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c"
Sep 15 11:43:27.741792 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.741773    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl"
Sep 15 11:43:27.859193 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.859162    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b66565ac-dce3-4615-898b-15dc352c2dbe-bundle\") pod \"b66565ac-dce3-4615-898b-15dc352c2dbe\" (UID: \"b66565ac-dce3-4615-898b-15dc352c2dbe\") "
Sep 15 11:43:27.859453 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.859221    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pm7pb\" (UniqueName: \"kubernetes.io/projected/98b2b127-12b4-4036-8b66-2e9657533393-kube-api-access-pm7pb\") pod \"98b2b127-12b4-4036-8b66-2e9657533393\" (UID: \"98b2b127-12b4-4036-8b66-2e9657533393\") "
Sep 15 11:43:27.859453 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.859247    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98b2b127-12b4-4036-8b66-2e9657533393-util\") pod \"98b2b127-12b4-4036-8b66-2e9657533393\" (UID: \"98b2b127-12b4-4036-8b66-2e9657533393\") "
Sep 15 11:43:27.859453 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.859304    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgpfz\" (UniqueName: \"kubernetes.io/projected/b66565ac-dce3-4615-898b-15dc352c2dbe-kube-api-access-mgpfz\") pod \"b66565ac-dce3-4615-898b-15dc352c2dbe\" (UID: \"b66565ac-dce3-4615-898b-15dc352c2dbe\") "
Sep 15 11:43:27.859453 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.859328    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b66565ac-dce3-4615-898b-15dc352c2dbe-util\") pod \"b66565ac-dce3-4615-898b-15dc352c2dbe\" (UID: \"b66565ac-dce3-4615-898b-15dc352c2dbe\") "
Sep 15 11:43:27.859453 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.859342    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43c1cec5-e4f7-4fb3-b570-7312f1c4c09e-bundle\") pod \"43c1cec5-e4f7-4fb3-b570-7312f1c4c09e\" (UID: \"43c1cec5-e4f7-4fb3-b570-7312f1c4c09e\") "
Sep 15 11:43:27.859453 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.859357    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89012e13-bdf0-4f96-8779-703812d3b36c-bundle\") pod \"89012e13-bdf0-4f96-8779-703812d3b36c\" (UID: \"89012e13-bdf0-4f96-8779-703812d3b36c\") "
Sep 15 11:43:27.859453 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.859383    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98b2b127-12b4-4036-8b66-2e9657533393-bundle\") pod \"98b2b127-12b4-4036-8b66-2e9657533393\" (UID: \"98b2b127-12b4-4036-8b66-2e9657533393\") "
Sep 15 11:43:27.859453 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.859432    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snkdv\" (UniqueName: \"kubernetes.io/projected/43c1cec5-e4f7-4fb3-b570-7312f1c4c09e-kube-api-access-snkdv\") pod \"43c1cec5-e4f7-4fb3-b570-7312f1c4c09e\" (UID: \"43c1cec5-e4f7-4fb3-b570-7312f1c4c09e\") "
Sep 15 11:43:27.859453 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.859457    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43c1cec5-e4f7-4fb3-b570-7312f1c4c09e-util\") pod \"43c1cec5-e4f7-4fb3-b570-7312f1c4c09e\" (UID: \"43c1cec5-e4f7-4fb3-b570-7312f1c4c09e\") "
Sep 15 11:43:27.859926 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.859484    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kg875\" (UniqueName: \"kubernetes.io/projected/89012e13-bdf0-4f96-8779-703812d3b36c-kube-api-access-kg875\") pod \"89012e13-bdf0-4f96-8779-703812d3b36c\" (UID: \"89012e13-bdf0-4f96-8779-703812d3b36c\") "
Sep 15 11:43:27.859926 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.859527    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89012e13-bdf0-4f96-8779-703812d3b36c-util\") pod \"89012e13-bdf0-4f96-8779-703812d3b36c\" (UID: \"89012e13-bdf0-4f96-8779-703812d3b36c\") "
Sep 15 11:43:27.860034 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.859937    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b66565ac-dce3-4615-898b-15dc352c2dbe-bundle" (OuterVolumeSpecName: "bundle") pod "b66565ac-dce3-4615-898b-15dc352c2dbe" (UID: "b66565ac-dce3-4615-898b-15dc352c2dbe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:43:27.860437 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.860405    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c1cec5-e4f7-4fb3-b570-7312f1c4c09e-bundle" (OuterVolumeSpecName: "bundle") pod "43c1cec5-e4f7-4fb3-b570-7312f1c4c09e" (UID: "43c1cec5-e4f7-4fb3-b570-7312f1c4c09e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:43:27.860837 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.860812    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89012e13-bdf0-4f96-8779-703812d3b36c-bundle" (OuterVolumeSpecName: "bundle") pod "89012e13-bdf0-4f96-8779-703812d3b36c" (UID: "89012e13-bdf0-4f96-8779-703812d3b36c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:43:27.861592 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.861568    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98b2b127-12b4-4036-8b66-2e9657533393-bundle" (OuterVolumeSpecName: "bundle") pod "98b2b127-12b4-4036-8b66-2e9657533393" (UID: "98b2b127-12b4-4036-8b66-2e9657533393"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:43:27.861856 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.861829    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98b2b127-12b4-4036-8b66-2e9657533393-kube-api-access-pm7pb" (OuterVolumeSpecName: "kube-api-access-pm7pb") pod "98b2b127-12b4-4036-8b66-2e9657533393" (UID: "98b2b127-12b4-4036-8b66-2e9657533393"). InnerVolumeSpecName "kube-api-access-pm7pb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:43:27.862781 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.862758    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b66565ac-dce3-4615-898b-15dc352c2dbe-kube-api-access-mgpfz" (OuterVolumeSpecName: "kube-api-access-mgpfz") pod "b66565ac-dce3-4615-898b-15dc352c2dbe" (UID: "b66565ac-dce3-4615-898b-15dc352c2dbe"). InnerVolumeSpecName "kube-api-access-mgpfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:43:27.863033 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.863013    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43c1cec5-e4f7-4fb3-b570-7312f1c4c09e-kube-api-access-snkdv" (OuterVolumeSpecName: "kube-api-access-snkdv") pod "43c1cec5-e4f7-4fb3-b570-7312f1c4c09e" (UID: "43c1cec5-e4f7-4fb3-b570-7312f1c4c09e"). InnerVolumeSpecName "kube-api-access-snkdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:43:27.863725 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.863701    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89012e13-bdf0-4f96-8779-703812d3b36c-kube-api-access-kg875" (OuterVolumeSpecName: "kube-api-access-kg875") pod "89012e13-bdf0-4f96-8779-703812d3b36c" (UID: "89012e13-bdf0-4f96-8779-703812d3b36c"). InnerVolumeSpecName "kube-api-access-kg875". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:43:27.867206 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.867168    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89012e13-bdf0-4f96-8779-703812d3b36c-util" (OuterVolumeSpecName: "util") pod "89012e13-bdf0-4f96-8779-703812d3b36c" (UID: "89012e13-bdf0-4f96-8779-703812d3b36c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:43:27.867299 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.867219    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c1cec5-e4f7-4fb3-b570-7312f1c4c09e-util" (OuterVolumeSpecName: "util") pod "43c1cec5-e4f7-4fb3-b570-7312f1c4c09e" (UID: "43c1cec5-e4f7-4fb3-b570-7312f1c4c09e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:43:27.868306 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.868245    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98b2b127-12b4-4036-8b66-2e9657533393-util" (OuterVolumeSpecName: "util") pod "98b2b127-12b4-4036-8b66-2e9657533393" (UID: "98b2b127-12b4-4036-8b66-2e9657533393"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:43:27.868895 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.868878    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b66565ac-dce3-4615-898b-15dc352c2dbe-util" (OuterVolumeSpecName: "util") pod "b66565ac-dce3-4615-898b-15dc352c2dbe" (UID: "b66565ac-dce3-4615-898b-15dc352c2dbe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:43:27.961070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.961036    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pm7pb\" (UniqueName: \"kubernetes.io/projected/98b2b127-12b4-4036-8b66-2e9657533393-kube-api-access-pm7pb\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:43:27.961070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.961065    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98b2b127-12b4-4036-8b66-2e9657533393-util\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:43:27.961287 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.961078    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgpfz\" (UniqueName: \"kubernetes.io/projected/b66565ac-dce3-4615-898b-15dc352c2dbe-kube-api-access-mgpfz\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:43:27.961287 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.961091    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b66565ac-dce3-4615-898b-15dc352c2dbe-util\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:43:27.961287 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.961103    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43c1cec5-e4f7-4fb3-b570-7312f1c4c09e-bundle\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:43:27.961287 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.961113    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89012e13-bdf0-4f96-8779-703812d3b36c-bundle\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:43:27.961287 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.961123    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98b2b127-12b4-4036-8b66-2e9657533393-bundle\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:43:27.961287 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.961135    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snkdv\" (UniqueName: \"kubernetes.io/projected/43c1cec5-e4f7-4fb3-b570-7312f1c4c09e-kube-api-access-snkdv\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:43:27.961287 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.961145    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43c1cec5-e4f7-4fb3-b570-7312f1c4c09e-util\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:43:27.961287 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.961156    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg875\" (UniqueName: \"kubernetes.io/projected/89012e13-bdf0-4f96-8779-703812d3b36c-kube-api-access-kg875\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:43:27.961287 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.961167    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89012e13-bdf0-4f96-8779-703812d3b36c-util\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:43:27.961287 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:27.961178    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b66565ac-dce3-4615-898b-15dc352c2dbe-bundle\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:43:28.536062 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:28.536034    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c"
Sep 15 11:43:28.536255 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:28.536033    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62pq4c" event={"ID":"43c1cec5-e4f7-4fb3-b570-7312f1c4c09e","Type":"ContainerDied","Data":"1d482c1b499948cc1c707cbb0c7b9b6f7d4d2b8df2104e33ceb17ff35fa92370"}
Sep 15 11:43:28.536255 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:28.536151    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d482c1b499948cc1c707cbb0c7b9b6f7d4d2b8df2104e33ceb17ff35fa92370"
Sep 15 11:43:28.537894 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:28.537877    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h"
Sep 15 11:43:28.538011 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:28.537927    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kfm9h" event={"ID":"b66565ac-dce3-4615-898b-15dc352c2dbe","Type":"ContainerDied","Data":"ab38ab88a53a81f4bf3b93fa6eaf754ee9491732baf6ff05ab7cddd13ee2645f"}
Sep 15 11:43:28.538011 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:28.537973    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab38ab88a53a81f4bf3b93fa6eaf754ee9491732baf6ff05ab7cddd13ee2645f"
Sep 15 11:43:28.539945 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:28.539925    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft"
Sep 15 11:43:28.539945 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:28.539940    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfvft" event={"ID":"89012e13-bdf0-4f96-8779-703812d3b36c","Type":"ContainerDied","Data":"4759ce79b744cc0e77c8ae768057a9ac04b286789e2829eea50fea62f126844a"}
Sep 15 11:43:28.540095 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:28.539969    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4759ce79b744cc0e77c8ae768057a9ac04b286789e2829eea50fea62f126844a"
Sep 15 11:43:28.542075 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:28.542051    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl" event={"ID":"98b2b127-12b4-4036-8b66-2e9657533393","Type":"ContainerDied","Data":"735d651de1a71faa0c9b0e6408e9beb45da680a414a567d84b2164e7a5cd1e5b"}
Sep 15 11:43:28.542185 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:28.542086    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfj4hl"
Sep 15 11:43:28.542185 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:28.542091    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="735d651de1a71faa0c9b0e6408e9beb45da680a414a567d84b2164e7a5cd1e5b"
Sep 15 11:43:39.876755 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.876720    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-hpj8s"]
Sep 15 11:43:39.877123 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877035    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89012e13-bdf0-4f96-8779-703812d3b36c" containerName="util"
Sep 15 11:43:39.877123 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877048    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="89012e13-bdf0-4f96-8779-703812d3b36c" containerName="util"
Sep 15 11:43:39.877123 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877056    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b66565ac-dce3-4615-898b-15dc352c2dbe" containerName="pull"
Sep 15 11:43:39.877123 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877062    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b66565ac-dce3-4615-898b-15dc352c2dbe" containerName="pull"
Sep 15 11:43:39.877123 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877071    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98b2b127-12b4-4036-8b66-2e9657533393" containerName="pull"
Sep 15 11:43:39.877123 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877077    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="98b2b127-12b4-4036-8b66-2e9657533393" containerName="pull"
Sep 15 11:43:39.877123 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877088    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89012e13-bdf0-4f96-8779-703812d3b36c" containerName="extract"
Sep 15 11:43:39.877123 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877093    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="89012e13-bdf0-4f96-8779-703812d3b36c" containerName="extract"
Sep 15 11:43:39.877123 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877100    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b66565ac-dce3-4615-898b-15dc352c2dbe" containerName="util"
Sep 15 11:43:39.877123 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877105    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b66565ac-dce3-4615-898b-15dc352c2dbe" containerName="util"
Sep 15 11:43:39.877123 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877112    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43c1cec5-e4f7-4fb3-b570-7312f1c4c09e" containerName="pull"
Sep 15 11:43:39.877123 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877117    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="43c1cec5-e4f7-4fb3-b570-7312f1c4c09e" containerName="pull"
Sep 15 11:43:39.877123 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877124    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98b2b127-12b4-4036-8b66-2e9657533393" containerName="util"
Sep 15 11:43:39.877123 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877129    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="98b2b127-12b4-4036-8b66-2e9657533393" containerName="util"
Sep 15 11:43:39.877556 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877136    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43c1cec5-e4f7-4fb3-b570-7312f1c4c09e" containerName="util"
Sep 15 11:43:39.877556 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877141    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="43c1cec5-e4f7-4fb3-b570-7312f1c4c09e" containerName="util"
Sep 15 11:43:39.877556 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877146    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43c1cec5-e4f7-4fb3-b570-7312f1c4c09e" containerName="extract"
Sep 15 11:43:39.877556 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877151    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="43c1cec5-e4f7-4fb3-b570-7312f1c4c09e" containerName="extract"
Sep 15 11:43:39.877556 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877158    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98b2b127-12b4-4036-8b66-2e9657533393" containerName="extract"
Sep 15 11:43:39.877556 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877163    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="98b2b127-12b4-4036-8b66-2e9657533393" containerName="extract"
Sep 15 11:43:39.877556 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877169    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89012e13-bdf0-4f96-8779-703812d3b36c" containerName="pull"
Sep 15 11:43:39.877556 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877176    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="89012e13-bdf0-4f96-8779-703812d3b36c" containerName="pull"
Sep 15 11:43:39.877556 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877185    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b66565ac-dce3-4615-898b-15dc352c2dbe" containerName="extract"
Sep 15 11:43:39.877556 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877189    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b66565ac-dce3-4615-898b-15dc352c2dbe" containerName="extract"
Sep 15 11:43:39.877556 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877238    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b66565ac-dce3-4615-898b-15dc352c2dbe" containerName="extract"
Sep 15 11:43:39.877556 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877245    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="89012e13-bdf0-4f96-8779-703812d3b36c" containerName="extract"
Sep 15 11:43:39.877556 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877250    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="98b2b127-12b4-4036-8b66-2e9657533393" containerName="extract"
Sep 15 11:43:39.877556 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.877257    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="43c1cec5-e4f7-4fb3-b570-7312f1c4c09e" containerName="extract"
Sep 15 11:43:39.881547 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.881531    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-hpj8s"
Sep 15 11:43:39.884299 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.884255    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 15 11:43:39.884299 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.884284    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 15 11:43:39.884497 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.884306    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 15 11:43:39.884497 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.884328    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-9l87r\""
Sep 15 11:43:39.891552 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:39.891532    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-hpj8s"]
Sep 15 11:43:40.057515 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:40.057477    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bwp8\" (UniqueName: \"kubernetes.io/projected/d7adf39a-5b75-47b5-adbd-2323c8d843d1-kube-api-access-9bwp8\") pod \"dns-operator-controller-manager-7b84cd7c9c-hpj8s\" (UID: \"d7adf39a-5b75-47b5-adbd-2323c8d843d1\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-hpj8s"
Sep 15 11:43:40.159008 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:40.158919    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bwp8\" (UniqueName: \"kubernetes.io/projected/d7adf39a-5b75-47b5-adbd-2323c8d843d1-kube-api-access-9bwp8\") pod \"dns-operator-controller-manager-7b84cd7c9c-hpj8s\" (UID: \"d7adf39a-5b75-47b5-adbd-2323c8d843d1\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-hpj8s"
Sep 15 11:43:40.167067 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:40.167037    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bwp8\" (UniqueName: \"kubernetes.io/projected/d7adf39a-5b75-47b5-adbd-2323c8d843d1-kube-api-access-9bwp8\") pod \"dns-operator-controller-manager-7b84cd7c9c-hpj8s\" (UID: \"d7adf39a-5b75-47b5-adbd-2323c8d843d1\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-hpj8s"
Sep 15 11:43:40.191553 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:40.191527    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-hpj8s"
Sep 15 11:43:40.464884 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:40.464810    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-hpj8s"]
Sep 15 11:43:40.467854 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:43:40.467829    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7adf39a_5b75_47b5_adbd_2323c8d843d1.slice/crio-18a06c54fce3867558e28df8e48b0d9e4036cd72c731af36b508dcaa6b165448 WatchSource:0}: Error finding container 18a06c54fce3867558e28df8e48b0d9e4036cd72c731af36b508dcaa6b165448: Status 404 returned error can't find the container with id 18a06c54fce3867558e28df8e48b0d9e4036cd72c731af36b508dcaa6b165448
Sep 15 11:43:40.604029 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:40.603989    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-hpj8s" event={"ID":"d7adf39a-5b75-47b5-adbd-2323c8d843d1","Type":"ContainerStarted","Data":"18a06c54fce3867558e28df8e48b0d9e4036cd72c731af36b508dcaa6b165448"}
Sep 15 11:43:42.705827 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:42.705789    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-4w9b4"]
Sep 15 11:43:42.709600 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:42.709567    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-4w9b4"
Sep 15 11:43:42.713242 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:42.713217    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-tc7fg\""
Sep 15 11:43:42.724623 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:42.724599    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-4w9b4"]
Sep 15 11:43:42.883637 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:42.883612    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4px85\" (UniqueName: \"kubernetes.io/projected/c3ae47f3-f49a-4383-8d05-7f3b4cbe8a2d-kube-api-access-4px85\") pod \"authorino-operator-76b478bd78-4w9b4\" (UID: \"c3ae47f3-f49a-4383-8d05-7f3b4cbe8a2d\") " pod="kuadrant-system/authorino-operator-76b478bd78-4w9b4"
Sep 15 11:43:42.984211 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:42.984127    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4px85\" (UniqueName: \"kubernetes.io/projected/c3ae47f3-f49a-4383-8d05-7f3b4cbe8a2d-kube-api-access-4px85\") pod \"authorino-operator-76b478bd78-4w9b4\" (UID: \"c3ae47f3-f49a-4383-8d05-7f3b4cbe8a2d\") " pod="kuadrant-system/authorino-operator-76b478bd78-4w9b4"
Sep 15 11:43:42.994787 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:42.994755    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4px85\" (UniqueName: \"kubernetes.io/projected/c3ae47f3-f49a-4383-8d05-7f3b4cbe8a2d-kube-api-access-4px85\") pod \"authorino-operator-76b478bd78-4w9b4\" (UID: \"c3ae47f3-f49a-4383-8d05-7f3b4cbe8a2d\") " pod="kuadrant-system/authorino-operator-76b478bd78-4w9b4"
Sep 15 11:43:43.021834 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:43.021806    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-4w9b4"
Sep 15 11:43:43.296701 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:43.296670    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-4w9b4"]
Sep 15 11:43:43.298084 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:43:43.298060    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3ae47f3_f49a_4383_8d05_7f3b4cbe8a2d.slice/crio-36f5fd0633ca17840a80e49c4ccab3df1578d2213d365ab409c6def5ddcfbab2 WatchSource:0}: Error finding container 36f5fd0633ca17840a80e49c4ccab3df1578d2213d365ab409c6def5ddcfbab2: Status 404 returned error can't find the container with id 36f5fd0633ca17840a80e49c4ccab3df1578d2213d365ab409c6def5ddcfbab2
Sep 15 11:43:43.622129 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:43.622094    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-hpj8s" event={"ID":"d7adf39a-5b75-47b5-adbd-2323c8d843d1","Type":"ContainerStarted","Data":"9ed4c8b62a7c1d97aa79bfcd8465e696511ebb788a6089dcc23f4d982fbd5449"}
Sep 15 11:43:43.622331 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:43.622191    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-hpj8s"
Sep 15 11:43:43.623530 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:43.623426    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-4w9b4" event={"ID":"c3ae47f3-f49a-4383-8d05-7f3b4cbe8a2d","Type":"ContainerStarted","Data":"36f5fd0633ca17840a80e49c4ccab3df1578d2213d365ab409c6def5ddcfbab2"}
Sep 15 11:43:43.645717 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:43.645674    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-hpj8s" podStartSLOduration=2.241294266 podStartE2EDuration="4.645661635s" totalImagesPullingTime="2.404367369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:43:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:43:43.644156967 +0000 UTC m=+400.361031151" watchObservedRunningTime="2026-09-15 11:43:43.645661635 +0000 UTC m=+400.362535819"
Sep 15 11:43:45.635943 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:45.635904    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-4w9b4" event={"ID":"c3ae47f3-f49a-4383-8d05-7f3b4cbe8a2d","Type":"ContainerStarted","Data":"74da694ac27a8272ec7ef65a498a81912550055390377e39b35a869f9f4473de"}
Sep 15 11:43:45.636426 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:45.636004    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-4w9b4"
Sep 15 11:43:45.655717 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:45.655665    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-4w9b4" podStartSLOduration=1.9257720329999999 podStartE2EDuration="3.655650181s" totalImagesPullingTime="1.729878148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:43:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:43:45.65396828 +0000 UTC m=+402.370842466" watchObservedRunningTime="2026-09-15 11:43:45.655650181 +0000 UTC m=+402.372524365"
Sep 15 11:43:54.175826 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.175789    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ll2hg"]
Sep 15 11:43:54.179394 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.179375    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ll2hg"
Sep 15 11:43:54.182029 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.182000    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mjhnk\""
Sep 15 11:43:54.196487 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.196464    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ll2hg"]
Sep 15 11:43:54.264147 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.264114    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ll2hg"]
Sep 15 11:43:54.264400 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:43:54.264378    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-xqsl6], unattached volumes=[], failed to process volumes=[extensions-socket-volume kube-api-access-xqsl6]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ll2hg" podUID="84fc2f6e-6226-41be-9cde-6808136d260f"
Sep 15 11:43:54.271771 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.271743    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ll2hg"]
Sep 15 11:43:54.272037 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.272015    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84fc2f6e-6226-41be-9cde-6808136d260f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-ll2hg\" (UID: \"84fc2f6e-6226-41be-9cde-6808136d260f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ll2hg"
Sep 15 11:43:54.272140 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.272063    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqsl6\" (UniqueName: \"kubernetes.io/projected/84fc2f6e-6226-41be-9cde-6808136d260f-kube-api-access-xqsl6\") pod \"kuadrant-operator-controller-manager-5769f99d9f-ll2hg\" (UID: \"84fc2f6e-6226-41be-9cde-6808136d260f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ll2hg"
Sep 15 11:43:54.287884 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.287859    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm"]
Sep 15 11:43:54.291321 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.291301    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm"
Sep 15 11:43:54.306800 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.306777    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm"]
Sep 15 11:43:54.372725 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.372684    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hcxp\" (UniqueName: \"kubernetes.io/projected/a419373f-88d3-4f88-8b1e-769527b2ad8a-kube-api-access-8hcxp\") pod \"kuadrant-operator-controller-manager-5769f99d9f-czsnm\" (UID: \"a419373f-88d3-4f88-8b1e-769527b2ad8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm"
Sep 15 11:43:54.372888 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.372731    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84fc2f6e-6226-41be-9cde-6808136d260f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-ll2hg\" (UID: \"84fc2f6e-6226-41be-9cde-6808136d260f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ll2hg"
Sep 15 11:43:54.372888 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.372806    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a419373f-88d3-4f88-8b1e-769527b2ad8a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-czsnm\" (UID: \"a419373f-88d3-4f88-8b1e-769527b2ad8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm"
Sep 15 11:43:54.372888 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.372856    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqsl6\" (UniqueName: \"kubernetes.io/projected/84fc2f6e-6226-41be-9cde-6808136d260f-kube-api-access-xqsl6\") pod \"kuadrant-operator-controller-manager-5769f99d9f-ll2hg\" (UID: \"84fc2f6e-6226-41be-9cde-6808136d260f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ll2hg"
Sep 15 11:43:54.373132 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.373114    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84fc2f6e-6226-41be-9cde-6808136d260f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-ll2hg\" (UID: \"84fc2f6e-6226-41be-9cde-6808136d260f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ll2hg"
Sep 15 11:43:54.378345 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:43:54.378328    2564 projected.go:196] Error preparing data for projected volume kube-api-access-xqsl6 for pod kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ll2hg: failed to fetch token: pod "kuadrant-operator-controller-manager-5769f99d9f-ll2hg" not found
Sep 15 11:43:54.378420 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:43:54.378396    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84fc2f6e-6226-41be-9cde-6808136d260f-kube-api-access-xqsl6 podName:84fc2f6e-6226-41be-9cde-6808136d260f nodeName:}" failed. No retries permitted until 2026-09-15 11:43:54.878376552 +0000 UTC m=+411.595250716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xqsl6" (UniqueName: "kubernetes.io/projected/84fc2f6e-6226-41be-9cde-6808136d260f-kube-api-access-xqsl6") pod "kuadrant-operator-controller-manager-5769f99d9f-ll2hg" (UID: "84fc2f6e-6226-41be-9cde-6808136d260f") : failed to fetch token: pod "kuadrant-operator-controller-manager-5769f99d9f-ll2hg" not found
Sep 15 11:43:54.473902 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.473820    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a419373f-88d3-4f88-8b1e-769527b2ad8a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-czsnm\" (UID: \"a419373f-88d3-4f88-8b1e-769527b2ad8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm"
Sep 15 11:43:54.474043 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.473915    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hcxp\" (UniqueName: \"kubernetes.io/projected/a419373f-88d3-4f88-8b1e-769527b2ad8a-kube-api-access-8hcxp\") pod \"kuadrant-operator-controller-manager-5769f99d9f-czsnm\" (UID: \"a419373f-88d3-4f88-8b1e-769527b2ad8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm"
Sep 15 11:43:54.474187 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.474166    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a419373f-88d3-4f88-8b1e-769527b2ad8a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-czsnm\" (UID: \"a419373f-88d3-4f88-8b1e-769527b2ad8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm"
Sep 15 11:43:54.484388 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.484363    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hcxp\" (UniqueName: \"kubernetes.io/projected/a419373f-88d3-4f88-8b1e-769527b2ad8a-kube-api-access-8hcxp\") pod \"kuadrant-operator-controller-manager-5769f99d9f-czsnm\" (UID: \"a419373f-88d3-4f88-8b1e-769527b2ad8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm"
Sep 15 11:43:54.601397 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.601362    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm"
Sep 15 11:43:54.635353 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.635016    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-hpj8s"
Sep 15 11:43:54.681319 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.681185    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ll2hg"
Sep 15 11:43:54.684324 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:43:54.684238    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-ll2hg\" is forbidden: User \"system:node:ip-10-0-129-183.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-183.ec2.internal' and this object" podUID="84fc2f6e-6226-41be-9cde-6808136d260f" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ll2hg"
Sep 15 11:43:54.691422 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.691403    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ll2hg"
Sep 15 11:43:54.693896 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:43:54.693873    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-ll2hg\" is forbidden: User \"system:node:ip-10-0-129-183.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-183.ec2.internal' and this object" podUID="84fc2f6e-6226-41be-9cde-6808136d260f" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ll2hg"
Sep 15 11:43:54.776524 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.776443    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84fc2f6e-6226-41be-9cde-6808136d260f-extensions-socket-volume\") pod \"84fc2f6e-6226-41be-9cde-6808136d260f\" (UID: \"84fc2f6e-6226-41be-9cde-6808136d260f\") "
Sep 15 11:43:54.776658 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.776628    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqsl6\" (UniqueName: \"kubernetes.io/projected/84fc2f6e-6226-41be-9cde-6808136d260f-kube-api-access-xqsl6\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:43:54.776811 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.776783    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84fc2f6e-6226-41be-9cde-6808136d260f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "84fc2f6e-6226-41be-9cde-6808136d260f" (UID: "84fc2f6e-6226-41be-9cde-6808136d260f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:43:54.876981 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.876949    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84fc2f6e-6226-41be-9cde-6808136d260f-extensions-socket-volume\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:43:54.921513 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:54.921490    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm"]
Sep 15 11:43:54.923443 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:43:54.923417    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda419373f_88d3_4f88_8b1e_769527b2ad8a.slice/crio-f2c4da69534854d3cc661288c0384e79bb43b0659c95fc028d18bfe826ddef04 WatchSource:0}: Error finding container f2c4da69534854d3cc661288c0384e79bb43b0659c95fc028d18bfe826ddef04: Status 404 returned error can't find the container with id f2c4da69534854d3cc661288c0384e79bb43b0659c95fc028d18bfe826ddef04
Sep 15 11:43:55.688784 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:55.688753    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ll2hg"
Sep 15 11:43:55.688784 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:55.688769    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm" event={"ID":"a419373f-88d3-4f88-8b1e-769527b2ad8a","Type":"ContainerStarted","Data":"f2c4da69534854d3cc661288c0384e79bb43b0659c95fc028d18bfe826ddef04"}
Sep 15 11:43:55.691008 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:43:55.690978    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-ll2hg\" is forbidden: User \"system:node:ip-10-0-129-183.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-183.ec2.internal' and this object" podUID="84fc2f6e-6226-41be-9cde-6808136d260f" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ll2hg"
Sep 15 11:43:55.698461 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:43:55.698428    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-ll2hg\" is forbidden: User \"system:node:ip-10-0-129-183.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-183.ec2.internal' and this object" podUID="84fc2f6e-6226-41be-9cde-6808136d260f" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ll2hg"
Sep 15 11:43:55.781112 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:55.781070    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84fc2f6e-6226-41be-9cde-6808136d260f" path="/var/lib/kubelet/pods/84fc2f6e-6226-41be-9cde-6808136d260f/volumes"
Sep 15 11:43:56.643587 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:56.643556    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-4w9b4"
Sep 15 11:43:58.707879 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:58.707794    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm" event={"ID":"a419373f-88d3-4f88-8b1e-769527b2ad8a","Type":"ContainerStarted","Data":"0e176b3d96f35fad3369c43a58a446d4a8182b547706c8629414bb297f2ccba7"}
Sep 15 11:43:58.708241 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:58.707883    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm"
Sep 15 11:43:58.733658 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:43:58.733607    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm" podStartSLOduration=1.338356206 podStartE2EDuration="4.733592164s" totalImagesPullingTime="3.395235958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:43:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:43:58.732330227 +0000 UTC m=+415.449204390" watchObservedRunningTime="2026-09-15 11:43:58.733592164 +0000 UTC m=+415.450466347"
Sep 15 11:44:09.715480 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:44:09.715449    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm"
Sep 15 11:44:32.031324 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:44:32.031227    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:44:32.033566 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:44:32.033547    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"
Sep 15 11:44:32.036344 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:44:32.036306    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 15 11:44:32.036465 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:44:32.036363    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hhdjf\""
Sep 15 11:44:32.044374 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:44:32.044351    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:44:32.072734 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:44:32.072706    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:44:32.182854 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:44:32.182820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f0336ab1-2036-4228-ab52-a3286a51a247-config-file\") pod \"limitador-limitador-84994f7ffc-sdhz6\" (UID: \"f0336ab1-2036-4228-ab52-a3286a51a247\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"
Sep 15 11:44:32.182854 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:44:32.182854    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq65x\" (UniqueName: \"kubernetes.io/projected/f0336ab1-2036-4228-ab52-a3286a51a247-kube-api-access-wq65x\") pod \"limitador-limitador-84994f7ffc-sdhz6\" (UID: \"f0336ab1-2036-4228-ab52-a3286a51a247\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"
Sep 15 11:44:32.284136 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:44:32.284057    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f0336ab1-2036-4228-ab52-a3286a51a247-config-file\") pod \"limitador-limitador-84994f7ffc-sdhz6\" (UID: \"f0336ab1-2036-4228-ab52-a3286a51a247\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"
Sep 15 11:44:32.284136 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:44:32.284092    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq65x\" (UniqueName: \"kubernetes.io/projected/f0336ab1-2036-4228-ab52-a3286a51a247-kube-api-access-wq65x\") pod \"limitador-limitador-84994f7ffc-sdhz6\" (UID: \"f0336ab1-2036-4228-ab52-a3286a51a247\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"
Sep 15 11:44:32.284703 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:44:32.284683    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f0336ab1-2036-4228-ab52-a3286a51a247-config-file\") pod \"limitador-limitador-84994f7ffc-sdhz6\" (UID: \"f0336ab1-2036-4228-ab52-a3286a51a247\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"
Sep 15 11:44:32.292171 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:44:32.292146    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq65x\" (UniqueName: \"kubernetes.io/projected/f0336ab1-2036-4228-ab52-a3286a51a247-kube-api-access-wq65x\") pod \"limitador-limitador-84994f7ffc-sdhz6\" (UID: \"f0336ab1-2036-4228-ab52-a3286a51a247\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"
Sep 15 11:44:32.344931 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:44:32.344899    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"
Sep 15 11:44:32.617690 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:44:32.617663    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:44:32.619184 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:44:32.619159    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0336ab1_2036_4228_ab52_a3286a51a247.slice/crio-bfb2d5f22d9836b54379b52e5538ff89370043398fcd15077534c7a65ba799d9 WatchSource:0}: Error finding container bfb2d5f22d9836b54379b52e5538ff89370043398fcd15077534c7a65ba799d9: Status 404 returned error can't find the container with id bfb2d5f22d9836b54379b52e5538ff89370043398fcd15077534c7a65ba799d9
Sep 15 11:44:32.872987 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:44:32.872897    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-sdhz6" event={"ID":"f0336ab1-2036-4228-ab52-a3286a51a247","Type":"ContainerStarted","Data":"bfb2d5f22d9836b54379b52e5538ff89370043398fcd15077534c7a65ba799d9"}
Sep 15 11:44:33.878474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:44:33.878379    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-sdhz6" event={"ID":"f0336ab1-2036-4228-ab52-a3286a51a247","Type":"ContainerStarted","Data":"c57b1f0ba87f59970dde8d79b50be387e45c42dd0acd6fcaaf9c4e1dd9678c2c"}
Sep 15 11:44:33.878829 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:44:33.878476    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"
Sep 15 11:44:33.895216 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:44:33.895164    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-sdhz6" podStartSLOduration=0.960698253 podStartE2EDuration="1.895146807s" totalImagesPullingTime="934.448554ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:44:33.894383727 +0000 UTC m=+450.611257911" watchObservedRunningTime="2026-09-15 11:44:33.895146807 +0000 UTC m=+450.612020992"
Sep 15 11:44:44.884060 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:44:44.884025    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"
Sep 15 11:45:47.843042 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:45:47.843008    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:46:02.241941 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:02.241856    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:46:07.610829 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:07.610793    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:46:11.867428 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:11.867395    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"]
Sep 15 11:46:11.870907 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:11.870885    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:11.874972 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:11.874947    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 15 11:46:11.874972 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:11.874964    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 15 11:46:11.875134 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:11.874981    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 15 11:46:11.875134 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:11.874996    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sl78g\""
Sep 15 11:46:11.879802 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:11.879777    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"]
Sep 15 11:46:11.969807 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:11.969773    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cce6b50-2494-4574-8cba-4fbc574d7a6a-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg\" (UID: \"9cce6b50-2494-4574-8cba-4fbc574d7a6a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:11.969992 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:11.969822    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cce6b50-2494-4574-8cba-4fbc574d7a6a-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg\" (UID: \"9cce6b50-2494-4574-8cba-4fbc574d7a6a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:11.969992 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:11.969865    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cce6b50-2494-4574-8cba-4fbc574d7a6a-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg\" (UID: \"9cce6b50-2494-4574-8cba-4fbc574d7a6a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:11.969992 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:11.969884    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cce6b50-2494-4574-8cba-4fbc574d7a6a-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg\" (UID: \"9cce6b50-2494-4574-8cba-4fbc574d7a6a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:11.970096 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:11.969999    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cce6b50-2494-4574-8cba-4fbc574d7a6a-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg\" (UID: \"9cce6b50-2494-4574-8cba-4fbc574d7a6a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:11.970096 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:11.970034    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx9n2\" (UniqueName: \"kubernetes.io/projected/9cce6b50-2494-4574-8cba-4fbc574d7a6a-kube-api-access-gx9n2\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg\" (UID: \"9cce6b50-2494-4574-8cba-4fbc574d7a6a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:12.070942 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:12.070907    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cce6b50-2494-4574-8cba-4fbc574d7a6a-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg\" (UID: \"9cce6b50-2494-4574-8cba-4fbc574d7a6a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:12.071142 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:12.070954    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cce6b50-2494-4574-8cba-4fbc574d7a6a-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg\" (UID: \"9cce6b50-2494-4574-8cba-4fbc574d7a6a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:12.071142 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:12.070980    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cce6b50-2494-4574-8cba-4fbc574d7a6a-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg\" (UID: \"9cce6b50-2494-4574-8cba-4fbc574d7a6a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:12.071142 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:12.071097    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cce6b50-2494-4574-8cba-4fbc574d7a6a-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg\" (UID: \"9cce6b50-2494-4574-8cba-4fbc574d7a6a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:12.071240 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:12.071182    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cce6b50-2494-4574-8cba-4fbc574d7a6a-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg\" (UID: \"9cce6b50-2494-4574-8cba-4fbc574d7a6a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:12.071240 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:12.071210    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx9n2\" (UniqueName: \"kubernetes.io/projected/9cce6b50-2494-4574-8cba-4fbc574d7a6a-kube-api-access-gx9n2\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg\" (UID: \"9cce6b50-2494-4574-8cba-4fbc574d7a6a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:12.071388 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:12.071364    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cce6b50-2494-4574-8cba-4fbc574d7a6a-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg\" (UID: \"9cce6b50-2494-4574-8cba-4fbc574d7a6a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:12.071464 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:12.071445    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cce6b50-2494-4574-8cba-4fbc574d7a6a-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg\" (UID: \"9cce6b50-2494-4574-8cba-4fbc574d7a6a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:12.071514 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:12.071486    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cce6b50-2494-4574-8cba-4fbc574d7a6a-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg\" (UID: \"9cce6b50-2494-4574-8cba-4fbc574d7a6a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:12.073194 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:12.073173    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cce6b50-2494-4574-8cba-4fbc574d7a6a-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg\" (UID: \"9cce6b50-2494-4574-8cba-4fbc574d7a6a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:12.073440 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:12.073423    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cce6b50-2494-4574-8cba-4fbc574d7a6a-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg\" (UID: \"9cce6b50-2494-4574-8cba-4fbc574d7a6a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:12.078870 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:12.078847    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx9n2\" (UniqueName: \"kubernetes.io/projected/9cce6b50-2494-4574-8cba-4fbc574d7a6a-kube-api-access-gx9n2\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg\" (UID: \"9cce6b50-2494-4574-8cba-4fbc574d7a6a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:12.181765 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:12.181686    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:12.454292 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:12.454248    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"]
Sep 15 11:46:12.455906 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:46:12.455869    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cce6b50_2494_4574_8cba_4fbc574d7a6a.slice/crio-12931e77974dc46ba81a378b6cd2c24b68b08ad8e001ce0ea745d88255445bea WatchSource:0}: Error finding container 12931e77974dc46ba81a378b6cd2c24b68b08ad8e001ce0ea745d88255445bea: Status 404 returned error can't find the container with id 12931e77974dc46ba81a378b6cd2c24b68b08ad8e001ce0ea745d88255445bea
Sep 15 11:46:12.897662 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:12.897622    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:46:13.388088 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:13.388052    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg" event={"ID":"9cce6b50-2494-4574-8cba-4fbc574d7a6a","Type":"ContainerStarted","Data":"12931e77974dc46ba81a378b6cd2c24b68b08ad8e001ce0ea745d88255445bea"}
Sep 15 11:46:14.394773 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:14.394738    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg" event={"ID":"9cce6b50-2494-4574-8cba-4fbc574d7a6a","Type":"ContainerStarted","Data":"d191604b3635995edfa8194d50f1ce5b8bd9875506c9e34e487595d21265e1d5"}
Sep 15 11:46:14.413809 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:14.413763    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg" podStartSLOduration=2.435530286 podStartE2EDuration="3.413745342s" totalImagesPullingTime="978.215056ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:46:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:46:14.41183003 +0000 UTC m=+551.128704215" watchObservedRunningTime="2026-09-15 11:46:14.413745342 +0000 UTC m=+551.130619526"
Sep 15 11:46:22.182616 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:22.182577    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:22.183364 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:22.182648    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:22.195240 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:22.195215    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:22.445509 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:22.445425    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xp6pg"
Sep 15 11:46:22.714756 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:22.714684    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:46:37.104322 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:37.104284    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:46:45.510916 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:45.510882    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:46:52.363658 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.363624    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"]
Sep 15 11:46:52.367626 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.367594    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:46:52.370083 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.370065    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 15 11:46:52.377213 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.377187    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"]
Sep 15 11:46:52.507450 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.507411    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9aacbb40-f592-48ed-b752-dbfa87b558c3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jtql8\" (UID: \"9aacbb40-f592-48ed-b752-dbfa87b558c3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:46:52.507637 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.507483    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr45p\" (UniqueName: \"kubernetes.io/projected/9aacbb40-f592-48ed-b752-dbfa87b558c3-kube-api-access-hr45p\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jtql8\" (UID: \"9aacbb40-f592-48ed-b752-dbfa87b558c3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:46:52.507637 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.507519    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9aacbb40-f592-48ed-b752-dbfa87b558c3-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jtql8\" (UID: \"9aacbb40-f592-48ed-b752-dbfa87b558c3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:46:52.507637 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.507541    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9aacbb40-f592-48ed-b752-dbfa87b558c3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jtql8\" (UID: \"9aacbb40-f592-48ed-b752-dbfa87b558c3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:46:52.507637 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.507576    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9aacbb40-f592-48ed-b752-dbfa87b558c3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jtql8\" (UID: \"9aacbb40-f592-48ed-b752-dbfa87b558c3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:46:52.507637 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.507601    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9aacbb40-f592-48ed-b752-dbfa87b558c3-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jtql8\" (UID: \"9aacbb40-f592-48ed-b752-dbfa87b558c3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:46:52.608448 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.608406    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9aacbb40-f592-48ed-b752-dbfa87b558c3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jtql8\" (UID: \"9aacbb40-f592-48ed-b752-dbfa87b558c3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:46:52.608448 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.608452    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9aacbb40-f592-48ed-b752-dbfa87b558c3-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jtql8\" (UID: \"9aacbb40-f592-48ed-b752-dbfa87b558c3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:46:52.608665 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.608480    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9aacbb40-f592-48ed-b752-dbfa87b558c3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jtql8\" (UID: \"9aacbb40-f592-48ed-b752-dbfa87b558c3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:46:52.608665 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.608524    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr45p\" (UniqueName: \"kubernetes.io/projected/9aacbb40-f592-48ed-b752-dbfa87b558c3-kube-api-access-hr45p\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jtql8\" (UID: \"9aacbb40-f592-48ed-b752-dbfa87b558c3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:46:52.608665 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.608548    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9aacbb40-f592-48ed-b752-dbfa87b558c3-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jtql8\" (UID: \"9aacbb40-f592-48ed-b752-dbfa87b558c3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:46:52.608815 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.608689    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9aacbb40-f592-48ed-b752-dbfa87b558c3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jtql8\" (UID: \"9aacbb40-f592-48ed-b752-dbfa87b558c3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:46:52.608914 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.608882    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9aacbb40-f592-48ed-b752-dbfa87b558c3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jtql8\" (UID: \"9aacbb40-f592-48ed-b752-dbfa87b558c3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:46:52.609029 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.608924    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9aacbb40-f592-48ed-b752-dbfa87b558c3-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jtql8\" (UID: \"9aacbb40-f592-48ed-b752-dbfa87b558c3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:46:52.609029 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.608974    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9aacbb40-f592-48ed-b752-dbfa87b558c3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jtql8\" (UID: \"9aacbb40-f592-48ed-b752-dbfa87b558c3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:46:52.610721 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.610696    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9aacbb40-f592-48ed-b752-dbfa87b558c3-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jtql8\" (UID: \"9aacbb40-f592-48ed-b752-dbfa87b558c3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:46:52.611040 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.611019    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9aacbb40-f592-48ed-b752-dbfa87b558c3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jtql8\" (UID: \"9aacbb40-f592-48ed-b752-dbfa87b558c3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:46:52.619742 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.619676    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr45p\" (UniqueName: \"kubernetes.io/projected/9aacbb40-f592-48ed-b752-dbfa87b558c3-kube-api-access-hr45p\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jtql8\" (UID: \"9aacbb40-f592-48ed-b752-dbfa87b558c3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:46:52.677658 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.677617    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:46:52.946858 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:52.946829    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"]
Sep 15 11:46:52.948409 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:46:52.948380    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9aacbb40_f592_48ed_b752_dbfa87b558c3.slice/crio-9fd3a5ae750216c532ee288c2374809f0cc723c3602a66e52ad36e395d58f934 WatchSource:0}: Error finding container 9fd3a5ae750216c532ee288c2374809f0cc723c3602a66e52ad36e395d58f934: Status 404 returned error can't find the container with id 9fd3a5ae750216c532ee288c2374809f0cc723c3602a66e52ad36e395d58f934
Sep 15 11:46:53.598167 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:53.598125    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8" event={"ID":"9aacbb40-f592-48ed-b752-dbfa87b558c3","Type":"ContainerStarted","Data":"4ba2737b27ea3e4757957a8481524ed3d1978308c8717d4b9ab458245cec7ef8"}
Sep 15 11:46:53.598705 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:53.598179    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8" event={"ID":"9aacbb40-f592-48ed-b752-dbfa87b558c3","Type":"ContainerStarted","Data":"9fd3a5ae750216c532ee288c2374809f0cc723c3602a66e52ad36e395d58f934"}
Sep 15 11:46:53.617899 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:53.617837    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8" podStartSLOduration=1.42874131 podStartE2EDuration="1.61782178s" totalImagesPullingTime="189.08047ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:46:53.615324564 +0000 UTC m=+590.332198751" watchObservedRunningTime="2026-09-15 11:46:53.61782178 +0000 UTC m=+590.334695964"
Sep 15 11:46:53.703224 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:46:53.703195    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:47:02.678371 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:47:02.678331    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:47:02.678371 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:47:02.678381    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:47:02.690856 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:47:02.690828    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:47:03.664833 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:47:03.664799    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jtql8"
Sep 15 11:50:15.512921 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:15.512878    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:50:16.441722 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.441682    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"]
Sep 15 11:50:16.445605 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.445581    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.446113 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.446086    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-credential-socket\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.446227 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.446130    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-workload-certs\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.446227 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.446150    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/504ac6bc-5c30-4720-b522-e5f5910b1a84-istiod-ca-cert\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.446345 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.446229    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-envoy\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.446345 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.446288    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-token\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.446345 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.446330    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-workload-socket\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.446451 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.446361    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpgrc\" (UniqueName: \"kubernetes.io/projected/504ac6bc-5c30-4720-b522-e5f5910b1a84-kube-api-access-lpgrc\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.446451 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.446395    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-podinfo\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.446586 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.446474    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-data\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.448257 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.448226    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ee96ca62-openshift-default-dockercfg-hbbdx\""
Sep 15 11:50:16.459040 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.458949    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"]
Sep 15 11:50:16.546855 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.546816    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-envoy\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.546855 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.546853    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-token\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.547405 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.546880    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-workload-socket\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.547405 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.546909    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpgrc\" (UniqueName: \"kubernetes.io/projected/504ac6bc-5c30-4720-b522-e5f5910b1a84-kube-api-access-lpgrc\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.547405 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.546938    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-podinfo\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.547405 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.547164    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-data\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.547405 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.547237    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-credential-socket\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.547405 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.547294    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-workload-certs\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.547405 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.547323    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/504ac6bc-5c30-4720-b522-e5f5910b1a84-istiod-ca-cert\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.547405 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.547365    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-workload-socket\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.547810 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.547532    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-data\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.548173 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.548127    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/504ac6bc-5c30-4720-b522-e5f5910b1a84-istiod-ca-cert\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.548516 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.548472    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-workload-certs\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.548755 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.548736    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-credential-socket\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.550039 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.550015    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-podinfo\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.550192 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.550175    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-envoy\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.559687 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.559654    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-token\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.559879 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.559857    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpgrc\" (UniqueName: \"kubernetes.io/projected/504ac6bc-5c30-4720-b522-e5f5910b1a84-kube-api-access-lpgrc\") pod \"e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") " pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:16.760780 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:16.760698    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:17.047218 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:17.047194    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"]
Sep 15 11:50:17.049525 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:50:17.049481    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod504ac6bc_5c30_4720_b522_e5f5910b1a84.slice/crio-5323106488ef66575a864f9fc921f1fc65dd9cff668d8b08e152ffe3b3a6ae80 WatchSource:0}: Error finding container 5323106488ef66575a864f9fc921f1fc65dd9cff668d8b08e152ffe3b3a6ae80: Status 404 returned error can't find the container with id 5323106488ef66575a864f9fc921f1fc65dd9cff668d8b08e152ffe3b3a6ae80
Sep 15 11:50:17.052139 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:17.052099    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:17.052236 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:17.052182    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:17.052236 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:17.052228    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:17.640505 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:17.640470    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt" event={"ID":"504ac6bc-5c30-4720-b522-e5f5910b1a84","Type":"ContainerStarted","Data":"7ac50f9d9c6b0aacf8a2a6b05e5764ac36bbf56b95164e5f9f9664c42f12c61a"}
Sep 15 11:50:17.641139 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:17.640528    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt" event={"ID":"504ac6bc-5c30-4720-b522-e5f5910b1a84","Type":"ContainerStarted","Data":"5323106488ef66575a864f9fc921f1fc65dd9cff668d8b08e152ffe3b3a6ae80"}
Sep 15 11:50:17.664669 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:17.664624    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt" podStartSLOduration=1.664609477 podStartE2EDuration="1.664609477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:50:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:50:17.662914068 +0000 UTC m=+794.379788255" watchObservedRunningTime="2026-09-15 11:50:17.664609477 +0000 UTC m=+794.381483661"
Sep 15 11:50:17.761053 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:17.761020    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:18.766452 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:18.766421    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:19.651101 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:19.651066    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:19.652197 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:19.652177    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:30.300497 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:30.300462    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:50:31.721034 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:31.721004    2564 generic.go:356] "Generic (PLEG): container finished" podID="504ac6bc-5c30-4720-b522-e5f5910b1a84" containerID="7ac50f9d9c6b0aacf8a2a6b05e5764ac36bbf56b95164e5f9f9664c42f12c61a" exitCode=0
Sep 15 11:50:31.721460 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:31.721078    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt" event={"ID":"504ac6bc-5c30-4720-b522-e5f5910b1a84","Type":"ContainerDied","Data":"7ac50f9d9c6b0aacf8a2a6b05e5764ac36bbf56b95164e5f9f9664c42f12c61a"}
Sep 15 11:50:31.721514 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:31.721499    2564 scope.go:117] "RemoveContainer" containerID="7ac50f9d9c6b0aacf8a2a6b05e5764ac36bbf56b95164e5f9f9664c42f12c61a"
Sep 15 11:50:31.722520 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:31.722492    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:31.722590 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:31.722572    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:31.722627 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:31.722615    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:32.728415 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:32.728382    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt" event={"ID":"504ac6bc-5c30-4720-b522-e5f5910b1a84","Type":"ContainerStarted","Data":"7e6ade320f8cfbfa241c3403f6e339d24b31208f2d487c08b8a2ba8bd60c68df"}
Sep 15 11:50:32.764283 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:32.762667    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:32.771315 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:32.769356    2564 patch_prober.go:28] interesting pod/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 15 11:50:32.771315 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:32.769443    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt" podUID="504ac6bc-5c30-4720-b522-e5f5910b1a84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 15 11:50:33.761336 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:33.761292    2564 patch_prober.go:28] interesting pod/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 15 11:50:33.761841 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:33.761370    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt" podUID="504ac6bc-5c30-4720-b522-e5f5910b1a84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 15 11:50:34.651552 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:34.651510    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:34.761983 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:34.761950    2564 patch_prober.go:28] interesting pod/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 15 11:50:34.762608 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:34.762576    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt" podUID="504ac6bc-5c30-4720-b522-e5f5910b1a84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 15 11:50:35.761359 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:35.761319    2564 patch_prober.go:28] interesting pod/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 15 11:50:35.761566 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:35.761387    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt" podUID="504ac6bc-5c30-4720-b522-e5f5910b1a84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 15 11:50:36.761329 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:36.761285    2564 patch_prober.go:28] interesting pod/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 15 11:50:36.761828 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:36.761367    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt" podUID="504ac6bc-5c30-4720-b522-e5f5910b1a84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 15 11:50:37.040869 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.040784    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"]
Sep 15 11:50:37.043561 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.043542    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.046541 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.046519    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-1b147a-openshift-default-dockercfg-8cpwt\""
Sep 15 11:50:37.058329 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.058244    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"]
Sep 15 11:50:37.120480 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.120440    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-envoy\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.120665 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.120543    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-token\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.120665 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.120581    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-workload-socket\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.120665 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.120626    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14ebcd20-2506-4989-8f2f-263347c4e1e6-istiod-ca-cert\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.120837 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.120673    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fc9w\" (UniqueName: \"kubernetes.io/projected/14ebcd20-2506-4989-8f2f-263347c4e1e6-kube-api-access-2fc9w\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.120837 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.120723    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-credential-socket\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.120837 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.120776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-workload-certs\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.120837 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.120801    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-data\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.120837 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.120828    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-podinfo\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.221583 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.221544    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-credential-socket\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.221771 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.221602    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-workload-certs\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.221771 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.221627    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-data\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.221771 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.221652    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-podinfo\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.221771 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.221688    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-envoy\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.222002 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.221892    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-token\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.222002 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.221954    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-workload-socket\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.222108 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.222010    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14ebcd20-2506-4989-8f2f-263347c4e1e6-istiod-ca-cert\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.222108 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.222038    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-data\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.222108 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.222010    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-credential-socket\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.222108 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.222074    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fc9w\" (UniqueName: \"kubernetes.io/projected/14ebcd20-2506-4989-8f2f-263347c4e1e6-kube-api-access-2fc9w\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.222362 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.222336    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-workload-certs\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.222448 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.222423    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-workload-socket\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.222660 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.222638    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14ebcd20-2506-4989-8f2f-263347c4e1e6-istiod-ca-cert\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.224190 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.224164    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-envoy\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.224349 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.224322    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-podinfo\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.229400 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.229373    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-token\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.229864 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.229846    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fc9w\" (UniqueName: \"kubernetes.io/projected/14ebcd20-2506-4989-8f2f-263347c4e1e6-kube-api-access-2fc9w\") pod \"e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") " pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.376964 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.376892    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:37.667906 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.667868    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"]
Sep 15 11:50:37.671180 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:50:37.671149    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ebcd20_2506_4989_8f2f_263347c4e1e6.slice/crio-fd19093e920bd9bb0d657133c13d74fef5592406cc7a927b1347045d4062f1db WatchSource:0}: Error finding container fd19093e920bd9bb0d657133c13d74fef5592406cc7a927b1347045d4062f1db: Status 404 returned error can't find the container with id fd19093e920bd9bb0d657133c13d74fef5592406cc7a927b1347045d4062f1db
Sep 15 11:50:37.673511 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.673473    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:37.673606 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.673545    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:37.673606 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.673574    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:37.760495 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.760450    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk" event={"ID":"14ebcd20-2506-4989-8f2f-263347c4e1e6","Type":"ContainerStarted","Data":"97d74666b2b3e0c8ab4cd8a95445731c39de77f6f5fe836f49560697135ec173"}
Sep 15 11:50:37.760733 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.760516    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk" event={"ID":"14ebcd20-2506-4989-8f2f-263347c4e1e6","Type":"ContainerStarted","Data":"fd19093e920bd9bb0d657133c13d74fef5592406cc7a927b1347045d4062f1db"}
Sep 15 11:50:37.784217 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.784153    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk" podStartSLOduration=0.784132381 podStartE2EDuration="784.132381ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:50:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:50:37.781095572 +0000 UTC m=+814.497969757" watchObservedRunningTime="2026-09-15 11:50:37.784132381 +0000 UTC m=+814.501006566"
Sep 15 11:50:37.930040 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.929940    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:37.931526 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:37.931498    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:38.378015 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:38.377977    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:38.382809 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:38.382781    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:38.766485 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:38.766388    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:38.767173 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:38.767155    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:40.023305 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:40.023243    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee96ca62-52dpq"]
Sep 15 11:50:40.025668 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:40.025648    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee96ca62-52dpq"
Sep 15 11:50:40.028299 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:40.028277    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjx8x\""
Sep 15 11:50:40.028570 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:40.028555    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 11:50:40.037285 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:40.037247    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee96ca62-52dpq"]
Sep 15 11:50:40.150634 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:40.150597    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/286fd3e3-623a-4a0c-985f-4c7d79ea5952-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ee96ca62-52dpq\" (UID: \"286fd3e3-623a-4a0c-985f-4c7d79ea5952\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee96ca62-52dpq"
Sep 15 11:50:40.251570 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:40.251539    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/286fd3e3-623a-4a0c-985f-4c7d79ea5952-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ee96ca62-52dpq\" (UID: \"286fd3e3-623a-4a0c-985f-4c7d79ea5952\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee96ca62-52dpq"
Sep 15 11:50:40.252289 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:40.252240    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/286fd3e3-623a-4a0c-985f-4c7d79ea5952-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ee96ca62-52dpq\" (UID: \"286fd3e3-623a-4a0c-985f-4c7d79ea5952\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee96ca62-52dpq"
Sep 15 11:50:40.336551 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:40.336518    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee96ca62-52dpq"
Sep 15 11:50:40.609252 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:40.609224    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee96ca62-52dpq"]
Sep 15 11:50:40.610801 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:50:40.610771    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod286fd3e3_623a_4a0c_985f_4c7d79ea5952.slice/crio-db6aab72b90a6c55831cc7abd8b41fc3032208f506f29b54e000e65cf206b930 WatchSource:0}: Error finding container db6aab72b90a6c55831cc7abd8b41fc3032208f506f29b54e000e65cf206b930: Status 404 returned error can't find the container with id db6aab72b90a6c55831cc7abd8b41fc3032208f506f29b54e000e65cf206b930
Sep 15 11:50:40.612875 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:40.612859    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:50:40.778829 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:40.778795    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee96ca62-52dpq" event={"ID":"286fd3e3-623a-4a0c-985f-4c7d79ea5952","Type":"ContainerStarted","Data":"db6aab72b90a6c55831cc7abd8b41fc3032208f506f29b54e000e65cf206b930"}
Sep 15 11:50:43.798484 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:43.798399    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee96ca62-52dpq" event={"ID":"286fd3e3-623a-4a0c-985f-4c7d79ea5952","Type":"ContainerStarted","Data":"f2e0de2018c4abbbc3684a26cd71fd2a656d3a571f2449271406881359ecc2cb"}
Sep 15 11:50:43.814381 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:43.814335    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee96ca62-52dpq" podStartSLOduration=1.312097613 podStartE2EDuration="3.81431918s" totalImagesPullingTime="2.502221567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:50:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:50:43.812518257 +0000 UTC m=+820.529392432" watchObservedRunningTime="2026-09-15 11:50:43.81431918 +0000 UTC m=+820.531193415"
Sep 15 11:50:44.805925 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:44.805892    2564 generic.go:356] "Generic (PLEG): container finished" podID="286fd3e3-623a-4a0c-985f-4c7d79ea5952" containerID="f2e0de2018c4abbbc3684a26cd71fd2a656d3a571f2449271406881359ecc2cb" exitCode=0
Sep 15 11:50:44.806353 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:44.805946    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee96ca62-52dpq" event={"ID":"286fd3e3-623a-4a0c-985f-4c7d79ea5952","Type":"ContainerDied","Data":"f2e0de2018c4abbbc3684a26cd71fd2a656d3a571f2449271406881359ecc2cb"}
Sep 15 11:50:44.911476 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:44.911436    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:50:45.953768 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:45.953742    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee96ca62-52dpq"
Sep 15 11:50:46.007921 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:46.007886    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/286fd3e3-623a-4a0c-985f-4c7d79ea5952-maas-api-service-ca\") pod \"286fd3e3-623a-4a0c-985f-4c7d79ea5952\" (UID: \"286fd3e3-623a-4a0c-985f-4c7d79ea5952\") "
Sep 15 11:50:46.008202 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:46.008179    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/286fd3e3-623a-4a0c-985f-4c7d79ea5952-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "286fd3e3-623a-4a0c-985f-4c7d79ea5952" (UID: "286fd3e3-623a-4a0c-985f-4c7d79ea5952"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:50:46.108774 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:46.108691    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/286fd3e3-623a-4a0c-985f-4c7d79ea5952-maas-api-service-ca\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:50:46.817837 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:46.817808    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee96ca62-52dpq"
Sep 15 11:50:46.818009 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:46.817846    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee96ca62-52dpq" event={"ID":"286fd3e3-623a-4a0c-985f-4c7d79ea5952","Type":"ContainerDied","Data":"db6aab72b90a6c55831cc7abd8b41fc3032208f506f29b54e000e65cf206b930"}
Sep 15 11:50:46.818009 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:46.817892    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db6aab72b90a6c55831cc7abd8b41fc3032208f506f29b54e000e65cf206b930"
Sep 15 11:50:51.034573 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:51.034536    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee96ca62-52dpq"]
Sep 15 11:50:51.037760 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:51.037736    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee96ca62-52dpq"]
Sep 15 11:50:51.212332 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:51.206643    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"]
Sep 15 11:50:51.212332 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:51.206985    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt" podUID="504ac6bc-5c30-4720-b522-e5f5910b1a84" containerName="istio-proxy" containerID="cri-o://7e6ade320f8cfbfa241c3403f6e339d24b31208f2d487c08b8a2ba8bd60c68df" gracePeriod=30
Sep 15 11:50:51.779899 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:51.779860    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="286fd3e3-623a-4a0c-985f-4c7d79ea5952" path="/var/lib/kubelet/pods/286fd3e3-623a-4a0c-985f-4c7d79ea5952/volumes"
Sep 15 11:50:52.472651 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.472614    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"]
Sep 15 11:50:52.473169 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.473153    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="286fd3e3-623a-4a0c-985f-4c7d79ea5952" containerName="revoke-keys"
Sep 15 11:50:52.473230 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.473170    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="286fd3e3-623a-4a0c-985f-4c7d79ea5952" containerName="revoke-keys"
Sep 15 11:50:52.473337 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.473254    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="286fd3e3-623a-4a0c-985f-4c7d79ea5952" containerName="revoke-keys"
Sep 15 11:50:52.475738 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.475715    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.478435 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.478410    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-c353d682-gw-openshift-default-dockercfg-74ksg\""
Sep 15 11:50:52.486437 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.486415    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"]
Sep 15 11:50:52.584849 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.584814    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-podinfo\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.584849 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.584852    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfghd\" (UniqueName: \"kubernetes.io/projected/7aba9b04-b257-4b9c-b4d7-3243e79459cd-kube-api-access-hfghd\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.585096 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.584879    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-workload-certs\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.585096 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.584962    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-envoy\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.585096 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.584999    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istiod-ca-cert\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.585096 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.585043    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-credential-socket\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.585096 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.585059    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-token\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.585396 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.585106    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-workload-socket\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.585396 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.585122    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-data\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.685831 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.685786    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-envoy\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.686017 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.685848    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istiod-ca-cert\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.686017 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.685903    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-credential-socket\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.686017 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.685930    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-token\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.686017 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.685967    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-workload-socket\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.686017 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.685991    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-data\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.686282 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.686066    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-podinfo\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.686282 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.686092    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfghd\" (UniqueName: \"kubernetes.io/projected/7aba9b04-b257-4b9c-b4d7-3243e79459cd-kube-api-access-hfghd\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.686282 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.686129    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-workload-certs\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.686439 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.686377    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-credential-socket\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.686604 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.686581    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-workload-socket\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.686666 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.686621    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-data\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.686989 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.686963    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-workload-certs\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.687475 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.687451    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istiod-ca-cert\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.688647 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.688619    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-envoy\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.689183 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.689158    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-podinfo\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.694816 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.694794    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-token\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.694920 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.694860    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfghd\" (UniqueName: \"kubernetes.io/projected/7aba9b04-b257-4b9c-b4d7-3243e79459cd-kube-api-access-hfghd\") pod \"e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") " pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.806333 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.806304    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:52.933250 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.933211    2564 patch_prober.go:28] interesting pod/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 11:50:52.933406 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:52.933298    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt" podUID="504ac6bc-5c30-4720-b522-e5f5910b1a84" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 11:50:53.087482 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:53.087448    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"]
Sep 15 11:50:53.089007 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:50:53.088961    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aba9b04_b257_4b9c_b4d7_3243e79459cd.slice/crio-3cfa64e38be6afb639a77451bb204d252bf71cd185eb636624ec7678c9f9ec07 WatchSource:0}: Error finding container 3cfa64e38be6afb639a77451bb204d252bf71cd185eb636624ec7678c9f9ec07: Status 404 returned error can't find the container with id 3cfa64e38be6afb639a77451bb204d252bf71cd185eb636624ec7678c9f9ec07
Sep 15 11:50:53.092100 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:53.092058    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:53.092196 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:53.092144    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:53.092196 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:53.092185    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:53.861744 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:53.861709    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk" event={"ID":"7aba9b04-b257-4b9c-b4d7-3243e79459cd","Type":"ContainerStarted","Data":"6d8aedf55c2e51408d20180d24337ec1de5c9674ecda3bfe309e401a319ed796"}
Sep 15 11:50:53.862150 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:53.861768    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk" event={"ID":"7aba9b04-b257-4b9c-b4d7-3243e79459cd","Type":"ContainerStarted","Data":"3cfa64e38be6afb639a77451bb204d252bf71cd185eb636624ec7678c9f9ec07"}
Sep 15 11:50:53.884108 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:53.884057    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk" podStartSLOduration=1.884039972 podStartE2EDuration="1.884039972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:50:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:50:53.881388562 +0000 UTC m=+830.598262747" watchObservedRunningTime="2026-09-15 11:50:53.884039972 +0000 UTC m=+830.600914226"
Sep 15 11:50:54.806569 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:54.806530    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:54.808401 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:54.808376    2564 patch_prober.go:28] interesting pod/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 11:50:54.808527 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:54.808422    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk" podUID="14ebcd20-2506-4989-8f2f-263347c4e1e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 11:50:54.811359 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:54.811341    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:54.868406 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:54.868372    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:54.869382 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:54.869358    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:50:55.875590 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:55.875497    2564 generic.go:356] "Generic (PLEG): container finished" podID="14ebcd20-2506-4989-8f2f-263347c4e1e6" containerID="97d74666b2b3e0c8ab4cd8a95445731c39de77f6f5fe836f49560697135ec173" exitCode=0
Sep 15 11:50:55.875590 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:55.875574    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk" event={"ID":"14ebcd20-2506-4989-8f2f-263347c4e1e6","Type":"ContainerDied","Data":"97d74666b2b3e0c8ab4cd8a95445731c39de77f6f5fe836f49560697135ec173"}
Sep 15 11:50:55.876078 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:55.876060    2564 scope.go:117] "RemoveContainer" containerID="97d74666b2b3e0c8ab4cd8a95445731c39de77f6f5fe836f49560697135ec173"
Sep 15 11:50:55.877074 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:55.877046    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:55.877197 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:55.877112    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:55.877197 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:55.877143    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:50:56.494219 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.494194    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:56.626779 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.626738    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-token\") pod \"504ac6bc-5c30-4720-b522-e5f5910b1a84\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") "
Sep 15 11:50:56.626972 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.626797    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-credential-socket\") pod \"504ac6bc-5c30-4720-b522-e5f5910b1a84\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") "
Sep 15 11:50:56.626972 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.626816    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/504ac6bc-5c30-4720-b522-e5f5910b1a84-istiod-ca-cert\") pod \"504ac6bc-5c30-4720-b522-e5f5910b1a84\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") "
Sep 15 11:50:56.626972 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.626850    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-workload-certs\") pod \"504ac6bc-5c30-4720-b522-e5f5910b1a84\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") "
Sep 15 11:50:56.626972 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.626866    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-envoy\") pod \"504ac6bc-5c30-4720-b522-e5f5910b1a84\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") "
Sep 15 11:50:56.626972 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.626920    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-podinfo\") pod \"504ac6bc-5c30-4720-b522-e5f5910b1a84\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") "
Sep 15 11:50:56.626972 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.626966    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-data\") pod \"504ac6bc-5c30-4720-b522-e5f5910b1a84\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") "
Sep 15 11:50:56.627389 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.627107    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpgrc\" (UniqueName: \"kubernetes.io/projected/504ac6bc-5c30-4720-b522-e5f5910b1a84-kube-api-access-lpgrc\") pod \"504ac6bc-5c30-4720-b522-e5f5910b1a84\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") "
Sep 15 11:50:56.627389 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.627110    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "504ac6bc-5c30-4720-b522-e5f5910b1a84" (UID: "504ac6bc-5c30-4720-b522-e5f5910b1a84"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:50:56.627389 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.627136    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "504ac6bc-5c30-4720-b522-e5f5910b1a84" (UID: "504ac6bc-5c30-4720-b522-e5f5910b1a84"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:50:56.627389 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.627204    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/504ac6bc-5c30-4720-b522-e5f5910b1a84-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "504ac6bc-5c30-4720-b522-e5f5910b1a84" (UID: "504ac6bc-5c30-4720-b522-e5f5910b1a84"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:50:56.627389 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.627325    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-data" (OuterVolumeSpecName: "istio-data") pod "504ac6bc-5c30-4720-b522-e5f5910b1a84" (UID: "504ac6bc-5c30-4720-b522-e5f5910b1a84"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:50:56.627389 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.627354    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-workload-socket\") pod \"504ac6bc-5c30-4720-b522-e5f5910b1a84\" (UID: \"504ac6bc-5c30-4720-b522-e5f5910b1a84\") "
Sep 15 11:50:56.627722 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.627563    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "504ac6bc-5c30-4720-b522-e5f5910b1a84" (UID: "504ac6bc-5c30-4720-b522-e5f5910b1a84"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:50:56.627722 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.627664    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-data\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:50:56.627722 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.627681    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-workload-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:50:56.627722 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.627695    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-credential-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:50:56.627722 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.627710    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/504ac6bc-5c30-4720-b522-e5f5910b1a84-istiod-ca-cert\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:50:56.627722 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.627723    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-workload-certs\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:50:56.629731 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.629703    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "504ac6bc-5c30-4720-b522-e5f5910b1a84" (UID: "504ac6bc-5c30-4720-b522-e5f5910b1a84"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:50:56.629838 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.629706    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/504ac6bc-5c30-4720-b522-e5f5910b1a84-kube-api-access-lpgrc" (OuterVolumeSpecName: "kube-api-access-lpgrc") pod "504ac6bc-5c30-4720-b522-e5f5910b1a84" (UID: "504ac6bc-5c30-4720-b522-e5f5910b1a84"). InnerVolumeSpecName "kube-api-access-lpgrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:50:56.629838 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.629736    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "504ac6bc-5c30-4720-b522-e5f5910b1a84" (UID: "504ac6bc-5c30-4720-b522-e5f5910b1a84"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:50:56.629838 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.629750    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-token" (OuterVolumeSpecName: "istio-token") pod "504ac6bc-5c30-4720-b522-e5f5910b1a84" (UID: "504ac6bc-5c30-4720-b522-e5f5910b1a84"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:50:56.729290 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.729172    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpgrc\" (UniqueName: \"kubernetes.io/projected/504ac6bc-5c30-4720-b522-e5f5910b1a84-kube-api-access-lpgrc\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:50:56.729290 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.729207    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-token\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:50:56.729290 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.729217    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-envoy\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:50:56.729290 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.729225    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/504ac6bc-5c30-4720-b522-e5f5910b1a84-istio-podinfo\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:50:56.883278 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.883228    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk" event={"ID":"14ebcd20-2506-4989-8f2f-263347c4e1e6","Type":"ContainerStarted","Data":"1676a8771846d921e1b6e20087a9fe9234cdd764052abb2471f1a2fecd08e96d"}
Sep 15 11:50:56.885025 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.885000    2564 generic.go:356] "Generic (PLEG): container finished" podID="504ac6bc-5c30-4720-b522-e5f5910b1a84" containerID="7e6ade320f8cfbfa241c3403f6e339d24b31208f2d487c08b8a2ba8bd60c68df" exitCode=0
Sep 15 11:50:56.885161 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.885039    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"
Sep 15 11:50:56.885161 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.885084    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt" event={"ID":"504ac6bc-5c30-4720-b522-e5f5910b1a84","Type":"ContainerDied","Data":"7e6ade320f8cfbfa241c3403f6e339d24b31208f2d487c08b8a2ba8bd60c68df"}
Sep 15 11:50:56.885161 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.885139    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt" event={"ID":"504ac6bc-5c30-4720-b522-e5f5910b1a84","Type":"ContainerDied","Data":"5323106488ef66575a864f9fc921f1fc65dd9cff668d8b08e152ffe3b3a6ae80"}
Sep 15 11:50:56.885348 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.885171    2564 scope.go:117] "RemoveContainer" containerID="7e6ade320f8cfbfa241c3403f6e339d24b31208f2d487c08b8a2ba8bd60c68df"
Sep 15 11:50:56.895102 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.895081    2564 scope.go:117] "RemoveContainer" containerID="7ac50f9d9c6b0aacf8a2a6b05e5764ac36bbf56b95164e5f9f9664c42f12c61a"
Sep 15 11:50:56.903439 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.903422    2564 scope.go:117] "RemoveContainer" containerID="7e6ade320f8cfbfa241c3403f6e339d24b31208f2d487c08b8a2ba8bd60c68df"
Sep 15 11:50:56.903704 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:50:56.903689    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e6ade320f8cfbfa241c3403f6e339d24b31208f2d487c08b8a2ba8bd60c68df\": container with ID starting with 7e6ade320f8cfbfa241c3403f6e339d24b31208f2d487c08b8a2ba8bd60c68df not found: ID does not exist" containerID="7e6ade320f8cfbfa241c3403f6e339d24b31208f2d487c08b8a2ba8bd60c68df"
Sep 15 11:50:56.903798 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.903710    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e6ade320f8cfbfa241c3403f6e339d24b31208f2d487c08b8a2ba8bd60c68df"} err="failed to get container status \"7e6ade320f8cfbfa241c3403f6e339d24b31208f2d487c08b8a2ba8bd60c68df\": rpc error: code = NotFound desc = could not find container \"7e6ade320f8cfbfa241c3403f6e339d24b31208f2d487c08b8a2ba8bd60c68df\": container with ID starting with 7e6ade320f8cfbfa241c3403f6e339d24b31208f2d487c08b8a2ba8bd60c68df not found: ID does not exist"
Sep 15 11:50:56.903798 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.903727    2564 scope.go:117] "RemoveContainer" containerID="7ac50f9d9c6b0aacf8a2a6b05e5764ac36bbf56b95164e5f9f9664c42f12c61a"
Sep 15 11:50:56.903924 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:50:56.903908    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ac50f9d9c6b0aacf8a2a6b05e5764ac36bbf56b95164e5f9f9664c42f12c61a\": container with ID starting with 7ac50f9d9c6b0aacf8a2a6b05e5764ac36bbf56b95164e5f9f9664c42f12c61a not found: ID does not exist" containerID="7ac50f9d9c6b0aacf8a2a6b05e5764ac36bbf56b95164e5f9f9664c42f12c61a"
Sep 15 11:50:56.903966 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.903926    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ac50f9d9c6b0aacf8a2a6b05e5764ac36bbf56b95164e5f9f9664c42f12c61a"} err="failed to get container status \"7ac50f9d9c6b0aacf8a2a6b05e5764ac36bbf56b95164e5f9f9664c42f12c61a\": rpc error: code = NotFound desc = could not find container \"7ac50f9d9c6b0aacf8a2a6b05e5764ac36bbf56b95164e5f9f9664c42f12c61a\": container with ID starting with 7ac50f9d9c6b0aacf8a2a6b05e5764ac36bbf56b95164e5f9f9664c42f12c61a not found: ID does not exist"
Sep 15 11:50:56.919871 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.919844    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"]
Sep 15 11:50:56.923742 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:56.923718    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ee96ca62-openshift-default-c4d995fd-2blzt"]
Sep 15 11:50:57.377691 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:57.377654    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:50:57.378188 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:57.378034    2564 patch_prober.go:28] interesting pod/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 15 11:50:57.378400 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:57.378375    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk" podUID="14ebcd20-2506-4989-8f2f-263347c4e1e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 15 11:50:57.781551 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:57.781460    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="504ac6bc-5c30-4720-b522-e5f5910b1a84" path="/var/lib/kubelet/pods/504ac6bc-5c30-4720-b522-e5f5910b1a84/volumes"
Sep 15 11:50:58.378196 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:58.378155    2564 patch_prober.go:28] interesting pod/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 15 11:50:58.378617 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:58.378227    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk" podUID="14ebcd20-2506-4989-8f2f-263347c4e1e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 15 11:50:59.378212 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:59.378163    2564 patch_prober.go:28] interesting pod/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 15 11:50:59.378631 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:50:59.378234    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk" podUID="14ebcd20-2506-4989-8f2f-263347c4e1e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 15 11:51:00.377306 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:00.377248    2564 patch_prober.go:28] interesting pod/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 15 11:51:00.377558 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:00.377338    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk" podUID="14ebcd20-2506-4989-8f2f-263347c4e1e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 15 11:51:01.377803 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:01.377766    2564 patch_prober.go:28] interesting pod/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 15 11:51:01.378216 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:01.377828    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk" podUID="14ebcd20-2506-4989-8f2f-263347c4e1e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 15 11:51:02.006857 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:02.006817    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:51:02.381054 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:02.381020    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:51:02.381458 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:02.381299    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:51:02.382041 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:02.382023    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:51:10.910451 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:10.910404    2564 patch_prober.go:28] interesting pod/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 11:51:10.910854 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:10.910502    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk" podUID="7aba9b04-b257-4b9c-b4d7-3243e79459cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 11:51:12.981171 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:12.981138    2564 generic.go:356] "Generic (PLEG): container finished" podID="7aba9b04-b257-4b9c-b4d7-3243e79459cd" containerID="6d8aedf55c2e51408d20180d24337ec1de5c9674ecda3bfe309e401a319ed796" exitCode=0
Sep 15 11:51:12.981752 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:12.981219    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk" event={"ID":"7aba9b04-b257-4b9c-b4d7-3243e79459cd","Type":"ContainerDied","Data":"6d8aedf55c2e51408d20180d24337ec1de5c9674ecda3bfe309e401a319ed796"}
Sep 15 11:51:12.981827 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:12.981757    2564 scope.go:117] "RemoveContainer" containerID="6d8aedf55c2e51408d20180d24337ec1de5c9674ecda3bfe309e401a319ed796"
Sep 15 11:51:12.982777 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:12.982748    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:51:12.982836 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:12.982822    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:51:12.982871 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:12.982855    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:51:13.988376 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:13.988338    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk" event={"ID":"7aba9b04-b257-4b9c-b4d7-3243e79459cd","Type":"ContainerStarted","Data":"420daf9736f461587d0858aaf878a4e49ab5165cbd3a2382d3887d711f98e825"}
Sep 15 11:51:14.807422 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:14.807380    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:51:14.807632 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:14.807608    2564 patch_prober.go:28] interesting pod/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 15 11:51:14.807687 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:14.807660    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk" podUID="7aba9b04-b257-4b9c-b4d7-3243e79459cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 15 11:51:15.806755 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:15.806726    2564 patch_prober.go:28] interesting pod/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 15 11:51:15.807157 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:15.806789    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk" podUID="7aba9b04-b257-4b9c-b4d7-3243e79459cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 15 11:51:16.807161 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:16.807122    2564 patch_prober.go:28] interesting pod/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 15 11:51:16.807609 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:16.807197    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk" podUID="7aba9b04-b257-4b9c-b4d7-3243e79459cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 15 11:51:17.807405 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:17.807371    2564 patch_prober.go:28] interesting pod/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 15 11:51:17.807808 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:17.807423    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk" podUID="7aba9b04-b257-4b9c-b4d7-3243e79459cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 15 11:51:18.806900 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:18.806860    2564 patch_prober.go:28] interesting pod/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 15 11:51:18.807081 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:18.806925    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk" podUID="7aba9b04-b257-4b9c-b4d7-3243e79459cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 15 11:51:19.108448 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:19.108351    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:51:19.810095 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:19.810060    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:51:19.810620 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:19.810583    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:51:19.811157 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:19.811139    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:51:20.600789 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:20.600754    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c353d682-f88v4"]
Sep 15 11:51:20.601168 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:20.601127    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="504ac6bc-5c30-4720-b522-e5f5910b1a84" containerName="istio-proxy"
Sep 15 11:51:20.601168 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:20.601137    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="504ac6bc-5c30-4720-b522-e5f5910b1a84" containerName="istio-proxy"
Sep 15 11:51:20.601168 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:20.601148    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="504ac6bc-5c30-4720-b522-e5f5910b1a84" containerName="istio-proxy"
Sep 15 11:51:20.601168 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:20.601153    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="504ac6bc-5c30-4720-b522-e5f5910b1a84" containerName="istio-proxy"
Sep 15 11:51:20.601335 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:20.601215    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="504ac6bc-5c30-4720-b522-e5f5910b1a84" containerName="istio-proxy"
Sep 15 11:51:20.601335 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:20.601224    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="504ac6bc-5c30-4720-b522-e5f5910b1a84" containerName="istio-proxy"
Sep 15 11:51:20.604391 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:20.604373    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c353d682-f88v4"
Sep 15 11:51:20.606964 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:20.606940    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjx8x\""
Sep 15 11:51:20.607074 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:20.606947    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 11:51:20.612296 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:20.612253    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c353d682-f88v4"]
Sep 15 11:51:20.652000 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:20.651968    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/695b7717-93e4-4366-970c-4f9bd6cfc9cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c353d682-f88v4\" (UID: \"695b7717-93e4-4366-970c-4f9bd6cfc9cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c353d682-f88v4"
Sep 15 11:51:20.753164 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:20.753133    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/695b7717-93e4-4366-970c-4f9bd6cfc9cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c353d682-f88v4\" (UID: \"695b7717-93e4-4366-970c-4f9bd6cfc9cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c353d682-f88v4"
Sep 15 11:51:20.754017 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:20.753993    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/695b7717-93e4-4366-970c-4f9bd6cfc9cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c353d682-f88v4\" (UID: \"695b7717-93e4-4366-970c-4f9bd6cfc9cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c353d682-f88v4"
Sep 15 11:51:20.916694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:20.916611    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c353d682-f88v4"
Sep 15 11:51:21.187130 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:21.187096    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c353d682-f88v4"]
Sep 15 11:51:21.189020 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:51:21.188993    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod695b7717_93e4_4366_970c_4f9bd6cfc9cd.slice/crio-af15c11beb8568afc1a6b1a973247d357e084e78546ef0b2f293307935478f51 WatchSource:0}: Error finding container af15c11beb8568afc1a6b1a973247d357e084e78546ef0b2f293307935478f51: Status 404 returned error can't find the container with id af15c11beb8568afc1a6b1a973247d357e084e78546ef0b2f293307935478f51
Sep 15 11:51:22.033245 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:22.033157    2564 generic.go:356] "Generic (PLEG): container finished" podID="695b7717-93e4-4366-970c-4f9bd6cfc9cd" containerID="58ef3d777cb644f385460d559dd89dc58c0b44b6d6773363bd2f16f9bf81dc90" exitCode=0
Sep 15 11:51:22.033245 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:22.033208    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c353d682-f88v4" event={"ID":"695b7717-93e4-4366-970c-4f9bd6cfc9cd","Type":"ContainerDied","Data":"58ef3d777cb644f385460d559dd89dc58c0b44b6d6773363bd2f16f9bf81dc90"}
Sep 15 11:51:22.033245 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:22.033246    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c353d682-f88v4" event={"ID":"695b7717-93e4-4366-970c-4f9bd6cfc9cd","Type":"ContainerStarted","Data":"af15c11beb8568afc1a6b1a973247d357e084e78546ef0b2f293307935478f51"}
Sep 15 11:51:23.166274 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:23.166238    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c353d682-f88v4"
Sep 15 11:51:23.276068 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:23.276036    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/695b7717-93e4-4366-970c-4f9bd6cfc9cd-maas-api-service-ca\") pod \"695b7717-93e4-4366-970c-4f9bd6cfc9cd\" (UID: \"695b7717-93e4-4366-970c-4f9bd6cfc9cd\") "
Sep 15 11:51:23.276418 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:23.276396    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/695b7717-93e4-4366-970c-4f9bd6cfc9cd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "695b7717-93e4-4366-970c-4f9bd6cfc9cd" (UID: "695b7717-93e4-4366-970c-4f9bd6cfc9cd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:51:23.376842 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:23.376808    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/695b7717-93e4-4366-970c-4f9bd6cfc9cd-maas-api-service-ca\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:51:24.045779 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:24.045679    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c353d682-f88v4"
Sep 15 11:51:24.045779 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:24.045705    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c353d682-f88v4" event={"ID":"695b7717-93e4-4366-970c-4f9bd6cfc9cd","Type":"ContainerDied","Data":"af15c11beb8568afc1a6b1a973247d357e084e78546ef0b2f293307935478f51"}
Sep 15 11:51:24.045779 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:24.045746    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af15c11beb8568afc1a6b1a973247d357e084e78546ef0b2f293307935478f51"
Sep 15 11:51:27.446321 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:27.446256    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c353d682-f88v4"]
Sep 15 11:51:27.448677 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:27.448649    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c353d682-f88v4"]
Sep 15 11:51:27.593868 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:27.593836    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"]
Sep 15 11:51:27.594122 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:27.594074    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk" podUID="7aba9b04-b257-4b9c-b4d7-3243e79459cd" containerName="istio-proxy" containerID="cri-o://420daf9736f461587d0858aaf878a4e49ab5165cbd3a2382d3887d711f98e825" gracePeriod=30
Sep 15 11:51:27.779637 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:27.779550    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="695b7717-93e4-4366-970c-4f9bd6cfc9cd" path="/var/lib/kubelet/pods/695b7717-93e4-4366-970c-4f9bd6cfc9cd/volumes"
Sep 15 11:51:28.435940 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.435910    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"]
Sep 15 11:51:28.436332 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.436308    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="695b7717-93e4-4366-970c-4f9bd6cfc9cd" containerName="revoke-keys"
Sep 15 11:51:28.436332 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.436330    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="695b7717-93e4-4366-970c-4f9bd6cfc9cd" containerName="revoke-keys"
Sep 15 11:51:28.436472 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.436458    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="695b7717-93e4-4366-970c-4f9bd6cfc9cd" containerName="revoke-keys"
Sep 15 11:51:28.439769 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.439749    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.442630 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.442614    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b02eba29-openshift-default-dockercfg-4fjxs\""
Sep 15 11:51:28.455397 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.455374    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"]
Sep 15 11:51:28.523849 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.523815    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-workload-certs\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.523991 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.523865    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-token\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.523991 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.523918    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-envoy\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.524065 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.523994    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8svm7\" (UniqueName: \"kubernetes.io/projected/580509a4-3a78-405f-90ce-f816afc1e7a1-kube-api-access-8svm7\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.524065 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.524058    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-podinfo\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.524127 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.524075    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-data\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.524127 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.524101    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-workload-socket\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.524192 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.524126    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/580509a4-3a78-405f-90ce-f816afc1e7a1-istiod-ca-cert\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.524192 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.524155    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-credential-socket\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.625532 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.625484    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-podinfo\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.625532 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.625533    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-data\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.625768 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.625563    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-workload-socket\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.625768 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.625587    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/580509a4-3a78-405f-90ce-f816afc1e7a1-istiod-ca-cert\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.625768 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.625626    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-credential-socket\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.625768 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.625656    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-workload-certs\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.625768 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.625710    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-token\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.625768 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.625735    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-envoy\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.625768 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.625769    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8svm7\" (UniqueName: \"kubernetes.io/projected/580509a4-3a78-405f-90ce-f816afc1e7a1-kube-api-access-8svm7\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.626184 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.626037    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-data\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.626184 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.626052    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-workload-socket\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.626350 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.626320    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-workload-certs\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.626434 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.626363    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-credential-socket\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.627203 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.627176    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/580509a4-3a78-405f-90ce-f816afc1e7a1-istiod-ca-cert\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.628578 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.628528    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-envoy\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.629250 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.629224    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-podinfo\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.635538 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.635511    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-token\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.635719 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.635697    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8svm7\" (UniqueName: \"kubernetes.io/projected/580509a4-3a78-405f-90ce-f816afc1e7a1-kube-api-access-8svm7\") pod \"e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") " pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:28.750521 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:28.750429    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:29.029846 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:29.029820    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"]
Sep 15 11:51:29.030990 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:51:29.030962    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod580509a4_3a78_405f_90ce_f816afc1e7a1.slice/crio-b3e523a3bb07c7c465cf5f33490ef2f8a691765ba242b94f859b8bf9a5614aeb WatchSource:0}: Error finding container b3e523a3bb07c7c465cf5f33490ef2f8a691765ba242b94f859b8bf9a5614aeb: Status 404 returned error can't find the container with id b3e523a3bb07c7c465cf5f33490ef2f8a691765ba242b94f859b8bf9a5614aeb
Sep 15 11:51:29.033189 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:29.033154    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:51:29.033300 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:29.033240    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:51:29.033370 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:29.033303    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:51:29.073806 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:29.073776    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8" event={"ID":"580509a4-3a78-405f-90ce-f816afc1e7a1","Type":"ContainerStarted","Data":"b3e523a3bb07c7c465cf5f33490ef2f8a691765ba242b94f859b8bf9a5614aeb"}
Sep 15 11:51:30.080281 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:30.080223    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8" event={"ID":"580509a4-3a78-405f-90ce-f816afc1e7a1","Type":"ContainerStarted","Data":"2e5f5b976097a7e091309f67d0b6d2d213f3886d069677b59b25e999a404f3d0"}
Sep 15 11:51:30.101535 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:30.101488    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8" podStartSLOduration=2.101472515 podStartE2EDuration="2.101472515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:51:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:51:30.100087085 +0000 UTC m=+866.816961277" watchObservedRunningTime="2026-09-15 11:51:30.101472515 +0000 UTC m=+866.818346698"
Sep 15 11:51:30.751549 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:30.751509    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:30.756623 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:30.756590    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:30.907608 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:30.907570    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:51:31.085663 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:31.085615    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:31.086660 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:31.086633    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:32.838006 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:32.837983    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:51:32.966238 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:32.966146    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfghd\" (UniqueName: \"kubernetes.io/projected/7aba9b04-b257-4b9c-b4d7-3243e79459cd-kube-api-access-hfghd\") pod \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") "
Sep 15 11:51:32.966238 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:32.966190    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-credential-socket\") pod \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") "
Sep 15 11:51:32.966482 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:32.966238    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-data\") pod \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") "
Sep 15 11:51:32.966482 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:32.966284    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-envoy\") pod \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") "
Sep 15 11:51:32.966482 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:32.966319    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-workload-certs\") pod \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") "
Sep 15 11:51:32.966482 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:32.966349    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-podinfo\") pod \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") "
Sep 15 11:51:32.966482 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:32.966423    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-token\") pod \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") "
Sep 15 11:51:32.966482 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:32.966459    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istiod-ca-cert\") pod \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") "
Sep 15 11:51:32.966482 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:32.966483    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-workload-socket\") pod \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\" (UID: \"7aba9b04-b257-4b9c-b4d7-3243e79459cd\") "
Sep 15 11:51:32.966817 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:32.966571    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7aba9b04-b257-4b9c-b4d7-3243e79459cd" (UID: "7aba9b04-b257-4b9c-b4d7-3243e79459cd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:32.966817 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:32.966585    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-data" (OuterVolumeSpecName: "istio-data") pod "7aba9b04-b257-4b9c-b4d7-3243e79459cd" (UID: "7aba9b04-b257-4b9c-b4d7-3243e79459cd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:32.966817 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:32.966625    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7aba9b04-b257-4b9c-b4d7-3243e79459cd" (UID: "7aba9b04-b257-4b9c-b4d7-3243e79459cd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:32.966817 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:32.966788    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7aba9b04-b257-4b9c-b4d7-3243e79459cd" (UID: "7aba9b04-b257-4b9c-b4d7-3243e79459cd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:32.966817 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:32.966810    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-workload-certs\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:51:32.967021 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:32.966831    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-credential-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:51:32.967021 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:32.966845    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-data\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:51:32.967021 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:32.966887    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7aba9b04-b257-4b9c-b4d7-3243e79459cd" (UID: "7aba9b04-b257-4b9c-b4d7-3243e79459cd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:51:32.968560 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:32.968525    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7aba9b04-b257-4b9c-b4d7-3243e79459cd" (UID: "7aba9b04-b257-4b9c-b4d7-3243e79459cd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:51:32.968680 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:32.968621    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7aba9b04-b257-4b9c-b4d7-3243e79459cd" (UID: "7aba9b04-b257-4b9c-b4d7-3243e79459cd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:32.968773 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:32.968755    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7aba9b04-b257-4b9c-b4d7-3243e79459cd-kube-api-access-hfghd" (OuterVolumeSpecName: "kube-api-access-hfghd") pod "7aba9b04-b257-4b9c-b4d7-3243e79459cd" (UID: "7aba9b04-b257-4b9c-b4d7-3243e79459cd"). InnerVolumeSpecName "kube-api-access-hfghd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:32.968825 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:32.968803    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-token" (OuterVolumeSpecName: "istio-token") pod "7aba9b04-b257-4b9c-b4d7-3243e79459cd" (UID: "7aba9b04-b257-4b9c-b4d7-3243e79459cd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:33.067968 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:33.067933    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfghd\" (UniqueName: \"kubernetes.io/projected/7aba9b04-b257-4b9c-b4d7-3243e79459cd-kube-api-access-hfghd\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:51:33.067968 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:33.067961    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-envoy\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:51:33.067968 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:33.067971    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-podinfo\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:51:33.067968 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:33.067979    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istio-token\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:51:33.068218 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:33.067987    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7aba9b04-b257-4b9c-b4d7-3243e79459cd-istiod-ca-cert\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:51:33.068218 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:33.067997    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aba9b04-b257-4b9c-b4d7-3243e79459cd-workload-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:51:33.098446 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:33.098416    2564 generic.go:356] "Generic (PLEG): container finished" podID="7aba9b04-b257-4b9c-b4d7-3243e79459cd" containerID="420daf9736f461587d0858aaf878a4e49ab5165cbd3a2382d3887d711f98e825" exitCode=0
Sep 15 11:51:33.098587 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:33.098468    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"
Sep 15 11:51:33.098587 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:33.098501    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk" event={"ID":"7aba9b04-b257-4b9c-b4d7-3243e79459cd","Type":"ContainerDied","Data":"420daf9736f461587d0858aaf878a4e49ab5165cbd3a2382d3887d711f98e825"}
Sep 15 11:51:33.098587 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:33.098572    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk" event={"ID":"7aba9b04-b257-4b9c-b4d7-3243e79459cd","Type":"ContainerDied","Data":"3cfa64e38be6afb639a77451bb204d252bf71cd185eb636624ec7678c9f9ec07"}
Sep 15 11:51:33.098689 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:33.098603    2564 scope.go:117] "RemoveContainer" containerID="420daf9736f461587d0858aaf878a4e49ab5165cbd3a2382d3887d711f98e825"
Sep 15 11:51:33.107930 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:33.107913    2564 scope.go:117] "RemoveContainer" containerID="6d8aedf55c2e51408d20180d24337ec1de5c9674ecda3bfe309e401a319ed796"
Sep 15 11:51:33.115810 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:33.115793    2564 scope.go:117] "RemoveContainer" containerID="420daf9736f461587d0858aaf878a4e49ab5165cbd3a2382d3887d711f98e825"
Sep 15 11:51:33.116077 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:51:33.116055    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"420daf9736f461587d0858aaf878a4e49ab5165cbd3a2382d3887d711f98e825\": container with ID starting with 420daf9736f461587d0858aaf878a4e49ab5165cbd3a2382d3887d711f98e825 not found: ID does not exist" containerID="420daf9736f461587d0858aaf878a4e49ab5165cbd3a2382d3887d711f98e825"
Sep 15 11:51:33.116134 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:33.116083    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"420daf9736f461587d0858aaf878a4e49ab5165cbd3a2382d3887d711f98e825"} err="failed to get container status \"420daf9736f461587d0858aaf878a4e49ab5165cbd3a2382d3887d711f98e825\": rpc error: code = NotFound desc = could not find container \"420daf9736f461587d0858aaf878a4e49ab5165cbd3a2382d3887d711f98e825\": container with ID starting with 420daf9736f461587d0858aaf878a4e49ab5165cbd3a2382d3887d711f98e825 not found: ID does not exist"
Sep 15 11:51:33.116134 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:33.116098    2564 scope.go:117] "RemoveContainer" containerID="6d8aedf55c2e51408d20180d24337ec1de5c9674ecda3bfe309e401a319ed796"
Sep 15 11:51:33.116372 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:51:33.116354    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d8aedf55c2e51408d20180d24337ec1de5c9674ecda3bfe309e401a319ed796\": container with ID starting with 6d8aedf55c2e51408d20180d24337ec1de5c9674ecda3bfe309e401a319ed796 not found: ID does not exist" containerID="6d8aedf55c2e51408d20180d24337ec1de5c9674ecda3bfe309e401a319ed796"
Sep 15 11:51:33.116424 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:33.116377    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d8aedf55c2e51408d20180d24337ec1de5c9674ecda3bfe309e401a319ed796"} err="failed to get container status \"6d8aedf55c2e51408d20180d24337ec1de5c9674ecda3bfe309e401a319ed796\": rpc error: code = NotFound desc = could not find container \"6d8aedf55c2e51408d20180d24337ec1de5c9674ecda3bfe309e401a319ed796\": container with ID starting with 6d8aedf55c2e51408d20180d24337ec1de5c9674ecda3bfe309e401a319ed796 not found: ID does not exist"
Sep 15 11:51:33.120839 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:33.120814    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"]
Sep 15 11:51:33.126007 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:33.125987    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-c353d682-gw-openshift-default-654d459956-vjgvk"]
Sep 15 11:51:33.779454 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:33.779417    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7aba9b04-b257-4b9c-b4d7-3243e79459cd" path="/var/lib/kubelet/pods/7aba9b04-b257-4b9c-b4d7-3243e79459cd/volumes"
Sep 15 11:51:45.405494 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:45.405456    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:51:47.129418 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:47.129375    2564 patch_prober.go:28] interesting pod/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 11:51:47.129913 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:47.129461    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8" podUID="580509a4-3a78-405f-90ce-f816afc1e7a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 11:51:48.190589 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:48.190555    2564 generic.go:356] "Generic (PLEG): container finished" podID="580509a4-3a78-405f-90ce-f816afc1e7a1" containerID="2e5f5b976097a7e091309f67d0b6d2d213f3886d069677b59b25e999a404f3d0" exitCode=0
Sep 15 11:51:48.191000 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:48.190627    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8" event={"ID":"580509a4-3a78-405f-90ce-f816afc1e7a1","Type":"ContainerDied","Data":"2e5f5b976097a7e091309f67d0b6d2d213f3886d069677b59b25e999a404f3d0"}
Sep 15 11:51:48.191060 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:48.191033    2564 scope.go:117] "RemoveContainer" containerID="2e5f5b976097a7e091309f67d0b6d2d213f3886d069677b59b25e999a404f3d0"
Sep 15 11:51:48.192066 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:48.192038    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:51:48.192131 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:48.192104    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:51:48.192171 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:48.192135    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:51:49.199174 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:49.199138    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8" event={"ID":"580509a4-3a78-405f-90ce-f816afc1e7a1","Type":"ContainerStarted","Data":"d98e5adc5a045470e8952b4f34db7b6e5d0b8bb51d1554effe36f6a2d85c959d"}
Sep 15 11:51:49.751224 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:49.751188    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:49.751676 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:49.751582    2564 patch_prober.go:28] interesting pod/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 15 11:51:49.751871 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:49.751847    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8" podUID="580509a4-3a78-405f-90ce-f816afc1e7a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 15 11:51:50.751699 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:50.751653    2564 patch_prober.go:28] interesting pod/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 15 11:51:50.752210 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:50.751723    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8" podUID="580509a4-3a78-405f-90ce-f816afc1e7a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 15 11:51:51.751061 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:51.751012    2564 patch_prober.go:28] interesting pod/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 15 11:51:51.751303 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:51.751086    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8" podUID="580509a4-3a78-405f-90ce-f816afc1e7a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 15 11:51:52.751933 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:52.751884    2564 patch_prober.go:28] interesting pod/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 15 11:51:52.752473 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:52.751955    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8" podUID="580509a4-3a78-405f-90ce-f816afc1e7a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 15 11:51:53.751528 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:53.751484    2564 patch_prober.go:28] interesting pod/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 15 11:51:53.751743 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:53.751576    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8" podUID="580509a4-3a78-405f-90ce-f816afc1e7a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 15 11:51:54.755021 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:54.754988    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:54.755468 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:54.755279    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:51:54.756013 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:51:54.755990    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:52:00.481321 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:00.481230    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b02eba29-pj67r"]
Sep 15 11:52:00.481685 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:00.481650    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7aba9b04-b257-4b9c-b4d7-3243e79459cd" containerName="istio-proxy"
Sep 15 11:52:00.481685 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:00.481665    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7aba9b04-b257-4b9c-b4d7-3243e79459cd" containerName="istio-proxy"
Sep 15 11:52:00.481685 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:00.481684    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7aba9b04-b257-4b9c-b4d7-3243e79459cd" containerName="istio-proxy"
Sep 15 11:52:00.481789 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:00.481690    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7aba9b04-b257-4b9c-b4d7-3243e79459cd" containerName="istio-proxy"
Sep 15 11:52:00.481789 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:00.481753    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7aba9b04-b257-4b9c-b4d7-3243e79459cd" containerName="istio-proxy"
Sep 15 11:52:00.483992 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:00.483974    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b02eba29-pj67r"
Sep 15 11:52:00.489451 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:00.489426    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 11:52:00.489592 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:00.489457    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjx8x\""
Sep 15 11:52:00.495538 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:00.495512    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b02eba29-pj67r"]
Sep 15 11:52:00.520583 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:00.520554    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38f9f444-60e6-4521-8a3c-5e4c3abb6ffc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b02eba29-pj67r\" (UID: \"38f9f444-60e6-4521-8a3c-5e4c3abb6ffc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b02eba29-pj67r"
Sep 15 11:52:00.621569 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:00.621530    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38f9f444-60e6-4521-8a3c-5e4c3abb6ffc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b02eba29-pj67r\" (UID: \"38f9f444-60e6-4521-8a3c-5e4c3abb6ffc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b02eba29-pj67r"
Sep 15 11:52:00.622249 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:00.622222    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38f9f444-60e6-4521-8a3c-5e4c3abb6ffc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b02eba29-pj67r\" (UID: \"38f9f444-60e6-4521-8a3c-5e4c3abb6ffc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b02eba29-pj67r"
Sep 15 11:52:00.796809 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:00.796687    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b02eba29-pj67r"
Sep 15 11:52:01.068347 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:01.068311    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b02eba29-pj67r"]
Sep 15 11:52:01.070055 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:52:01.070026    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38f9f444_60e6_4521_8a3c_5e4c3abb6ffc.slice/crio-24b1904965fc78d7d4eb13b9d93e61dfbd1b693d746448e3195f1f26dba80300 WatchSource:0}: Error finding container 24b1904965fc78d7d4eb13b9d93e61dfbd1b693d746448e3195f1f26dba80300: Status 404 returned error can't find the container with id 24b1904965fc78d7d4eb13b9d93e61dfbd1b693d746448e3195f1f26dba80300
Sep 15 11:52:01.269161 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:01.269122    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b02eba29-pj67r" event={"ID":"38f9f444-60e6-4521-8a3c-5e4c3abb6ffc","Type":"ContainerStarted","Data":"24b1904965fc78d7d4eb13b9d93e61dfbd1b693d746448e3195f1f26dba80300"}
Sep 15 11:52:02.276390 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:02.276285    2564 generic.go:356] "Generic (PLEG): container finished" podID="38f9f444-60e6-4521-8a3c-5e4c3abb6ffc" containerID="fbd39e1efdc6996d25eb1596b829d0b52451001e41e719ddd49a5be734b48195" exitCode=0
Sep 15 11:52:02.276390 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:02.276368    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b02eba29-pj67r" event={"ID":"38f9f444-60e6-4521-8a3c-5e4c3abb6ffc","Type":"ContainerDied","Data":"fbd39e1efdc6996d25eb1596b829d0b52451001e41e719ddd49a5be734b48195"}
Sep 15 11:52:02.410062 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:02.410029    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:52:03.410804 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:03.410780    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b02eba29-pj67r"
Sep 15 11:52:03.447549 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:03.447518    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38f9f444-60e6-4521-8a3c-5e4c3abb6ffc-maas-api-service-ca\") pod \"38f9f444-60e6-4521-8a3c-5e4c3abb6ffc\" (UID: \"38f9f444-60e6-4521-8a3c-5e4c3abb6ffc\") "
Sep 15 11:52:03.447905 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:03.447879    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38f9f444-60e6-4521-8a3c-5e4c3abb6ffc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "38f9f444-60e6-4521-8a3c-5e4c3abb6ffc" (UID: "38f9f444-60e6-4521-8a3c-5e4c3abb6ffc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:52:03.549378 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:03.549285    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38f9f444-60e6-4521-8a3c-5e4c3abb6ffc-maas-api-service-ca\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:52:04.289187 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:04.289154    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b02eba29-pj67r"
Sep 15 11:52:04.289358 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:04.289148    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b02eba29-pj67r" event={"ID":"38f9f444-60e6-4521-8a3c-5e4c3abb6ffc","Type":"ContainerDied","Data":"24b1904965fc78d7d4eb13b9d93e61dfbd1b693d746448e3195f1f26dba80300"}
Sep 15 11:52:04.289358 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:04.289314    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24b1904965fc78d7d4eb13b9d93e61dfbd1b693d746448e3195f1f26dba80300"
Sep 15 11:52:13.304856 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:13.304817    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b02eba29-pj67r"]
Sep 15 11:52:13.306840 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:13.306817    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b02eba29-pj67r"]
Sep 15 11:52:13.780069 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:13.779984    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38f9f444-60e6-4521-8a3c-5e4c3abb6ffc" path="/var/lib/kubelet/pods/38f9f444-60e6-4521-8a3c-5e4c3abb6ffc/volumes"
Sep 15 11:52:15.171435 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:15.171401    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"]
Sep 15 11:52:15.171823 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:15.171613    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8" podUID="580509a4-3a78-405f-90ce-f816afc1e7a1" containerName="istio-proxy" containerID="cri-o://d98e5adc5a045470e8952b4f34db7b6e5d0b8bb51d1554effe36f6a2d85c959d" gracePeriod=30
Sep 15 11:52:16.016147 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.016111    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"]
Sep 15 11:52:16.016521 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.016506    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38f9f444-60e6-4521-8a3c-5e4c3abb6ffc" containerName="revoke-keys"
Sep 15 11:52:16.016584 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.016524    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="38f9f444-60e6-4521-8a3c-5e4c3abb6ffc" containerName="revoke-keys"
Sep 15 11:52:16.016625 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.016596    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="38f9f444-60e6-4521-8a3c-5e4c3abb6ffc" containerName="revoke-keys"
Sep 15 11:52:16.016625 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.016609    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7aba9b04-b257-4b9c-b4d7-3243e79459cd" containerName="istio-proxy"
Sep 15 11:52:16.019223 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.019200    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.022845 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.022822    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-f6336aa2-openshift-default-dockercfg-jjcfc\""
Sep 15 11:52:16.053587 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.053565    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"]
Sep 15 11:52:16.157708 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.157660    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53cc34b4-7f39-4a59-ab36-bdee13a80808-istiod-ca-cert\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.157708 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.157707    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-credential-socket\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.157970 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.157785    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-workload-certs\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.157970 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.157870    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-envoy\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.157970 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.157913    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7n6z\" (UniqueName: \"kubernetes.io/projected/53cc34b4-7f39-4a59-ab36-bdee13a80808-kube-api-access-c7n6z\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.158132 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.158003    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-workload-socket\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.158132 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.158057    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-podinfo\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.158132 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.158081    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-token\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.158132 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.158107    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-data\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.259234 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.259191    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-workload-socket\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.259844 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.259256    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-podinfo\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.259844 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.259296    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-token\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.259844 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.259324    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-data\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.259844 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.259353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53cc34b4-7f39-4a59-ab36-bdee13a80808-istiod-ca-cert\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.259844 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.259388    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-credential-socket\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.259844 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.259437    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-workload-certs\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.259844 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.259472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-envoy\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.259844 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.259496    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7n6z\" (UniqueName: \"kubernetes.io/projected/53cc34b4-7f39-4a59-ab36-bdee13a80808-kube-api-access-c7n6z\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.259844 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.259650    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-workload-socket\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.259844 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.259703    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-data\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.260447 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.259904    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-credential-socket\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.260447 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.259954    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-workload-certs\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.260447 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.260348    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53cc34b4-7f39-4a59-ab36-bdee13a80808-istiod-ca-cert\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.261857 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.261832    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-podinfo\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.261987 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.261968    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-envoy\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.268344 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.268246    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-token\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.268878 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.268857    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7n6z\" (UniqueName: \"kubernetes.io/projected/53cc34b4-7f39-4a59-ab36-bdee13a80808-kube-api-access-c7n6z\") pod \"e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") " pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.329824 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.329796    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:16.619408 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.619381    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"]
Sep 15 11:52:16.620726 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:52:16.620703    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53cc34b4_7f39_4a59_ab36_bdee13a80808.slice/crio-eb6e11364d4860f048c04d4fa98a2d13023b159fb630a75295229e3b9cd47c17 WatchSource:0}: Error finding container eb6e11364d4860f048c04d4fa98a2d13023b159fb630a75295229e3b9cd47c17: Status 404 returned error can't find the container with id eb6e11364d4860f048c04d4fa98a2d13023b159fb630a75295229e3b9cd47c17
Sep 15 11:52:16.622903 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.622871    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:52:16.622956 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.622937    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:52:16.622997 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:16.622965    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:52:17.362080 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:17.362042    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c" event={"ID":"53cc34b4-7f39-4a59-ab36-bdee13a80808","Type":"ContainerStarted","Data":"c226299882aba633d4561c3a9188e11a06bcabe736f3cf39730228411ded25ae"}
Sep 15 11:52:17.362539 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:17.362104    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c" event={"ID":"53cc34b4-7f39-4a59-ab36-bdee13a80808","Type":"ContainerStarted","Data":"eb6e11364d4860f048c04d4fa98a2d13023b159fb630a75295229e3b9cd47c17"}
Sep 15 11:52:17.404483 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:17.404427    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c" podStartSLOduration=2.404410096 podStartE2EDuration="2.404410096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:52:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:52:17.402549283 +0000 UTC m=+914.119423469" watchObservedRunningTime="2026-09-15 11:52:17.404410096 +0000 UTC m=+914.121284280"
Sep 15 11:52:18.330624 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:18.330588    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:18.335543 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:18.335518    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:18.367392 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:18.367367    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:18.368070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:18.368052    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:18.617716 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:18.617634    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:52:20.380570 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.380537    2564 generic.go:356] "Generic (PLEG): container finished" podID="580509a4-3a78-405f-90ce-f816afc1e7a1" containerID="d98e5adc5a045470e8952b4f34db7b6e5d0b8bb51d1554effe36f6a2d85c959d" exitCode=0
Sep 15 11:52:20.380953 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.380598    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8" event={"ID":"580509a4-3a78-405f-90ce-f816afc1e7a1","Type":"ContainerDied","Data":"d98e5adc5a045470e8952b4f34db7b6e5d0b8bb51d1554effe36f6a2d85c959d"}
Sep 15 11:52:20.380953 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.380677    2564 scope.go:117] "RemoveContainer" containerID="2e5f5b976097a7e091309f67d0b6d2d213f3886d069677b59b25e999a404f3d0"
Sep 15 11:52:20.430214 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.430187    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:52:20.498048 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.497968    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8svm7\" (UniqueName: \"kubernetes.io/projected/580509a4-3a78-405f-90ce-f816afc1e7a1-kube-api-access-8svm7\") pod \"580509a4-3a78-405f-90ce-f816afc1e7a1\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") "
Sep 15 11:52:20.498048 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.497999    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-data\") pod \"580509a4-3a78-405f-90ce-f816afc1e7a1\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") "
Sep 15 11:52:20.498048 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.498039    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-workload-socket\") pod \"580509a4-3a78-405f-90ce-f816afc1e7a1\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") "
Sep 15 11:52:20.498317 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.498118    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-envoy\") pod \"580509a4-3a78-405f-90ce-f816afc1e7a1\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") "
Sep 15 11:52:20.498317 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.498157    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-token\") pod \"580509a4-3a78-405f-90ce-f816afc1e7a1\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") "
Sep 15 11:52:20.498317 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.498194    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-workload-certs\") pod \"580509a4-3a78-405f-90ce-f816afc1e7a1\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") "
Sep 15 11:52:20.498317 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.498216    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-podinfo\") pod \"580509a4-3a78-405f-90ce-f816afc1e7a1\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") "
Sep 15 11:52:20.498317 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.498315    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/580509a4-3a78-405f-90ce-f816afc1e7a1-istiod-ca-cert\") pod \"580509a4-3a78-405f-90ce-f816afc1e7a1\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") "
Sep 15 11:52:20.498590 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.498356    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-data" (OuterVolumeSpecName: "istio-data") pod "580509a4-3a78-405f-90ce-f816afc1e7a1" (UID: "580509a4-3a78-405f-90ce-f816afc1e7a1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:20.498590 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.498369    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-credential-socket\") pod \"580509a4-3a78-405f-90ce-f816afc1e7a1\" (UID: \"580509a4-3a78-405f-90ce-f816afc1e7a1\") "
Sep 15 11:52:20.498590 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.498443    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "580509a4-3a78-405f-90ce-f816afc1e7a1" (UID: "580509a4-3a78-405f-90ce-f816afc1e7a1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:20.498803 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.498587    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "580509a4-3a78-405f-90ce-f816afc1e7a1" (UID: "580509a4-3a78-405f-90ce-f816afc1e7a1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:20.498803 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.498686    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "580509a4-3a78-405f-90ce-f816afc1e7a1" (UID: "580509a4-3a78-405f-90ce-f816afc1e7a1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:20.498803 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.498723    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/580509a4-3a78-405f-90ce-f816afc1e7a1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "580509a4-3a78-405f-90ce-f816afc1e7a1" (UID: "580509a4-3a78-405f-90ce-f816afc1e7a1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:52:20.499112 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.499080    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-workload-certs\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:52:20.499112 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.499103    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/580509a4-3a78-405f-90ce-f816afc1e7a1-istiod-ca-cert\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:52:20.499272 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.499118    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-credential-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:52:20.499272 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.499131    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-data\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:52:20.499272 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.499144    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-workload-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:52:20.500606 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.500571    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "580509a4-3a78-405f-90ce-f816afc1e7a1" (UID: "580509a4-3a78-405f-90ce-f816afc1e7a1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:52:20.500881 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.500860    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-token" (OuterVolumeSpecName: "istio-token") pod "580509a4-3a78-405f-90ce-f816afc1e7a1" (UID: "580509a4-3a78-405f-90ce-f816afc1e7a1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:52:20.500953 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.500934    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/580509a4-3a78-405f-90ce-f816afc1e7a1-kube-api-access-8svm7" (OuterVolumeSpecName: "kube-api-access-8svm7") pod "580509a4-3a78-405f-90ce-f816afc1e7a1" (UID: "580509a4-3a78-405f-90ce-f816afc1e7a1"). InnerVolumeSpecName "kube-api-access-8svm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:52:20.501009 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.500980    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "580509a4-3a78-405f-90ce-f816afc1e7a1" (UID: "580509a4-3a78-405f-90ce-f816afc1e7a1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:20.600112 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.600077    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-envoy\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:52:20.600112 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.600106    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-token\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:52:20.600112 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.600118    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/580509a4-3a78-405f-90ce-f816afc1e7a1-istio-podinfo\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:52:20.600390 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:20.600130    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8svm7\" (UniqueName: \"kubernetes.io/projected/580509a4-3a78-405f-90ce-f816afc1e7a1-kube-api-access-8svm7\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:52:21.387138 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:21.387110    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"
Sep 15 11:52:21.387623 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:21.387105    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8" event={"ID":"580509a4-3a78-405f-90ce-f816afc1e7a1","Type":"ContainerDied","Data":"b3e523a3bb07c7c465cf5f33490ef2f8a691765ba242b94f859b8bf9a5614aeb"}
Sep 15 11:52:21.387623 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:21.387257    2564 scope.go:117] "RemoveContainer" containerID="d98e5adc5a045470e8952b4f34db7b6e5d0b8bb51d1554effe36f6a2d85c959d"
Sep 15 11:52:21.423688 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:21.423653    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"]
Sep 15 11:52:21.427248 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:21.427224    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b02eba29-openshift-default-7ffcb64954-bvff8"]
Sep 15 11:52:21.779800 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:21.779718    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="580509a4-3a78-405f-90ce-f816afc1e7a1" path="/var/lib/kubelet/pods/580509a4-3a78-405f-90ce-f816afc1e7a1/volumes"
Sep 15 11:52:34.025513 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:34.025429    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:52:37.482533 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:37.482499    2564 generic.go:356] "Generic (PLEG): container finished" podID="53cc34b4-7f39-4a59-ab36-bdee13a80808" containerID="c226299882aba633d4561c3a9188e11a06bcabe736f3cf39730228411ded25ae" exitCode=0
Sep 15 11:52:37.482957 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:37.482574    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c" event={"ID":"53cc34b4-7f39-4a59-ab36-bdee13a80808","Type":"ContainerDied","Data":"c226299882aba633d4561c3a9188e11a06bcabe736f3cf39730228411ded25ae"}
Sep 15 11:52:37.482999 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:37.482961    2564 scope.go:117] "RemoveContainer" containerID="c226299882aba633d4561c3a9188e11a06bcabe736f3cf39730228411ded25ae"
Sep 15 11:52:37.484063 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:37.484034    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:52:37.484128 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:37.484114    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:52:37.484164 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:37.484146    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:52:38.491362 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:38.491323    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c" event={"ID":"53cc34b4-7f39-4a59-ab36-bdee13a80808","Type":"ContainerStarted","Data":"862d62dda4e9aa306c45c413ba8377ed3fe00e1a87654add28f4933c9266b798"}
Sep 15 11:52:39.330194 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:39.330155    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:39.330443 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:39.330405    2564 patch_prober.go:28] interesting pod/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 15 11:52:39.330502 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:39.330468    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c" podUID="53cc34b4-7f39-4a59-ab36-bdee13a80808" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 15 11:52:40.330281 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:40.330223    2564 patch_prober.go:28] interesting pod/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 15 11:52:40.330688 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:40.330309    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c" podUID="53cc34b4-7f39-4a59-ab36-bdee13a80808" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 15 11:52:41.330904 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:41.330868    2564 patch_prober.go:28] interesting pod/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 15 11:52:41.331324 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:41.330937    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c" podUID="53cc34b4-7f39-4a59-ab36-bdee13a80808" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 15 11:52:42.330452 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:42.330415    2564 patch_prober.go:28] interesting pod/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 15 11:52:42.330600 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:42.330485    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c" podUID="53cc34b4-7f39-4a59-ab36-bdee13a80808" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 15 11:52:43.330873 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:43.330836    2564 patch_prober.go:28] interesting pod/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 15 11:52:43.331301 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:43.330888    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c" podUID="53cc34b4-7f39-4a59-ab36-bdee13a80808" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 15 11:52:44.464076 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:44.464033    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:44.464579 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:44.464497    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:44.465372 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:44.465350    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:44.840302 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:44.840270    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6336aa2-f8726"]
Sep 15 11:52:44.840655 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:44.840627    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="580509a4-3a78-405f-90ce-f816afc1e7a1" containerName="istio-proxy"
Sep 15 11:52:44.840655 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:44.840646    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="580509a4-3a78-405f-90ce-f816afc1e7a1" containerName="istio-proxy"
Sep 15 11:52:44.840655 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:44.840660    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="580509a4-3a78-405f-90ce-f816afc1e7a1" containerName="istio-proxy"
Sep 15 11:52:44.840907 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:44.840666    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="580509a4-3a78-405f-90ce-f816afc1e7a1" containerName="istio-proxy"
Sep 15 11:52:44.840907 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:44.840739    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="580509a4-3a78-405f-90ce-f816afc1e7a1" containerName="istio-proxy"
Sep 15 11:52:44.842992 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:44.842973    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6336aa2-f8726"
Sep 15 11:52:44.845952 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:44.845934    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 11:52:44.846066 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:44.846054    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjx8x\""
Sep 15 11:52:44.851766 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:44.851745    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6336aa2-f8726"]
Sep 15 11:52:44.922364 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:44.922323    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1611b6-3f82-41b9-8325-e5a9858e78fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f6336aa2-f8726\" (UID: \"2d1611b6-3f82-41b9-8325-e5a9858e78fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6336aa2-f8726"
Sep 15 11:52:45.022898 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:45.022864    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1611b6-3f82-41b9-8325-e5a9858e78fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f6336aa2-f8726\" (UID: \"2d1611b6-3f82-41b9-8325-e5a9858e78fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6336aa2-f8726"
Sep 15 11:52:45.023566 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:45.023545    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1611b6-3f82-41b9-8325-e5a9858e78fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f6336aa2-f8726\" (UID: \"2d1611b6-3f82-41b9-8325-e5a9858e78fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6336aa2-f8726"
Sep 15 11:52:45.155570 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:45.155491    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6336aa2-f8726"
Sep 15 11:52:45.444359 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:45.444319    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6336aa2-f8726"]
Sep 15 11:52:45.445334 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:52:45.445305    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d1611b6_3f82_41b9_8325_e5a9858e78fd.slice/crio-ea3f69c17db2e1eb0bfd70321a507ca45e042fbad7d80057681f4db288a6762e WatchSource:0}: Error finding container ea3f69c17db2e1eb0bfd70321a507ca45e042fbad7d80057681f4db288a6762e: Status 404 returned error can't find the container with id ea3f69c17db2e1eb0bfd70321a507ca45e042fbad7d80057681f4db288a6762e
Sep 15 11:52:45.537683 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:45.537647    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6336aa2-f8726" event={"ID":"2d1611b6-3f82-41b9-8325-e5a9858e78fd","Type":"ContainerStarted","Data":"ea3f69c17db2e1eb0bfd70321a507ca45e042fbad7d80057681f4db288a6762e"}
Sep 15 11:52:46.544399 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:46.544298    2564 generic.go:356] "Generic (PLEG): container finished" podID="2d1611b6-3f82-41b9-8325-e5a9858e78fd" containerID="33b5be3f2f7cd798ca0d9351bdb878e5ae18e37425dc7d7f4e3d12237fda8a3e" exitCode=0
Sep 15 11:52:46.544766 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:46.544390    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6336aa2-f8726" event={"ID":"2d1611b6-3f82-41b9-8325-e5a9858e78fd","Type":"ContainerDied","Data":"33b5be3f2f7cd798ca0d9351bdb878e5ae18e37425dc7d7f4e3d12237fda8a3e"}
Sep 15 11:52:47.677857 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:47.677830    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6336aa2-f8726"
Sep 15 11:52:47.746895 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:47.746866    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1611b6-3f82-41b9-8325-e5a9858e78fd-maas-api-service-ca\") pod \"2d1611b6-3f82-41b9-8325-e5a9858e78fd\" (UID: \"2d1611b6-3f82-41b9-8325-e5a9858e78fd\") "
Sep 15 11:52:47.747213 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:47.747185    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d1611b6-3f82-41b9-8325-e5a9858e78fd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2d1611b6-3f82-41b9-8325-e5a9858e78fd" (UID: "2d1611b6-3f82-41b9-8325-e5a9858e78fd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:52:47.848131 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:47.848041    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1611b6-3f82-41b9-8325-e5a9858e78fd-maas-api-service-ca\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:52:48.557485 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:48.557444    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6336aa2-f8726"
Sep 15 11:52:48.557485 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:48.557481    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6336aa2-f8726" event={"ID":"2d1611b6-3f82-41b9-8325-e5a9858e78fd","Type":"ContainerDied","Data":"ea3f69c17db2e1eb0bfd70321a507ca45e042fbad7d80057681f4db288a6762e"}
Sep 15 11:52:48.557703 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:48.557550    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea3f69c17db2e1eb0bfd70321a507ca45e042fbad7d80057681f4db288a6762e"
Sep 15 11:52:51.720479 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:51.720440    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6336aa2-f8726"]
Sep 15 11:52:51.727596 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:51.727573    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6336aa2-f8726"]
Sep 15 11:52:51.780071 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:51.780036    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d1611b6-3f82-41b9-8325-e5a9858e78fd" path="/var/lib/kubelet/pods/2d1611b6-3f82-41b9-8325-e5a9858e78fd/volumes"
Sep 15 11:52:51.910349 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:51.910313    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"]
Sep 15 11:52:51.910533 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:51.910510    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c" podUID="53cc34b4-7f39-4a59-ab36-bdee13a80808" containerName="istio-proxy" containerID="cri-o://862d62dda4e9aa306c45c413ba8377ed3fe00e1a87654add28f4933c9266b798" gracePeriod=30
Sep 15 11:52:57.146358 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.146331    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:57.233922 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.233842    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-workload-socket\") pod \"53cc34b4-7f39-4a59-ab36-bdee13a80808\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") "
Sep 15 11:52:57.233922 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.233885    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53cc34b4-7f39-4a59-ab36-bdee13a80808-istiod-ca-cert\") pod \"53cc34b4-7f39-4a59-ab36-bdee13a80808\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") "
Sep 15 11:52:57.233922 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.233903    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-credential-socket\") pod \"53cc34b4-7f39-4a59-ab36-bdee13a80808\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") "
Sep 15 11:52:57.234172 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.234023    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-workload-certs\") pod \"53cc34b4-7f39-4a59-ab36-bdee13a80808\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") "
Sep 15 11:52:57.234172 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.234069    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-envoy\") pod \"53cc34b4-7f39-4a59-ab36-bdee13a80808\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") "
Sep 15 11:52:57.234172 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.234098    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7n6z\" (UniqueName: \"kubernetes.io/projected/53cc34b4-7f39-4a59-ab36-bdee13a80808-kube-api-access-c7n6z\") pod \"53cc34b4-7f39-4a59-ab36-bdee13a80808\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") "
Sep 15 11:52:57.234172 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.234124    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-podinfo\") pod \"53cc34b4-7f39-4a59-ab36-bdee13a80808\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") "
Sep 15 11:52:57.234172 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.234153    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-token\") pod \"53cc34b4-7f39-4a59-ab36-bdee13a80808\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") "
Sep 15 11:52:57.234474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.234178    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-data\") pod \"53cc34b4-7f39-4a59-ab36-bdee13a80808\" (UID: \"53cc34b4-7f39-4a59-ab36-bdee13a80808\") "
Sep 15 11:52:57.234474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.234115    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "53cc34b4-7f39-4a59-ab36-bdee13a80808" (UID: "53cc34b4-7f39-4a59-ab36-bdee13a80808"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:57.234474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.234240    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "53cc34b4-7f39-4a59-ab36-bdee13a80808" (UID: "53cc34b4-7f39-4a59-ab36-bdee13a80808"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:57.234474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.234365    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53cc34b4-7f39-4a59-ab36-bdee13a80808-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "53cc34b4-7f39-4a59-ab36-bdee13a80808" (UID: "53cc34b4-7f39-4a59-ab36-bdee13a80808"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:52:57.234474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.234365    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "53cc34b4-7f39-4a59-ab36-bdee13a80808" (UID: "53cc34b4-7f39-4a59-ab36-bdee13a80808"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:57.234768 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.234536    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-workload-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:52:57.234768 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.234556    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53cc34b4-7f39-4a59-ab36-bdee13a80808-istiod-ca-cert\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:52:57.234768 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.234572    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-credential-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:52:57.234768 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.234579    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-data" (OuterVolumeSpecName: "istio-data") pod "53cc34b4-7f39-4a59-ab36-bdee13a80808" (UID: "53cc34b4-7f39-4a59-ab36-bdee13a80808"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:57.234768 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.234585    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-workload-certs\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:52:57.236289 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.236249    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "53cc34b4-7f39-4a59-ab36-bdee13a80808" (UID: "53cc34b4-7f39-4a59-ab36-bdee13a80808"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:52:57.236408 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.236313    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53cc34b4-7f39-4a59-ab36-bdee13a80808-kube-api-access-c7n6z" (OuterVolumeSpecName: "kube-api-access-c7n6z") pod "53cc34b4-7f39-4a59-ab36-bdee13a80808" (UID: "53cc34b4-7f39-4a59-ab36-bdee13a80808"). InnerVolumeSpecName "kube-api-access-c7n6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:52:57.236598 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.236579    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "53cc34b4-7f39-4a59-ab36-bdee13a80808" (UID: "53cc34b4-7f39-4a59-ab36-bdee13a80808"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:57.236646 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.236606    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-token" (OuterVolumeSpecName: "istio-token") pod "53cc34b4-7f39-4a59-ab36-bdee13a80808" (UID: "53cc34b4-7f39-4a59-ab36-bdee13a80808"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:52:57.286139 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.286104    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:52:57.335072 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.335042    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-envoy\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:52:57.335072 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.335067    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7n6z\" (UniqueName: \"kubernetes.io/projected/53cc34b4-7f39-4a59-ab36-bdee13a80808-kube-api-access-c7n6z\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:52:57.335072 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.335077    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-podinfo\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:52:57.335401 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.335086    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-token\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:52:57.335401 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.335095    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53cc34b4-7f39-4a59-ab36-bdee13a80808-istio-data\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:52:57.609683 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.609640    2564 generic.go:356] "Generic (PLEG): container finished" podID="53cc34b4-7f39-4a59-ab36-bdee13a80808" containerID="862d62dda4e9aa306c45c413ba8377ed3fe00e1a87654add28f4933c9266b798" exitCode=0
Sep 15 11:52:57.609868 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.609691    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"
Sep 15 11:52:57.609868 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.609707    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c" event={"ID":"53cc34b4-7f39-4a59-ab36-bdee13a80808","Type":"ContainerDied","Data":"862d62dda4e9aa306c45c413ba8377ed3fe00e1a87654add28f4933c9266b798"}
Sep 15 11:52:57.609868 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.609761    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c" event={"ID":"53cc34b4-7f39-4a59-ab36-bdee13a80808","Type":"ContainerDied","Data":"eb6e11364d4860f048c04d4fa98a2d13023b159fb630a75295229e3b9cd47c17"}
Sep 15 11:52:57.609868 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.609793    2564 scope.go:117] "RemoveContainer" containerID="862d62dda4e9aa306c45c413ba8377ed3fe00e1a87654add28f4933c9266b798"
Sep 15 11:52:57.619487 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.619468    2564 scope.go:117] "RemoveContainer" containerID="c226299882aba633d4561c3a9188e11a06bcabe736f3cf39730228411ded25ae"
Sep 15 11:52:57.627583 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.627563    2564 scope.go:117] "RemoveContainer" containerID="862d62dda4e9aa306c45c413ba8377ed3fe00e1a87654add28f4933c9266b798"
Sep 15 11:52:57.627862 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:52:57.627837    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"862d62dda4e9aa306c45c413ba8377ed3fe00e1a87654add28f4933c9266b798\": container with ID starting with 862d62dda4e9aa306c45c413ba8377ed3fe00e1a87654add28f4933c9266b798 not found: ID does not exist" containerID="862d62dda4e9aa306c45c413ba8377ed3fe00e1a87654add28f4933c9266b798"
Sep 15 11:52:57.627951 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.627868    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"862d62dda4e9aa306c45c413ba8377ed3fe00e1a87654add28f4933c9266b798"} err="failed to get container status \"862d62dda4e9aa306c45c413ba8377ed3fe00e1a87654add28f4933c9266b798\": rpc error: code = NotFound desc = could not find container \"862d62dda4e9aa306c45c413ba8377ed3fe00e1a87654add28f4933c9266b798\": container with ID starting with 862d62dda4e9aa306c45c413ba8377ed3fe00e1a87654add28f4933c9266b798 not found: ID does not exist"
Sep 15 11:52:57.627951 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.627886    2564 scope.go:117] "RemoveContainer" containerID="c226299882aba633d4561c3a9188e11a06bcabe736f3cf39730228411ded25ae"
Sep 15 11:52:57.628142 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:52:57.628123    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c226299882aba633d4561c3a9188e11a06bcabe736f3cf39730228411ded25ae\": container with ID starting with c226299882aba633d4561c3a9188e11a06bcabe736f3cf39730228411ded25ae not found: ID does not exist" containerID="c226299882aba633d4561c3a9188e11a06bcabe736f3cf39730228411ded25ae"
Sep 15 11:52:57.628188 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.628148    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c226299882aba633d4561c3a9188e11a06bcabe736f3cf39730228411ded25ae"} err="failed to get container status \"c226299882aba633d4561c3a9188e11a06bcabe736f3cf39730228411ded25ae\": rpc error: code = NotFound desc = could not find container \"c226299882aba633d4561c3a9188e11a06bcabe736f3cf39730228411ded25ae\": container with ID starting with c226299882aba633d4561c3a9188e11a06bcabe736f3cf39730228411ded25ae not found: ID does not exist"
Sep 15 11:52:57.646377 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.646352    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"]
Sep 15 11:52:57.662097 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.662069    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-f6336aa2-openshift-default-69d966677b-6tf6c"]
Sep 15 11:52:57.779756 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:52:57.779720    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53cc34b4-7f39-4a59-ab36-bdee13a80808" path="/var/lib/kubelet/pods/53cc34b4-7f39-4a59-ab36-bdee13a80808/volumes"
Sep 15 11:53:05.446448 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:05.446411    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-155ffe-4w6d6"]
Sep 15 11:53:05.446842 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:05.446772    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53cc34b4-7f39-4a59-ab36-bdee13a80808" containerName="istio-proxy"
Sep 15 11:53:05.446842 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:05.446785    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="53cc34b4-7f39-4a59-ab36-bdee13a80808" containerName="istio-proxy"
Sep 15 11:53:05.446842 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:05.446812    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d1611b6-3f82-41b9-8325-e5a9858e78fd" containerName="revoke-keys"
Sep 15 11:53:05.446842 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:05.446818    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d1611b6-3f82-41b9-8325-e5a9858e78fd" containerName="revoke-keys"
Sep 15 11:53:05.446973 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:05.446871    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="580509a4-3a78-405f-90ce-f816afc1e7a1" containerName="istio-proxy"
Sep 15 11:53:05.446973 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:05.446883    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="53cc34b4-7f39-4a59-ab36-bdee13a80808" containerName="istio-proxy"
Sep 15 11:53:05.446973 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:05.446889    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d1611b6-3f82-41b9-8325-e5a9858e78fd" containerName="revoke-keys"
Sep 15 11:53:05.446973 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:05.446895    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="53cc34b4-7f39-4a59-ab36-bdee13a80808" containerName="istio-proxy"
Sep 15 11:53:05.455662 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:05.455631    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-155ffe-4w6d6"
Sep 15 11:53:05.462631 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:05.462605    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 11:53:05.462738 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:05.462657    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjx8x\""
Sep 15 11:53:05.473084 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:05.473059    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-155ffe-4w6d6"]
Sep 15 11:53:05.504395 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:05.504365    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/571da77a-bcc6-4d89-9d5d-baeebba8688f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-155ffe-4w6d6\" (UID: \"571da77a-bcc6-4d89-9d5d-baeebba8688f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-155ffe-4w6d6"
Sep 15 11:53:05.605441 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:05.605403    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/571da77a-bcc6-4d89-9d5d-baeebba8688f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-155ffe-4w6d6\" (UID: \"571da77a-bcc6-4d89-9d5d-baeebba8688f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-155ffe-4w6d6"
Sep 15 11:53:05.605987 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:05.605966    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/571da77a-bcc6-4d89-9d5d-baeebba8688f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-155ffe-4w6d6\" (UID: \"571da77a-bcc6-4d89-9d5d-baeebba8688f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-155ffe-4w6d6"
Sep 15 11:53:05.765810 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:05.765714    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-155ffe-4w6d6"
Sep 15 11:53:06.041917 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:06.041888    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-155ffe-4w6d6"]
Sep 15 11:53:06.043609 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:53:06.043580    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod571da77a_bcc6_4d89_9d5d_baeebba8688f.slice/crio-f0c55f1697d2b33b60b94ed4702f6e13280f077dc946e1aa5c3d73c5d7d88169 WatchSource:0}: Error finding container f0c55f1697d2b33b60b94ed4702f6e13280f077dc946e1aa5c3d73c5d7d88169: Status 404 returned error can't find the container with id f0c55f1697d2b33b60b94ed4702f6e13280f077dc946e1aa5c3d73c5d7d88169
Sep 15 11:53:06.666565 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:06.666521    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-155ffe-4w6d6" event={"ID":"571da77a-bcc6-4d89-9d5d-baeebba8688f","Type":"ContainerStarted","Data":"ff5f53169c264b0f67d97f8fecffca5e0edd0ddd9525df9812176c7d2f688bd3"}
Sep 15 11:53:06.666989 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:06.666597    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-155ffe-4w6d6" event={"ID":"571da77a-bcc6-4d89-9d5d-baeebba8688f","Type":"ContainerStarted","Data":"f0c55f1697d2b33b60b94ed4702f6e13280f077dc946e1aa5c3d73c5d7d88169"}
Sep 15 11:53:06.697205 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:06.697151    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-155ffe-4w6d6" podStartSLOduration=1.6971372759999999 podStartE2EDuration="1.697137276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:53:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:53:06.696550474 +0000 UTC m=+963.413424657" watchObservedRunningTime="2026-09-15 11:53:06.697137276 +0000 UTC m=+963.414011509"
Sep 15 11:53:07.672773 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:07.672739    2564 generic.go:356] "Generic (PLEG): container finished" podID="571da77a-bcc6-4d89-9d5d-baeebba8688f" containerID="ff5f53169c264b0f67d97f8fecffca5e0edd0ddd9525df9812176c7d2f688bd3" exitCode=0
Sep 15 11:53:07.673194 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:07.672825    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-155ffe-4w6d6" event={"ID":"571da77a-bcc6-4d89-9d5d-baeebba8688f","Type":"ContainerDied","Data":"ff5f53169c264b0f67d97f8fecffca5e0edd0ddd9525df9812176c7d2f688bd3"}
Sep 15 11:53:08.209691 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:08.209655    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:53:08.804718 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:08.804697    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-155ffe-4w6d6"
Sep 15 11:53:08.936182 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:08.936100    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/571da77a-bcc6-4d89-9d5d-baeebba8688f-maas-api-service-ca\") pod \"571da77a-bcc6-4d89-9d5d-baeebba8688f\" (UID: \"571da77a-bcc6-4d89-9d5d-baeebba8688f\") "
Sep 15 11:53:08.936482 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:08.936461    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/571da77a-bcc6-4d89-9d5d-baeebba8688f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "571da77a-bcc6-4d89-9d5d-baeebba8688f" (UID: "571da77a-bcc6-4d89-9d5d-baeebba8688f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:53:09.037390 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:09.037353    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/571da77a-bcc6-4d89-9d5d-baeebba8688f-maas-api-service-ca\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:53:09.684623 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:09.684592    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-155ffe-4w6d6"
Sep 15 11:53:09.684623 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:09.684615    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-155ffe-4w6d6" event={"ID":"571da77a-bcc6-4d89-9d5d-baeebba8688f","Type":"ContainerDied","Data":"f0c55f1697d2b33b60b94ed4702f6e13280f077dc946e1aa5c3d73c5d7d88169"}
Sep 15 11:53:09.684835 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:09.684660    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0c55f1697d2b33b60b94ed4702f6e13280f077dc946e1aa5c3d73c5d7d88169"
Sep 15 11:53:16.343131 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:16.343083    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-155ffe-4w6d6"]
Sep 15 11:53:16.345462 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:16.345439    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-155ffe-4w6d6"]
Sep 15 11:53:17.778336 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:17.778302    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="571da77a-bcc6-4d89-9d5d-baeebba8688f" path="/var/lib/kubelet/pods/571da77a-bcc6-4d89-9d5d-baeebba8688f/volumes"
Sep 15 11:53:19.122799 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:19.122767    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:53:24.391556 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:24.391522    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1b147a-p6n29"]
Sep 15 11:53:24.391980 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:24.391869    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="571da77a-bcc6-4d89-9d5d-baeebba8688f" containerName="revoke-keys"
Sep 15 11:53:24.391980 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:24.391880    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="571da77a-bcc6-4d89-9d5d-baeebba8688f" containerName="revoke-keys"
Sep 15 11:53:24.391980 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:24.391902    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53cc34b4-7f39-4a59-ab36-bdee13a80808" containerName="istio-proxy"
Sep 15 11:53:24.391980 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:24.391907    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="53cc34b4-7f39-4a59-ab36-bdee13a80808" containerName="istio-proxy"
Sep 15 11:53:24.391980 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:24.391961    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="571da77a-bcc6-4d89-9d5d-baeebba8688f" containerName="revoke-keys"
Sep 15 11:53:24.396102 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:24.396085    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1b147a-p6n29"
Sep 15 11:53:24.399651 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:24.399626    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 11:53:24.399950 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:24.399934    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjx8x\""
Sep 15 11:53:24.409670 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:24.409638    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1b147a-p6n29"]
Sep 15 11:53:24.481184 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:24.481143    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02cc8e1d-91c7-4578-a99d-a0ada1fb3422-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1b147a-p6n29\" (UID: \"02cc8e1d-91c7-4578-a99d-a0ada1fb3422\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1b147a-p6n29"
Sep 15 11:53:24.581899 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:24.581856    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02cc8e1d-91c7-4578-a99d-a0ada1fb3422-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1b147a-p6n29\" (UID: \"02cc8e1d-91c7-4578-a99d-a0ada1fb3422\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1b147a-p6n29"
Sep 15 11:53:24.582556 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:24.582534    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02cc8e1d-91c7-4578-a99d-a0ada1fb3422-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1b147a-p6n29\" (UID: \"02cc8e1d-91c7-4578-a99d-a0ada1fb3422\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1b147a-p6n29"
Sep 15 11:53:24.706237 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:24.706146    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1b147a-p6n29"
Sep 15 11:53:24.981711 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:24.981681    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1b147a-p6n29"]
Sep 15 11:53:24.984300 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:53:24.984257    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02cc8e1d_91c7_4578_a99d_a0ada1fb3422.slice/crio-260787d891c6cc153b47c8f5171b4e4038b872e1b78557b468b8e0b9c1453250 WatchSource:0}: Error finding container 260787d891c6cc153b47c8f5171b4e4038b872e1b78557b468b8e0b9c1453250: Status 404 returned error can't find the container with id 260787d891c6cc153b47c8f5171b4e4038b872e1b78557b468b8e0b9c1453250
Sep 15 11:53:25.779300 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:25.779256    2564 generic.go:356] "Generic (PLEG): container finished" podID="02cc8e1d-91c7-4578-a99d-a0ada1fb3422" containerID="e49c41a980eed9387b3ce8f45f6c088c52f33a88b3bbd92cc2bdf31d00c1c0fd" exitCode=0
Sep 15 11:53:25.779660 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:25.779479    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1b147a-p6n29" event={"ID":"02cc8e1d-91c7-4578-a99d-a0ada1fb3422","Type":"ContainerDied","Data":"e49c41a980eed9387b3ce8f45f6c088c52f33a88b3bbd92cc2bdf31d00c1c0fd"}
Sep 15 11:53:25.779660 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:25.779517    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1b147a-p6n29" event={"ID":"02cc8e1d-91c7-4578-a99d-a0ada1fb3422","Type":"ContainerStarted","Data":"260787d891c6cc153b47c8f5171b4e4038b872e1b78557b468b8e0b9c1453250"}
Sep 15 11:53:26.909441 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:26.909415    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1b147a-p6n29"
Sep 15 11:53:27.000498 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:27.000451    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02cc8e1d-91c7-4578-a99d-a0ada1fb3422-maas-api-service-ca\") pod \"02cc8e1d-91c7-4578-a99d-a0ada1fb3422\" (UID: \"02cc8e1d-91c7-4578-a99d-a0ada1fb3422\") "
Sep 15 11:53:27.000850 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:27.000824    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02cc8e1d-91c7-4578-a99d-a0ada1fb3422-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "02cc8e1d-91c7-4578-a99d-a0ada1fb3422" (UID: "02cc8e1d-91c7-4578-a99d-a0ada1fb3422"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:53:27.101045 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:27.100997    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02cc8e1d-91c7-4578-a99d-a0ada1fb3422-maas-api-service-ca\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:53:27.790770 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:27.790742    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1b147a-p6n29"
Sep 15 11:53:27.790893 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:27.790778    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1b147a-p6n29" event={"ID":"02cc8e1d-91c7-4578-a99d-a0ada1fb3422","Type":"ContainerDied","Data":"260787d891c6cc153b47c8f5171b4e4038b872e1b78557b468b8e0b9c1453250"}
Sep 15 11:53:27.790893 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:27.790827    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="260787d891c6cc153b47c8f5171b4e4038b872e1b78557b468b8e0b9c1453250"
Sep 15 11:53:35.128636 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:35.128596    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1b147a-p6n29"]
Sep 15 11:53:35.130824 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:35.130797    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1b147a-p6n29"]
Sep 15 11:53:35.781775 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:35.781739    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02cc8e1d-91c7-4578-a99d-a0ada1fb3422" path="/var/lib/kubelet/pods/02cc8e1d-91c7-4578-a99d-a0ada1fb3422/volumes"
Sep 15 11:53:37.539700 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:37.539667    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:53:42.210387 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:42.210352    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"]
Sep 15 11:53:42.210844 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:42.210606    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk" podUID="14ebcd20-2506-4989-8f2f-263347c4e1e6" containerName="istio-proxy" containerID="cri-o://1676a8771846d921e1b6e20087a9fe9234cdd764052abb2471f1a2fecd08e96d" gracePeriod=30
Sep 15 11:53:47.456337 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.456311    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:53:47.582085 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.582046    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fc9w\" (UniqueName: \"kubernetes.io/projected/14ebcd20-2506-4989-8f2f-263347c4e1e6-kube-api-access-2fc9w\") pod \"14ebcd20-2506-4989-8f2f-263347c4e1e6\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") "
Sep 15 11:53:47.582243 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.582100    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-workload-socket\") pod \"14ebcd20-2506-4989-8f2f-263347c4e1e6\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") "
Sep 15 11:53:47.582243 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.582138    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-token\") pod \"14ebcd20-2506-4989-8f2f-263347c4e1e6\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") "
Sep 15 11:53:47.582243 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.582157    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-data\") pod \"14ebcd20-2506-4989-8f2f-263347c4e1e6\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") "
Sep 15 11:53:47.582243 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.582196    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-workload-certs\") pod \"14ebcd20-2506-4989-8f2f-263347c4e1e6\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") "
Sep 15 11:53:47.582504 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.582303    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-podinfo\") pod \"14ebcd20-2506-4989-8f2f-263347c4e1e6\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") "
Sep 15 11:53:47.582504 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.582339    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14ebcd20-2506-4989-8f2f-263347c4e1e6-istiod-ca-cert\") pod \"14ebcd20-2506-4989-8f2f-263347c4e1e6\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") "
Sep 15 11:53:47.582504 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.582363    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-credential-socket\") pod \"14ebcd20-2506-4989-8f2f-263347c4e1e6\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") "
Sep 15 11:53:47.582504 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.582412    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-envoy\") pod \"14ebcd20-2506-4989-8f2f-263347c4e1e6\" (UID: \"14ebcd20-2506-4989-8f2f-263347c4e1e6\") "
Sep 15 11:53:47.582504 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.582449    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "14ebcd20-2506-4989-8f2f-263347c4e1e6" (UID: "14ebcd20-2506-4989-8f2f-263347c4e1e6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:53:47.582744 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.582535    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "14ebcd20-2506-4989-8f2f-263347c4e1e6" (UID: "14ebcd20-2506-4989-8f2f-263347c4e1e6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:53:47.582744 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.582551    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-data" (OuterVolumeSpecName: "istio-data") pod "14ebcd20-2506-4989-8f2f-263347c4e1e6" (UID: "14ebcd20-2506-4989-8f2f-263347c4e1e6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:53:47.582838 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.582749    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "14ebcd20-2506-4989-8f2f-263347c4e1e6" (UID: "14ebcd20-2506-4989-8f2f-263347c4e1e6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:53:47.582838 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.582763    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-data\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:53:47.582838 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.582785    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-workload-certs\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:53:47.582838 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.582800    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-workload-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:53:47.582981 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.582847    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14ebcd20-2506-4989-8f2f-263347c4e1e6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "14ebcd20-2506-4989-8f2f-263347c4e1e6" (UID: "14ebcd20-2506-4989-8f2f-263347c4e1e6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:53:47.584306 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.584277    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14ebcd20-2506-4989-8f2f-263347c4e1e6-kube-api-access-2fc9w" (OuterVolumeSpecName: "kube-api-access-2fc9w") pod "14ebcd20-2506-4989-8f2f-263347c4e1e6" (UID: "14ebcd20-2506-4989-8f2f-263347c4e1e6"). InnerVolumeSpecName "kube-api-access-2fc9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:53:47.584442 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.584424    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "14ebcd20-2506-4989-8f2f-263347c4e1e6" (UID: "14ebcd20-2506-4989-8f2f-263347c4e1e6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:53:47.584696 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.584672    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-token" (OuterVolumeSpecName: "istio-token") pod "14ebcd20-2506-4989-8f2f-263347c4e1e6" (UID: "14ebcd20-2506-4989-8f2f-263347c4e1e6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:53:47.584696 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.584685    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "14ebcd20-2506-4989-8f2f-263347c4e1e6" (UID: "14ebcd20-2506-4989-8f2f-263347c4e1e6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:53:47.683782 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.683752    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-podinfo\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:53:47.683782 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.683777    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14ebcd20-2506-4989-8f2f-263347c4e1e6-istiod-ca-cert\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:53:47.683782 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.683787    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-credential-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:53:47.684000 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.683795    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-envoy\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:53:47.684000 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.683804    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fc9w\" (UniqueName: \"kubernetes.io/projected/14ebcd20-2506-4989-8f2f-263347c4e1e6-kube-api-access-2fc9w\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:53:47.684000 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.683813    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14ebcd20-2506-4989-8f2f-263347c4e1e6-istio-token\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:53:47.905401 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.905315    2564 generic.go:356] "Generic (PLEG): container finished" podID="14ebcd20-2506-4989-8f2f-263347c4e1e6" containerID="1676a8771846d921e1b6e20087a9fe9234cdd764052abb2471f1a2fecd08e96d" exitCode=0
Sep 15 11:53:47.905401 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.905360    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"
Sep 15 11:53:47.905401 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.905364    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk" event={"ID":"14ebcd20-2506-4989-8f2f-263347c4e1e6","Type":"ContainerDied","Data":"1676a8771846d921e1b6e20087a9fe9234cdd764052abb2471f1a2fecd08e96d"}
Sep 15 11:53:47.905643 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.905410    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk" event={"ID":"14ebcd20-2506-4989-8f2f-263347c4e1e6","Type":"ContainerDied","Data":"fd19093e920bd9bb0d657133c13d74fef5592406cc7a927b1347045d4062f1db"}
Sep 15 11:53:47.905643 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.905435    2564 scope.go:117] "RemoveContainer" containerID="1676a8771846d921e1b6e20087a9fe9234cdd764052abb2471f1a2fecd08e96d"
Sep 15 11:53:47.914632 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.914612    2564 scope.go:117] "RemoveContainer" containerID="97d74666b2b3e0c8ab4cd8a95445731c39de77f6f5fe836f49560697135ec173"
Sep 15 11:53:47.923553 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.923534    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"]
Sep 15 11:53:47.923617 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.923569    2564 scope.go:117] "RemoveContainer" containerID="1676a8771846d921e1b6e20087a9fe9234cdd764052abb2471f1a2fecd08e96d"
Sep 15 11:53:47.923843 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:53:47.923827    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1676a8771846d921e1b6e20087a9fe9234cdd764052abb2471f1a2fecd08e96d\": container with ID starting with 1676a8771846d921e1b6e20087a9fe9234cdd764052abb2471f1a2fecd08e96d not found: ID does not exist" containerID="1676a8771846d921e1b6e20087a9fe9234cdd764052abb2471f1a2fecd08e96d"
Sep 15 11:53:47.923885 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.923850    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1676a8771846d921e1b6e20087a9fe9234cdd764052abb2471f1a2fecd08e96d"} err="failed to get container status \"1676a8771846d921e1b6e20087a9fe9234cdd764052abb2471f1a2fecd08e96d\": rpc error: code = NotFound desc = could not find container \"1676a8771846d921e1b6e20087a9fe9234cdd764052abb2471f1a2fecd08e96d\": container with ID starting with 1676a8771846d921e1b6e20087a9fe9234cdd764052abb2471f1a2fecd08e96d not found: ID does not exist"
Sep 15 11:53:47.923885 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.923867    2564 scope.go:117] "RemoveContainer" containerID="97d74666b2b3e0c8ab4cd8a95445731c39de77f6f5fe836f49560697135ec173"
Sep 15 11:53:47.924106 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:53:47.924090    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97d74666b2b3e0c8ab4cd8a95445731c39de77f6f5fe836f49560697135ec173\": container with ID starting with 97d74666b2b3e0c8ab4cd8a95445731c39de77f6f5fe836f49560697135ec173 not found: ID does not exist" containerID="97d74666b2b3e0c8ab4cd8a95445731c39de77f6f5fe836f49560697135ec173"
Sep 15 11:53:47.924151 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.924110    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97d74666b2b3e0c8ab4cd8a95445731c39de77f6f5fe836f49560697135ec173"} err="failed to get container status \"97d74666b2b3e0c8ab4cd8a95445731c39de77f6f5fe836f49560697135ec173\": rpc error: code = NotFound desc = could not find container \"97d74666b2b3e0c8ab4cd8a95445731c39de77f6f5fe836f49560697135ec173\": container with ID starting with 97d74666b2b3e0c8ab4cd8a95445731c39de77f6f5fe836f49560697135ec173 not found: ID does not exist"
Sep 15 11:53:47.928571 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:47.928548    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk"]
Sep 15 11:53:48.381968 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:48.381932    2564 patch_prober.go:28] interesting pod/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 11:53:48.382139 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:48.382003    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-1b147a-openshift-default-546b9c4784-hnbtk" podUID="14ebcd20-2506-4989-8f2f-263347c4e1e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 11:53:49.778850 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:49.778818    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14ebcd20-2506-4989-8f2f-263347c4e1e6" path="/var/lib/kubelet/pods/14ebcd20-2506-4989-8f2f-263347c4e1e6/volumes"
Sep 15 11:53:50.600164 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:53:50.600126    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:54:12.031109 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.031066    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"]
Sep 15 11:54:12.032161 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.032125    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14ebcd20-2506-4989-8f2f-263347c4e1e6" containerName="istio-proxy"
Sep 15 11:54:12.032161 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.032154    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="14ebcd20-2506-4989-8f2f-263347c4e1e6" containerName="istio-proxy"
Sep 15 11:54:12.032367 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.032170    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02cc8e1d-91c7-4578-a99d-a0ada1fb3422" containerName="revoke-keys"
Sep 15 11:54:12.032367 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.032180    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="02cc8e1d-91c7-4578-a99d-a0ada1fb3422" containerName="revoke-keys"
Sep 15 11:54:12.032367 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.032201    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14ebcd20-2506-4989-8f2f-263347c4e1e6" containerName="istio-proxy"
Sep 15 11:54:12.032367 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.032210    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="14ebcd20-2506-4989-8f2f-263347c4e1e6" containerName="istio-proxy"
Sep 15 11:54:12.032367 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.032316    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="14ebcd20-2506-4989-8f2f-263347c4e1e6" containerName="istio-proxy"
Sep 15 11:54:12.032367 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.032329    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="14ebcd20-2506-4989-8f2f-263347c4e1e6" containerName="istio-proxy"
Sep 15 11:54:12.032367 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.032342    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="02cc8e1d-91c7-4578-a99d-a0ada1fb3422" containerName="revoke-keys"
Sep 15 11:54:12.037851 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.037829    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.040722 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.040697    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-7b7b3c-openshift-default-dockercfg-6lwch\""
Sep 15 11:54:12.047405 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.046866    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"]
Sep 15 11:54:12.198740 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.198708    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-data\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.198740 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.198741    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-workload-certs\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.199004 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.198773    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2afdc252-dfd8-479e-a1da-13ec795d2305-istiod-ca-cert\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.199004 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.198810    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtcz4\" (UniqueName: \"kubernetes.io/projected/2afdc252-dfd8-479e-a1da-13ec795d2305-kube-api-access-gtcz4\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.199004 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.198855    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-workload-socket\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.199004 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.198900    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-envoy\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.199004 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.198949    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-credential-socket\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.199218 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.199009    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-token\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.199218 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.199049    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-podinfo\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.299968 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.299868    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-data\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.299968 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.299910    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-workload-certs\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.299968 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.299953    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2afdc252-dfd8-479e-a1da-13ec795d2305-istiod-ca-cert\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.300235 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.299977    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtcz4\" (UniqueName: \"kubernetes.io/projected/2afdc252-dfd8-479e-a1da-13ec795d2305-kube-api-access-gtcz4\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.300235 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.300016    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-workload-socket\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.300235 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.300041    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-envoy\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.300235 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.300065    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-credential-socket\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.300235 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.300122    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-token\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.300235 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.300165    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-podinfo\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.300582 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.300465    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-data\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.300582 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.300557    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-workload-certs\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.300693 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.300620    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-credential-socket\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.300753 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.300697    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-workload-socket\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.301031 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.301007    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2afdc252-dfd8-479e-a1da-13ec795d2305-istiod-ca-cert\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.302336 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.302315    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-envoy\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.302579 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.302562    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-podinfo\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.308805 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.308783    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-token\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.309302 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.309281    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtcz4\" (UniqueName: \"kubernetes.io/projected/2afdc252-dfd8-479e-a1da-13ec795d2305-kube-api-access-gtcz4\") pod \"e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") " pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.352223 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.352198    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:12.629291 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.629251    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"]
Sep 15 11:54:12.630659 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:54:12.630631    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2afdc252_dfd8_479e_a1da_13ec795d2305.slice/crio-80679d17c24abab9fd776b7b35e13f7871a98ce4727a61803b6a0a16a1b49571 WatchSource:0}: Error finding container 80679d17c24abab9fd776b7b35e13f7871a98ce4727a61803b6a0a16a1b49571: Status 404 returned error can't find the container with id 80679d17c24abab9fd776b7b35e13f7871a98ce4727a61803b6a0a16a1b49571
Sep 15 11:54:12.632973 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.632935    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:54:12.633082 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.633013    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:54:12.633082 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:12.633060    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:54:13.054882 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:13.054850    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j" event={"ID":"2afdc252-dfd8-479e-a1da-13ec795d2305","Type":"ContainerStarted","Data":"a58b4528c8cc32fa1288dec4425d34782ad4fb5872aa3be8579d7cffd4eb4b93"}
Sep 15 11:54:13.055284 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:13.054930    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j" event={"ID":"2afdc252-dfd8-479e-a1da-13ec795d2305","Type":"ContainerStarted","Data":"80679d17c24abab9fd776b7b35e13f7871a98ce4727a61803b6a0a16a1b49571"}
Sep 15 11:54:13.075705 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:13.075653    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j" podStartSLOduration=1.075636952 podStartE2EDuration="1.075636952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:54:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:54:13.074698676 +0000 UTC m=+1029.791572862" watchObservedRunningTime="2026-09-15 11:54:13.075636952 +0000 UTC m=+1029.792511135"
Sep 15 11:54:13.353138 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:13.353044    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:13.358221 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:13.358190    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:14.059946 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:14.059917    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:14.060947 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:14.060928    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:20.417389 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:20.417358    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:54:30.016916 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:30.016864    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": read tcp 10.133.0.2:43724->10.133.0.52:15021: read: connection reset by peer" start-of-body=
Sep 15 11:54:30.017334 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:30.016938    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j" podUID="2afdc252-dfd8-479e-a1da-13ec795d2305" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": read tcp 10.133.0.2:43724->10.133.0.52:15021: read: connection reset by peer"
Sep 15 11:54:30.152453 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:30.152418    2564 generic.go:356] "Generic (PLEG): container finished" podID="2afdc252-dfd8-479e-a1da-13ec795d2305" containerID="a58b4528c8cc32fa1288dec4425d34782ad4fb5872aa3be8579d7cffd4eb4b93" exitCode=0
Sep 15 11:54:30.152643 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:30.152492    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j" event={"ID":"2afdc252-dfd8-479e-a1da-13ec795d2305","Type":"ContainerDied","Data":"a58b4528c8cc32fa1288dec4425d34782ad4fb5872aa3be8579d7cffd4eb4b93"}
Sep 15 11:54:30.152915 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:30.152893    2564 scope.go:117] "RemoveContainer" containerID="a58b4528c8cc32fa1288dec4425d34782ad4fb5872aa3be8579d7cffd4eb4b93"
Sep 15 11:54:30.153888 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:30.153859    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:54:30.153972 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:30.153925    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:54:30.153972 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:30.153958    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:54:30.609682 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:30.609640    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:54:31.164596 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:31.164548    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j" event={"ID":"2afdc252-dfd8-479e-a1da-13ec795d2305","Type":"ContainerStarted","Data":"419cd430180757f9d911ddf8d220d6f553e36f89080ac17e7dce745716ae1279"}
Sep 15 11:54:31.352974 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:31.352928    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:31.353170 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:31.353065    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 15 11:54:31.353170 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:31.353121    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j" podUID="2afdc252-dfd8-479e-a1da-13ec795d2305" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 15 11:54:31.840611 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:31.840577    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"]
Sep 15 11:54:31.844714 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:31.844692    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:31.886647 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:31.886488    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9064d2be-openshift-default-dockercfg-g2rvw\""
Sep 15 11:54:31.891808 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:31.891562    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"]
Sep 15 11:54:31.976823 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:31.976776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7015977c-42f3-4228-892b-e73f85660deb-istiod-ca-cert\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:31.977114 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:31.977093    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-istio-data\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:31.977249 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:31.977233    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7015977c-42f3-4228-892b-e73f85660deb-istio-token\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:31.977432 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:31.977408    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-workload-socket\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:31.977525 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:31.977449    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-credential-socket\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:31.977525 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:31.977472    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-workload-certs\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:31.977525 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:31.977496    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjjjj\" (UniqueName: \"kubernetes.io/projected/7015977c-42f3-4228-892b-e73f85660deb-kube-api-access-hjjjj\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:31.977675 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:31.977525    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-istio-envoy\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:31.977675 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:31.977555    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7015977c-42f3-4228-892b-e73f85660deb-istio-podinfo\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:32.078298 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.078232    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-workload-socket\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:32.078502 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.078316    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-credential-socket\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:32.078502 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.078339    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-workload-certs\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:32.078502 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.078365    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjjjj\" (UniqueName: \"kubernetes.io/projected/7015977c-42f3-4228-892b-e73f85660deb-kube-api-access-hjjjj\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:32.078502 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.078396    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-istio-envoy\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:32.078502 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.078423    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7015977c-42f3-4228-892b-e73f85660deb-istio-podinfo\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:32.078781 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.078513    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7015977c-42f3-4228-892b-e73f85660deb-istiod-ca-cert\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:32.078781 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.078570    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-istio-data\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:32.078781 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.078603    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7015977c-42f3-4228-892b-e73f85660deb-istio-token\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:32.078953 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.078916    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-workload-socket\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:32.079090 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.079065    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-credential-socket\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:32.079255 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.079232    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-istio-data\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:32.079330 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.079307    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-workload-certs\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:32.079824 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.079803    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7015977c-42f3-4228-892b-e73f85660deb-istiod-ca-cert\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:32.080868 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.080848    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-istio-envoy\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:32.081686 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.081663    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7015977c-42f3-4228-892b-e73f85660deb-istio-podinfo\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:32.086980 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.086950    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7015977c-42f3-4228-892b-e73f85660deb-istio-token\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:32.087067 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.087013    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjjjj\" (UniqueName: \"kubernetes.io/projected/7015977c-42f3-4228-892b-e73f85660deb-kube-api-access-hjjjj\") pod \"e2e-mt-9064d2be-openshift-default-78549465b-vnfgv\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") " pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:32.196548 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.196445    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:32.372877 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.372771    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 15 11:54:32.372877 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.372859    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j" podUID="2afdc252-dfd8-479e-a1da-13ec795d2305" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 15 11:54:32.493719 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.493690    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"]
Sep 15 11:54:32.497872 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:54:32.497842    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7015977c_42f3_4228_892b_e73f85660deb.slice/crio-4d94397aaae49efb17a4d3c83aa65d3325a5d4da0a4bc977200ff018bdb4692a WatchSource:0}: Error finding container 4d94397aaae49efb17a4d3c83aa65d3325a5d4da0a4bc977200ff018bdb4692a: Status 404 returned error can't find the container with id 4d94397aaae49efb17a4d3c83aa65d3325a5d4da0a4bc977200ff018bdb4692a
Sep 15 11:54:32.500348 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.500312    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:54:32.500440 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.500378    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:54:32.500440 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:32.500409    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:54:33.182998 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:33.182951    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv" event={"ID":"7015977c-42f3-4228-892b-e73f85660deb","Type":"ContainerStarted","Data":"e862e1d0b50c5e4dd0ca7f58e45b764f37b49ad34ce098b81c9111724f1f9109"}
Sep 15 11:54:33.183216 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:33.183016    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv" event={"ID":"7015977c-42f3-4228-892b-e73f85660deb","Type":"ContainerStarted","Data":"4d94397aaae49efb17a4d3c83aa65d3325a5d4da0a4bc977200ff018bdb4692a"}
Sep 15 11:54:33.197554 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:33.197524    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:33.202491 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:33.202468    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:33.209533 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:33.209491    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv" podStartSLOduration=2.209477202 podStartE2EDuration="2.209477202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:54:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:54:33.208811545 +0000 UTC m=+1049.925685730" watchObservedRunningTime="2026-09-15 11:54:33.209477202 +0000 UTC m=+1049.926351386"
Sep 15 11:54:33.353295 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:33.353238    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 15 11:54:33.353490 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:33.353323    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j" podUID="2afdc252-dfd8-479e-a1da-13ec795d2305" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 15 11:54:34.188883 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:34.188851    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:34.189812 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:34.189789    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:34.352946 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:34.352900    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 15 11:54:34.353445 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:34.352970    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j" podUID="2afdc252-dfd8-479e-a1da-13ec795d2305" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 15 11:54:35.352804 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:35.352761    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 15 11:54:35.353018 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:35.352831    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j" podUID="2afdc252-dfd8-479e-a1da-13ec795d2305" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 15 11:54:36.358694 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:36.358656    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:36.359176 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:36.359034    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:36.360106 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:36.360083    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 11:54:43.216033 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:43.215996    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:54:54.315506 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:54.315472    2564 generic.go:356] "Generic (PLEG): container finished" podID="7015977c-42f3-4228-892b-e73f85660deb" containerID="e862e1d0b50c5e4dd0ca7f58e45b764f37b49ad34ce098b81c9111724f1f9109" exitCode=0
Sep 15 11:54:54.315913 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:54.315547    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv" event={"ID":"7015977c-42f3-4228-892b-e73f85660deb","Type":"ContainerDied","Data":"e862e1d0b50c5e4dd0ca7f58e45b764f37b49ad34ce098b81c9111724f1f9109"}
Sep 15 11:54:54.316018 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:54.316000    2564 scope.go:117] "RemoveContainer" containerID="e862e1d0b50c5e4dd0ca7f58e45b764f37b49ad34ce098b81c9111724f1f9109"
Sep 15 11:54:54.317055 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:54.317025    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:54:54.317113 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:54.317095    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:54:54.317148 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:54.317125    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:54:55.324375 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:55.324342    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv" event={"ID":"7015977c-42f3-4228-892b-e73f85660deb","Type":"ContainerStarted","Data":"800c5f92ce7bd804c21b4d3914eccf9fd4e649ac88140999079428f43a1357db"}
Sep 15 11:54:56.197381 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:56.197294    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:54:56.197592 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:56.197569    2564 patch_prober.go:28] interesting pod/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 15 11:54:56.197638 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:56.197620    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv" podUID="7015977c-42f3-4228-892b-e73f85660deb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 15 11:54:57.197046 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:57.197003    2564 patch_prober.go:28] interesting pod/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 15 11:54:57.197490 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:57.197070    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv" podUID="7015977c-42f3-4228-892b-e73f85660deb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 15 11:54:57.312678 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:57.312637    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:54:58.197016 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:58.196971    2564 patch_prober.go:28] interesting pod/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 15 11:54:58.197350 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:58.197038    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv" podUID="7015977c-42f3-4228-892b-e73f85660deb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 15 11:54:59.197621 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:59.197581    2564 patch_prober.go:28] interesting pod/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 15 11:54:59.198099 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:54:59.197648    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv" podUID="7015977c-42f3-4228-892b-e73f85660deb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 15 11:55:00.197557 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:00.197519    2564 patch_prober.go:28] interesting pod/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 15 11:55:00.197739 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:00.197583    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv" podUID="7015977c-42f3-4228-892b-e73f85660deb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 15 11:55:01.201197 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:01.201161    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:55:01.201605 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:01.201441    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:55:01.202094 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:01.202077    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:55:07.841086 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:07.841043    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9064d2be-6vczl"]
Sep 15 11:55:07.844502 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:07.844474    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9064d2be-6vczl"
Sep 15 11:55:07.847300 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:07.847279    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 11:55:07.847412 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:07.847303    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjx8x\""
Sep 15 11:55:07.853116 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:07.853091    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9064d2be-6vczl"]
Sep 15 11:55:07.907978 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:07.907941    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6adeff9-3111-4f28-b57e-2362f0fcc40b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9064d2be-6vczl\" (UID: \"d6adeff9-3111-4f28-b57e-2362f0fcc40b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9064d2be-6vczl"
Sep 15 11:55:08.009357 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:08.009313    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6adeff9-3111-4f28-b57e-2362f0fcc40b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9064d2be-6vczl\" (UID: \"d6adeff9-3111-4f28-b57e-2362f0fcc40b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9064d2be-6vczl"
Sep 15 11:55:08.009943 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:08.009917    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6adeff9-3111-4f28-b57e-2362f0fcc40b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9064d2be-6vczl\" (UID: \"d6adeff9-3111-4f28-b57e-2362f0fcc40b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9064d2be-6vczl"
Sep 15 11:55:08.156637 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:08.156548    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9064d2be-6vczl"
Sep 15 11:55:08.428254 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:08.428227    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9064d2be-6vczl"]
Sep 15 11:55:08.429736 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:55:08.429709    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6adeff9_3111_4f28_b57e_2362f0fcc40b.slice/crio-21943a80024821a14ce494e04e8ecc877f018445a5985f0eda56da9d72b5ecaa WatchSource:0}: Error finding container 21943a80024821a14ce494e04e8ecc877f018445a5985f0eda56da9d72b5ecaa: Status 404 returned error can't find the container with id 21943a80024821a14ce494e04e8ecc877f018445a5985f0eda56da9d72b5ecaa
Sep 15 11:55:09.413709 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:09.413667    2564 generic.go:356] "Generic (PLEG): container finished" podID="d6adeff9-3111-4f28-b57e-2362f0fcc40b" containerID="9aabfe08ee4e19fcdd27816ad5e16dacc2683eb3581d017b8a9b2ab276f0d48c" exitCode=0
Sep 15 11:55:09.414114 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:09.413752    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9064d2be-6vczl" event={"ID":"d6adeff9-3111-4f28-b57e-2362f0fcc40b","Type":"ContainerDied","Data":"9aabfe08ee4e19fcdd27816ad5e16dacc2683eb3581d017b8a9b2ab276f0d48c"}
Sep 15 11:55:09.414114 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:09.413818    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9064d2be-6vczl" event={"ID":"d6adeff9-3111-4f28-b57e-2362f0fcc40b","Type":"ContainerStarted","Data":"21943a80024821a14ce494e04e8ecc877f018445a5985f0eda56da9d72b5ecaa"}
Sep 15 11:55:10.547797 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:10.547771    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9064d2be-6vczl"
Sep 15 11:55:10.629872 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:10.629842    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6adeff9-3111-4f28-b57e-2362f0fcc40b-maas-api-service-ca\") pod \"d6adeff9-3111-4f28-b57e-2362f0fcc40b\" (UID: \"d6adeff9-3111-4f28-b57e-2362f0fcc40b\") "
Sep 15 11:55:10.630175 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:10.630150    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6adeff9-3111-4f28-b57e-2362f0fcc40b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d6adeff9-3111-4f28-b57e-2362f0fcc40b" (UID: "d6adeff9-3111-4f28-b57e-2362f0fcc40b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:55:10.730599 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:10.730516    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6adeff9-3111-4f28-b57e-2362f0fcc40b-maas-api-service-ca\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:55:11.426811 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:11.426782    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9064d2be-6vczl"
Sep 15 11:55:11.426991 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:11.426819    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9064d2be-6vczl" event={"ID":"d6adeff9-3111-4f28-b57e-2362f0fcc40b","Type":"ContainerDied","Data":"21943a80024821a14ce494e04e8ecc877f018445a5985f0eda56da9d72b5ecaa"}
Sep 15 11:55:11.426991 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:11.426863    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21943a80024821a14ce494e04e8ecc877f018445a5985f0eda56da9d72b5ecaa"
Sep 15 11:55:17.769056 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.769017    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"]
Sep 15 11:55:17.769459 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.769431    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6adeff9-3111-4f28-b57e-2362f0fcc40b" containerName="revoke-keys"
Sep 15 11:55:17.769459 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.769446    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6adeff9-3111-4f28-b57e-2362f0fcc40b" containerName="revoke-keys"
Sep 15 11:55:17.769538 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.769523    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6adeff9-3111-4f28-b57e-2362f0fcc40b" containerName="revoke-keys"
Sep 15 11:55:17.772501 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.772484    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:17.776558 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.776530    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w2-7b7b3c\"/\"openshift-service-ca.crt\""
Sep 15 11:55:17.776888 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.776589    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w2-7b7b3c\"/\"auth-test-model-7b7b3c-kserve-self-signed-certs\""
Sep 15 11:55:17.777153 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.776617    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w2-7b7b3c\"/\"default-dockercfg-h9z4x\""
Sep 15 11:55:17.777467 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.776644    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w2-7b7b3c\"/\"kube-root-ca.crt\""
Sep 15 11:55:17.782746 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.782714    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"]
Sep 15 11:55:17.889153 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.889118    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhgqh\" (UniqueName: \"kubernetes.io/projected/d9908d90-7f34-4044-92de-0dd21f32a1b6-kube-api-access-lhgqh\") pod \"auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") " pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:17.889383 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.889169    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-model-cache\") pod \"auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") " pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:17.889383 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.889243    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-home\") pod \"auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") " pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:17.889383 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.889323    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-tmp-dir\") pod \"auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") " pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:17.889383 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.889348    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-dshm\") pod \"auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") " pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:17.889383 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.889369    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9908d90-7f34-4044-92de-0dd21f32a1b6-tls-certs\") pod \"auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") " pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:17.990326 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.990285    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-home\") pod \"auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") " pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:17.990526 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.990337    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-tmp-dir\") pod \"auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") " pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:17.990526 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.990357    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-dshm\") pod \"auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") " pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:17.990526 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.990372    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9908d90-7f34-4044-92de-0dd21f32a1b6-tls-certs\") pod \"auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") " pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:17.990526 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.990435    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhgqh\" (UniqueName: \"kubernetes.io/projected/d9908d90-7f34-4044-92de-0dd21f32a1b6-kube-api-access-lhgqh\") pod \"auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") " pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:17.990526 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.990463    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-model-cache\") pod \"auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") " pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:17.990817 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.990787    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-tmp-dir\") pod \"auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") " pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:17.990875 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.990794    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-home\") pod \"auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") " pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:17.991013 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.990990    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-model-cache\") pod \"auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") " pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:17.992662 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.992636    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-dshm\") pod \"auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") " pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:17.992978 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:17.992959    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9908d90-7f34-4044-92de-0dd21f32a1b6-tls-certs\") pod \"auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") " pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:18.001331 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:18.001306    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhgqh\" (UniqueName: \"kubernetes.io/projected/d9908d90-7f34-4044-92de-0dd21f32a1b6-kube-api-access-lhgqh\") pod \"auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") " pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:18.083786 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:18.083750    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:18.364499 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:18.364471    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"]
Sep 15 11:55:18.365086 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:55:18.365059    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9908d90_7f34_4044_92de_0dd21f32a1b6.slice/crio-37c7b37edb9d3817175a1f9d1c3a3d30d9966a492d4e54f94031d908ebe6d646 WatchSource:0}: Error finding container 37c7b37edb9d3817175a1f9d1c3a3d30d9966a492d4e54f94031d908ebe6d646: Status 404 returned error can't find the container with id 37c7b37edb9d3817175a1f9d1c3a3d30d9966a492d4e54f94031d908ebe6d646
Sep 15 11:55:18.470523 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:18.470490    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm" event={"ID":"d9908d90-7f34-4044-92de-0dd21f32a1b6","Type":"ContainerStarted","Data":"cc5878201bae609e8ba93ffc5cd06a4a3030c68b8f9f14f678092eff294e5a03"}
Sep 15 11:55:18.470682 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:18.470534    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm" event={"ID":"d9908d90-7f34-4044-92de-0dd21f32a1b6","Type":"ContainerStarted","Data":"37c7b37edb9d3817175a1f9d1c3a3d30d9966a492d4e54f94031d908ebe6d646"}
Sep 15 11:55:18.487648 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:18.487597    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm" podStartSLOduration=1.487579972 podStartE2EDuration="1.487579972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:55:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:55:18.487398079 +0000 UTC m=+1095.204272264" watchObservedRunningTime="2026-09-15 11:55:18.487579972 +0000 UTC m=+1095.204454157"
Sep 15 11:55:18.563987 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:18.563951    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9064d2be-6vczl"]
Sep 15 11:55:18.568187 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:18.568159    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9064d2be-6vczl"]
Sep 15 11:55:19.779301 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:19.779243    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6adeff9-3111-4f28-b57e-2362f0fcc40b" path="/var/lib/kubelet/pods/d6adeff9-3111-4f28-b57e-2362f0fcc40b/volumes"
Sep 15 11:55:21.709472 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:21.709429    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:55:25.158936 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:25.158893    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"]
Sep 15 11:55:25.159435 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:25.159162    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv" podUID="7015977c-42f3-4228-892b-e73f85660deb" containerName="istio-proxy" containerID="cri-o://800c5f92ce7bd804c21b4d3914eccf9fd4e649ac88140999079428f43a1357db" gracePeriod=30
Sep 15 11:55:28.083855 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:28.083820    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:28.084350 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:28.083912    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:28.096469 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:28.096444    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:28.542514 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:28.542431    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:55:30.409386 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.409361    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:55:30.511443 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.511370    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-istio-envoy\") pod \"7015977c-42f3-4228-892b-e73f85660deb\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") "
Sep 15 11:55:30.511443 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.511411    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7015977c-42f3-4228-892b-e73f85660deb-istio-token\") pod \"7015977c-42f3-4228-892b-e73f85660deb\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") "
Sep 15 11:55:30.511443 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.511428    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-workload-socket\") pod \"7015977c-42f3-4228-892b-e73f85660deb\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") "
Sep 15 11:55:30.511726 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.511451    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7015977c-42f3-4228-892b-e73f85660deb-istiod-ca-cert\") pod \"7015977c-42f3-4228-892b-e73f85660deb\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") "
Sep 15 11:55:30.511726 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.511478    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjjjj\" (UniqueName: \"kubernetes.io/projected/7015977c-42f3-4228-892b-e73f85660deb-kube-api-access-hjjjj\") pod \"7015977c-42f3-4228-892b-e73f85660deb\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") "
Sep 15 11:55:30.511726 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.511503    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-workload-certs\") pod \"7015977c-42f3-4228-892b-e73f85660deb\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") "
Sep 15 11:55:30.511726 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.511653    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-istio-data\") pod \"7015977c-42f3-4228-892b-e73f85660deb\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") "
Sep 15 11:55:30.511726 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.511680    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7015977c-42f3-4228-892b-e73f85660deb" (UID: "7015977c-42f3-4228-892b-e73f85660deb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:55:30.511726 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.511693    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-credential-socket\") pod \"7015977c-42f3-4228-892b-e73f85660deb\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") "
Sep 15 11:55:30.512101 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.511764    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7015977c-42f3-4228-892b-e73f85660deb-istio-podinfo\") pod \"7015977c-42f3-4228-892b-e73f85660deb\" (UID: \"7015977c-42f3-4228-892b-e73f85660deb\") "
Sep 15 11:55:30.512101 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.511896    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7015977c-42f3-4228-892b-e73f85660deb" (UID: "7015977c-42f3-4228-892b-e73f85660deb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:55:30.512101 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.511914    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7015977c-42f3-4228-892b-e73f85660deb" (UID: "7015977c-42f3-4228-892b-e73f85660deb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:55:30.512101 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.512021    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-istio-data" (OuterVolumeSpecName: "istio-data") pod "7015977c-42f3-4228-892b-e73f85660deb" (UID: "7015977c-42f3-4228-892b-e73f85660deb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:55:30.512366 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.512143    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-workload-certs\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:55:30.512366 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.512164    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-istio-data\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:55:30.512366 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.512178    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-credential-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:55:30.512366 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.512191    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-workload-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:55:30.512366 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.512218    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7015977c-42f3-4228-892b-e73f85660deb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7015977c-42f3-4228-892b-e73f85660deb" (UID: "7015977c-42f3-4228-892b-e73f85660deb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:55:30.513783 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.513757    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7015977c-42f3-4228-892b-e73f85660deb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7015977c-42f3-4228-892b-e73f85660deb" (UID: "7015977c-42f3-4228-892b-e73f85660deb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:55:30.513882 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.513771    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7015977c-42f3-4228-892b-e73f85660deb-istio-token" (OuterVolumeSpecName: "istio-token") pod "7015977c-42f3-4228-892b-e73f85660deb" (UID: "7015977c-42f3-4228-892b-e73f85660deb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:55:30.514003 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.513980    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7015977c-42f3-4228-892b-e73f85660deb-kube-api-access-hjjjj" (OuterVolumeSpecName: "kube-api-access-hjjjj") pod "7015977c-42f3-4228-892b-e73f85660deb" (UID: "7015977c-42f3-4228-892b-e73f85660deb"). InnerVolumeSpecName "kube-api-access-hjjjj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:55:30.514054 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.513986    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7015977c-42f3-4228-892b-e73f85660deb" (UID: "7015977c-42f3-4228-892b-e73f85660deb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:55:30.540940 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.540907    2564 generic.go:356] "Generic (PLEG): container finished" podID="7015977c-42f3-4228-892b-e73f85660deb" containerID="800c5f92ce7bd804c21b4d3914eccf9fd4e649ac88140999079428f43a1357db" exitCode=0
Sep 15 11:55:30.541070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.540966    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"
Sep 15 11:55:30.541070 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.540996    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv" event={"ID":"7015977c-42f3-4228-892b-e73f85660deb","Type":"ContainerDied","Data":"800c5f92ce7bd804c21b4d3914eccf9fd4e649ac88140999079428f43a1357db"}
Sep 15 11:55:30.541146 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.541082    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv" event={"ID":"7015977c-42f3-4228-892b-e73f85660deb","Type":"ContainerDied","Data":"4d94397aaae49efb17a4d3c83aa65d3325a5d4da0a4bc977200ff018bdb4692a"}
Sep 15 11:55:30.541146 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.541111    2564 scope.go:117] "RemoveContainer" containerID="800c5f92ce7bd804c21b4d3914eccf9fd4e649ac88140999079428f43a1357db"
Sep 15 11:55:30.550718 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.550698    2564 scope.go:117] "RemoveContainer" containerID="e862e1d0b50c5e4dd0ca7f58e45b764f37b49ad34ce098b81c9111724f1f9109"
Sep 15 11:55:30.559229 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.559210    2564 scope.go:117] "RemoveContainer" containerID="800c5f92ce7bd804c21b4d3914eccf9fd4e649ac88140999079428f43a1357db"
Sep 15 11:55:30.559522 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:55:30.559499    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"800c5f92ce7bd804c21b4d3914eccf9fd4e649ac88140999079428f43a1357db\": container with ID starting with 800c5f92ce7bd804c21b4d3914eccf9fd4e649ac88140999079428f43a1357db not found: ID does not exist" containerID="800c5f92ce7bd804c21b4d3914eccf9fd4e649ac88140999079428f43a1357db"
Sep 15 11:55:30.559578 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.559534    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"800c5f92ce7bd804c21b4d3914eccf9fd4e649ac88140999079428f43a1357db"} err="failed to get container status \"800c5f92ce7bd804c21b4d3914eccf9fd4e649ac88140999079428f43a1357db\": rpc error: code = NotFound desc = could not find container \"800c5f92ce7bd804c21b4d3914eccf9fd4e649ac88140999079428f43a1357db\": container with ID starting with 800c5f92ce7bd804c21b4d3914eccf9fd4e649ac88140999079428f43a1357db not found: ID does not exist"
Sep 15 11:55:30.559578 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.559558    2564 scope.go:117] "RemoveContainer" containerID="e862e1d0b50c5e4dd0ca7f58e45b764f37b49ad34ce098b81c9111724f1f9109"
Sep 15 11:55:30.559840 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:55:30.559818    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e862e1d0b50c5e4dd0ca7f58e45b764f37b49ad34ce098b81c9111724f1f9109\": container with ID starting with e862e1d0b50c5e4dd0ca7f58e45b764f37b49ad34ce098b81c9111724f1f9109 not found: ID does not exist" containerID="e862e1d0b50c5e4dd0ca7f58e45b764f37b49ad34ce098b81c9111724f1f9109"
Sep 15 11:55:30.559882 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.559848    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e862e1d0b50c5e4dd0ca7f58e45b764f37b49ad34ce098b81c9111724f1f9109"} err="failed to get container status \"e862e1d0b50c5e4dd0ca7f58e45b764f37b49ad34ce098b81c9111724f1f9109\": rpc error: code = NotFound desc = could not find container \"e862e1d0b50c5e4dd0ca7f58e45b764f37b49ad34ce098b81c9111724f1f9109\": container with ID starting with e862e1d0b50c5e4dd0ca7f58e45b764f37b49ad34ce098b81c9111724f1f9109 not found: ID does not exist"
Sep 15 11:55:30.565165 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.565143    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"]
Sep 15 11:55:30.569032 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.569011    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9064d2be-openshift-default-78549465b-vnfgv"]
Sep 15 11:55:30.613152 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.613134    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7015977c-42f3-4228-892b-e73f85660deb-istio-envoy\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:55:30.613152 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.613152    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7015977c-42f3-4228-892b-e73f85660deb-istio-token\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:55:30.613300 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.613160    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7015977c-42f3-4228-892b-e73f85660deb-istiod-ca-cert\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:55:30.613300 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.613169    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjjjj\" (UniqueName: \"kubernetes.io/projected/7015977c-42f3-4228-892b-e73f85660deb-kube-api-access-hjjjj\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:55:30.613300 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:30.613178    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7015977c-42f3-4228-892b-e73f85660deb-istio-podinfo\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:55:31.779411 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:31.779379    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7015977c-42f3-4228-892b-e73f85660deb" path="/var/lib/kubelet/pods/7015977c-42f3-4228-892b-e73f85660deb/volumes"
Sep 15 11:55:37.568109 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:37.568070    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:55:39.484564 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.484523    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"]
Sep 15 11:55:39.484956 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.484871    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7015977c-42f3-4228-892b-e73f85660deb" containerName="istio-proxy"
Sep 15 11:55:39.484956 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.484884    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7015977c-42f3-4228-892b-e73f85660deb" containerName="istio-proxy"
Sep 15 11:55:39.484956 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.484950    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7015977c-42f3-4228-892b-e73f85660deb" containerName="istio-proxy"
Sep 15 11:55:39.488175 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.488156    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.490985 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.490966    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w1-7f9f55-openshift-default-dockercfg-2tfc9\""
Sep 15 11:55:39.498635 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.498612    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"]
Sep 15 11:55:39.599866 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.599831    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-envoy\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.599866 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.599882    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-credential-socket\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.600132 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.599971    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-workload-certs\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.600132 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.599995    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-podinfo\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.600132 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.600022    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-data\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.600132 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.600121    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-token\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.600337 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.600184    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-workload-socket\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.600337 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.600205    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istiod-ca-cert\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.600337 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.600253    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt25d\" (UniqueName: \"kubernetes.io/projected/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-kube-api-access-zt25d\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.701716 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.701670    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-workload-certs\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.701716 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.701717    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-podinfo\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.701972 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.701733    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-data\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.701972 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.701769    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-token\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.701972 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.701805    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-workload-socket\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.701972 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.701820    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istiod-ca-cert\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.701972 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.701846    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt25d\" (UniqueName: \"kubernetes.io/projected/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-kube-api-access-zt25d\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.701972 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.701876    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-envoy\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.701972 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.701902    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-credential-socket\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.702380 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.702145    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-workload-certs\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.702380 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.702185    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-workload-socket\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.702380 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.702229    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-credential-socket\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.702665 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.702642    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-data\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.702725 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.702643    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istiod-ca-cert\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.704595 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.704574    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-envoy\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.704904 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.704884    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-podinfo\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.710474 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.710454    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-token\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.710564 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.710521    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt25d\" (UniqueName: \"kubernetes.io/projected/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-kube-api-access-zt25d\") pod \"e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") " pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:39.800388 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:39.800312    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:40.082475 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:40.082450    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"]
Sep 15 11:55:40.084583 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:55:40.084547    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad12a77b_2cc5_4d71_a03a_0815dfa38bef.slice/crio-afafc72a5b4a6b92a2560e12ac8dcc95a31fb5cdf525eab837f71a54a762fc35 WatchSource:0}: Error finding container afafc72a5b4a6b92a2560e12ac8dcc95a31fb5cdf525eab837f71a54a762fc35: Status 404 returned error can't find the container with id afafc72a5b4a6b92a2560e12ac8dcc95a31fb5cdf525eab837f71a54a762fc35
Sep 15 11:55:40.087163 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:40.087126    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:55:40.087253 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:40.087199    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:55:40.087253 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:40.087229    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:55:40.607282 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:40.607234    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6" event={"ID":"ad12a77b-2cc5-4d71-a03a-0815dfa38bef","Type":"ContainerStarted","Data":"e4f42b366d9b34f87a9328e94424be551c43207a83eb39bb3311b347663a5e53"}
Sep 15 11:55:40.607672 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:40.607311    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6" event={"ID":"ad12a77b-2cc5-4d71-a03a-0815dfa38bef","Type":"ContainerStarted","Data":"afafc72a5b4a6b92a2560e12ac8dcc95a31fb5cdf525eab837f71a54a762fc35"}
Sep 15 11:55:40.633179 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:40.633117    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6" podStartSLOduration=1.633097174 podStartE2EDuration="1.633097174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:55:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:55:40.627364119 +0000 UTC m=+1117.344238304" watchObservedRunningTime="2026-09-15 11:55:40.633097174 +0000 UTC m=+1117.349971363"
Sep 15 11:55:40.800783 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:40.800748    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:41.805375 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:41.805349    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:42.618133 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:42.618103    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:42.619039 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:42.619019    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:55:51.402737 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:55:51.402700    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:56:02.734047 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:02.734010    2564 generic.go:356] "Generic (PLEG): container finished" podID="ad12a77b-2cc5-4d71-a03a-0815dfa38bef" containerID="e4f42b366d9b34f87a9328e94424be551c43207a83eb39bb3311b347663a5e53" exitCode=0
Sep 15 11:56:02.734498 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:02.734078    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6" event={"ID":"ad12a77b-2cc5-4d71-a03a-0815dfa38bef","Type":"ContainerDied","Data":"e4f42b366d9b34f87a9328e94424be551c43207a83eb39bb3311b347663a5e53"}
Sep 15 11:56:02.734498 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:02.734472    2564 scope.go:117] "RemoveContainer" containerID="e4f42b366d9b34f87a9328e94424be551c43207a83eb39bb3311b347663a5e53"
Sep 15 11:56:02.735566 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:02.735535    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:56:02.735637 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:02.735621    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:56:02.735679 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:02.735662    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:56:03.742097 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:03.742056    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6" event={"ID":"ad12a77b-2cc5-4d71-a03a-0815dfa38bef","Type":"ContainerStarted","Data":"318b269a3b9c75317ec0b0b9dfbd3f9ee73abb5316307b3294f2f0810caf6ecf"}
Sep 15 11:56:03.801500 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:03.801461    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:56:03.801725 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:03.801703    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 15 11:56:03.801779 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:03.801762    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6" podUID="ad12a77b-2cc5-4d71-a03a-0815dfa38bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 15 11:56:04.800867 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:04.800830    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 15 11:56:04.801295 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:04.800892    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6" podUID="ad12a77b-2cc5-4d71-a03a-0815dfa38bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 15 11:56:05.801307 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:05.801245    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 15 11:56:05.801679 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:05.801333    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6" podUID="ad12a77b-2cc5-4d71-a03a-0815dfa38bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 15 11:56:06.801464 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:06.801429    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 15 11:56:06.801976 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:06.801498    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6" podUID="ad12a77b-2cc5-4d71-a03a-0815dfa38bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 15 11:56:07.801199 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:07.801161    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 15 11:56:07.801392 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:07.801212    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6" podUID="ad12a77b-2cc5-4d71-a03a-0815dfa38bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 15 11:56:08.214656 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.214576    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:56:08.341097 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.341069    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"]
Sep 15 11:56:08.341609 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.341586    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7015977c-42f3-4228-892b-e73f85660deb" containerName="istio-proxy"
Sep 15 11:56:08.341609 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.341610    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7015977c-42f3-4228-892b-e73f85660deb" containerName="istio-proxy"
Sep 15 11:56:08.341784 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.341720    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7015977c-42f3-4228-892b-e73f85660deb" containerName="istio-proxy"
Sep 15 11:56:08.344435 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.344412    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.347129 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.347106    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w1-d2de76-openshift-default-dockercfg-jk9bk\""
Sep 15 11:56:08.366478 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.366451    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"]
Sep 15 11:56:08.491085 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.490993    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbglp\" (UniqueName: \"kubernetes.io/projected/15a2142e-b8ea-4be8-8fc7-691c32e98559-kube-api-access-bbglp\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.491335 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.491311    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-workload-socket\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.491454 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.491441    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-envoy\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.491608 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.491579    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-workload-certs\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.491678 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.491628    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-credential-socket\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.491678 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.491660    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-podinfo\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.491779 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.491686    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15a2142e-b8ea-4be8-8fc7-691c32e98559-istiod-ca-cert\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.491779 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.491723    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-data\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.491881 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.491791    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-token\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.593209 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.593176    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-credential-socket\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.593209 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.593212    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-podinfo\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.593526 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.593232    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15a2142e-b8ea-4be8-8fc7-691c32e98559-istiod-ca-cert\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.593526 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.593288    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-data\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.593526 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.593338    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-token\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.593526 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.593440    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbglp\" (UniqueName: \"kubernetes.io/projected/15a2142e-b8ea-4be8-8fc7-691c32e98559-kube-api-access-bbglp\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.593755 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.593671    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-workload-socket\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.593755 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.593721    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-data\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.593755 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.593739    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-envoy\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.593755 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.593676    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-credential-socket\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.593991 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.593809    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-workload-certs\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.593991 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.593928    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-workload-socket\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.594123 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.594103    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15a2142e-b8ea-4be8-8fc7-691c32e98559-istiod-ca-cert\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.594123 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.594117    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-workload-certs\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.595941 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.595917    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-envoy\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.596085 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.596069    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-podinfo\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.602202 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.602172    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-token\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.602300 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.602246    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbglp\" (UniqueName: \"kubernetes.io/projected/15a2142e-b8ea-4be8-8fc7-691c32e98559-kube-api-access-bbglp\") pod \"e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") " pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.666539 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.666486    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:08.947419 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.947373    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"]
Sep 15 11:56:08.948832 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:56:08.948801    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a2142e_b8ea_4be8_8fc7_691c32e98559.slice/crio-8e9d08a33a342b6775dc00fe1f71f21d2ed240e41737f55a04653883a80f121a WatchSource:0}: Error finding container 8e9d08a33a342b6775dc00fe1f71f21d2ed240e41737f55a04653883a80f121a: Status 404 returned error can't find the container with id 8e9d08a33a342b6775dc00fe1f71f21d2ed240e41737f55a04653883a80f121a
Sep 15 11:56:08.951045 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.951002    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:56:08.951156 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.951087    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:56:08.951156 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.951117    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:56:08.995979 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.995174    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:56:08.995979 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.995832    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:56:08.996787 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:08.996766    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 11:56:09.789820 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:09.789776    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq" event={"ID":"15a2142e-b8ea-4be8-8fc7-691c32e98559","Type":"ContainerStarted","Data":"a4eb58deec9b768631a23ab81c3daddc1df4c0b3fb4ac85b6b1dcd317d537c6a"}
Sep 15 11:56:09.790230 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:09.789841    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq" event={"ID":"15a2142e-b8ea-4be8-8fc7-691c32e98559","Type":"ContainerStarted","Data":"8e9d08a33a342b6775dc00fe1f71f21d2ed240e41737f55a04653883a80f121a"}
Sep 15 11:56:09.813621 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:09.813574    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq" podStartSLOduration=1.81355986 podStartE2EDuration="1.81355986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:56:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:56:09.811193107 +0000 UTC m=+1146.528067294" watchObservedRunningTime="2026-09-15 11:56:09.81355986 +0000 UTC m=+1146.530434072"
Sep 15 11:56:10.667371 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:10.667331    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:10.672372 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:10.672344    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:10.796735 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:10.796694    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:10.797445 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:10.797425    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:23.006012 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:23.005975    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:56:32.935877 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:32.935842    2564 generic.go:356] "Generic (PLEG): container finished" podID="15a2142e-b8ea-4be8-8fc7-691c32e98559" containerID="a4eb58deec9b768631a23ab81c3daddc1df4c0b3fb4ac85b6b1dcd317d537c6a" exitCode=0
Sep 15 11:56:32.936380 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:32.935888    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq" event={"ID":"15a2142e-b8ea-4be8-8fc7-691c32e98559","Type":"ContainerDied","Data":"a4eb58deec9b768631a23ab81c3daddc1df4c0b3fb4ac85b6b1dcd317d537c6a"}
Sep 15 11:56:32.936380 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:32.936240    2564 scope.go:117] "RemoveContainer" containerID="a4eb58deec9b768631a23ab81c3daddc1df4c0b3fb4ac85b6b1dcd317d537c6a"
Sep 15 11:56:32.937399 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:32.937365    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:56:32.937515 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:32.937458    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:56:32.937515 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:32.937506    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:56:33.943015 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:33.942974    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq" event={"ID":"15a2142e-b8ea-4be8-8fc7-691c32e98559","Type":"ContainerStarted","Data":"435507c72b0dd49d359932169f628aec18f90b6fdaf32addc1d39ce4d9b58a8a"}
Sep 15 11:56:34.667209 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:34.667170    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:34.667611 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:34.667582    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 15 11:56:34.667794 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:34.667767    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq" podUID="15a2142e-b8ea-4be8-8fc7-691c32e98559" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 15 11:56:35.667471 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:35.667427    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 15 11:56:35.667980 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:35.667495    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq" podUID="15a2142e-b8ea-4be8-8fc7-691c32e98559" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 15 11:56:36.667659 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:36.667612    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 15 11:56:36.668175 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:36.667687    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq" podUID="15a2142e-b8ea-4be8-8fc7-691c32e98559" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 15 11:56:37.667251 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:37.667210    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 15 11:56:37.667599 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:37.667545    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq" podUID="15a2142e-b8ea-4be8-8fc7-691c32e98559" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 15 11:56:38.667093 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:38.667055    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 15 11:56:38.667724 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:38.667691    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq" podUID="15a2142e-b8ea-4be8-8fc7-691c32e98559" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 15 11:56:39.710914 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:39.710874    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:39.711464 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:39.711420    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:39.712395 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:39.712371    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 11:56:43.308879 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:43.308840    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:56:46.279254 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.279216    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"]
Sep 15 11:56:46.281576 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.281559    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.286785 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.286759    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-cc429a8e-openshift-default-dockercfg-9phcz\""
Sep 15 11:56:46.305979 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.305945    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"]
Sep 15 11:56:46.366668 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.366625    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-istio-envoy\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.367056 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.367027    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-workload-certs\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.367230 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.367209    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35c4cfc6-694e-4230-b146-9b622adb9942-istio-podinfo\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.367403 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.367386    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-workload-socket\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.367537 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.367522    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35c4cfc6-694e-4230-b146-9b622adb9942-istiod-ca-cert\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.367718 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.367703    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-istio-data\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.367849 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.367835    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35c4cfc6-694e-4230-b146-9b622adb9942-istio-token\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.368042 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.368018    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-credential-socket\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.368174 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.368157    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dxgt\" (UniqueName: \"kubernetes.io/projected/35c4cfc6-694e-4230-b146-9b622adb9942-kube-api-access-8dxgt\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.469709 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.469677    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-istio-data\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.469709 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.469713    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35c4cfc6-694e-4230-b146-9b622adb9942-istio-token\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.469977 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.469740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-credential-socket\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.469977 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.469758    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dxgt\" (UniqueName: \"kubernetes.io/projected/35c4cfc6-694e-4230-b146-9b622adb9942-kube-api-access-8dxgt\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.469977 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.469859    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-istio-envoy\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.470151 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.470068    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-workload-certs\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.470151 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.470117    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35c4cfc6-694e-4230-b146-9b622adb9942-istio-podinfo\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.470294 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.470149    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-workload-socket\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.470294 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.470174    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35c4cfc6-694e-4230-b146-9b622adb9942-istiod-ca-cert\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.470294 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.470184    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-istio-data\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.470294 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.470225    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-credential-socket\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.470508 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.470493    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-workload-socket\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.470586 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.470546    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-workload-certs\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.471154 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.471124    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35c4cfc6-694e-4230-b146-9b622adb9942-istiod-ca-cert\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.472377 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.472356    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-istio-envoy\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.472761 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.472744    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35c4cfc6-694e-4230-b146-9b622adb9942-istio-podinfo\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.481166 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.481146    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35c4cfc6-694e-4230-b146-9b622adb9942-istio-token\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.483648 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.483627    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dxgt\" (UniqueName: \"kubernetes.io/projected/35c4cfc6-694e-4230-b146-9b622adb9942-kube-api-access-8dxgt\") pod \"e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") " pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.591758 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.591724    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:46.880209 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.880179    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"]
Sep 15 11:56:46.881574 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:56:46.881548    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35c4cfc6_694e_4230_b146_9b622adb9942.slice/crio-841a2ee0209064101d52606c5ccd1aefaa3c0d979e9a38e1639bb51d6d527166 WatchSource:0}: Error finding container 841a2ee0209064101d52606c5ccd1aefaa3c0d979e9a38e1639bb51d6d527166: Status 404 returned error can't find the container with id 841a2ee0209064101d52606c5ccd1aefaa3c0d979e9a38e1639bb51d6d527166
Sep 15 11:56:46.883743 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.883710    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:56:46.883823 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.883779    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:56:46.883823 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:46.883806    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:56:47.032353 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:47.032306    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7" event={"ID":"35c4cfc6-694e-4230-b146-9b622adb9942","Type":"ContainerStarted","Data":"cb132229723fffc8bb39a27953e6928701c6533c6d332d1846d6c41fd390b9c8"}
Sep 15 11:56:47.032546 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:47.032379    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7" event={"ID":"35c4cfc6-694e-4230-b146-9b622adb9942","Type":"ContainerStarted","Data":"841a2ee0209064101d52606c5ccd1aefaa3c0d979e9a38e1639bb51d6d527166"}
Sep 15 11:56:47.067871 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:47.067797    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7" podStartSLOduration=1.067775473 podStartE2EDuration="1.067775473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:56:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:56:47.06388762 +0000 UTC m=+1183.780761803" watchObservedRunningTime="2026-09-15 11:56:47.067775473 +0000 UTC m=+1183.784649657"
Sep 15 11:56:47.592656 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:47.592621    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:47.594079 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:47.594051    2564 patch_prober.go:28] interesting pod/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 15 11:56:47.594242 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:47.594111    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7" podUID="35c4cfc6-694e-4230-b146-9b622adb9942" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 15 11:56:48.596037 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:48.596004    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:49.046111 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:49.046026    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:49.046915 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:49.046891    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:56:59.213122 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:56:59.213087    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:57:03.877812 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:03.877778    2564 scope.go:117] "RemoveContainer" containerID="f2e0de2018c4abbbc3684a26cd71fd2a656d3a571f2449271406881359ecc2cb"
Sep 15 11:57:09.165256 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:09.165156    2564 generic.go:356] "Generic (PLEG): container finished" podID="35c4cfc6-694e-4230-b146-9b622adb9942" containerID="cb132229723fffc8bb39a27953e6928701c6533c6d332d1846d6c41fd390b9c8" exitCode=0
Sep 15 11:57:09.165256 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:09.165230    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7" event={"ID":"35c4cfc6-694e-4230-b146-9b622adb9942","Type":"ContainerDied","Data":"cb132229723fffc8bb39a27953e6928701c6533c6d332d1846d6c41fd390b9c8"}
Sep 15 11:57:09.165724 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:09.165653    2564 scope.go:117] "RemoveContainer" containerID="cb132229723fffc8bb39a27953e6928701c6533c6d332d1846d6c41fd390b9c8"
Sep 15 11:57:09.166757 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:09.166715    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:57:09.166865 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:09.166818    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:57:09.166930 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:09.166869    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:57:10.179048 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:10.179008    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7" event={"ID":"35c4cfc6-694e-4230-b146-9b622adb9942","Type":"ContainerStarted","Data":"7d61ff6d5d2d389307f91bdf1cf4385056d64358dcf1898c50dd620c4b53ff9e"}
Sep 15 11:57:10.592437 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:10.592392    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:57:10.592657 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:10.592635    2564 patch_prober.go:28] interesting pod/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 15 11:57:10.592705 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:10.592686    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7" podUID="35c4cfc6-694e-4230-b146-9b622adb9942" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 15 11:57:11.592789 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:11.592751    2564 patch_prober.go:28] interesting pod/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 15 11:57:11.593195 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:11.592806    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7" podUID="35c4cfc6-694e-4230-b146-9b622adb9942" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 15 11:57:12.592100 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:12.592066    2564 patch_prober.go:28] interesting pod/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 15 11:57:12.592296 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:12.592121    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7" podUID="35c4cfc6-694e-4230-b146-9b622adb9942" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 15 11:57:13.592590 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:13.592549    2564 patch_prober.go:28] interesting pod/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 15 11:57:13.593081 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:13.593034    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7" podUID="35c4cfc6-694e-4230-b146-9b622adb9942" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 15 11:57:14.593078 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:14.593033    2564 patch_prober.go:28] interesting pod/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 15 11:57:14.593527 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:14.593100    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7" podUID="35c4cfc6-694e-4230-b146-9b622adb9942" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 15 11:57:15.592111 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:15.592079    2564 patch_prober.go:28] interesting pod/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 15 11:57:15.592326 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:15.592131    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7" podUID="35c4cfc6-694e-4230-b146-9b622adb9942" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 15 11:57:16.596116 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:16.596084    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:57:16.596510 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:16.596370    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:57:16.597112 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:16.597094    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:57:20.610306 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:20.610272    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:57:25.803715 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:25.803678    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"]
Sep 15 11:57:36.373901 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.373867    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"]
Sep 15 11:57:36.376541 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.376519    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:36.379113 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.379088    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w2-42b26e\"/\"kube-root-ca.crt\""
Sep 15 11:57:36.380317 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.380296    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w2-42b26e\"/\"sub-test-model-42b26e-kserve-self-signed-certs\""
Sep 15 11:57:36.380428 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.380333    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w2-42b26e\"/\"openshift-service-ca.crt\""
Sep 15 11:57:36.380428 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.380349    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w2-42b26e\"/\"default-dockercfg-77nkl\""
Sep 15 11:57:36.387595 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.387570    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"]
Sep 15 11:57:36.535687 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.535648    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-dshm\") pod \"sub-test-model-42b26e-kserve-774945b48f-n6d6j\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") " pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:36.535687 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.535691    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltjwt\" (UniqueName: \"kubernetes.io/projected/719a5ec1-d69a-4356-8486-070ead3e6f54-kube-api-access-ltjwt\") pod \"sub-test-model-42b26e-kserve-774945b48f-n6d6j\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") " pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:36.535922 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.535728    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-home\") pod \"sub-test-model-42b26e-kserve-774945b48f-n6d6j\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") " pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:36.535922 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.535746    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-tmp-dir\") pod \"sub-test-model-42b26e-kserve-774945b48f-n6d6j\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") " pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:36.535922 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.535824    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/719a5ec1-d69a-4356-8486-070ead3e6f54-tls-certs\") pod \"sub-test-model-42b26e-kserve-774945b48f-n6d6j\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") " pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:36.535922 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.535879    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-model-cache\") pod \"sub-test-model-42b26e-kserve-774945b48f-n6d6j\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") " pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:36.636756 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.636670    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-model-cache\") pod \"sub-test-model-42b26e-kserve-774945b48f-n6d6j\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") " pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:36.636756 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.636725    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-dshm\") pod \"sub-test-model-42b26e-kserve-774945b48f-n6d6j\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") " pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:36.636967 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.636761    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltjwt\" (UniqueName: \"kubernetes.io/projected/719a5ec1-d69a-4356-8486-070ead3e6f54-kube-api-access-ltjwt\") pod \"sub-test-model-42b26e-kserve-774945b48f-n6d6j\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") " pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:36.636967 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.636797    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-home\") pod \"sub-test-model-42b26e-kserve-774945b48f-n6d6j\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") " pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:36.636967 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.636818    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-tmp-dir\") pod \"sub-test-model-42b26e-kserve-774945b48f-n6d6j\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") " pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:36.636967 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.636865    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/719a5ec1-d69a-4356-8486-070ead3e6f54-tls-certs\") pod \"sub-test-model-42b26e-kserve-774945b48f-n6d6j\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") " pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:36.637208 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.637139    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-model-cache\") pod \"sub-test-model-42b26e-kserve-774945b48f-n6d6j\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") " pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:36.637208 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.637175    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-tmp-dir\") pod \"sub-test-model-42b26e-kserve-774945b48f-n6d6j\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") " pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:36.637358 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.637328    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-home\") pod \"sub-test-model-42b26e-kserve-774945b48f-n6d6j\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") " pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:36.639027 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.639005    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-dshm\") pod \"sub-test-model-42b26e-kserve-774945b48f-n6d6j\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") " pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:36.639216 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.639198    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/719a5ec1-d69a-4356-8486-070ead3e6f54-tls-certs\") pod \"sub-test-model-42b26e-kserve-774945b48f-n6d6j\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") " pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:36.644635 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.644614    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltjwt\" (UniqueName: \"kubernetes.io/projected/719a5ec1-d69a-4356-8486-070ead3e6f54-kube-api-access-ltjwt\") pod \"sub-test-model-42b26e-kserve-774945b48f-n6d6j\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") " pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:36.686527 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.686491    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:36.959284 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:36.959244    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"]
Sep 15 11:57:36.961306 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:57:36.961257    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod719a5ec1_d69a_4356_8486_070ead3e6f54.slice/crio-d697c6bc1385415fa0b4060f8d20c93a2534b927d956c0cd7a57d41f61266464 WatchSource:0}: Error finding container d697c6bc1385415fa0b4060f8d20c93a2534b927d956c0cd7a57d41f61266464: Status 404 returned error can't find the container with id d697c6bc1385415fa0b4060f8d20c93a2534b927d956c0cd7a57d41f61266464
Sep 15 11:57:37.340207 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:37.340168    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j" event={"ID":"719a5ec1-d69a-4356-8486-070ead3e6f54","Type":"ContainerStarted","Data":"4be8f1e138051860259e44ac15689c576ca477ec0206dfee7d0bb694d6e9214a"}
Sep 15 11:57:37.340207 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:37.340212    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j" event={"ID":"719a5ec1-d69a-4356-8486-070ead3e6f54","Type":"ContainerStarted","Data":"d697c6bc1385415fa0b4060f8d20c93a2534b927d956c0cd7a57d41f61266464"}
Sep 15 11:57:37.362081 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:37.362027    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j" podStartSLOduration=1.362011739 podStartE2EDuration="1.362011739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:57:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:57:37.359394708 +0000 UTC m=+1234.076268896" watchObservedRunningTime="2026-09-15 11:57:37.362011739 +0000 UTC m=+1234.078885971"
Sep 15 11:57:38.503914 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:38.503883    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:57:40.822674 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:40.822632    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm" podUID="d9908d90-7f34-4044-92de-0dd21f32a1b6" containerName="main" containerID="cri-o://cc5878201bae609e8ba93ffc5cd06a4a3030c68b8f9f14f678092eff294e5a03" gracePeriod=45
Sep 15 11:57:41.073054 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.072994    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:57:41.182585 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.182553    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhgqh\" (UniqueName: \"kubernetes.io/projected/d9908d90-7f34-4044-92de-0dd21f32a1b6-kube-api-access-lhgqh\") pod \"d9908d90-7f34-4044-92de-0dd21f32a1b6\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") "
Sep 15 11:57:41.182768 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.182602    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-dshm\") pod \"d9908d90-7f34-4044-92de-0dd21f32a1b6\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") "
Sep 15 11:57:41.182768 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.182651    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-tmp-dir\") pod \"d9908d90-7f34-4044-92de-0dd21f32a1b6\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") "
Sep 15 11:57:41.182768 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.182689    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9908d90-7f34-4044-92de-0dd21f32a1b6-tls-certs\") pod \"d9908d90-7f34-4044-92de-0dd21f32a1b6\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") "
Sep 15 11:57:41.182768 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.182714    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-home\") pod \"d9908d90-7f34-4044-92de-0dd21f32a1b6\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") "
Sep 15 11:57:41.182768 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.182745    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-model-cache\") pod \"d9908d90-7f34-4044-92de-0dd21f32a1b6\" (UID: \"d9908d90-7f34-4044-92de-0dd21f32a1b6\") "
Sep 15 11:57:41.183035 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.182952    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-home" (OuterVolumeSpecName: "home") pod "d9908d90-7f34-4044-92de-0dd21f32a1b6" (UID: "d9908d90-7f34-4044-92de-0dd21f32a1b6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:57:41.183035 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.182967    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d9908d90-7f34-4044-92de-0dd21f32a1b6" (UID: "d9908d90-7f34-4044-92de-0dd21f32a1b6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:57:41.183150 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.183064    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-model-cache" (OuterVolumeSpecName: "model-cache") pod "d9908d90-7f34-4044-92de-0dd21f32a1b6" (UID: "d9908d90-7f34-4044-92de-0dd21f32a1b6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:57:41.183150 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.183121    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-home\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:57:41.183150 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.183134    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-tmp-dir\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:57:41.184880 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.184849    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9908d90-7f34-4044-92de-0dd21f32a1b6-kube-api-access-lhgqh" (OuterVolumeSpecName: "kube-api-access-lhgqh") pod "d9908d90-7f34-4044-92de-0dd21f32a1b6" (UID: "d9908d90-7f34-4044-92de-0dd21f32a1b6"). InnerVolumeSpecName "kube-api-access-lhgqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:57:41.185234 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.185202    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-dshm" (OuterVolumeSpecName: "dshm") pod "d9908d90-7f34-4044-92de-0dd21f32a1b6" (UID: "d9908d90-7f34-4044-92de-0dd21f32a1b6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:57:41.185234 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.185210    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9908d90-7f34-4044-92de-0dd21f32a1b6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d9908d90-7f34-4044-92de-0dd21f32a1b6" (UID: "d9908d90-7f34-4044-92de-0dd21f32a1b6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:57:41.283625 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.283586    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhgqh\" (UniqueName: \"kubernetes.io/projected/d9908d90-7f34-4044-92de-0dd21f32a1b6-kube-api-access-lhgqh\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:57:41.283625 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.283615    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-dshm\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:57:41.283625 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.283625    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9908d90-7f34-4044-92de-0dd21f32a1b6-tls-certs\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:57:41.283625 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.283635    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9908d90-7f34-4044-92de-0dd21f32a1b6-model-cache\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:57:41.369414 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.369322    2564 generic.go:356] "Generic (PLEG): container finished" podID="d9908d90-7f34-4044-92de-0dd21f32a1b6" containerID="cc5878201bae609e8ba93ffc5cd06a4a3030c68b8f9f14f678092eff294e5a03" exitCode=0
Sep 15 11:57:41.369414 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.369373    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"
Sep 15 11:57:41.369590 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.369411    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm" event={"ID":"d9908d90-7f34-4044-92de-0dd21f32a1b6","Type":"ContainerDied","Data":"cc5878201bae609e8ba93ffc5cd06a4a3030c68b8f9f14f678092eff294e5a03"}
Sep 15 11:57:41.369590 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.369464    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm" event={"ID":"d9908d90-7f34-4044-92de-0dd21f32a1b6","Type":"ContainerDied","Data":"37c7b37edb9d3817175a1f9d1c3a3d30d9966a492d4e54f94031d908ebe6d646"}
Sep 15 11:57:41.369590 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.369483    2564 scope.go:117] "RemoveContainer" containerID="cc5878201bae609e8ba93ffc5cd06a4a3030c68b8f9f14f678092eff294e5a03"
Sep 15 11:57:41.381387 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.381369    2564 scope.go:117] "RemoveContainer" containerID="cc5878201bae609e8ba93ffc5cd06a4a3030c68b8f9f14f678092eff294e5a03"
Sep 15 11:57:41.381814 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:57:41.381794    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc5878201bae609e8ba93ffc5cd06a4a3030c68b8f9f14f678092eff294e5a03\": container with ID starting with cc5878201bae609e8ba93ffc5cd06a4a3030c68b8f9f14f678092eff294e5a03 not found: ID does not exist" containerID="cc5878201bae609e8ba93ffc5cd06a4a3030c68b8f9f14f678092eff294e5a03"
Sep 15 11:57:41.381906 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.381823    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc5878201bae609e8ba93ffc5cd06a4a3030c68b8f9f14f678092eff294e5a03"} err="failed to get container status \"cc5878201bae609e8ba93ffc5cd06a4a3030c68b8f9f14f678092eff294e5a03\": rpc error: code = NotFound desc = could not find container \"cc5878201bae609e8ba93ffc5cd06a4a3030c68b8f9f14f678092eff294e5a03\": container with ID starting with cc5878201bae609e8ba93ffc5cd06a4a3030c68b8f9f14f678092eff294e5a03 not found: ID does not exist"
Sep 15 11:57:41.391713 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.391690    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"]
Sep 15 11:57:41.398084 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.398061    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w2-7b7b3c/auth-test-model-7b7b3c-kserve-75df65cf95-s2wqm"]
Sep 15 11:57:41.779222 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:41.779146    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9908d90-7f34-4044-92de-0dd21f32a1b6" path="/var/lib/kubelet/pods/d9908d90-7f34-4044-92de-0dd21f32a1b6/volumes"
Sep 15 11:57:46.686724 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:46.686680    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:46.687297 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:46.686757    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:46.698817 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:46.698790    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:47.417350 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:47.417318    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:57:54.098932 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:54.098893    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc429a8e-p5gkd"]
Sep 15 11:57:54.099344 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:54.099275    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9908d90-7f34-4044-92de-0dd21f32a1b6" containerName="main"
Sep 15 11:57:54.099344 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:54.099287    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9908d90-7f34-4044-92de-0dd21f32a1b6" containerName="main"
Sep 15 11:57:54.099431 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:54.099365    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9908d90-7f34-4044-92de-0dd21f32a1b6" containerName="main"
Sep 15 11:57:54.102592 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:54.102573    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc429a8e-p5gkd"
Sep 15 11:57:54.105037 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:54.105001    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 11:57:54.105202 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:54.105184    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjx8x\""
Sep 15 11:57:54.110427 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:54.109952    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc429a8e-p5gkd"]
Sep 15 11:57:54.194627 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:54.194591    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1eb6f533-15ba-49c9-a1b5-07c0da00649b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-cc429a8e-p5gkd\" (UID: \"1eb6f533-15ba-49c9-a1b5-07c0da00649b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc429a8e-p5gkd"
Sep 15 11:57:54.295801 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:54.295762    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1eb6f533-15ba-49c9-a1b5-07c0da00649b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-cc429a8e-p5gkd\" (UID: \"1eb6f533-15ba-49c9-a1b5-07c0da00649b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc429a8e-p5gkd"
Sep 15 11:57:54.296455 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:54.296432    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1eb6f533-15ba-49c9-a1b5-07c0da00649b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-cc429a8e-p5gkd\" (UID: \"1eb6f533-15ba-49c9-a1b5-07c0da00649b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc429a8e-p5gkd"
Sep 15 11:57:54.405994 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:54.405907    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:57:54.414376 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:54.414354    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc429a8e-p5gkd"
Sep 15 11:57:54.683525 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:54.683499    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc429a8e-p5gkd"]
Sep 15 11:57:54.685421 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:57:54.685390    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eb6f533_15ba_49c9_a1b5_07c0da00649b.slice/crio-c35efa1a9123d1eda64130dd8a26d87b0ce1cf9b24d8229747dcbade4f574367 WatchSource:0}: Error finding container c35efa1a9123d1eda64130dd8a26d87b0ce1cf9b24d8229747dcbade4f574367: Status 404 returned error can't find the container with id c35efa1a9123d1eda64130dd8a26d87b0ce1cf9b24d8229747dcbade4f574367
Sep 15 11:57:55.453722 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:55.453688    2564 generic.go:356] "Generic (PLEG): container finished" podID="1eb6f533-15ba-49c9-a1b5-07c0da00649b" containerID="b1d6d975ac9be40ca70ce020a340b61a80b5a1f3f1194f3295dbae1b6eddd2b7" exitCode=0
Sep 15 11:57:55.454138 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:55.453774    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc429a8e-p5gkd" event={"ID":"1eb6f533-15ba-49c9-a1b5-07c0da00649b","Type":"ContainerDied","Data":"b1d6d975ac9be40ca70ce020a340b61a80b5a1f3f1194f3295dbae1b6eddd2b7"}
Sep 15 11:57:55.454138 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:55.453827    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc429a8e-p5gkd" event={"ID":"1eb6f533-15ba-49c9-a1b5-07c0da00649b","Type":"ContainerStarted","Data":"c35efa1a9123d1eda64130dd8a26d87b0ce1cf9b24d8229747dcbade4f574367"}
Sep 15 11:57:56.591875 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:56.591852    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc429a8e-p5gkd"
Sep 15 11:57:56.614656 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:56.614623    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1eb6f533-15ba-49c9-a1b5-07c0da00649b-maas-api-service-ca\") pod \"1eb6f533-15ba-49c9-a1b5-07c0da00649b\" (UID: \"1eb6f533-15ba-49c9-a1b5-07c0da00649b\") "
Sep 15 11:57:56.614934 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:56.614910    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1eb6f533-15ba-49c9-a1b5-07c0da00649b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1eb6f533-15ba-49c9-a1b5-07c0da00649b" (UID: "1eb6f533-15ba-49c9-a1b5-07c0da00649b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:57:56.715683 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:56.715600    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1eb6f533-15ba-49c9-a1b5-07c0da00649b-maas-api-service-ca\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:57:57.468811 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:57.468776    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc429a8e-p5gkd"
Sep 15 11:57:57.469074 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:57.468814    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc429a8e-p5gkd" event={"ID":"1eb6f533-15ba-49c9-a1b5-07c0da00649b","Type":"ContainerDied","Data":"c35efa1a9123d1eda64130dd8a26d87b0ce1cf9b24d8229747dcbade4f574367"}
Sep 15 11:57:57.469074 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:57:57.468859    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c35efa1a9123d1eda64130dd8a26d87b0ce1cf9b24d8229747dcbade4f574367"
Sep 15 11:58:03.903305 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:58:03.903253    2564 scope.go:117] "RemoveContainer" containerID="58ef3d777cb644f385460d559dd89dc58c0b44b6d6773363bd2f16f9bf81dc90"
Sep 15 11:58:03.911882 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:58:03.911858    2564 scope.go:117] "RemoveContainer" containerID="fbd39e1efdc6996d25eb1596b829d0b52451001e41e719ddd49a5be734b48195"
Sep 15 11:58:09.406074 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:58:09.406038    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:58:09.872531 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:58:09.872490    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc429a8e-p5gkd"]
Sep 15 11:58:09.874698 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:58:09.874676    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc429a8e-p5gkd"]
Sep 15 11:58:11.779866 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:58:11.779828    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1eb6f533-15ba-49c9-a1b5-07c0da00649b" path="/var/lib/kubelet/pods/1eb6f533-15ba-49c9-a1b5-07c0da00649b/volumes"
Sep 15 11:58:20.607467 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:58:20.607432    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:58:32.913242 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:58:32.913205    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:58:54.606228 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:58:54.606196    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:59:02.097153 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:02.097119    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"]
Sep 15 11:59:02.097558 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:02.097416    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7" podUID="35c4cfc6-694e-4230-b146-9b622adb9942" containerName="istio-proxy" containerID="cri-o://7d61ff6d5d2d389307f91bdf1cf4385056d64358dcf1898c50dd620c4b53ff9e" gracePeriod=30
Sep 15 11:59:03.940006 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:03.939971    2564 scope.go:117] "RemoveContainer" containerID="33b5be3f2f7cd798ca0d9351bdb878e5ae18e37425dc7d7f4e3d12237fda8a3e"
Sep 15 11:59:07.346073 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.346049    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:59:07.513885 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.513804    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-istio-data\") pod \"35c4cfc6-694e-4230-b146-9b622adb9942\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") "
Sep 15 11:59:07.513885 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.513838    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-workload-socket\") pod \"35c4cfc6-694e-4230-b146-9b622adb9942\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") "
Sep 15 11:59:07.513885 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.513861    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dxgt\" (UniqueName: \"kubernetes.io/projected/35c4cfc6-694e-4230-b146-9b622adb9942-kube-api-access-8dxgt\") pod \"35c4cfc6-694e-4230-b146-9b622adb9942\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") "
Sep 15 11:59:07.513885 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.513887    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35c4cfc6-694e-4230-b146-9b622adb9942-istiod-ca-cert\") pod \"35c4cfc6-694e-4230-b146-9b622adb9942\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") "
Sep 15 11:59:07.514187 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.513934    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35c4cfc6-694e-4230-b146-9b622adb9942-istio-podinfo\") pod \"35c4cfc6-694e-4230-b146-9b622adb9942\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") "
Sep 15 11:59:07.514187 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.513961    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35c4cfc6-694e-4230-b146-9b622adb9942-istio-token\") pod \"35c4cfc6-694e-4230-b146-9b622adb9942\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") "
Sep 15 11:59:07.514187 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.514107    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-istio-data" (OuterVolumeSpecName: "istio-data") pod "35c4cfc6-694e-4230-b146-9b622adb9942" (UID: "35c4cfc6-694e-4230-b146-9b622adb9942"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:07.514187 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.514120    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "35c4cfc6-694e-4230-b146-9b622adb9942" (UID: "35c4cfc6-694e-4230-b146-9b622adb9942"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:07.514187 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.514162    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-istio-envoy\") pod \"35c4cfc6-694e-4230-b146-9b622adb9942\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") "
Sep 15 11:59:07.514464 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.514199    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-credential-socket\") pod \"35c4cfc6-694e-4230-b146-9b622adb9942\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") "
Sep 15 11:59:07.514464 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.514307    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-workload-certs\") pod \"35c4cfc6-694e-4230-b146-9b622adb9942\" (UID: \"35c4cfc6-694e-4230-b146-9b622adb9942\") "
Sep 15 11:59:07.514464 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.514431    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35c4cfc6-694e-4230-b146-9b622adb9942-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "35c4cfc6-694e-4230-b146-9b622adb9942" (UID: "35c4cfc6-694e-4230-b146-9b622adb9942"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:59:07.514637 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.514562    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "35c4cfc6-694e-4230-b146-9b622adb9942" (UID: "35c4cfc6-694e-4230-b146-9b622adb9942"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:07.514722 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.514700    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-credential-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:59:07.514791 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.514715    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "35c4cfc6-694e-4230-b146-9b622adb9942" (UID: "35c4cfc6-694e-4230-b146-9b622adb9942"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:07.514791 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.514727    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-istio-data\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:59:07.514791 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.514742    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-workload-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:59:07.514791 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.514755    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35c4cfc6-694e-4230-b146-9b622adb9942-istiod-ca-cert\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:59:07.516149 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.516121    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35c4cfc6-694e-4230-b146-9b622adb9942-kube-api-access-8dxgt" (OuterVolumeSpecName: "kube-api-access-8dxgt") pod "35c4cfc6-694e-4230-b146-9b622adb9942" (UID: "35c4cfc6-694e-4230-b146-9b622adb9942"). InnerVolumeSpecName "kube-api-access-8dxgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:59:07.516280 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.516231    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35c4cfc6-694e-4230-b146-9b622adb9942-istio-token" (OuterVolumeSpecName: "istio-token") pod "35c4cfc6-694e-4230-b146-9b622adb9942" (UID: "35c4cfc6-694e-4230-b146-9b622adb9942"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:59:07.516340 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.516278    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/35c4cfc6-694e-4230-b146-9b622adb9942-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "35c4cfc6-694e-4230-b146-9b622adb9942" (UID: "35c4cfc6-694e-4230-b146-9b622adb9942"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:59:07.516378 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.516342    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "35c4cfc6-694e-4230-b146-9b622adb9942" (UID: "35c4cfc6-694e-4230-b146-9b622adb9942"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:07.615822 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.615794    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-workload-certs\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:59:07.615822 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.615819    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dxgt\" (UniqueName: \"kubernetes.io/projected/35c4cfc6-694e-4230-b146-9b622adb9942-kube-api-access-8dxgt\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:59:07.615822 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.615830    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35c4cfc6-694e-4230-b146-9b622adb9942-istio-podinfo\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:59:07.616032 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.615839    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35c4cfc6-694e-4230-b146-9b622adb9942-istio-token\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:59:07.616032 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.615846    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35c4cfc6-694e-4230-b146-9b622adb9942-istio-envoy\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:59:07.878906 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.878872    2564 generic.go:356] "Generic (PLEG): container finished" podID="35c4cfc6-694e-4230-b146-9b622adb9942" containerID="7d61ff6d5d2d389307f91bdf1cf4385056d64358dcf1898c50dd620c4b53ff9e" exitCode=0
Sep 15 11:59:07.879084 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.878922    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"
Sep 15 11:59:07.879084 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.878944    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7" event={"ID":"35c4cfc6-694e-4230-b146-9b622adb9942","Type":"ContainerDied","Data":"7d61ff6d5d2d389307f91bdf1cf4385056d64358dcf1898c50dd620c4b53ff9e"}
Sep 15 11:59:07.879084 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.878995    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7" event={"ID":"35c4cfc6-694e-4230-b146-9b622adb9942","Type":"ContainerDied","Data":"841a2ee0209064101d52606c5ccd1aefaa3c0d979e9a38e1639bb51d6d527166"}
Sep 15 11:59:07.879084 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.879017    2564 scope.go:117] "RemoveContainer" containerID="7d61ff6d5d2d389307f91bdf1cf4385056d64358dcf1898c50dd620c4b53ff9e"
Sep 15 11:59:07.888460 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.888443    2564 scope.go:117] "RemoveContainer" containerID="cb132229723fffc8bb39a27953e6928701c6533c6d332d1846d6c41fd390b9c8"
Sep 15 11:59:07.896982 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.896968    2564 scope.go:117] "RemoveContainer" containerID="7d61ff6d5d2d389307f91bdf1cf4385056d64358dcf1898c50dd620c4b53ff9e"
Sep 15 11:59:07.897357 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:59:07.897313    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d61ff6d5d2d389307f91bdf1cf4385056d64358dcf1898c50dd620c4b53ff9e\": container with ID starting with 7d61ff6d5d2d389307f91bdf1cf4385056d64358dcf1898c50dd620c4b53ff9e not found: ID does not exist" containerID="7d61ff6d5d2d389307f91bdf1cf4385056d64358dcf1898c50dd620c4b53ff9e"
Sep 15 11:59:07.897468 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.897355    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d61ff6d5d2d389307f91bdf1cf4385056d64358dcf1898c50dd620c4b53ff9e"} err="failed to get container status \"7d61ff6d5d2d389307f91bdf1cf4385056d64358dcf1898c50dd620c4b53ff9e\": rpc error: code = NotFound desc = could not find container \"7d61ff6d5d2d389307f91bdf1cf4385056d64358dcf1898c50dd620c4b53ff9e\": container with ID starting with 7d61ff6d5d2d389307f91bdf1cf4385056d64358dcf1898c50dd620c4b53ff9e not found: ID does not exist"
Sep 15 11:59:07.897468 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.897378    2564 scope.go:117] "RemoveContainer" containerID="cb132229723fffc8bb39a27953e6928701c6533c6d332d1846d6c41fd390b9c8"
Sep 15 11:59:07.897879 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:59:07.897858    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb132229723fffc8bb39a27953e6928701c6533c6d332d1846d6c41fd390b9c8\": container with ID starting with cb132229723fffc8bb39a27953e6928701c6533c6d332d1846d6c41fd390b9c8 not found: ID does not exist" containerID="cb132229723fffc8bb39a27953e6928701c6533c6d332d1846d6c41fd390b9c8"
Sep 15 11:59:07.897974 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.897888    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb132229723fffc8bb39a27953e6928701c6533c6d332d1846d6c41fd390b9c8"} err="failed to get container status \"cb132229723fffc8bb39a27953e6928701c6533c6d332d1846d6c41fd390b9c8\": rpc error: code = NotFound desc = could not find container \"cb132229723fffc8bb39a27953e6928701c6533c6d332d1846d6c41fd390b9c8\": container with ID starting with cb132229723fffc8bb39a27953e6928701c6533c6d332d1846d6c41fd390b9c8 not found: ID does not exist"
Sep 15 11:59:07.900324 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.900303    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"]
Sep 15 11:59:07.905885 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:07.905865    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-cc429a8e-openshift-default-6f4c7db78d-shfv7"]
Sep 15 11:59:09.779350 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:09.779316    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35c4cfc6-694e-4230-b146-9b622adb9942" path="/var/lib/kubelet/pods/35c4cfc6-694e-4230-b146-9b622adb9942/volumes"
Sep 15 11:59:10.516856 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:10.516819    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:59:19.062633 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:19.062593    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"]
Sep 15 11:59:23.806713 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:23.806676    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:59:34.081614 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:34.081523    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j" podUID="719a5ec1-d69a-4356-8486-070ead3e6f54" containerName="main" containerID="cri-o://4be8f1e138051860259e44ac15689c576ca477ec0206dfee7d0bb694d6e9214a" gracePeriod=45
Sep 15 11:59:34.323051 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:34.323025    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:59:34.451937 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:34.451840    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/719a5ec1-d69a-4356-8486-070ead3e6f54-tls-certs\") pod \"719a5ec1-d69a-4356-8486-070ead3e6f54\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") "
Sep 15 11:59:34.451937 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:34.451906    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-dshm\") pod \"719a5ec1-d69a-4356-8486-070ead3e6f54\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") "
Sep 15 11:59:34.452167 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:34.451945    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-tmp-dir\") pod \"719a5ec1-d69a-4356-8486-070ead3e6f54\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") "
Sep 15 11:59:34.452167 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:34.452008    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltjwt\" (UniqueName: \"kubernetes.io/projected/719a5ec1-d69a-4356-8486-070ead3e6f54-kube-api-access-ltjwt\") pod \"719a5ec1-d69a-4356-8486-070ead3e6f54\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") "
Sep 15 11:59:34.452167 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:34.452030    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-home\") pod \"719a5ec1-d69a-4356-8486-070ead3e6f54\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") "
Sep 15 11:59:34.452167 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:34.452051    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-model-cache\") pod \"719a5ec1-d69a-4356-8486-070ead3e6f54\" (UID: \"719a5ec1-d69a-4356-8486-070ead3e6f54\") "
Sep 15 11:59:34.452406 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:34.452356    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "719a5ec1-d69a-4356-8486-070ead3e6f54" (UID: "719a5ec1-d69a-4356-8486-070ead3e6f54"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:34.452406 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:34.452367    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-home" (OuterVolumeSpecName: "home") pod "719a5ec1-d69a-4356-8486-070ead3e6f54" (UID: "719a5ec1-d69a-4356-8486-070ead3e6f54"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:34.452540 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:34.452513    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-model-cache" (OuterVolumeSpecName: "model-cache") pod "719a5ec1-d69a-4356-8486-070ead3e6f54" (UID: "719a5ec1-d69a-4356-8486-070ead3e6f54"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:34.454286 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:34.454249    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/719a5ec1-d69a-4356-8486-070ead3e6f54-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "719a5ec1-d69a-4356-8486-070ead3e6f54" (UID: "719a5ec1-d69a-4356-8486-070ead3e6f54"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:59:34.454538 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:34.454517    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-dshm" (OuterVolumeSpecName: "dshm") pod "719a5ec1-d69a-4356-8486-070ead3e6f54" (UID: "719a5ec1-d69a-4356-8486-070ead3e6f54"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:34.454615 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:34.454533    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/719a5ec1-d69a-4356-8486-070ead3e6f54-kube-api-access-ltjwt" (OuterVolumeSpecName: "kube-api-access-ltjwt") pod "719a5ec1-d69a-4356-8486-070ead3e6f54" (UID: "719a5ec1-d69a-4356-8486-070ead3e6f54"). InnerVolumeSpecName "kube-api-access-ltjwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:59:34.553465 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:34.553430    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltjwt\" (UniqueName: \"kubernetes.io/projected/719a5ec1-d69a-4356-8486-070ead3e6f54-kube-api-access-ltjwt\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:59:34.553465 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:34.553458    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-home\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:59:34.553465 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:34.553467    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-model-cache\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:59:34.553761 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:34.553478    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/719a5ec1-d69a-4356-8486-070ead3e6f54-tls-certs\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:59:34.553761 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:34.553486    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-dshm\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:59:34.553761 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:34.553493    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/719a5ec1-d69a-4356-8486-070ead3e6f54-tmp-dir\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 11:59:35.034891 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:35.034848    2564 generic.go:356] "Generic (PLEG): container finished" podID="719a5ec1-d69a-4356-8486-070ead3e6f54" containerID="4be8f1e138051860259e44ac15689c576ca477ec0206dfee7d0bb694d6e9214a" exitCode=0
Sep 15 11:59:35.034891 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:35.034893    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"
Sep 15 11:59:35.035176 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:35.034925    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j" event={"ID":"719a5ec1-d69a-4356-8486-070ead3e6f54","Type":"ContainerDied","Data":"4be8f1e138051860259e44ac15689c576ca477ec0206dfee7d0bb694d6e9214a"}
Sep 15 11:59:35.035176 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:35.034976    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j" event={"ID":"719a5ec1-d69a-4356-8486-070ead3e6f54","Type":"ContainerDied","Data":"d697c6bc1385415fa0b4060f8d20c93a2534b927d956c0cd7a57d41f61266464"}
Sep 15 11:59:35.035176 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:35.034994    2564 scope.go:117] "RemoveContainer" containerID="4be8f1e138051860259e44ac15689c576ca477ec0206dfee7d0bb694d6e9214a"
Sep 15 11:59:35.044319 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:35.044289    2564 scope.go:117] "RemoveContainer" containerID="4be8f1e138051860259e44ac15689c576ca477ec0206dfee7d0bb694d6e9214a"
Sep 15 11:59:35.044582 ip-10-0-129-183 kubenswrapper[2564]: E0915 11:59:35.044566    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4be8f1e138051860259e44ac15689c576ca477ec0206dfee7d0bb694d6e9214a\": container with ID starting with 4be8f1e138051860259e44ac15689c576ca477ec0206dfee7d0bb694d6e9214a not found: ID does not exist" containerID="4be8f1e138051860259e44ac15689c576ca477ec0206dfee7d0bb694d6e9214a"
Sep 15 11:59:35.044643 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:35.044588    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4be8f1e138051860259e44ac15689c576ca477ec0206dfee7d0bb694d6e9214a"} err="failed to get container status \"4be8f1e138051860259e44ac15689c576ca477ec0206dfee7d0bb694d6e9214a\": rpc error: code = NotFound desc = could not find container \"4be8f1e138051860259e44ac15689c576ca477ec0206dfee7d0bb694d6e9214a\": container with ID starting with 4be8f1e138051860259e44ac15689c576ca477ec0206dfee7d0bb694d6e9214a not found: ID does not exist"
Sep 15 11:59:35.057736 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:35.057711    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"]
Sep 15 11:59:35.063134 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:35.063113    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w2-42b26e/sub-test-model-42b26e-kserve-774945b48f-n6d6j"]
Sep 15 11:59:35.779748 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:35.779715    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="719a5ec1-d69a-4356-8486-070ead3e6f54" path="/var/lib/kubelet/pods/719a5ec1-d69a-4356-8486-070ead3e6f54/volumes"
Sep 15 11:59:44.513093 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:44.513055    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 11:59:57.626793 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.626754    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"]
Sep 15 11:59:57.627321 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.627306    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="719a5ec1-d69a-4356-8486-070ead3e6f54" containerName="main"
Sep 15 11:59:57.627381 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.627325    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="719a5ec1-d69a-4356-8486-070ead3e6f54" containerName="main"
Sep 15 11:59:57.627381 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.627339    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35c4cfc6-694e-4230-b146-9b622adb9942" containerName="istio-proxy"
Sep 15 11:59:57.627381 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.627347    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="35c4cfc6-694e-4230-b146-9b622adb9942" containerName="istio-proxy"
Sep 15 11:59:57.627381 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.627373    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eb6f533-15ba-49c9-a1b5-07c0da00649b" containerName="revoke-keys"
Sep 15 11:59:57.627514 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.627382    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eb6f533-15ba-49c9-a1b5-07c0da00649b" containerName="revoke-keys"
Sep 15 11:59:57.627514 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.627393    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35c4cfc6-694e-4230-b146-9b622adb9942" containerName="istio-proxy"
Sep 15 11:59:57.627514 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.627402    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="35c4cfc6-694e-4230-b146-9b622adb9942" containerName="istio-proxy"
Sep 15 11:59:57.627514 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.627480    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="35c4cfc6-694e-4230-b146-9b622adb9942" containerName="istio-proxy"
Sep 15 11:59:57.627514 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.627492    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="719a5ec1-d69a-4356-8486-070ead3e6f54" containerName="main"
Sep 15 11:59:57.627514 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.627500    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eb6f533-15ba-49c9-a1b5-07c0da00649b" containerName="revoke-keys"
Sep 15 11:59:57.632144 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.632124    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.634913 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.634893    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-a1650b-openshift-default-dockercfg-x9n4x\""
Sep 15 11:59:57.645643 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.645615    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"]
Sep 15 11:59:57.662386 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.662350    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-envoy\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.662562 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.662465    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-podinfo\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.662562 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.662530    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-workload-socket\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.662701 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.662576    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-token\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.662701 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.662620    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14ce34ce-3962-4d13-8d29-c338304a91c5-istiod-ca-cert\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.662701 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.662646    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbv98\" (UniqueName: \"kubernetes.io/projected/14ce34ce-3962-4d13-8d29-c338304a91c5-kube-api-access-rbv98\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.662701 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.662695    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-data\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.662996 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.662722    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-credential-socket\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.662996 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.662771    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-workload-certs\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.763228 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.763186    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-envoy\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.763228 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.763229    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-podinfo\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.763695 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.763252    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-workload-socket\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.763695 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.763301    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-token\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.763695 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.763322    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14ce34ce-3962-4d13-8d29-c338304a91c5-istiod-ca-cert\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.763695 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.763342    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbv98\" (UniqueName: \"kubernetes.io/projected/14ce34ce-3962-4d13-8d29-c338304a91c5-kube-api-access-rbv98\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.763695 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.763369    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-data\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.763695 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.763395    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-credential-socket\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.763695 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.763427    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-workload-certs\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.764064 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.763786    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-data\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.764064 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.763875    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-credential-socket\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.764236 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.764198    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-workload-certs\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.764405 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.764249    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14ce34ce-3962-4d13-8d29-c338304a91c5-istiod-ca-cert\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.764405 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.764253    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-workload-socket\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.766068 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.766043    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-envoy\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.766325 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.766304    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-podinfo\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.772613 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.772579    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-token\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.772731 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.772686    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbv98\" (UniqueName: \"kubernetes.io/projected/14ce34ce-3962-4d13-8d29-c338304a91c5-kube-api-access-rbv98\") pod \"e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") " pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:57.942678 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:57.942585    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:58.230545 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:58.230517    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"]
Sep 15 11:59:58.233257 ip-10-0-129-183 kubenswrapper[2564]: W0915 11:59:58.233228    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ce34ce_3962_4d13_8d29_c338304a91c5.slice/crio-246b57afc533467cd8e17a0415dab388fb4a4a8177834bba7900f03abdf89fac WatchSource:0}: Error finding container 246b57afc533467cd8e17a0415dab388fb4a4a8177834bba7900f03abdf89fac: Status 404 returned error can't find the container with id 246b57afc533467cd8e17a0415dab388fb4a4a8177834bba7900f03abdf89fac
Sep 15 11:59:58.235699 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:58.235655    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:59:58.235793 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:58.235746    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:59:58.235832 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:58.235791    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 11:59:59.172003 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:59.171957    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp" event={"ID":"14ce34ce-3962-4d13-8d29-c338304a91c5","Type":"ContainerStarted","Data":"a801c06e678fac617fd66f321cf3665e37a89eed0de87de25e5661ee6aba6b82"}
Sep 15 11:59:59.172483 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:59.172025    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp" event={"ID":"14ce34ce-3962-4d13-8d29-c338304a91c5","Type":"ContainerStarted","Data":"246b57afc533467cd8e17a0415dab388fb4a4a8177834bba7900f03abdf89fac"}
Sep 15 11:59:59.194932 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:59.194883    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp" podStartSLOduration=2.194868148 podStartE2EDuration="2.194868148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:59:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:59:59.192689071 +0000 UTC m=+1375.909563254" watchObservedRunningTime="2026-09-15 11:59:59.194868148 +0000 UTC m=+1375.911742333"
Sep 15 11:59:59.943432 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:59.943398    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 11:59:59.949155 ip-10-0-129-183 kubenswrapper[2564]: I0915 11:59:59.949126    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 12:00:00.165504 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:00.165466    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-7f9f55-29824560-cvc5k"]
Sep 15 12:00:00.165925 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:00.165909    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="35c4cfc6-694e-4230-b146-9b622adb9942" containerName="istio-proxy"
Sep 15 12:00:00.169048 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:00.169029    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7b7b3c-29824560-xcr7d"]
Sep 15 12:00:00.169194 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:00.169173    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-7f9f55-29824560-cvc5k"
Sep 15 12:00:00.172433 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:00.172409    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824560-vg852"]
Sep 15 12:00:00.172816 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:00.172539    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7b7b3c-29824560-xcr7d"
Sep 15 12:00:00.173039 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:00.173022    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjx8x\""
Sep 15 12:00:00.175843 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:00.175754    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-vg852"
Sep 15 12:00:00.178682 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:00.178652    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-7f9f55-29824560-cvc5k"]
Sep 15 12:00:00.179252 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:00.179202    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 12:00:00.180433 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:00.180410    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 12:00:00.183910 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:00.183629    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-7f9f55-29824560-cvc5k"
Sep 15 12:00:00.186708 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:00.186683    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824560-vg852"]
Sep 15 12:00:00.189510 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:00.189488    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7b7b3c-29824560-xcr7d"]
Sep 15 12:00:00.197600 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:00.197540    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7b7b3c-29824560-xcr7d"
Sep 15 12:00:00.239643 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:00.239616    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-vg852"
Sep 15 12:00:00.491290 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:00.491244    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-7f9f55-29824560-cvc5k"]
Sep 15 12:00:00.492899 ip-10-0-129-183 kubenswrapper[2564]: W0915 12:00:00.492872    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2eea705_43de_4ae4_9cbf_f6e953e18fab.slice/crio-da373c76dc4e2d90c0f2d93e84053c166500d239b7c66a8532f6abbaea5ffd7c WatchSource:0}: Error finding container da373c76dc4e2d90c0f2d93e84053c166500d239b7c66a8532f6abbaea5ffd7c: Status 404 returned error can't find the container with id da373c76dc4e2d90c0f2d93e84053c166500d239b7c66a8532f6abbaea5ffd7c
Sep 15 12:00:00.494182 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:00.494159    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7b7b3c-29824560-xcr7d"]
Sep 15 12:00:00.495774 ip-10-0-129-183 kubenswrapper[2564]: W0915 12:00:00.495749    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13939405_3459_4bf6_bd40_ced609afc2b2.slice/crio-cc7d7a833e152f85768435407385f3326ce2e7c061fde96414783b199dd4c411 WatchSource:0}: Error finding container cc7d7a833e152f85768435407385f3326ce2e7c061fde96414783b199dd4c411: Status 404 returned error can't find the container with id cc7d7a833e152f85768435407385f3326ce2e7c061fde96414783b199dd4c411
Sep 15 12:00:00.556291 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:00.556245    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824560-vg852"]
Sep 15 12:00:00.558195 ip-10-0-129-183 kubenswrapper[2564]: W0915 12:00:00.558165    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dbc6233_83a1_4151_8872_99f293cf7e43.slice/crio-b40b2995bcac8fa6a77782c82c40a42f517067b6fc7917af831ba746cf8f2581 WatchSource:0}: Error finding container b40b2995bcac8fa6a77782c82c40a42f517067b6fc7917af831ba746cf8f2581: Status 404 returned error can't find the container with id b40b2995bcac8fa6a77782c82c40a42f517067b6fc7917af831ba746cf8f2581
Sep 15 12:00:01.186057 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:01.186021    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-vg852" event={"ID":"2dbc6233-83a1-4151-8872-99f293cf7e43","Type":"ContainerStarted","Data":"e8248f50ed16d395310b70c6ebb3d2345a57af453c4820b976b0d94670d5ab53"}
Sep 15 12:00:01.186566 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:01.186083    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-vg852" event={"ID":"2dbc6233-83a1-4151-8872-99f293cf7e43","Type":"ContainerStarted","Data":"b40b2995bcac8fa6a77782c82c40a42f517067b6fc7917af831ba746cf8f2581"}
Sep 15 12:00:01.187718 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:01.187683    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7b7b3c-29824560-xcr7d" event={"ID":"13939405-3459-4bf6-bd40-ced609afc2b2","Type":"ContainerStarted","Data":"4c19d0bf573e8746aee994dd1a86903cfeee28f9fdb37756ab7a750c90c8cff2"}
Sep 15 12:00:01.187838 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:01.187727    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7b7b3c-29824560-xcr7d" event={"ID":"13939405-3459-4bf6-bd40-ced609afc2b2","Type":"ContainerStarted","Data":"cc7d7a833e152f85768435407385f3326ce2e7c061fde96414783b199dd4c411"}
Sep 15 12:00:01.189109 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:01.189089    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-7f9f55-29824560-cvc5k" event={"ID":"d2eea705-43de-4ae4-9cbf-f6e953e18fab","Type":"ContainerStarted","Data":"022e548aa70969429c215ce23bb91677862ed7d850ee7c90601970fb9a65cd7a"}
Sep 15 12:00:01.189196 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:01.189126    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-7f9f55-29824560-cvc5k" event={"ID":"d2eea705-43de-4ae4-9cbf-f6e953e18fab","Type":"ContainerStarted","Data":"da373c76dc4e2d90c0f2d93e84053c166500d239b7c66a8532f6abbaea5ffd7c"}
Sep 15 12:00:01.202817 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:01.202769    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-vg852" podStartSLOduration=1.202754193 podStartE2EDuration="1.202754193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:00:01.200257578 +0000 UTC m=+1377.917131764" watchObservedRunningTime="2026-09-15 12:00:01.202754193 +0000 UTC m=+1377.919628376"
Sep 15 12:00:01.218316 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:01.218228    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7b7b3c-29824560-xcr7d" podStartSLOduration=1.2182072019999999 podStartE2EDuration="1.218207202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:00:01.215150171 +0000 UTC m=+1377.932024358" watchObservedRunningTime="2026-09-15 12:00:01.218207202 +0000 UTC m=+1377.935081388"
Sep 15 12:00:01.232811 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:01.232748    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-7f9f55-29824560-cvc5k" podStartSLOduration=1.232730618 podStartE2EDuration="1.232730618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:00:01.228882149 +0000 UTC m=+1377.945756333" watchObservedRunningTime="2026-09-15 12:00:01.232730618 +0000 UTC m=+1377.949604803"
Sep 15 12:00:02.197301 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:02.197244    2564 generic.go:356] "Generic (PLEG): container finished" podID="2dbc6233-83a1-4151-8872-99f293cf7e43" containerID="e8248f50ed16d395310b70c6ebb3d2345a57af453c4820b976b0d94670d5ab53" exitCode=0
Sep 15 12:00:02.197301 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:02.197290    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-vg852" event={"ID":"2dbc6233-83a1-4151-8872-99f293cf7e43","Type":"ContainerDied","Data":"e8248f50ed16d395310b70c6ebb3d2345a57af453c4820b976b0d94670d5ab53"}
Sep 15 12:00:02.198859 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:02.198836    2564 generic.go:356] "Generic (PLEG): container finished" podID="13939405-3459-4bf6-bd40-ced609afc2b2" containerID="4c19d0bf573e8746aee994dd1a86903cfeee28f9fdb37756ab7a750c90c8cff2" exitCode=0
Sep 15 12:00:02.198948 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:02.198862    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7b7b3c-29824560-xcr7d" event={"ID":"13939405-3459-4bf6-bd40-ced609afc2b2","Type":"ContainerDied","Data":"4c19d0bf573e8746aee994dd1a86903cfeee28f9fdb37756ab7a750c90c8cff2"}
Sep 15 12:00:02.200394 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:02.200374    2564 generic.go:356] "Generic (PLEG): container finished" podID="d2eea705-43de-4ae4-9cbf-f6e953e18fab" containerID="022e548aa70969429c215ce23bb91677862ed7d850ee7c90601970fb9a65cd7a" exitCode=0
Sep 15 12:00:02.200500 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:02.200422    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-7f9f55-29824560-cvc5k" event={"ID":"d2eea705-43de-4ae4-9cbf-f6e953e18fab","Type":"ContainerDied","Data":"022e548aa70969429c215ce23bb91677862ed7d850ee7c90601970fb9a65cd7a"}
Sep 15 12:00:03.345518 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:03.345487    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-vg852"
Sep 15 12:00:03.406209 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:03.406185    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7b7b3c-29824560-xcr7d"
Sep 15 12:00:03.409155 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:03.409136    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-7f9f55-29824560-cvc5k"
Sep 15 12:00:03.971551 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:03.971515    2564 scope.go:117] "RemoveContainer" containerID="e49c41a980eed9387b3ce8f45f6c088c52f33a88b3bbd92cc2bdf31d00c1c0fd"
Sep 15 12:00:03.980397 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:03.980371    2564 scope.go:117] "RemoveContainer" containerID="ff5f53169c264b0f67d97f8fecffca5e0edd0ddd9525df9812176c7d2f688bd3"
Sep 15 12:00:04.213051 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:04.213019    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-7f9f55-29824560-cvc5k"
Sep 15 12:00:04.213290 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:04.213051    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-7f9f55-29824560-cvc5k" event={"ID":"d2eea705-43de-4ae4-9cbf-f6e953e18fab","Type":"ContainerDied","Data":"da373c76dc4e2d90c0f2d93e84053c166500d239b7c66a8532f6abbaea5ffd7c"}
Sep 15 12:00:04.213290 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:04.213130    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da373c76dc4e2d90c0f2d93e84053c166500d239b7c66a8532f6abbaea5ffd7c"
Sep 15 12:00:04.214706 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:04.214677    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-vg852" event={"ID":"2dbc6233-83a1-4151-8872-99f293cf7e43","Type":"ContainerDied","Data":"b40b2995bcac8fa6a77782c82c40a42f517067b6fc7917af831ba746cf8f2581"}
Sep 15 12:00:04.214844 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:04.214736    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b40b2995bcac8fa6a77782c82c40a42f517067b6fc7917af831ba746cf8f2581"
Sep 15 12:00:04.214844 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:04.214687    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-vg852"
Sep 15 12:00:04.216230 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:04.216206    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7b7b3c-29824560-xcr7d" event={"ID":"13939405-3459-4bf6-bd40-ced609afc2b2","Type":"ContainerDied","Data":"cc7d7a833e152f85768435407385f3326ce2e7c061fde96414783b199dd4c411"}
Sep 15 12:00:04.216368 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:04.216247    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc7d7a833e152f85768435407385f3326ce2e7c061fde96414783b199dd4c411"
Sep 15 12:00:04.216368 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:04.216220    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7b7b3c-29824560-xcr7d"
Sep 15 12:00:11.319757 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:11.319722    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:00:21.323248 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:21.323211    2564 generic.go:356] "Generic (PLEG): container finished" podID="14ce34ce-3962-4d13-8d29-c338304a91c5" containerID="a801c06e678fac617fd66f321cf3665e37a89eed0de87de25e5661ee6aba6b82" exitCode=0
Sep 15 12:00:21.323677 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:21.323292    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp" event={"ID":"14ce34ce-3962-4d13-8d29-c338304a91c5","Type":"ContainerDied","Data":"a801c06e678fac617fd66f321cf3665e37a89eed0de87de25e5661ee6aba6b82"}
Sep 15 12:00:21.323720 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:21.323678    2564 scope.go:117] "RemoveContainer" containerID="a801c06e678fac617fd66f321cf3665e37a89eed0de87de25e5661ee6aba6b82"
Sep 15 12:00:21.324788 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:21.324760    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:00:21.324844 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:21.324825    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:00:21.324881 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:21.324858    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:00:22.331310 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:22.331254    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp" event={"ID":"14ce34ce-3962-4d13-8d29-c338304a91c5","Type":"ContainerStarted","Data":"730908e575fcce7e5d7465cc752064c2b85986d4df9e31de40c9647af1a74a5d"}
Sep 15 12:00:22.943520 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:22.943486    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 12:00:22.943741 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:22.943718    2564 patch_prober.go:28] interesting pod/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 15 12:00:22.943806 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:22.943778    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp" podUID="14ce34ce-3962-4d13-8d29-c338304a91c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 15 12:00:23.943699 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:23.943667    2564 patch_prober.go:28] interesting pod/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 15 12:00:23.944100 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:23.943730    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp" podUID="14ce34ce-3962-4d13-8d29-c338304a91c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 15 12:00:24.943672 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:24.943636    2564 patch_prober.go:28] interesting pod/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 15 12:00:24.943859 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:24.943705    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp" podUID="14ce34ce-3962-4d13-8d29-c338304a91c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 15 12:00:25.943790 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:25.943752    2564 patch_prober.go:28] interesting pod/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 15 12:00:25.943950 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:25.943814    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp" podUID="14ce34ce-3962-4d13-8d29-c338304a91c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 15 12:00:26.943438 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:26.943397    2564 patch_prober.go:28] interesting pod/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 15 12:00:26.943633 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:26.943455    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp" podUID="14ce34ce-3962-4d13-8d29-c338304a91c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 15 12:00:27.086483 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.086442    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"]
Sep 15 12:00:27.087015 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.086994    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2eea705-43de-4ae4-9cbf-f6e953e18fab" containerName="cleanup"
Sep 15 12:00:27.087186 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.087174    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2eea705-43de-4ae4-9cbf-f6e953e18fab" containerName="cleanup"
Sep 15 12:00:27.087328 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.087315    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13939405-3459-4bf6-bd40-ced609afc2b2" containerName="cleanup"
Sep 15 12:00:27.087429 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.087420    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="13939405-3459-4bf6-bd40-ced609afc2b2" containerName="cleanup"
Sep 15 12:00:27.087529 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.087518    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dbc6233-83a1-4151-8872-99f293cf7e43" containerName="cleanup"
Sep 15 12:00:27.087613 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.087595    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dbc6233-83a1-4151-8872-99f293cf7e43" containerName="cleanup"
Sep 15 12:00:27.087813 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.087801    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dbc6233-83a1-4151-8872-99f293cf7e43" containerName="cleanup"
Sep 15 12:00:27.087906 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.087896    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2eea705-43de-4ae4-9cbf-f6e953e18fab" containerName="cleanup"
Sep 15 12:00:27.087984 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.087975    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="13939405-3459-4bf6-bd40-ced609afc2b2" containerName="cleanup"
Sep 15 12:00:27.091601 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.091583    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.096960 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.096465    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-6b0cb9-openshift-default-dockercfg-2bj6j\""
Sep 15 12:00:27.101296 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.101168    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"]
Sep 15 12:00:27.263192 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.263097    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-envoy\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.263192 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.263140    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-credential-socket\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.263192 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.263161    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istiod-ca-cert\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.263492 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.263293    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-workload-socket\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.263492 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.263344    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-podinfo\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.263492 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.263414    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-data\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.263492 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.263470    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqlv7\" (UniqueName: \"kubernetes.io/projected/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-kube-api-access-wqlv7\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.263650 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.263509    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-token\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.263650 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.263535    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-workload-certs\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.364316 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.364279    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-workload-socket\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.364513 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.364336    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-podinfo\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.364513 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.364381    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-data\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.364513 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.364438    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqlv7\" (UniqueName: \"kubernetes.io/projected/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-kube-api-access-wqlv7\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.364513 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.364469    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-token\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.364513 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.364499    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-workload-certs\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.364797 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.364553    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-envoy\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.364797 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.364591    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-credential-socket\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.364797 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.364616    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istiod-ca-cert\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.364954 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.364909    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-data\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.365061 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.365035    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-workload-certs\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.365252 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.365231    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-credential-socket\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.365381 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.365358    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-workload-socket\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.365445 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.365391    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istiod-ca-cert\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.367077 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.367051    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-envoy\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.367200 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.367178    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-podinfo\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.391799 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.391766    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-token\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.391938 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.391866    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqlv7\" (UniqueName: \"kubernetes.io/projected/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-kube-api-access-wqlv7\") pod \"e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") " pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.406166 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.406144    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:27.685166 ip-10-0-129-183 kubenswrapper[2564]: W0915 12:00:27.685131    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb362d76e_2a31_4e6a_a7d2_3d4b13c6cd62.slice/crio-a2e932cafb5a59c63584cb42ea4c2d58ab585f3cfb838c32280ce816939aec0d WatchSource:0}: Error finding container a2e932cafb5a59c63584cb42ea4c2d58ab585f3cfb838c32280ce816939aec0d: Status 404 returned error can't find the container with id a2e932cafb5a59c63584cb42ea4c2d58ab585f3cfb838c32280ce816939aec0d
Sep 15 12:00:27.686905 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.686876    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"]
Sep 15 12:00:27.687373 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.687337    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:00:27.687431 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.687408    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:00:27.687469 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.687437    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:00:27.947572 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.947490    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 12:00:27.947859 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.947832    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 12:00:27.948529 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:27.948509    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 12:00:28.373728 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:28.373694    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv" event={"ID":"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62","Type":"ContainerStarted","Data":"9b57ada6772ebc024fa85ae16fcd81e2baf3d8ff2c536c3469baeba1971605e4"}
Sep 15 12:00:28.374207 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:28.373744    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv" event={"ID":"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62","Type":"ContainerStarted","Data":"a2e932cafb5a59c63584cb42ea4c2d58ab585f3cfb838c32280ce816939aec0d"}
Sep 15 12:00:28.405295 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:28.405227    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv" podStartSLOduration=1.405211629 podStartE2EDuration="1.405211629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:00:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:00:28.402652966 +0000 UTC m=+1405.119527187" watchObservedRunningTime="2026-09-15 12:00:28.405211629 +0000 UTC m=+1405.122085813"
Sep 15 12:00:28.406758 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:28.406739    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:28.411653 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:28.411628    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:28.633215 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:28.633110    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:00:29.379965 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:29.379932    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:29.380906 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:29.380885    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:41.018511 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:41.018469    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:00:51.517412 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:51.517378    2564 generic.go:356] "Generic (PLEG): container finished" podID="b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" containerID="9b57ada6772ebc024fa85ae16fcd81e2baf3d8ff2c536c3469baeba1971605e4" exitCode=0
Sep 15 12:00:51.517791 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:51.517450    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv" event={"ID":"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62","Type":"ContainerDied","Data":"9b57ada6772ebc024fa85ae16fcd81e2baf3d8ff2c536c3469baeba1971605e4"}
Sep 15 12:00:51.517847 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:51.517836    2564 scope.go:117] "RemoveContainer" containerID="9b57ada6772ebc024fa85ae16fcd81e2baf3d8ff2c536c3469baeba1971605e4"
Sep 15 12:00:51.518962 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:51.518933    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:00:51.519025 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:51.519005    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:00:51.519061 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:51.519036    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:00:52.524812 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:52.524773    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv" event={"ID":"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62","Type":"ContainerStarted","Data":"f4df2e63397f4afb4288bd80684be0047434218b4b30c438a188575f09de4f75"}
Sep 15 12:00:53.407372 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:53.407330    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:53.407595 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:53.407570    2564 patch_prober.go:28] interesting pod/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 15 12:00:53.407652 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:53.407633    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv" podUID="b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 15 12:00:54.406983 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:54.406944    2564 patch_prober.go:28] interesting pod/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 15 12:00:54.407435 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:54.407028    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv" podUID="b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 15 12:00:55.406781 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:55.406743    2564 patch_prober.go:28] interesting pod/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 15 12:00:55.406973 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:55.406811    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv" podUID="b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 15 12:00:56.407316 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:56.407213    2564 patch_prober.go:28] interesting pod/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 15 12:00:56.407711 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:56.407310    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv" podUID="b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 15 12:00:57.406630 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:57.406582    2564 patch_prober.go:28] interesting pod/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 15 12:00:57.406808 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:57.406677    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv" podUID="b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 15 12:00:58.410735 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:58.410705    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:58.411144 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:58.410984    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:58.411626 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:58.411603    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:00:58.925546 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:00:58.925513    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:01:03.533682 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:03.533639    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a1650b-z7vv9"]
Sep 15 12:01:03.536767 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:03.536750    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a1650b-z7vv9"
Sep 15 12:01:03.539828 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:03.539809    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 12:01:03.540063 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:03.540045    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjx8x\""
Sep 15 12:01:03.548103 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:03.548074    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a1650b-z7vv9"]
Sep 15 12:01:03.632567 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:03.632524    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c053d01-9884-4d25-835a-912702c7eebc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a1650b-z7vv9\" (UID: \"7c053d01-9884-4d25-835a-912702c7eebc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a1650b-z7vv9"
Sep 15 12:01:03.733745 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:03.733706    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c053d01-9884-4d25-835a-912702c7eebc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a1650b-z7vv9\" (UID: \"7c053d01-9884-4d25-835a-912702c7eebc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a1650b-z7vv9"
Sep 15 12:01:03.736394 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:03.736369    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 12:01:03.744937 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:03.744908    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c053d01-9884-4d25-835a-912702c7eebc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a1650b-z7vv9\" (UID: \"7c053d01-9884-4d25-835a-912702c7eebc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a1650b-z7vv9"
Sep 15 12:01:03.850409 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:03.850378    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjx8x\""
Sep 15 12:01:03.858480 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:03.858450    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a1650b-z7vv9"
Sep 15 12:01:04.142181 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:04.142154    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a1650b-z7vv9"]
Sep 15 12:01:04.142929 ip-10-0-129-183 kubenswrapper[2564]: W0915 12:01:04.142898    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c053d01_9884_4d25_835a_912702c7eebc.slice/crio-3c87c5845034d73912e734bb4f50f869ea326b17e74fee8efc3747bc8af5afc6 WatchSource:0}: Error finding container 3c87c5845034d73912e734bb4f50f869ea326b17e74fee8efc3747bc8af5afc6: Status 404 returned error can't find the container with id 3c87c5845034d73912e734bb4f50f869ea326b17e74fee8efc3747bc8af5afc6
Sep 15 12:01:04.597838 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:04.597802    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a1650b-z7vv9" event={"ID":"7c053d01-9884-4d25-835a-912702c7eebc","Type":"ContainerStarted","Data":"f9cb7a0756e99641451554036a763ed59604629c31977f43369b952c0b19e6d7"}
Sep 15 12:01:04.598217 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:04.597859    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a1650b-z7vv9" event={"ID":"7c053d01-9884-4d25-835a-912702c7eebc","Type":"ContainerStarted","Data":"3c87c5845034d73912e734bb4f50f869ea326b17e74fee8efc3747bc8af5afc6"}
Sep 15 12:01:04.615004 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:04.614947    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a1650b-z7vv9" podStartSLOduration=1.61493346 podStartE2EDuration="1.61493346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:01:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:01:04.613288439 +0000 UTC m=+1441.330162628" watchObservedRunningTime="2026-09-15 12:01:04.61493346 +0000 UTC m=+1441.331807644"
Sep 15 12:01:05.605710 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:05.605673    2564 generic.go:356] "Generic (PLEG): container finished" podID="7c053d01-9884-4d25-835a-912702c7eebc" containerID="f9cb7a0756e99641451554036a763ed59604629c31977f43369b952c0b19e6d7" exitCode=0
Sep 15 12:01:05.606142 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:05.605777    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a1650b-z7vv9" event={"ID":"7c053d01-9884-4d25-835a-912702c7eebc","Type":"ContainerDied","Data":"f9cb7a0756e99641451554036a763ed59604629c31977f43369b952c0b19e6d7"}
Sep 15 12:01:06.749901 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:06.749874    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a1650b-z7vv9"
Sep 15 12:01:06.865077 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:06.864982    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c053d01-9884-4d25-835a-912702c7eebc-maas-api-service-ca\") pod \"7c053d01-9884-4d25-835a-912702c7eebc\" (UID: \"7c053d01-9884-4d25-835a-912702c7eebc\") "
Sep 15 12:01:06.865382 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:06.865360    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c053d01-9884-4d25-835a-912702c7eebc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7c053d01-9884-4d25-835a-912702c7eebc" (UID: "7c053d01-9884-4d25-835a-912702c7eebc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:01:06.966150 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:06.966116    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c053d01-9884-4d25-835a-912702c7eebc-maas-api-service-ca\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:01:07.619341 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:07.619312    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a1650b-z7vv9"
Sep 15 12:01:07.619510 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:07.619335    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a1650b-z7vv9" event={"ID":"7c053d01-9884-4d25-835a-912702c7eebc","Type":"ContainerDied","Data":"3c87c5845034d73912e734bb4f50f869ea326b17e74fee8efc3747bc8af5afc6"}
Sep 15 12:01:07.619510 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:07.619384    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c87c5845034d73912e734bb4f50f869ea326b17e74fee8efc3747bc8af5afc6"
Sep 15 12:01:16.121094 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:16.121059    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:01:19.340659 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:19.340622    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a1650b-z7vv9"]
Sep 15 12:01:19.343719 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:19.343695    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a1650b-z7vv9"]
Sep 15 12:01:19.779544 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:19.779461    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c053d01-9884-4d25-835a-912702c7eebc" path="/var/lib/kubelet/pods/7c053d01-9884-4d25-835a-912702c7eebc/volumes"
Sep 15 12:01:22.563059 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.563019    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"]
Sep 15 12:01:22.563491 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.563475    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c053d01-9884-4d25-835a-912702c7eebc" containerName="revoke-keys"
Sep 15 12:01:22.563541 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.563494    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c053d01-9884-4d25-835a-912702c7eebc" containerName="revoke-keys"
Sep 15 12:01:22.563591 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.563578    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c053d01-9884-4d25-835a-912702c7eebc" containerName="revoke-keys"
Sep 15 12:01:22.567022 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.567006    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.570017 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.569992    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-030981-openshift-default-dockercfg-shhpq\""
Sep 15 12:01:22.578178 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.578154    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"]
Sep 15 12:01:22.629470 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.629440    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-envoy\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.629659 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.629493    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-workload-certs\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.629659 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.629569    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-credential-socket\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.629659 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.629607    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zw46\" (UniqueName: \"kubernetes.io/projected/abc72f3a-6d05-4182-b00b-5bb20815a96e-kube-api-access-7zw46\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.629659 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.629633    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-token\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.629659 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.629655    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abc72f3a-6d05-4182-b00b-5bb20815a96e-istiod-ca-cert\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.629936 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.629760    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-workload-socket\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.629936 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.629795    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-data\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.629936 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.629817    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-podinfo\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.730882 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.730845    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zw46\" (UniqueName: \"kubernetes.io/projected/abc72f3a-6d05-4182-b00b-5bb20815a96e-kube-api-access-7zw46\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.730882 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.730887    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-token\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.731142 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.730904    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abc72f3a-6d05-4182-b00b-5bb20815a96e-istiod-ca-cert\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.731142 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.730968    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-workload-socket\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.731142 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.730997    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-data\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.731142 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.731029    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-podinfo\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.731142 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.731070    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-envoy\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.731142 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.731117    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-workload-certs\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.731484 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.731146    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-credential-socket\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.731484 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.731460    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-credential-socket\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.731593 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.731556    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-data\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.731593 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.731574    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-workload-certs\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.731702 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.731669    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-workload-socket\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.731967 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.731949    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abc72f3a-6d05-4182-b00b-5bb20815a96e-istiod-ca-cert\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.733452 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.733423    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-envoy\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.733764 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.733743    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-podinfo\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.738446 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.738414    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-token\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.739354 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.739333    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zw46\" (UniqueName: \"kubernetes.io/projected/abc72f3a-6d05-4182-b00b-5bb20815a96e-kube-api-access-7zw46\") pod \"e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") " pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:22.877767 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:22.877663    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:23.161997 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:23.161965    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"]
Sep 15 12:01:23.163948 ip-10-0-129-183 kubenswrapper[2564]: W0915 12:01:23.163914    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc72f3a_6d05_4182_b00b_5bb20815a96e.slice/crio-09de032292d7f3ba1259fdbdf1755d156b204713f8b73c7a85e05e9f3b5e230b WatchSource:0}: Error finding container 09de032292d7f3ba1259fdbdf1755d156b204713f8b73c7a85e05e9f3b5e230b: Status 404 returned error can't find the container with id 09de032292d7f3ba1259fdbdf1755d156b204713f8b73c7a85e05e9f3b5e230b
Sep 15 12:01:23.166503 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:23.166457    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:01:23.166605 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:23.166550    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:01:23.166605 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:23.166590    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:01:23.713367 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:23.713329    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7" event={"ID":"abc72f3a-6d05-4182-b00b-5bb20815a96e","Type":"ContainerStarted","Data":"a08d7fb7192cf06e04904c4e5500a15b816e1ad1c3005f4a56c734fd5d957154"}
Sep 15 12:01:23.713787 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:23.713392    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7" event={"ID":"abc72f3a-6d05-4182-b00b-5bb20815a96e","Type":"ContainerStarted","Data":"09de032292d7f3ba1259fdbdf1755d156b204713f8b73c7a85e05e9f3b5e230b"}
Sep 15 12:01:23.736964 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:23.736919    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7" podStartSLOduration=1.736903815 podStartE2EDuration="1.736903815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:01:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:01:23.734107571 +0000 UTC m=+1460.450981756" watchObservedRunningTime="2026-09-15 12:01:23.736903815 +0000 UTC m=+1460.453777998"
Sep 15 12:01:23.878578 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:23.878543    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:24.883756 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:24.883717    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:25.728471 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:25.728443    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:25.729732 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:25.729708    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:28.749685 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:28.749650    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"]
Sep 15 12:01:28.750105 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:28.749899    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp" podUID="14ce34ce-3962-4d13-8d29-c338304a91c5" containerName="istio-proxy" containerID="cri-o://730908e575fcce7e5d7465cc752064c2b85986d4df9e31de40c9647af1a74a5d" gracePeriod=30
Sep 15 12:01:29.131374 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:29.131336    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6b0cb9-kxj6c"]
Sep 15 12:01:29.134125 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:29.134108    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6b0cb9-kxj6c"
Sep 15 12:01:29.137359 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:29.137336    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 12:01:29.137504 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:29.137488    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjx8x\""
Sep 15 12:01:29.149312 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:29.149286    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6b0cb9-kxj6c"]
Sep 15 12:01:29.197777 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:29.197743    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b496d4c-29ff-4e10-a45a-09da42a35bd9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-6b0cb9-kxj6c\" (UID: \"5b496d4c-29ff-4e10-a45a-09da42a35bd9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6b0cb9-kxj6c"
Sep 15 12:01:29.298969 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:29.298925    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b496d4c-29ff-4e10-a45a-09da42a35bd9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-6b0cb9-kxj6c\" (UID: \"5b496d4c-29ff-4e10-a45a-09da42a35bd9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6b0cb9-kxj6c"
Sep 15 12:01:29.299631 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:29.299606    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b496d4c-29ff-4e10-a45a-09da42a35bd9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-6b0cb9-kxj6c\" (UID: \"5b496d4c-29ff-4e10-a45a-09da42a35bd9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6b0cb9-kxj6c"
Sep 15 12:01:29.444819 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:29.444736    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6b0cb9-kxj6c"
Sep 15 12:01:29.716901 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:29.716874    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6b0cb9-kxj6c"]
Sep 15 12:01:29.717683 ip-10-0-129-183 kubenswrapper[2564]: W0915 12:01:29.717655    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b496d4c_29ff_4e10_a45a_09da42a35bd9.slice/crio-bef1a1d6f7e52f7cc03944bf64ffef48500d7c72ec1e8f2a6e2a1a9d08451802 WatchSource:0}: Error finding container bef1a1d6f7e52f7cc03944bf64ffef48500d7c72ec1e8f2a6e2a1a9d08451802: Status 404 returned error can't find the container with id bef1a1d6f7e52f7cc03944bf64ffef48500d7c72ec1e8f2a6e2a1a9d08451802
Sep 15 12:01:29.752982 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:29.752950    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6b0cb9-kxj6c" event={"ID":"5b496d4c-29ff-4e10-a45a-09da42a35bd9","Type":"ContainerStarted","Data":"bef1a1d6f7e52f7cc03944bf64ffef48500d7c72ec1e8f2a6e2a1a9d08451802"}
Sep 15 12:01:30.761089 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:30.761001    2564 generic.go:356] "Generic (PLEG): container finished" podID="5b496d4c-29ff-4e10-a45a-09da42a35bd9" containerID="3b8831ab15bdefad065c2bcfb711ab68be8b369f1671323b84a5313a0d25209e" exitCode=0
Sep 15 12:01:30.761491 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:30.761082    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6b0cb9-kxj6c" event={"ID":"5b496d4c-29ff-4e10-a45a-09da42a35bd9","Type":"ContainerDied","Data":"3b8831ab15bdefad065c2bcfb711ab68be8b369f1671323b84a5313a0d25209e"}
Sep 15 12:01:31.909526 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:31.909500    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6b0cb9-kxj6c"
Sep 15 12:01:32.028500 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:32.028409    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b496d4c-29ff-4e10-a45a-09da42a35bd9-maas-api-service-ca\") pod \"5b496d4c-29ff-4e10-a45a-09da42a35bd9\" (UID: \"5b496d4c-29ff-4e10-a45a-09da42a35bd9\") "
Sep 15 12:01:32.028782 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:32.028756    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b496d4c-29ff-4e10-a45a-09da42a35bd9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5b496d4c-29ff-4e10-a45a-09da42a35bd9" (UID: "5b496d4c-29ff-4e10-a45a-09da42a35bd9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:01:32.129435 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:32.129382    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b496d4c-29ff-4e10-a45a-09da42a35bd9-maas-api-service-ca\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:01:32.611548 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:32.611514    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:01:32.774104 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:32.774077    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6b0cb9-kxj6c"
Sep 15 12:01:32.774283 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:32.774115    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6b0cb9-kxj6c" event={"ID":"5b496d4c-29ff-4e10-a45a-09da42a35bd9","Type":"ContainerDied","Data":"bef1a1d6f7e52f7cc03944bf64ffef48500d7c72ec1e8f2a6e2a1a9d08451802"}
Sep 15 12:01:32.774283 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:32.774159    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bef1a1d6f7e52f7cc03944bf64ffef48500d7c72ec1e8f2a6e2a1a9d08451802"
Sep 15 12:01:33.996034 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:33.996011    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 12:01:34.149359 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.149324    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-token\") pod \"14ce34ce-3962-4d13-8d29-c338304a91c5\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") "
Sep 15 12:01:34.149892 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.149866    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-credential-socket\") pod \"14ce34ce-3962-4d13-8d29-c338304a91c5\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") "
Sep 15 12:01:34.150130 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.150099    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-workload-certs\") pod \"14ce34ce-3962-4d13-8d29-c338304a91c5\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") "
Sep 15 12:01:34.150321 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.150304    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbv98\" (UniqueName: \"kubernetes.io/projected/14ce34ce-3962-4d13-8d29-c338304a91c5-kube-api-access-rbv98\") pod \"14ce34ce-3962-4d13-8d29-c338304a91c5\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") "
Sep 15 12:01:34.150474 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.150460    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-data\") pod \"14ce34ce-3962-4d13-8d29-c338304a91c5\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") "
Sep 15 12:01:34.150585 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.150572    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-podinfo\") pod \"14ce34ce-3962-4d13-8d29-c338304a91c5\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") "
Sep 15 12:01:34.150704 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.150655    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "14ce34ce-3962-4d13-8d29-c338304a91c5" (UID: "14ce34ce-3962-4d13-8d29-c338304a91c5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:01:34.150778 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.150684    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14ce34ce-3962-4d13-8d29-c338304a91c5-istiod-ca-cert\") pod \"14ce34ce-3962-4d13-8d29-c338304a91c5\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") "
Sep 15 12:01:34.150834 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.150813    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-envoy\") pod \"14ce34ce-3962-4d13-8d29-c338304a91c5\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") "
Sep 15 12:01:34.150888 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.150874    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-workload-socket\") pod \"14ce34ce-3962-4d13-8d29-c338304a91c5\" (UID: \"14ce34ce-3962-4d13-8d29-c338304a91c5\") "
Sep 15 12:01:34.151203 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.151175    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-data" (OuterVolumeSpecName: "istio-data") pod "14ce34ce-3962-4d13-8d29-c338304a91c5" (UID: "14ce34ce-3962-4d13-8d29-c338304a91c5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:01:34.151960 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.151371    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14ce34ce-3962-4d13-8d29-c338304a91c5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "14ce34ce-3962-4d13-8d29-c338304a91c5" (UID: "14ce34ce-3962-4d13-8d29-c338304a91c5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:01:34.152099 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.151735    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "14ce34ce-3962-4d13-8d29-c338304a91c5" (UID: "14ce34ce-3962-4d13-8d29-c338304a91c5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:01:34.152197 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.151559    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-credential-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:01:34.154111 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.154070    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "14ce34ce-3962-4d13-8d29-c338304a91c5" (UID: "14ce34ce-3962-4d13-8d29-c338304a91c5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:01:34.154287 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.154208    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-token" (OuterVolumeSpecName: "istio-token") pod "14ce34ce-3962-4d13-8d29-c338304a91c5" (UID: "14ce34ce-3962-4d13-8d29-c338304a91c5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:01:34.154408 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.154306    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "14ce34ce-3962-4d13-8d29-c338304a91c5" (UID: "14ce34ce-3962-4d13-8d29-c338304a91c5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 12:01:34.155086 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.155050    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14ce34ce-3962-4d13-8d29-c338304a91c5-kube-api-access-rbv98" (OuterVolumeSpecName: "kube-api-access-rbv98") pod "14ce34ce-3962-4d13-8d29-c338304a91c5" (UID: "14ce34ce-3962-4d13-8d29-c338304a91c5"). InnerVolumeSpecName "kube-api-access-rbv98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:01:34.157644 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.155276    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "14ce34ce-3962-4d13-8d29-c338304a91c5" (UID: "14ce34ce-3962-4d13-8d29-c338304a91c5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:01:34.253197 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.253145    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-workload-certs\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:01:34.253197 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.253187    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbv98\" (UniqueName: \"kubernetes.io/projected/14ce34ce-3962-4d13-8d29-c338304a91c5-kube-api-access-rbv98\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:01:34.253197 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.253203    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-data\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:01:34.253536 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.253217    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-podinfo\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:01:34.253536 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.253230    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14ce34ce-3962-4d13-8d29-c338304a91c5-istiod-ca-cert\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:01:34.253536 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.253246    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-envoy\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:01:34.253536 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.253273    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ce34ce-3962-4d13-8d29-c338304a91c5-workload-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:01:34.253536 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.253287    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14ce34ce-3962-4d13-8d29-c338304a91c5-istio-token\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:01:34.791417 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.791380    2564 generic.go:356] "Generic (PLEG): container finished" podID="14ce34ce-3962-4d13-8d29-c338304a91c5" containerID="730908e575fcce7e5d7465cc752064c2b85986d4df9e31de40c9647af1a74a5d" exitCode=0
Sep 15 12:01:34.791605 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.791440    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"
Sep 15 12:01:34.791605 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.791458    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp" event={"ID":"14ce34ce-3962-4d13-8d29-c338304a91c5","Type":"ContainerDied","Data":"730908e575fcce7e5d7465cc752064c2b85986d4df9e31de40c9647af1a74a5d"}
Sep 15 12:01:34.791605 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.791512    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp" event={"ID":"14ce34ce-3962-4d13-8d29-c338304a91c5","Type":"ContainerDied","Data":"246b57afc533467cd8e17a0415dab388fb4a4a8177834bba7900f03abdf89fac"}
Sep 15 12:01:34.791605 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.791536    2564 scope.go:117] "RemoveContainer" containerID="730908e575fcce7e5d7465cc752064c2b85986d4df9e31de40c9647af1a74a5d"
Sep 15 12:01:34.801416 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.801396    2564 scope.go:117] "RemoveContainer" containerID="a801c06e678fac617fd66f321cf3665e37a89eed0de87de25e5661ee6aba6b82"
Sep 15 12:01:34.809642 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.809627    2564 scope.go:117] "RemoveContainer" containerID="730908e575fcce7e5d7465cc752064c2b85986d4df9e31de40c9647af1a74a5d"
Sep 15 12:01:34.809900 ip-10-0-129-183 kubenswrapper[2564]: E0915 12:01:34.809883    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"730908e575fcce7e5d7465cc752064c2b85986d4df9e31de40c9647af1a74a5d\": container with ID starting with 730908e575fcce7e5d7465cc752064c2b85986d4df9e31de40c9647af1a74a5d not found: ID does not exist" containerID="730908e575fcce7e5d7465cc752064c2b85986d4df9e31de40c9647af1a74a5d"
Sep 15 12:01:34.809956 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.809908    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"730908e575fcce7e5d7465cc752064c2b85986d4df9e31de40c9647af1a74a5d"} err="failed to get container status \"730908e575fcce7e5d7465cc752064c2b85986d4df9e31de40c9647af1a74a5d\": rpc error: code = NotFound desc = could not find container \"730908e575fcce7e5d7465cc752064c2b85986d4df9e31de40c9647af1a74a5d\": container with ID starting with 730908e575fcce7e5d7465cc752064c2b85986d4df9e31de40c9647af1a74a5d not found: ID does not exist"
Sep 15 12:01:34.809956 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.809924    2564 scope.go:117] "RemoveContainer" containerID="a801c06e678fac617fd66f321cf3665e37a89eed0de87de25e5661ee6aba6b82"
Sep 15 12:01:34.810190 ip-10-0-129-183 kubenswrapper[2564]: E0915 12:01:34.810171    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a801c06e678fac617fd66f321cf3665e37a89eed0de87de25e5661ee6aba6b82\": container with ID starting with a801c06e678fac617fd66f321cf3665e37a89eed0de87de25e5661ee6aba6b82 not found: ID does not exist" containerID="a801c06e678fac617fd66f321cf3665e37a89eed0de87de25e5661ee6aba6b82"
Sep 15 12:01:34.810240 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.810197    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a801c06e678fac617fd66f321cf3665e37a89eed0de87de25e5661ee6aba6b82"} err="failed to get container status \"a801c06e678fac617fd66f321cf3665e37a89eed0de87de25e5661ee6aba6b82\": rpc error: code = NotFound desc = could not find container \"a801c06e678fac617fd66f321cf3665e37a89eed0de87de25e5661ee6aba6b82\": container with ID starting with a801c06e678fac617fd66f321cf3665e37a89eed0de87de25e5661ee6aba6b82 not found: ID does not exist"
Sep 15 12:01:34.815599 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.815572    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"]
Sep 15 12:01:34.822649 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:34.822628    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-a1650b-openshift-default-7f6dcbc8bb-tt8lp"]
Sep 15 12:01:35.779339 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:35.779303    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14ce34ce-3962-4d13-8d29-c338304a91c5" path="/var/lib/kubelet/pods/14ce34ce-3962-4d13-8d29-c338304a91c5/volumes"
Sep 15 12:01:45.229978 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:45.229942    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6b0cb9-kxj6c"]
Sep 15 12:01:45.233837 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:45.233813    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6b0cb9-kxj6c"]
Sep 15 12:01:45.780827 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:45.780791    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b496d4c-29ff-4e10-a45a-09da42a35bd9" path="/var/lib/kubelet/pods/5b496d4c-29ff-4e10-a45a-09da42a35bd9/volumes"
Sep 15 12:01:49.413660 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:49.413617    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:01:49.905638 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:49.905605    2564 generic.go:356] "Generic (PLEG): container finished" podID="abc72f3a-6d05-4182-b00b-5bb20815a96e" containerID="a08d7fb7192cf06e04904c4e5500a15b816e1ad1c3005f4a56c734fd5d957154" exitCode=0
Sep 15 12:01:49.905862 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:49.905680    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7" event={"ID":"abc72f3a-6d05-4182-b00b-5bb20815a96e","Type":"ContainerDied","Data":"a08d7fb7192cf06e04904c4e5500a15b816e1ad1c3005f4a56c734fd5d957154"}
Sep 15 12:01:49.906078 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:49.906064    2564 scope.go:117] "RemoveContainer" containerID="a08d7fb7192cf06e04904c4e5500a15b816e1ad1c3005f4a56c734fd5d957154"
Sep 15 12:01:49.907197 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:49.907169    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:01:49.907253 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:49.907232    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:01:49.907312 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:49.907299    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:01:50.913871 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:50.913829    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7" event={"ID":"abc72f3a-6d05-4182-b00b-5bb20815a96e","Type":"ContainerStarted","Data":"805a38b7abc40154afaf14dbe07a85cf594f6d02f0826415e2b406e60bbbdf9a"}
Sep 15 12:01:51.598149 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.598114    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"]
Sep 15 12:01:51.598790 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.598768    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14ce34ce-3962-4d13-8d29-c338304a91c5" containerName="istio-proxy"
Sep 15 12:01:51.598790 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.598790    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="14ce34ce-3962-4d13-8d29-c338304a91c5" containerName="istio-proxy"
Sep 15 12:01:51.598973 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.598815    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b496d4c-29ff-4e10-a45a-09da42a35bd9" containerName="revoke-keys"
Sep 15 12:01:51.598973 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.598824    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b496d4c-29ff-4e10-a45a-09da42a35bd9" containerName="revoke-keys"
Sep 15 12:01:51.598973 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.598916    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b496d4c-29ff-4e10-a45a-09da42a35bd9" containerName="revoke-keys"
Sep 15 12:01:51.598973 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.598931    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="14ce34ce-3962-4d13-8d29-c338304a91c5" containerName="istio-proxy"
Sep 15 12:01:51.598973 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.598941    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="14ce34ce-3962-4d13-8d29-c338304a91c5" containerName="istio-proxy"
Sep 15 12:01:51.601412 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.601381    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.605134 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.605107    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-0249d8-openshift-default-dockercfg-dhpmj\""
Sep 15 12:01:51.619953 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.619917    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"]
Sep 15 12:01:51.632059 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.632035    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq4wh\" (UniqueName: \"kubernetes.io/projected/89ffea22-7478-4d02-892c-13fde0efd9f4-kube-api-access-cq4wh\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.632161 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.632064    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-envoy\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.632161 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.632088    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89ffea22-7478-4d02-892c-13fde0efd9f4-istiod-ca-cert\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.632161 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.632120    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-podinfo\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.632324 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.632165    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-token\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.632324 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.632187    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-workload-socket\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.632324 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.632210    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-data\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.632324 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.632300    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-workload-certs\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.632475 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.632336    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-credential-socket\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.733820 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.733774    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-credential-socket\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.734009 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.733963    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq4wh\" (UniqueName: \"kubernetes.io/projected/89ffea22-7478-4d02-892c-13fde0efd9f4-kube-api-access-cq4wh\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.734101 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.734033    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-envoy\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.734101 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.734073    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89ffea22-7478-4d02-892c-13fde0efd9f4-istiod-ca-cert\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.734221 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.734121    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-podinfo\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.734221 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.734159    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-token\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.734221 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.734191    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-workload-socket\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.734397 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.734217    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-data\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.734397 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.734276    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-credential-socket\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.734397 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.734377    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-workload-certs\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.734630 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.734609    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-data\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.734726 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.734696    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-workload-certs\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.735435 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.735407    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-workload-socket\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.736046 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.736023    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89ffea22-7478-4d02-892c-13fde0efd9f4-istiod-ca-cert\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.738520 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.738475    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-envoy\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.739363 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.739340    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-podinfo\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.746020 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.745995    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-token\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.759951 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.759895    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq4wh\" (UniqueName: \"kubernetes.io/projected/89ffea22-7478-4d02-892c-13fde0efd9f4-kube-api-access-cq4wh\") pod \"e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") " pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:51.878358 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.878250    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:51.879420 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.879394    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 15 12:01:51.879906 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.879615    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7" podUID="abc72f3a-6d05-4182-b00b-5bb20815a96e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 15 12:01:51.912356 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:51.912331    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:52.231310 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:52.231285    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"]
Sep 15 12:01:52.232897 ip-10-0-129-183 kubenswrapper[2564]: W0915 12:01:52.232862    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89ffea22_7478_4d02_892c_13fde0efd9f4.slice/crio-e6f48f6ed0107511a8982e345feed129963f3f64a866cb9fc24626c91ad835e8 WatchSource:0}: Error finding container e6f48f6ed0107511a8982e345feed129963f3f64a866cb9fc24626c91ad835e8: Status 404 returned error can't find the container with id e6f48f6ed0107511a8982e345feed129963f3f64a866cb9fc24626c91ad835e8
Sep 15 12:01:52.235133 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:52.235101    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:01:52.235230 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:52.235178    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:01:52.235230 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:52.235224    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:01:52.878550 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:52.878495    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 15 12:01:52.878735 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:52.878589    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7" podUID="abc72f3a-6d05-4182-b00b-5bb20815a96e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 15 12:01:52.926879 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:52.926834    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54" event={"ID":"89ffea22-7478-4d02-892c-13fde0efd9f4","Type":"ContainerStarted","Data":"70a6e2936a9d31c1307f6e8c50ed645ce2b29c3b8b3df1c8fbd4cf3dd3702e8e"}
Sep 15 12:01:52.927039 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:52.926899    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54" event={"ID":"89ffea22-7478-4d02-892c-13fde0efd9f4","Type":"ContainerStarted","Data":"e6f48f6ed0107511a8982e345feed129963f3f64a866cb9fc24626c91ad835e8"}
Sep 15 12:01:52.958359 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:52.958298    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54" podStartSLOduration=1.958258429 podStartE2EDuration="1.958258429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:01:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:01:52.953664274 +0000 UTC m=+1489.670538461" watchObservedRunningTime="2026-09-15 12:01:52.958258429 +0000 UTC m=+1489.675132621"
Sep 15 12:01:53.632594 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:53.632559    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"]
Sep 15 12:01:53.632955 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:53.632764    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv" podUID="b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" containerName="istio-proxy" containerID="cri-o://f4df2e63397f4afb4288bd80684be0047434218b4b30c438a188575f09de4f75" gracePeriod=30
Sep 15 12:01:53.878689 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:53.878655    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 15 12:01:53.878860 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:53.878712    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7" podUID="abc72f3a-6d05-4182-b00b-5bb20815a96e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 15 12:01:53.913514 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:53.913422    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:53.918864 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:53.918840    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:53.933050 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:53.933023    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:53.933745 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:53.933727    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:01:54.878962 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:54.878918    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 15 12:01:54.879533 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:54.878985    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7" podUID="abc72f3a-6d05-4182-b00b-5bb20815a96e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 15 12:01:55.728419 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:55.728389    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:55.878243 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:55.878197    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 15 12:01:55.878431 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:55.878285    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7" podUID="abc72f3a-6d05-4182-b00b-5bb20815a96e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 15 12:01:56.882230 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:56.882198    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:56.883934 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:56.883910    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:01:58.413550 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:58.413510    2564 patch_prober.go:28] interesting pod/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 12:01:58.413970 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:58.413606    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv" podUID="b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 12:01:58.899946 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:58.899916    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:01:58.971073 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:58.971035    2564 generic.go:356] "Generic (PLEG): container finished" podID="b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" containerID="f4df2e63397f4afb4288bd80684be0047434218b4b30c438a188575f09de4f75" exitCode=0
Sep 15 12:01:58.971241 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:58.971084    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"
Sep 15 12:01:58.971241 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:58.971115    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv" event={"ID":"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62","Type":"ContainerDied","Data":"f4df2e63397f4afb4288bd80684be0047434218b4b30c438a188575f09de4f75"}
Sep 15 12:01:58.971241 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:58.971173    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv" event={"ID":"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62","Type":"ContainerDied","Data":"a2e932cafb5a59c63584cb42ea4c2d58ab585f3cfb838c32280ce816939aec0d"}
Sep 15 12:01:58.971241 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:58.971199    2564 scope.go:117] "RemoveContainer" containerID="f4df2e63397f4afb4288bd80684be0047434218b4b30c438a188575f09de4f75"
Sep 15 12:01:58.980610 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:58.980589    2564 scope.go:117] "RemoveContainer" containerID="9b57ada6772ebc024fa85ae16fcd81e2baf3d8ff2c536c3469baeba1971605e4"
Sep 15 12:01:58.989188 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:58.989164    2564 scope.go:117] "RemoveContainer" containerID="f4df2e63397f4afb4288bd80684be0047434218b4b30c438a188575f09de4f75"
Sep 15 12:01:58.989472 ip-10-0-129-183 kubenswrapper[2564]: E0915 12:01:58.989455    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4df2e63397f4afb4288bd80684be0047434218b4b30c438a188575f09de4f75\": container with ID starting with f4df2e63397f4afb4288bd80684be0047434218b4b30c438a188575f09de4f75 not found: ID does not exist" containerID="f4df2e63397f4afb4288bd80684be0047434218b4b30c438a188575f09de4f75"
Sep 15 12:01:58.989526 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:58.989481    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4df2e63397f4afb4288bd80684be0047434218b4b30c438a188575f09de4f75"} err="failed to get container status \"f4df2e63397f4afb4288bd80684be0047434218b4b30c438a188575f09de4f75\": rpc error: code = NotFound desc = could not find container \"f4df2e63397f4afb4288bd80684be0047434218b4b30c438a188575f09de4f75\": container with ID starting with f4df2e63397f4afb4288bd80684be0047434218b4b30c438a188575f09de4f75 not found: ID does not exist"
Sep 15 12:01:58.989526 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:58.989497    2564 scope.go:117] "RemoveContainer" containerID="9b57ada6772ebc024fa85ae16fcd81e2baf3d8ff2c536c3469baeba1971605e4"
Sep 15 12:01:58.989718 ip-10-0-129-183 kubenswrapper[2564]: E0915 12:01:58.989703    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b57ada6772ebc024fa85ae16fcd81e2baf3d8ff2c536c3469baeba1971605e4\": container with ID starting with 9b57ada6772ebc024fa85ae16fcd81e2baf3d8ff2c536c3469baeba1971605e4 not found: ID does not exist" containerID="9b57ada6772ebc024fa85ae16fcd81e2baf3d8ff2c536c3469baeba1971605e4"
Sep 15 12:01:58.989756 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:58.989721    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b57ada6772ebc024fa85ae16fcd81e2baf3d8ff2c536c3469baeba1971605e4"} err="failed to get container status \"9b57ada6772ebc024fa85ae16fcd81e2baf3d8ff2c536c3469baeba1971605e4\": rpc error: code = NotFound desc = could not find container \"9b57ada6772ebc024fa85ae16fcd81e2baf3d8ff2c536c3469baeba1971605e4\": container with ID starting with 9b57ada6772ebc024fa85ae16fcd81e2baf3d8ff2c536c3469baeba1971605e4 not found: ID does not exist"
Sep 15 12:01:59.006170 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.006115    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istiod-ca-cert\") pod \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") "
Sep 15 12:01:59.006170 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.006146    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-envoy\") pod \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") "
Sep 15 12:01:59.006360 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.006174    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-workload-certs\") pod \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") "
Sep 15 12:01:59.006360 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.006213    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-podinfo\") pod \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") "
Sep 15 12:01:59.006360 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.006246    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-workload-socket\") pod \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") "
Sep 15 12:01:59.006360 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.006300    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqlv7\" (UniqueName: \"kubernetes.io/projected/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-kube-api-access-wqlv7\") pod \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") "
Sep 15 12:01:59.006360 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.006328    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-data\") pod \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") "
Sep 15 12:01:59.006624 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.006441    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-token\") pod \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") "
Sep 15 12:01:59.006624 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.006495    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-credential-socket\") pod \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\" (UID: \"b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62\") "
Sep 15 12:01:59.006624 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.006494    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" (UID: "b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:01:59.006624 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.006584    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" (UID: "b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:01:59.006624 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.006582    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" (UID: "b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:01:59.006881 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.006735    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-data" (OuterVolumeSpecName: "istio-data") pod "b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" (UID: "b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:01:59.006881 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.006833    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istiod-ca-cert\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:01:59.006881 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.006835    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" (UID: "b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:01:59.006881 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.006852    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-workload-certs\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:01:59.006881 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.006867    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-workload-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:01:59.006881 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.006880    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-data\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:01:59.008291 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.008256    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" (UID: "b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:01:59.008583 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.008569    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-token" (OuterVolumeSpecName: "istio-token") pod "b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" (UID: "b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:01:59.008749 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.008733    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" (UID: "b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 12:01:59.008794 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.008750    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-kube-api-access-wqlv7" (OuterVolumeSpecName: "kube-api-access-wqlv7") pod "b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" (UID: "b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62"). InnerVolumeSpecName "kube-api-access-wqlv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:01:59.107941 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.107902    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-token\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:01:59.107941 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.107931    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-credential-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:01:59.107941 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.107941    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-envoy\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:01:59.107941 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.107949    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-istio-podinfo\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:01:59.108206 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.107959    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqlv7\" (UniqueName: \"kubernetes.io/projected/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62-kube-api-access-wqlv7\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:01:59.295709 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.295681    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"]
Sep 15 12:01:59.299960 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.299921    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-6b0cb9-openshift-default-6b774f69d6-r7mwv"]
Sep 15 12:01:59.779665 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:01:59.779629    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" path="/var/lib/kubelet/pods/b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62/volumes"
Sep 15 12:02:04.021367 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:04.021336    2564 scope.go:117] "RemoveContainer" containerID="9aabfe08ee4e19fcdd27816ad5e16dacc2683eb3581d017b8a9b2ab276f0d48c"
Sep 15 12:02:04.829493 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:04.829458    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-7f9f55-29824560-cvc5k"]
Sep 15 12:02:04.835508 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:04.835478    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-7f9f55-29824560-cvc5k"]
Sep 15 12:02:05.780189 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:05.780148    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2eea705-43de-4ae4-9cbf-f6e953e18fab" path="/var/lib/kubelet/pods/d2eea705-43de-4ae4-9cbf-f6e953e18fab/volumes"
Sep 15 12:02:06.116838 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:06.116801    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:02:12.455911 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:12.455871    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"]
Sep 15 12:02:12.462759 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:12.462701    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6" podUID="ad12a77b-2cc5-4d71-a03a-0815dfa38bef" containerName="istio-proxy" containerID="cri-o://318b269a3b9c75317ec0b0b9dfbd3f9ee73abb5316307b3294f2f0810caf6ecf" gracePeriod=30
Sep 15 12:02:12.926779 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:12.926744    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-d2de76-x2rkq"]
Sep 15 12:02:12.927116 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:12.927104    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14ce34ce-3962-4d13-8d29-c338304a91c5" containerName="istio-proxy"
Sep 15 12:02:12.927162 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:12.927117    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="14ce34ce-3962-4d13-8d29-c338304a91c5" containerName="istio-proxy"
Sep 15 12:02:12.927162 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:12.927137    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" containerName="istio-proxy"
Sep 15 12:02:12.927162 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:12.927142    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" containerName="istio-proxy"
Sep 15 12:02:12.927162 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:12.927152    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" containerName="istio-proxy"
Sep 15 12:02:12.927162 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:12.927159    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" containerName="istio-proxy"
Sep 15 12:02:12.927342 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:12.927214    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" containerName="istio-proxy"
Sep 15 12:02:12.927342 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:12.927224    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b362d76e-2a31-4e6a-a7d2-3d4b13c6cd62" containerName="istio-proxy"
Sep 15 12:02:12.930466 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:12.930448    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-d2de76-x2rkq"
Sep 15 12:02:12.934342 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:12.934318    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 12:02:12.934483 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:12.934344    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjx8x\""
Sep 15 12:02:12.943390 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:12.943363    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-d2de76-x2rkq"]
Sep 15 12:02:13.055880 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:13.055835    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8fda656-323b-4b47-b1d2-dc7d2ddd0041-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w1-d2de76-x2rkq\" (UID: \"e8fda656-323b-4b47-b1d2-dc7d2ddd0041\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-d2de76-x2rkq"
Sep 15 12:02:13.157575 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:13.157537    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8fda656-323b-4b47-b1d2-dc7d2ddd0041-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w1-d2de76-x2rkq\" (UID: \"e8fda656-323b-4b47-b1d2-dc7d2ddd0041\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-d2de76-x2rkq"
Sep 15 12:02:13.158273 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:13.158233    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8fda656-323b-4b47-b1d2-dc7d2ddd0041-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w1-d2de76-x2rkq\" (UID: \"e8fda656-323b-4b47-b1d2-dc7d2ddd0041\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-d2de76-x2rkq"
Sep 15 12:02:13.240708 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:13.240683    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-d2de76-x2rkq"
Sep 15 12:02:13.540546 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:13.540361    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-d2de76-x2rkq"]
Sep 15 12:02:13.543776 ip-10-0-129-183 kubenswrapper[2564]: W0915 12:02:13.543744    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8fda656_323b_4b47_b1d2_dc7d2ddd0041.slice/crio-bbf86aecc6d26afe732a12004d1a33e2b0bfcc14abb832db101dbe1582ef63d6 WatchSource:0}: Error finding container bbf86aecc6d26afe732a12004d1a33e2b0bfcc14abb832db101dbe1582ef63d6: Status 404 returned error can't find the container with id bbf86aecc6d26afe732a12004d1a33e2b0bfcc14abb832db101dbe1582ef63d6
Sep 15 12:02:14.079617 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:14.079574    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-d2de76-x2rkq" event={"ID":"e8fda656-323b-4b47-b1d2-dc7d2ddd0041","Type":"ContainerStarted","Data":"b24a91e91cde8ace51d98c91c367a049fd9528a7165b5163e5a391bed9282b30"}
Sep 15 12:02:14.079808 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:14.079634    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-d2de76-x2rkq" event={"ID":"e8fda656-323b-4b47-b1d2-dc7d2ddd0041","Type":"ContainerStarted","Data":"bbf86aecc6d26afe732a12004d1a33e2b0bfcc14abb832db101dbe1582ef63d6"}
Sep 15 12:02:14.098571 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:14.098506    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-d2de76-x2rkq" podStartSLOduration=2.098486322 podStartE2EDuration="2.098486322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:02:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:02:14.096174444 +0000 UTC m=+1510.813048628" watchObservedRunningTime="2026-09-15 12:02:14.098486322 +0000 UTC m=+1510.815360507"
Sep 15 12:02:15.087398 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:15.087365    2564 generic.go:356] "Generic (PLEG): container finished" podID="e8fda656-323b-4b47-b1d2-dc7d2ddd0041" containerID="b24a91e91cde8ace51d98c91c367a049fd9528a7165b5163e5a391bed9282b30" exitCode=0
Sep 15 12:02:15.087784 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:15.087430    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-d2de76-x2rkq" event={"ID":"e8fda656-323b-4b47-b1d2-dc7d2ddd0041","Type":"ContainerDied","Data":"b24a91e91cde8ace51d98c91c367a049fd9528a7165b5163e5a391bed9282b30"}
Sep 15 12:02:16.235546 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:16.235522    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-d2de76-x2rkq"
Sep 15 12:02:16.392654 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:16.392626    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8fda656-323b-4b47-b1d2-dc7d2ddd0041-maas-api-service-ca\") pod \"e8fda656-323b-4b47-b1d2-dc7d2ddd0041\" (UID: \"e8fda656-323b-4b47-b1d2-dc7d2ddd0041\") "
Sep 15 12:02:16.392935 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:16.392912    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8fda656-323b-4b47-b1d2-dc7d2ddd0041-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e8fda656-323b-4b47-b1d2-dc7d2ddd0041" (UID: "e8fda656-323b-4b47-b1d2-dc7d2ddd0041"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:02:16.493816 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:16.493734    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8fda656-323b-4b47-b1d2-dc7d2ddd0041-maas-api-service-ca\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:02:17.101927 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.101887    2564 generic.go:356] "Generic (PLEG): container finished" podID="89ffea22-7478-4d02-892c-13fde0efd9f4" containerID="70a6e2936a9d31c1307f6e8c50ed645ce2b29c3b8b3df1c8fbd4cf3dd3702e8e" exitCode=0
Sep 15 12:02:17.102091 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.101961    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54" event={"ID":"89ffea22-7478-4d02-892c-13fde0efd9f4","Type":"ContainerDied","Data":"70a6e2936a9d31c1307f6e8c50ed645ce2b29c3b8b3df1c8fbd4cf3dd3702e8e"}
Sep 15 12:02:17.102402 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.102385    2564 scope.go:117] "RemoveContainer" containerID="70a6e2936a9d31c1307f6e8c50ed645ce2b29c3b8b3df1c8fbd4cf3dd3702e8e"
Sep 15 12:02:17.103537 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.103522    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-d2de76-x2rkq"
Sep 15 12:02:17.103649 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.103542    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-d2de76-x2rkq" event={"ID":"e8fda656-323b-4b47-b1d2-dc7d2ddd0041","Type":"ContainerDied","Data":"bbf86aecc6d26afe732a12004d1a33e2b0bfcc14abb832db101dbe1582ef63d6"}
Sep 15 12:02:17.103649 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.103555    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:02:17.103649 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.103579    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bbf86aecc6d26afe732a12004d1a33e2b0bfcc14abb832db101dbe1582ef63d6"
Sep 15 12:02:17.103649 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.103620    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:02:17.103867 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.103674    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:02:17.769089 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.769038    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 12:02:17.908644 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.908605    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-credential-socket\") pod \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") "
Sep 15 12:02:17.908854 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.908704    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-data\") pod \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") "
Sep 15 12:02:17.908854 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.908751    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istiod-ca-cert\") pod \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") "
Sep 15 12:02:17.908854 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.908784    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-podinfo\") pod \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") "
Sep 15 12:02:17.909030 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.908904    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-envoy\") pod \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") "
Sep 15 12:02:17.909030 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.908913    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ad12a77b-2cc5-4d71-a03a-0815dfa38bef" (UID: "ad12a77b-2cc5-4d71-a03a-0815dfa38bef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:02:17.909030 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.908937    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-workload-certs\") pod \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") "
Sep 15 12:02:17.909030 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.908941    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-data" (OuterVolumeSpecName: "istio-data") pod "ad12a77b-2cc5-4d71-a03a-0815dfa38bef" (UID: "ad12a77b-2cc5-4d71-a03a-0815dfa38bef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:02:17.909030 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.908975    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zt25d\" (UniqueName: \"kubernetes.io/projected/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-kube-api-access-zt25d\") pod \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") "
Sep 15 12:02:17.909030 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.908996    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-workload-socket\") pod \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") "
Sep 15 12:02:17.909378 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.909047    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-token\") pod \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\" (UID: \"ad12a77b-2cc5-4d71-a03a-0815dfa38bef\") "
Sep 15 12:02:17.909378 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.909073    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ad12a77b-2cc5-4d71-a03a-0815dfa38bef" (UID: "ad12a77b-2cc5-4d71-a03a-0815dfa38bef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:02:17.909378 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.909189    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ad12a77b-2cc5-4d71-a03a-0815dfa38bef" (UID: "ad12a77b-2cc5-4d71-a03a-0815dfa38bef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:02:17.909378 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.909203    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ad12a77b-2cc5-4d71-a03a-0815dfa38bef" (UID: "ad12a77b-2cc5-4d71-a03a-0815dfa38bef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:02:17.909593 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.909551    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-credential-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:02:17.909593 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.909570    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-data\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:02:17.909593 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.909585    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istiod-ca-cert\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:02:17.909757 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.909598    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-workload-certs\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:02:17.909757 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.909611    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-workload-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:02:17.910995 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.910970    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ad12a77b-2cc5-4d71-a03a-0815dfa38bef" (UID: "ad12a77b-2cc5-4d71-a03a-0815dfa38bef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 12:02:17.911440 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.911414    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-kube-api-access-zt25d" (OuterVolumeSpecName: "kube-api-access-zt25d") pod "ad12a77b-2cc5-4d71-a03a-0815dfa38bef" (UID: "ad12a77b-2cc5-4d71-a03a-0815dfa38bef"). InnerVolumeSpecName "kube-api-access-zt25d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:02:17.911570 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.911551    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-token" (OuterVolumeSpecName: "istio-token") pod "ad12a77b-2cc5-4d71-a03a-0815dfa38bef" (UID: "ad12a77b-2cc5-4d71-a03a-0815dfa38bef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:02:17.911617 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:17.911578    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ad12a77b-2cc5-4d71-a03a-0815dfa38bef" (UID: "ad12a77b-2cc5-4d71-a03a-0815dfa38bef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:02:18.010878 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:18.010782    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-token\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:02:18.010878 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:18.010814    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-podinfo\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:02:18.010878 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:18.010828    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-istio-envoy\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:02:18.010878 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:18.010841    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zt25d\" (UniqueName: \"kubernetes.io/projected/ad12a77b-2cc5-4d71-a03a-0815dfa38bef-kube-api-access-zt25d\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:02:18.112331 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:18.112287    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54" event={"ID":"89ffea22-7478-4d02-892c-13fde0efd9f4","Type":"ContainerStarted","Data":"00428c6014bb881ec1df61b88bd455a0bfd13f533f730d6348522f3e3cca892e"}
Sep 15 12:02:18.113895 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:18.113869    2564 generic.go:356] "Generic (PLEG): container finished" podID="ad12a77b-2cc5-4d71-a03a-0815dfa38bef" containerID="318b269a3b9c75317ec0b0b9dfbd3f9ee73abb5316307b3294f2f0810caf6ecf" exitCode=0
Sep 15 12:02:18.114020 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:18.113909    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"
Sep 15 12:02:18.114020 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:18.113929    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6" event={"ID":"ad12a77b-2cc5-4d71-a03a-0815dfa38bef","Type":"ContainerDied","Data":"318b269a3b9c75317ec0b0b9dfbd3f9ee73abb5316307b3294f2f0810caf6ecf"}
Sep 15 12:02:18.114020 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:18.113967    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6" event={"ID":"ad12a77b-2cc5-4d71-a03a-0815dfa38bef","Type":"ContainerDied","Data":"afafc72a5b4a6b92a2560e12ac8dcc95a31fb5cdf525eab837f71a54a762fc35"}
Sep 15 12:02:18.114020 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:18.113989    2564 scope.go:117] "RemoveContainer" containerID="318b269a3b9c75317ec0b0b9dfbd3f9ee73abb5316307b3294f2f0810caf6ecf"
Sep 15 12:02:18.123978 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:18.123959    2564 scope.go:117] "RemoveContainer" containerID="e4f42b366d9b34f87a9328e94424be551c43207a83eb39bb3311b347663a5e53"
Sep 15 12:02:18.132353 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:18.132320    2564 scope.go:117] "RemoveContainer" containerID="318b269a3b9c75317ec0b0b9dfbd3f9ee73abb5316307b3294f2f0810caf6ecf"
Sep 15 12:02:18.132612 ip-10-0-129-183 kubenswrapper[2564]: E0915 12:02:18.132596    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"318b269a3b9c75317ec0b0b9dfbd3f9ee73abb5316307b3294f2f0810caf6ecf\": container with ID starting with 318b269a3b9c75317ec0b0b9dfbd3f9ee73abb5316307b3294f2f0810caf6ecf not found: ID does not exist" containerID="318b269a3b9c75317ec0b0b9dfbd3f9ee73abb5316307b3294f2f0810caf6ecf"
Sep 15 12:02:18.132670 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:18.132619    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"318b269a3b9c75317ec0b0b9dfbd3f9ee73abb5316307b3294f2f0810caf6ecf"} err="failed to get container status \"318b269a3b9c75317ec0b0b9dfbd3f9ee73abb5316307b3294f2f0810caf6ecf\": rpc error: code = NotFound desc = could not find container \"318b269a3b9c75317ec0b0b9dfbd3f9ee73abb5316307b3294f2f0810caf6ecf\": container with ID starting with 318b269a3b9c75317ec0b0b9dfbd3f9ee73abb5316307b3294f2f0810caf6ecf not found: ID does not exist"
Sep 15 12:02:18.132670 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:18.132635    2564 scope.go:117] "RemoveContainer" containerID="e4f42b366d9b34f87a9328e94424be551c43207a83eb39bb3311b347663a5e53"
Sep 15 12:02:18.132863 ip-10-0-129-183 kubenswrapper[2564]: E0915 12:02:18.132848    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4f42b366d9b34f87a9328e94424be551c43207a83eb39bb3311b347663a5e53\": container with ID starting with e4f42b366d9b34f87a9328e94424be551c43207a83eb39bb3311b347663a5e53 not found: ID does not exist" containerID="e4f42b366d9b34f87a9328e94424be551c43207a83eb39bb3311b347663a5e53"
Sep 15 12:02:18.132900 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:18.132868    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4f42b366d9b34f87a9328e94424be551c43207a83eb39bb3311b347663a5e53"} err="failed to get container status \"e4f42b366d9b34f87a9328e94424be551c43207a83eb39bb3311b347663a5e53\": rpc error: code = NotFound desc = could not find container \"e4f42b366d9b34f87a9328e94424be551c43207a83eb39bb3311b347663a5e53\": container with ID starting with e4f42b366d9b34f87a9328e94424be551c43207a83eb39bb3311b347663a5e53 not found: ID does not exist"
Sep 15 12:02:18.162329 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:18.162247    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"]
Sep 15 12:02:18.170401 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:18.170357    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-7f9f55-openshift-default-8975b688d-vnrb6"]
Sep 15 12:02:18.913404 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:18.913369    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:02:18.913865 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:18.913627    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 15 12:02:18.913865 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:18.913701    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54" podUID="89ffea22-7478-4d02-892c-13fde0efd9f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 15 12:02:19.781149 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:19.781110    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad12a77b-2cc5-4d71-a03a-0815dfa38bef" path="/var/lib/kubelet/pods/ad12a77b-2cc5-4d71-a03a-0815dfa38bef/volumes"
Sep 15 12:02:19.913432 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:19.913391    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 15 12:02:19.913907 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:19.913454    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54" podUID="89ffea22-7478-4d02-892c-13fde0efd9f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 15 12:02:20.912827 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:20.912792    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 15 12:02:20.913009 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:20.912847    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54" podUID="89ffea22-7478-4d02-892c-13fde0efd9f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 15 12:02:21.913114 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:21.913075    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 15 12:02:21.913539 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:21.913162    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54" podUID="89ffea22-7478-4d02-892c-13fde0efd9f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 15 12:02:22.913387 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:22.913348    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 15 12:02:22.913786 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:22.913414    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54" podUID="89ffea22-7478-4d02-892c-13fde0efd9f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 15 12:02:23.916624 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:23.916590    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:02:23.917049 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:23.916968    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:02:23.917745 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:23.917722    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:02:24.118826 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:24.118792    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-d2de76-x2rkq"]
Sep 15 12:02:24.122272 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:24.122236    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-d2de76-x2rkq"]
Sep 15 12:02:24.212568 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:24.212478    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:02:25.779483 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:25.779451    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8fda656-323b-4b47-b1d2-dc7d2ddd0041" path="/var/lib/kubelet/pods/e8fda656-323b-4b47-b1d2-dc7d2ddd0041/volumes"
Sep 15 12:02:31.426728 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:31.426685    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"]
Sep 15 12:02:31.427297 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:31.426887    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq" podUID="15a2142e-b8ea-4be8-8fc7-691c32e98559" containerName="istio-proxy" containerID="cri-o://435507c72b0dd49d359932169f628aec18f90b6fdaf32addc1d39ce4d9b58a8a" gracePeriod=30
Sep 15 12:02:34.323294 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:34.323244    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:02:36.678058 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.678031    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 12:02:36.787538 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.787450    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-credential-socket\") pod \"15a2142e-b8ea-4be8-8fc7-691c32e98559\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") "
Sep 15 12:02:36.787538 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.787491    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-data\") pod \"15a2142e-b8ea-4be8-8fc7-691c32e98559\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") "
Sep 15 12:02:36.787538 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.787532    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-workload-certs\") pod \"15a2142e-b8ea-4be8-8fc7-691c32e98559\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") "
Sep 15 12:02:36.787796 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.787571    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15a2142e-b8ea-4be8-8fc7-691c32e98559-istiod-ca-cert\") pod \"15a2142e-b8ea-4be8-8fc7-691c32e98559\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") "
Sep 15 12:02:36.787796 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.787636    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-podinfo\") pod \"15a2142e-b8ea-4be8-8fc7-691c32e98559\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") "
Sep 15 12:02:36.787796 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.787663    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-envoy\") pod \"15a2142e-b8ea-4be8-8fc7-691c32e98559\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") "
Sep 15 12:02:36.787796 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.787729    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbglp\" (UniqueName: \"kubernetes.io/projected/15a2142e-b8ea-4be8-8fc7-691c32e98559-kube-api-access-bbglp\") pod \"15a2142e-b8ea-4be8-8fc7-691c32e98559\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") "
Sep 15 12:02:36.787796 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.787756    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-workload-socket\") pod \"15a2142e-b8ea-4be8-8fc7-691c32e98559\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") "
Sep 15 12:02:36.787796 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.787782    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "15a2142e-b8ea-4be8-8fc7-691c32e98559" (UID: "15a2142e-b8ea-4be8-8fc7-691c32e98559"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:02:36.788118 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.787816    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-token\") pod \"15a2142e-b8ea-4be8-8fc7-691c32e98559\" (UID: \"15a2142e-b8ea-4be8-8fc7-691c32e98559\") "
Sep 15 12:02:36.788118 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.787858    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-data" (OuterVolumeSpecName: "istio-data") pod "15a2142e-b8ea-4be8-8fc7-691c32e98559" (UID: "15a2142e-b8ea-4be8-8fc7-691c32e98559"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:02:36.788118 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.788054    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "15a2142e-b8ea-4be8-8fc7-691c32e98559" (UID: "15a2142e-b8ea-4be8-8fc7-691c32e98559"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:02:36.788118 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.788068    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-credential-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:02:36.788118 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.788077    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "15a2142e-b8ea-4be8-8fc7-691c32e98559" (UID: "15a2142e-b8ea-4be8-8fc7-691c32e98559"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:02:36.788118 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.788084    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-data\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:02:36.788381 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.788249    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15a2142e-b8ea-4be8-8fc7-691c32e98559-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "15a2142e-b8ea-4be8-8fc7-691c32e98559" (UID: "15a2142e-b8ea-4be8-8fc7-691c32e98559"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:02:36.789973 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.789941    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "15a2142e-b8ea-4be8-8fc7-691c32e98559" (UID: "15a2142e-b8ea-4be8-8fc7-691c32e98559"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 12:02:36.790065 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.790002    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-token" (OuterVolumeSpecName: "istio-token") pod "15a2142e-b8ea-4be8-8fc7-691c32e98559" (UID: "15a2142e-b8ea-4be8-8fc7-691c32e98559"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:02:36.790178 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.790154    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "15a2142e-b8ea-4be8-8fc7-691c32e98559" (UID: "15a2142e-b8ea-4be8-8fc7-691c32e98559"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:02:36.790238 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.790200    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15a2142e-b8ea-4be8-8fc7-691c32e98559-kube-api-access-bbglp" (OuterVolumeSpecName: "kube-api-access-bbglp") pod "15a2142e-b8ea-4be8-8fc7-691c32e98559" (UID: "15a2142e-b8ea-4be8-8fc7-691c32e98559"). InnerVolumeSpecName "kube-api-access-bbglp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:02:36.889001 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.888967    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-token\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:02:36.889001 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.888995    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-workload-certs\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:02:36.889001 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.889006    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15a2142e-b8ea-4be8-8fc7-691c32e98559-istiod-ca-cert\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:02:36.889229 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.889014    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-podinfo\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:02:36.889229 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.889023    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-istio-envoy\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:02:36.889229 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.889031    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbglp\" (UniqueName: \"kubernetes.io/projected/15a2142e-b8ea-4be8-8fc7-691c32e98559-kube-api-access-bbglp\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:02:36.889229 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:36.889039    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a2142e-b8ea-4be8-8fc7-691c32e98559-workload-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:02:37.242655 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:37.242620    2564 generic.go:356] "Generic (PLEG): container finished" podID="15a2142e-b8ea-4be8-8fc7-691c32e98559" containerID="435507c72b0dd49d359932169f628aec18f90b6fdaf32addc1d39ce4d9b58a8a" exitCode=0
Sep 15 12:02:37.242871 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:37.242678    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"
Sep 15 12:02:37.242871 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:37.242688    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq" event={"ID":"15a2142e-b8ea-4be8-8fc7-691c32e98559","Type":"ContainerDied","Data":"435507c72b0dd49d359932169f628aec18f90b6fdaf32addc1d39ce4d9b58a8a"}
Sep 15 12:02:37.242871 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:37.242731    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq" event={"ID":"15a2142e-b8ea-4be8-8fc7-691c32e98559","Type":"ContainerDied","Data":"8e9d08a33a342b6775dc00fe1f71f21d2ed240e41737f55a04653883a80f121a"}
Sep 15 12:02:37.242871 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:37.242753    2564 scope.go:117] "RemoveContainer" containerID="435507c72b0dd49d359932169f628aec18f90b6fdaf32addc1d39ce4d9b58a8a"
Sep 15 12:02:37.252902 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:37.252882    2564 scope.go:117] "RemoveContainer" containerID="a4eb58deec9b768631a23ab81c3daddc1df4c0b3fb4ac85b6b1dcd317d537c6a"
Sep 15 12:02:37.261200 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:37.261180    2564 scope.go:117] "RemoveContainer" containerID="435507c72b0dd49d359932169f628aec18f90b6fdaf32addc1d39ce4d9b58a8a"
Sep 15 12:02:37.261506 ip-10-0-129-183 kubenswrapper[2564]: E0915 12:02:37.261485    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"435507c72b0dd49d359932169f628aec18f90b6fdaf32addc1d39ce4d9b58a8a\": container with ID starting with 435507c72b0dd49d359932169f628aec18f90b6fdaf32addc1d39ce4d9b58a8a not found: ID does not exist" containerID="435507c72b0dd49d359932169f628aec18f90b6fdaf32addc1d39ce4d9b58a8a"
Sep 15 12:02:37.261561 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:37.261512    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"435507c72b0dd49d359932169f628aec18f90b6fdaf32addc1d39ce4d9b58a8a"} err="failed to get container status \"435507c72b0dd49d359932169f628aec18f90b6fdaf32addc1d39ce4d9b58a8a\": rpc error: code = NotFound desc = could not find container \"435507c72b0dd49d359932169f628aec18f90b6fdaf32addc1d39ce4d9b58a8a\": container with ID starting with 435507c72b0dd49d359932169f628aec18f90b6fdaf32addc1d39ce4d9b58a8a not found: ID does not exist"
Sep 15 12:02:37.261561 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:37.261528    2564 scope.go:117] "RemoveContainer" containerID="a4eb58deec9b768631a23ab81c3daddc1df4c0b3fb4ac85b6b1dcd317d537c6a"
Sep 15 12:02:37.261762 ip-10-0-129-183 kubenswrapper[2564]: E0915 12:02:37.261745    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4eb58deec9b768631a23ab81c3daddc1df4c0b3fb4ac85b6b1dcd317d537c6a\": container with ID starting with a4eb58deec9b768631a23ab81c3daddc1df4c0b3fb4ac85b6b1dcd317d537c6a not found: ID does not exist" containerID="a4eb58deec9b768631a23ab81c3daddc1df4c0b3fb4ac85b6b1dcd317d537c6a"
Sep 15 12:02:37.261808 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:37.261768    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4eb58deec9b768631a23ab81c3daddc1df4c0b3fb4ac85b6b1dcd317d537c6a"} err="failed to get container status \"a4eb58deec9b768631a23ab81c3daddc1df4c0b3fb4ac85b6b1dcd317d537c6a\": rpc error: code = NotFound desc = could not find container \"a4eb58deec9b768631a23ab81c3daddc1df4c0b3fb4ac85b6b1dcd317d537c6a\": container with ID starting with a4eb58deec9b768631a23ab81c3daddc1df4c0b3fb4ac85b6b1dcd317d537c6a not found: ID does not exist"
Sep 15 12:02:37.266766 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:37.266736    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"]
Sep 15 12:02:37.272000 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:37.271979    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-d2de76-openshift-default-5f8c5d784b-ql5vq"]
Sep 15 12:02:37.780711 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:37.780674    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15a2142e-b8ea-4be8-8fc7-691c32e98559" path="/var/lib/kubelet/pods/15a2142e-b8ea-4be8-8fc7-691c32e98559/volumes"
Sep 15 12:02:46.417453 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:46.417411    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:02:56.704698 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:56.704659    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:02:59.786655 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.786619    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"]
Sep 15 12:02:59.787145 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.787126    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15a2142e-b8ea-4be8-8fc7-691c32e98559" containerName="istio-proxy"
Sep 15 12:02:59.787215 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.787147    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="15a2142e-b8ea-4be8-8fc7-691c32e98559" containerName="istio-proxy"
Sep 15 12:02:59.787215 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.787171    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad12a77b-2cc5-4d71-a03a-0815dfa38bef" containerName="istio-proxy"
Sep 15 12:02:59.787215 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.787179    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad12a77b-2cc5-4d71-a03a-0815dfa38bef" containerName="istio-proxy"
Sep 15 12:02:59.787215 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.787189    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15a2142e-b8ea-4be8-8fc7-691c32e98559" containerName="istio-proxy"
Sep 15 12:02:59.787215 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.787198    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="15a2142e-b8ea-4be8-8fc7-691c32e98559" containerName="istio-proxy"
Sep 15 12:02:59.787401 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.787218    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8fda656-323b-4b47-b1d2-dc7d2ddd0041" containerName="revoke-keys"
Sep 15 12:02:59.787401 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.787229    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8fda656-323b-4b47-b1d2-dc7d2ddd0041" containerName="revoke-keys"
Sep 15 12:02:59.787401 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.787338    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8fda656-323b-4b47-b1d2-dc7d2ddd0041" containerName="revoke-keys"
Sep 15 12:02:59.787401 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.787353    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad12a77b-2cc5-4d71-a03a-0815dfa38bef" containerName="istio-proxy"
Sep 15 12:02:59.787401 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.787363    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="15a2142e-b8ea-4be8-8fc7-691c32e98559" containerName="istio-proxy"
Sep 15 12:02:59.787401 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.787372    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="15a2142e-b8ea-4be8-8fc7-691c32e98559" containerName="istio-proxy"
Sep 15 12:02:59.787401 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.787382    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad12a77b-2cc5-4d71-a03a-0815dfa38bef" containerName="istio-proxy"
Sep 15 12:02:59.790624 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.790600    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:02:59.793231 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.793208    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-c04390-openshift-default-dockercfg-n99jh\""
Sep 15 12:02:59.801816 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.801786    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"]
Sep 15 12:02:59.904538 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.904500    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-credential-socket\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:02:59.904747 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.904586    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-token\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:02:59.904833 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.904745    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5klbc\" (UniqueName: \"kubernetes.io/projected/aa1a6369-9df4-4439-a837-b2aad648bc29-kube-api-access-5klbc\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:02:59.905161 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.905133    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-envoy\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:02:59.905302 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.905216    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-podinfo\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:02:59.905302 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.905281    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-data\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:02:59.905438 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.905387    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-workload-certs\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:02:59.905495 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.905442    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-workload-socket\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:02:59.905550 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:02:59.905510    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa1a6369-9df4-4439-a837-b2aad648bc29-istiod-ca-cert\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:00.006584 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:00.006539    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-envoy\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:00.006584 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:00.006584    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-podinfo\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:00.006855 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:00.006614    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-data\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:00.006855 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:00.006646    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-workload-certs\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:00.006855 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:00.006667    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-workload-socket\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:00.006855 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:00.006700    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa1a6369-9df4-4439-a837-b2aad648bc29-istiod-ca-cert\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:00.007067 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:00.006932    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-credential-socket\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:00.007067 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:00.006990    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-token\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:00.007067 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:00.007051    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5klbc\" (UniqueName: \"kubernetes.io/projected/aa1a6369-9df4-4439-a837-b2aad648bc29-kube-api-access-5klbc\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:00.007334 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:00.007303    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-credential-socket\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:00.007516 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:00.007491    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-workload-certs\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:00.007588 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:00.007511    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa1a6369-9df4-4439-a837-b2aad648bc29-istiod-ca-cert\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:00.007745 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:00.007723    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-data\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:00.007811 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:00.007751    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-workload-socket\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:00.009013 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:00.008988    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-envoy\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:00.009347 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:00.009323    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-podinfo\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:00.016344 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:00.016315    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-token\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:00.016473 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:00.016450    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5klbc\" (UniqueName: \"kubernetes.io/projected/aa1a6369-9df4-4439-a837-b2aad648bc29-kube-api-access-5klbc\") pod \"e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") " pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:00.104198 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:00.104160    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:00.391948 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:00.391916    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"]
Sep 15 12:03:00.393228 ip-10-0-129-183 kubenswrapper[2564]: W0915 12:03:00.393200    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa1a6369_9df4_4439_a837_b2aad648bc29.slice/crio-1bfa130a9a1007a3b4a8811802113874f04ad2c15ad55b1be608cbd6b86de085 WatchSource:0}: Error finding container 1bfa130a9a1007a3b4a8811802113874f04ad2c15ad55b1be608cbd6b86de085: Status 404 returned error can't find the container with id 1bfa130a9a1007a3b4a8811802113874f04ad2c15ad55b1be608cbd6b86de085
Sep 15 12:03:00.395371 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:00.395333    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:03:00.395494 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:00.395414    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:03:00.395494 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:00.395466    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:03:01.393759 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:01.393721    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql" event={"ID":"aa1a6369-9df4-4439-a837-b2aad648bc29","Type":"ContainerStarted","Data":"beb741589059148b6c7dad659a1606c8a558717deafbf9f49c34a0912478477c"}
Sep 15 12:03:01.394174 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:01.393813    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql" event={"ID":"aa1a6369-9df4-4439-a837-b2aad648bc29","Type":"ContainerStarted","Data":"1bfa130a9a1007a3b4a8811802113874f04ad2c15ad55b1be608cbd6b86de085"}
Sep 15 12:03:01.421239 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:01.421184    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql" podStartSLOduration=2.421168366 podStartE2EDuration="2.421168366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:02:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:03:01.419937949 +0000 UTC m=+1558.136812135" watchObservedRunningTime="2026-09-15 12:03:01.421168366 +0000 UTC m=+1558.138042550"
Sep 15 12:03:02.104757 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:02.104718    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:02.110225 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:02.110198    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:02.399728 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:02.399633    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:02.400639 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:02.400623    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:09.104912 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:09.104872    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:03:18.285963 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:18.285480    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": read tcp 10.133.0.2:45726->10.133.0.71:15021: read: connection reset by peer" start-of-body=
Sep 15 12:03:18.285963 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:18.285548    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql" podUID="aa1a6369-9df4-4439-a837-b2aad648bc29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": read tcp 10.133.0.2:45726->10.133.0.71:15021: read: connection reset by peer"
Sep 15 12:03:18.508078 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:18.507999    2564 generic.go:356] "Generic (PLEG): container finished" podID="aa1a6369-9df4-4439-a837-b2aad648bc29" containerID="beb741589059148b6c7dad659a1606c8a558717deafbf9f49c34a0912478477c" exitCode=0
Sep 15 12:03:18.508216 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:18.508076    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql" event={"ID":"aa1a6369-9df4-4439-a837-b2aad648bc29","Type":"ContainerDied","Data":"beb741589059148b6c7dad659a1606c8a558717deafbf9f49c34a0912478477c"}
Sep 15 12:03:18.508501 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:18.508487    2564 scope.go:117] "RemoveContainer" containerID="beb741589059148b6c7dad659a1606c8a558717deafbf9f49c34a0912478477c"
Sep 15 12:03:18.509549 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:18.509520    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:03:18.509607 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:18.509588    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:03:18.509646 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:18.509618    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 12:03:19.515392 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:19.515360    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql" event={"ID":"aa1a6369-9df4-4439-a837-b2aad648bc29","Type":"ContainerStarted","Data":"cb39cdd5bab44695cbbefb53ecf7517d34576348ddedb829fa60adba6b29b235"}
Sep 15 12:03:20.104942 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:20.104903    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:20.105121 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:20.105047    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 15 12:03:20.105121 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:20.105106    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql" podUID="aa1a6369-9df4-4439-a837-b2aad648bc29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 15 12:03:21.104646 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:21.104603    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 15 12:03:21.105028 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:21.104678    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql" podUID="aa1a6369-9df4-4439-a837-b2aad648bc29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 15 12:03:22.105480 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:22.105442    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 15 12:03:22.105872 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:22.105524    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql" podUID="aa1a6369-9df4-4439-a837-b2aad648bc29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 15 12:03:23.105454 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:23.105417    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 15 12:03:23.105633 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:23.105499    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql" podUID="aa1a6369-9df4-4439-a837-b2aad648bc29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 15 12:03:24.104572 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:24.104529    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 15 12:03:24.104745 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:24.104593    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql" podUID="aa1a6369-9df4-4439-a837-b2aad648bc29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 15 12:03:25.108668 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:25.108635    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:25.109306 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:25.109051    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:25.109732 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:25.109717    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:29.159487 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:29.159446    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c04390-vcsl5"]
Sep 15 12:03:29.159883 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:29.159873    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad12a77b-2cc5-4d71-a03a-0815dfa38bef" containerName="istio-proxy"
Sep 15 12:03:29.159931 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:29.159885    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad12a77b-2cc5-4d71-a03a-0815dfa38bef" containerName="istio-proxy"
Sep 15 12:03:29.163196 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:29.163178    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c04390-vcsl5"
Sep 15 12:03:29.167131 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:29.167101    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjx8x\""
Sep 15 12:03:29.167306 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:29.167112    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 12:03:29.170020 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:29.169996    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c04390-vcsl5"]
Sep 15 12:03:29.303012 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:29.302975    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b884e0c6-8471-40d7-a011-fef7e6df87eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-c04390-vcsl5\" (UID: \"b884e0c6-8471-40d7-a011-fef7e6df87eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c04390-vcsl5"
Sep 15 12:03:29.404505 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:29.404465    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b884e0c6-8471-40d7-a011-fef7e6df87eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-c04390-vcsl5\" (UID: \"b884e0c6-8471-40d7-a011-fef7e6df87eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c04390-vcsl5"
Sep 15 12:03:29.405085 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:29.405066    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b884e0c6-8471-40d7-a011-fef7e6df87eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-c04390-vcsl5\" (UID: \"b884e0c6-8471-40d7-a011-fef7e6df87eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c04390-vcsl5"
Sep 15 12:03:29.475591 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:29.475514    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c04390-vcsl5"
Sep 15 12:03:29.748748 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:29.748715    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c04390-vcsl5"]
Sep 15 12:03:29.749927 ip-10-0-129-183 kubenswrapper[2564]: W0915 12:03:29.749895    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb884e0c6_8471_40d7_a011_fef7e6df87eb.slice/crio-cdad0edf372562fc621d58593df6cabaaeba8bab09be168bdbe3e47133156150 WatchSource:0}: Error finding container cdad0edf372562fc621d58593df6cabaaeba8bab09be168bdbe3e47133156150: Status 404 returned error can't find the container with id cdad0edf372562fc621d58593df6cabaaeba8bab09be168bdbe3e47133156150
Sep 15 12:03:30.581117 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:30.581085    2564 generic.go:356] "Generic (PLEG): container finished" podID="b884e0c6-8471-40d7-a011-fef7e6df87eb" containerID="6336f166068a5f1ede2d43629ba228267cef223f03a33400e37bc423e63275c7" exitCode=0
Sep 15 12:03:30.581507 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:30.581172    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c04390-vcsl5" event={"ID":"b884e0c6-8471-40d7-a011-fef7e6df87eb","Type":"ContainerDied","Data":"6336f166068a5f1ede2d43629ba228267cef223f03a33400e37bc423e63275c7"}
Sep 15 12:03:30.581507 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:30.581221    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c04390-vcsl5" event={"ID":"b884e0c6-8471-40d7-a011-fef7e6df87eb","Type":"ContainerStarted","Data":"cdad0edf372562fc621d58593df6cabaaeba8bab09be168bdbe3e47133156150"}
Sep 15 12:03:31.723653 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:31.723626    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c04390-vcsl5"
Sep 15 12:03:31.827582 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:31.827553    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b884e0c6-8471-40d7-a011-fef7e6df87eb-maas-api-service-ca\") pod \"b884e0c6-8471-40d7-a011-fef7e6df87eb\" (UID: \"b884e0c6-8471-40d7-a011-fef7e6df87eb\") "
Sep 15 12:03:31.827953 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:31.827934    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b884e0c6-8471-40d7-a011-fef7e6df87eb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b884e0c6-8471-40d7-a011-fef7e6df87eb" (UID: "b884e0c6-8471-40d7-a011-fef7e6df87eb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:03:31.929302 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:31.929204    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b884e0c6-8471-40d7-a011-fef7e6df87eb-maas-api-service-ca\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:03:32.601784 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:32.601742    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c04390-vcsl5" event={"ID":"b884e0c6-8471-40d7-a011-fef7e6df87eb","Type":"ContainerDied","Data":"cdad0edf372562fc621d58593df6cabaaeba8bab09be168bdbe3e47133156150"}
Sep 15 12:03:32.601991 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:32.601802    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cdad0edf372562fc621d58593df6cabaaeba8bab09be168bdbe3e47133156150"
Sep 15 12:03:32.601991 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:32.601764    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c04390-vcsl5"
Sep 15 12:03:35.750670 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:35.750634    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c04390-vcsl5"]
Sep 15 12:03:35.754949 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:35.754097    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c04390-vcsl5"]
Sep 15 12:03:35.783049 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:35.783009    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b884e0c6-8471-40d7-a011-fef7e6df87eb" path="/var/lib/kubelet/pods/b884e0c6-8471-40d7-a011-fef7e6df87eb/volumes"
Sep 15 12:03:40.713034 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:40.712994    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:03:42.720807 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:42.720775    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"]
Sep 15 12:03:42.721298 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:42.720984    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql" podUID="aa1a6369-9df4-4439-a837-b2aad648bc29" containerName="istio-proxy" containerID="cri-o://cb39cdd5bab44695cbbefb53ecf7517d34576348ddedb829fa60adba6b29b235" gracePeriod=30
Sep 15 12:03:46.450435 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:46.450391    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-030981-98zfl"]
Sep 15 12:03:46.450812 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:46.450792    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b884e0c6-8471-40d7-a011-fef7e6df87eb" containerName="revoke-keys"
Sep 15 12:03:46.450812 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:46.450804    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b884e0c6-8471-40d7-a011-fef7e6df87eb" containerName="revoke-keys"
Sep 15 12:03:46.450890 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:46.450873    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b884e0c6-8471-40d7-a011-fef7e6df87eb" containerName="revoke-keys"
Sep 15 12:03:46.454056 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:46.454033    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-030981-98zfl"
Sep 15 12:03:46.462583 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:46.462332    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-030981-98zfl"]
Sep 15 12:03:46.466947 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:46.466480    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjx8x\""
Sep 15 12:03:46.466947 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:46.466532    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8af3e304-0dc5-44e5-9ccd-3657f3f14ea9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-030981-98zfl\" (UID: \"8af3e304-0dc5-44e5-9ccd-3657f3f14ea9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-030981-98zfl"
Sep 15 12:03:46.466947 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:46.466535    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 12:03:46.567968 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:46.567934    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8af3e304-0dc5-44e5-9ccd-3657f3f14ea9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-030981-98zfl\" (UID: \"8af3e304-0dc5-44e5-9ccd-3657f3f14ea9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-030981-98zfl"
Sep 15 12:03:46.568651 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:46.568624    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8af3e304-0dc5-44e5-9ccd-3657f3f14ea9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-030981-98zfl\" (UID: \"8af3e304-0dc5-44e5-9ccd-3657f3f14ea9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-030981-98zfl"
Sep 15 12:03:46.766717 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:46.766638    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-030981-98zfl"
Sep 15 12:03:47.038219 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:47.038185    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-030981-98zfl"]
Sep 15 12:03:47.039626 ip-10-0-129-183 kubenswrapper[2564]: W0915 12:03:47.039595    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8af3e304_0dc5_44e5_9ccd_3657f3f14ea9.slice/crio-03f1b309d95d6729ea9ceeb3787a37794effba7094e42fac3b6cc32a3f2442f0 WatchSource:0}: Error finding container 03f1b309d95d6729ea9ceeb3787a37794effba7094e42fac3b6cc32a3f2442f0: Status 404 returned error can't find the container with id 03f1b309d95d6729ea9ceeb3787a37794effba7094e42fac3b6cc32a3f2442f0
Sep 15 12:03:47.692314 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:47.692282    2564 generic.go:356] "Generic (PLEG): container finished" podID="8af3e304-0dc5-44e5-9ccd-3657f3f14ea9" containerID="7117a63c0d3ae2226e93dc21cbfddea383ddd884514e99c28bb2969f82d16c43" exitCode=0
Sep 15 12:03:47.692729 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:47.692320    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-030981-98zfl" event={"ID":"8af3e304-0dc5-44e5-9ccd-3657f3f14ea9","Type":"ContainerDied","Data":"7117a63c0d3ae2226e93dc21cbfddea383ddd884514e99c28bb2969f82d16c43"}
Sep 15 12:03:47.692729 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:47.692395    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-030981-98zfl" event={"ID":"8af3e304-0dc5-44e5-9ccd-3657f3f14ea9","Type":"ContainerStarted","Data":"03f1b309d95d6729ea9ceeb3787a37794effba7094e42fac3b6cc32a3f2442f0"}
Sep 15 12:03:47.980240 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:47.980216    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:48.083153 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.083117    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-credential-socket\") pod \"aa1a6369-9df4-4439-a837-b2aad648bc29\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") "
Sep 15 12:03:48.083364 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.083185    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-token\") pod \"aa1a6369-9df4-4439-a837-b2aad648bc29\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") "
Sep 15 12:03:48.083364 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.083234    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-workload-socket\") pod \"aa1a6369-9df4-4439-a837-b2aad648bc29\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") "
Sep 15 12:03:48.083364 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.083295    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5klbc\" (UniqueName: \"kubernetes.io/projected/aa1a6369-9df4-4439-a837-b2aad648bc29-kube-api-access-5klbc\") pod \"aa1a6369-9df4-4439-a837-b2aad648bc29\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") "
Sep 15 12:03:48.083364 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.083325    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-envoy\") pod \"aa1a6369-9df4-4439-a837-b2aad648bc29\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") "
Sep 15 12:03:48.083364 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.083357    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa1a6369-9df4-4439-a837-b2aad648bc29-istiod-ca-cert\") pod \"aa1a6369-9df4-4439-a837-b2aad648bc29\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") "
Sep 15 12:03:48.083668 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.083386    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-data\") pod \"aa1a6369-9df4-4439-a837-b2aad648bc29\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") "
Sep 15 12:03:48.083668 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.083438    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-podinfo\") pod \"aa1a6369-9df4-4439-a837-b2aad648bc29\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") "
Sep 15 12:03:48.083668 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.083463    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-workload-certs\") pod \"aa1a6369-9df4-4439-a837-b2aad648bc29\" (UID: \"aa1a6369-9df4-4439-a837-b2aad648bc29\") "
Sep 15 12:03:48.083668 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.083484    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aa1a6369-9df4-4439-a837-b2aad648bc29" (UID: "aa1a6369-9df4-4439-a837-b2aad648bc29"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:03:48.083887 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.083674    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aa1a6369-9df4-4439-a837-b2aad648bc29" (UID: "aa1a6369-9df4-4439-a837-b2aad648bc29"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:03:48.083887 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.083689    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-data" (OuterVolumeSpecName: "istio-data") pod "aa1a6369-9df4-4439-a837-b2aad648bc29" (UID: "aa1a6369-9df4-4439-a837-b2aad648bc29"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:03:48.083887 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.083779    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa1a6369-9df4-4439-a837-b2aad648bc29-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aa1a6369-9df4-4439-a837-b2aad648bc29" (UID: "aa1a6369-9df4-4439-a837-b2aad648bc29"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:03:48.083887 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.083819    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-data\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:03:48.083887 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.083833    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-credential-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:03:48.083887 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.083843    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-workload-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:03:48.083887 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.083866    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aa1a6369-9df4-4439-a837-b2aad648bc29" (UID: "aa1a6369-9df4-4439-a837-b2aad648bc29"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:03:48.085566 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.085540    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aa1a6369-9df4-4439-a837-b2aad648bc29" (UID: "aa1a6369-9df4-4439-a837-b2aad648bc29"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 12:03:48.085696 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.085637    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-token" (OuterVolumeSpecName: "istio-token") pod "aa1a6369-9df4-4439-a837-b2aad648bc29" (UID: "aa1a6369-9df4-4439-a837-b2aad648bc29"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:03:48.086010 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.085970    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aa1a6369-9df4-4439-a837-b2aad648bc29" (UID: "aa1a6369-9df4-4439-a837-b2aad648bc29"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:03:48.086010 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.085978    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa1a6369-9df4-4439-a837-b2aad648bc29-kube-api-access-5klbc" (OuterVolumeSpecName: "kube-api-access-5klbc") pod "aa1a6369-9df4-4439-a837-b2aad648bc29" (UID: "aa1a6369-9df4-4439-a837-b2aad648bc29"). InnerVolumeSpecName "kube-api-access-5klbc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:03:48.185037 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.185003    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-token\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:03:48.185037 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.185034    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5klbc\" (UniqueName: \"kubernetes.io/projected/aa1a6369-9df4-4439-a837-b2aad648bc29-kube-api-access-5klbc\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:03:48.185037 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.185045    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-envoy\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:03:48.185285 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.185054    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa1a6369-9df4-4439-a837-b2aad648bc29-istiod-ca-cert\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:03:48.185285 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.185062    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa1a6369-9df4-4439-a837-b2aad648bc29-istio-podinfo\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:03:48.185285 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.185069    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa1a6369-9df4-4439-a837-b2aad648bc29-workload-certs\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:03:48.700887 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.700852    2564 generic.go:356] "Generic (PLEG): container finished" podID="aa1a6369-9df4-4439-a837-b2aad648bc29" containerID="cb39cdd5bab44695cbbefb53ecf7517d34576348ddedb829fa60adba6b29b235" exitCode=0
Sep 15 12:03:48.701359 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.700903    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"
Sep 15 12:03:48.701359 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.700941    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql" event={"ID":"aa1a6369-9df4-4439-a837-b2aad648bc29","Type":"ContainerDied","Data":"cb39cdd5bab44695cbbefb53ecf7517d34576348ddedb829fa60adba6b29b235"}
Sep 15 12:03:48.701359 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.700998    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql" event={"ID":"aa1a6369-9df4-4439-a837-b2aad648bc29","Type":"ContainerDied","Data":"1bfa130a9a1007a3b4a8811802113874f04ad2c15ad55b1be608cbd6b86de085"}
Sep 15 12:03:48.701359 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.701030    2564 scope.go:117] "RemoveContainer" containerID="cb39cdd5bab44695cbbefb53ecf7517d34576348ddedb829fa60adba6b29b235"
Sep 15 12:03:48.710999 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.710981    2564 scope.go:117] "RemoveContainer" containerID="beb741589059148b6c7dad659a1606c8a558717deafbf9f49c34a0912478477c"
Sep 15 12:03:48.720055 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.720034    2564 scope.go:117] "RemoveContainer" containerID="cb39cdd5bab44695cbbefb53ecf7517d34576348ddedb829fa60adba6b29b235"
Sep 15 12:03:48.720366 ip-10-0-129-183 kubenswrapper[2564]: E0915 12:03:48.720344    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb39cdd5bab44695cbbefb53ecf7517d34576348ddedb829fa60adba6b29b235\": container with ID starting with cb39cdd5bab44695cbbefb53ecf7517d34576348ddedb829fa60adba6b29b235 not found: ID does not exist" containerID="cb39cdd5bab44695cbbefb53ecf7517d34576348ddedb829fa60adba6b29b235"
Sep 15 12:03:48.720427 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.720375    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb39cdd5bab44695cbbefb53ecf7517d34576348ddedb829fa60adba6b29b235"} err="failed to get container status \"cb39cdd5bab44695cbbefb53ecf7517d34576348ddedb829fa60adba6b29b235\": rpc error: code = NotFound desc = could not find container \"cb39cdd5bab44695cbbefb53ecf7517d34576348ddedb829fa60adba6b29b235\": container with ID starting with cb39cdd5bab44695cbbefb53ecf7517d34576348ddedb829fa60adba6b29b235 not found: ID does not exist"
Sep 15 12:03:48.720427 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.720392    2564 scope.go:117] "RemoveContainer" containerID="beb741589059148b6c7dad659a1606c8a558717deafbf9f49c34a0912478477c"
Sep 15 12:03:48.720647 ip-10-0-129-183 kubenswrapper[2564]: E0915 12:03:48.720630    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"beb741589059148b6c7dad659a1606c8a558717deafbf9f49c34a0912478477c\": container with ID starting with beb741589059148b6c7dad659a1606c8a558717deafbf9f49c34a0912478477c not found: ID does not exist" containerID="beb741589059148b6c7dad659a1606c8a558717deafbf9f49c34a0912478477c"
Sep 15 12:03:48.720695 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.720651    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beb741589059148b6c7dad659a1606c8a558717deafbf9f49c34a0912478477c"} err="failed to get container status \"beb741589059148b6c7dad659a1606c8a558717deafbf9f49c34a0912478477c\": rpc error: code = NotFound desc = could not find container \"beb741589059148b6c7dad659a1606c8a558717deafbf9f49c34a0912478477c\": container with ID starting with beb741589059148b6c7dad659a1606c8a558717deafbf9f49c34a0912478477c not found: ID does not exist"
Sep 15 12:03:48.726380 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.726354    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"]
Sep 15 12:03:48.730479 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.730458    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c04390-openshift-default-74db84fd86-kxkql"]
Sep 15 12:03:48.835952 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.835929    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-030981-98zfl"
Sep 15 12:03:48.891874 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.891847    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8af3e304-0dc5-44e5-9ccd-3657f3f14ea9-maas-api-service-ca\") pod \"8af3e304-0dc5-44e5-9ccd-3657f3f14ea9\" (UID: \"8af3e304-0dc5-44e5-9ccd-3657f3f14ea9\") "
Sep 15 12:03:48.892197 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.892174    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8af3e304-0dc5-44e5-9ccd-3657f3f14ea9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8af3e304-0dc5-44e5-9ccd-3657f3f14ea9" (UID: "8af3e304-0dc5-44e5-9ccd-3657f3f14ea9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:03:48.993322 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:48.993214    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8af3e304-0dc5-44e5-9ccd-3657f3f14ea9-maas-api-service-ca\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:03:49.707505 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:49.707476    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-030981-98zfl"
Sep 15 12:03:49.707933 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:49.707476    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-030981-98zfl" event={"ID":"8af3e304-0dc5-44e5-9ccd-3657f3f14ea9","Type":"ContainerDied","Data":"03f1b309d95d6729ea9ceeb3787a37794effba7094e42fac3b6cc32a3f2442f0"}
Sep 15 12:03:49.707933 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:49.707599    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03f1b309d95d6729ea9ceeb3787a37794effba7094e42fac3b6cc32a3f2442f0"
Sep 15 12:03:49.779371 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:03:49.779338    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa1a6369-9df4-4439-a837-b2aad648bc29" path="/var/lib/kubelet/pods/aa1a6369-9df4-4439-a837-b2aad648bc29/volumes"
Sep 15 12:04:00.906635 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:00.906551    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:04:03.047983 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:03.047942    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-030981-98zfl"]
Sep 15 12:04:03.050288 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:03.050245    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-030981-98zfl"]
Sep 15 12:04:03.786380 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:03.786342    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8af3e304-0dc5-44e5-9ccd-3657f3f14ea9" path="/var/lib/kubelet/pods/8af3e304-0dc5-44e5-9ccd-3657f3f14ea9/volumes"
Sep 15 12:04:04.072821 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:04.072780    2564 scope.go:117] "RemoveContainer" containerID="b1d6d975ac9be40ca70ce020a340b61a80b5a1f3f1194f3295dbae1b6eddd2b7"
Sep 15 12:04:12.700093 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:12.700058    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:04:52.299710 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:52.299674    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"]
Sep 15 12:04:52.300314 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:52.299969    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7" podUID="abc72f3a-6d05-4182-b00b-5bb20815a96e" containerName="istio-proxy" containerID="cri-o://805a38b7abc40154afaf14dbe07a85cf594f6d02f0826415e2b406e60bbbdf9a" gracePeriod=30
Sep 15 12:04:52.698695 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:52.698655    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0249d8-pvqls"]
Sep 15 12:04:52.699110 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:52.699091    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa1a6369-9df4-4439-a837-b2aad648bc29" containerName="istio-proxy"
Sep 15 12:04:52.699110 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:52.699110    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa1a6369-9df4-4439-a837-b2aad648bc29" containerName="istio-proxy"
Sep 15 12:04:52.699249 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:52.699120    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa1a6369-9df4-4439-a837-b2aad648bc29" containerName="istio-proxy"
Sep 15 12:04:52.699249 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:52.699127    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa1a6369-9df4-4439-a837-b2aad648bc29" containerName="istio-proxy"
Sep 15 12:04:52.699249 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:52.699133    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8af3e304-0dc5-44e5-9ccd-3657f3f14ea9" containerName="revoke-keys"
Sep 15 12:04:52.699249 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:52.699140    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8af3e304-0dc5-44e5-9ccd-3657f3f14ea9" containerName="revoke-keys"
Sep 15 12:04:52.699249 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:52.699195    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8af3e304-0dc5-44e5-9ccd-3657f3f14ea9" containerName="revoke-keys"
Sep 15 12:04:52.699249 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:52.699204    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa1a6369-9df4-4439-a837-b2aad648bc29" containerName="istio-proxy"
Sep 15 12:04:52.699249 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:52.699212    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa1a6369-9df4-4439-a837-b2aad648bc29" containerName="istio-proxy"
Sep 15 12:04:52.702292 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:52.702251    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0249d8-pvqls"
Sep 15 12:04:52.706966 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:52.706950    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 12:04:52.707431 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:52.707416    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjx8x\""
Sep 15 12:04:52.715396 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:52.715375    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0249d8-pvqls"]
Sep 15 12:04:52.796866 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:52.796828    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9787f928-f79c-4a0f-88f0-ec68e65ce45e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-0249d8-pvqls\" (UID: \"9787f928-f79c-4a0f-88f0-ec68e65ce45e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0249d8-pvqls"
Sep 15 12:04:52.897698 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:52.897658    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9787f928-f79c-4a0f-88f0-ec68e65ce45e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-0249d8-pvqls\" (UID: \"9787f928-f79c-4a0f-88f0-ec68e65ce45e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0249d8-pvqls"
Sep 15 12:04:52.898323 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:52.898305    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9787f928-f79c-4a0f-88f0-ec68e65ce45e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-0249d8-pvqls\" (UID: \"9787f928-f79c-4a0f-88f0-ec68e65ce45e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0249d8-pvqls"
Sep 15 12:04:53.012617 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:53.012528    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0249d8-pvqls"
Sep 15 12:04:53.288535 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:53.288502    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0249d8-pvqls"]
Sep 15 12:04:53.289713 ip-10-0-129-183 kubenswrapper[2564]: W0915 12:04:53.289684    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9787f928_f79c_4a0f_88f0_ec68e65ce45e.slice/crio-bc87ac28ca14c131b5e2ad11ddaba9f83ea2546479f39d0f943e3aa8f0711505 WatchSource:0}: Error finding container bc87ac28ca14c131b5e2ad11ddaba9f83ea2546479f39d0f943e3aa8f0711505: Status 404 returned error can't find the container with id bc87ac28ca14c131b5e2ad11ddaba9f83ea2546479f39d0f943e3aa8f0711505
Sep 15 12:04:54.080697 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:54.080660    2564 generic.go:356] "Generic (PLEG): container finished" podID="9787f928-f79c-4a0f-88f0-ec68e65ce45e" containerID="8060bc5854635e67027d2e416298e6217dea358ee6feafff5acef24fa0705d80" exitCode=0
Sep 15 12:04:54.081109 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:54.080741    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0249d8-pvqls" event={"ID":"9787f928-f79c-4a0f-88f0-ec68e65ce45e","Type":"ContainerDied","Data":"8060bc5854635e67027d2e416298e6217dea358ee6feafff5acef24fa0705d80"}
Sep 15 12:04:54.081109 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:54.080811    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0249d8-pvqls" event={"ID":"9787f928-f79c-4a0f-88f0-ec68e65ce45e","Type":"ContainerStarted","Data":"bc87ac28ca14c131b5e2ad11ddaba9f83ea2546479f39d0f943e3aa8f0711505"}
Sep 15 12:04:55.224060 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:55.224034    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0249d8-pvqls"
Sep 15 12:04:55.319591 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:55.319562    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9787f928-f79c-4a0f-88f0-ec68e65ce45e-maas-api-service-ca\") pod \"9787f928-f79c-4a0f-88f0-ec68e65ce45e\" (UID: \"9787f928-f79c-4a0f-88f0-ec68e65ce45e\") "
Sep 15 12:04:55.319938 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:55.319914    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9787f928-f79c-4a0f-88f0-ec68e65ce45e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9787f928-f79c-4a0f-88f0-ec68e65ce45e" (UID: "9787f928-f79c-4a0f-88f0-ec68e65ce45e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:04:55.420933 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:55.420856    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9787f928-f79c-4a0f-88f0-ec68e65ce45e-maas-api-service-ca\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:04:56.093875 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:56.093848    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0249d8-pvqls"
Sep 15 12:04:56.094055 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:56.093886    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0249d8-pvqls" event={"ID":"9787f928-f79c-4a0f-88f0-ec68e65ce45e","Type":"ContainerDied","Data":"bc87ac28ca14c131b5e2ad11ddaba9f83ea2546479f39d0f943e3aa8f0711505"}
Sep 15 12:04:56.094055 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:56.093931    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc87ac28ca14c131b5e2ad11ddaba9f83ea2546479f39d0f943e3aa8f0711505"
Sep 15 12:04:56.884779 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:56.884740    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 12:04:56.885163 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:56.884795    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7" podUID="abc72f3a-6d05-4182-b00b-5bb20815a96e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 12:04:57.547883 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.547856    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:04:57.643461 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.643380    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-workload-certs\") pod \"abc72f3a-6d05-4182-b00b-5bb20815a96e\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") "
Sep 15 12:04:57.643461 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.643421    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-workload-socket\") pod \"abc72f3a-6d05-4182-b00b-5bb20815a96e\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") "
Sep 15 12:04:57.643461 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.643445    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-token\") pod \"abc72f3a-6d05-4182-b00b-5bb20815a96e\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") "
Sep 15 12:04:57.643745 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.643468    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-envoy\") pod \"abc72f3a-6d05-4182-b00b-5bb20815a96e\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") "
Sep 15 12:04:57.643745 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.643491    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zw46\" (UniqueName: \"kubernetes.io/projected/abc72f3a-6d05-4182-b00b-5bb20815a96e-kube-api-access-7zw46\") pod \"abc72f3a-6d05-4182-b00b-5bb20815a96e\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") "
Sep 15 12:04:57.643745 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.643521    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-podinfo\") pod \"abc72f3a-6d05-4182-b00b-5bb20815a96e\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") "
Sep 15 12:04:57.643745 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.643578    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abc72f3a-6d05-4182-b00b-5bb20815a96e-istiod-ca-cert\") pod \"abc72f3a-6d05-4182-b00b-5bb20815a96e\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") "
Sep 15 12:04:57.643745 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.643618    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-credential-socket\") pod \"abc72f3a-6d05-4182-b00b-5bb20815a96e\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") "
Sep 15 12:04:57.643745 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.643663    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-data\") pod \"abc72f3a-6d05-4182-b00b-5bb20815a96e\" (UID: \"abc72f3a-6d05-4182-b00b-5bb20815a96e\") "
Sep 15 12:04:57.643745 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.643680    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "abc72f3a-6d05-4182-b00b-5bb20815a96e" (UID: "abc72f3a-6d05-4182-b00b-5bb20815a96e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:04:57.643745 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.643739    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "abc72f3a-6d05-4182-b00b-5bb20815a96e" (UID: "abc72f3a-6d05-4182-b00b-5bb20815a96e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:04:57.644167 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.643956    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-data" (OuterVolumeSpecName: "istio-data") pod "abc72f3a-6d05-4182-b00b-5bb20815a96e" (UID: "abc72f3a-6d05-4182-b00b-5bb20815a96e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:04:57.644167 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.643996    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-workload-certs\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:04:57.644167 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.644015    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-workload-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:04:57.644167 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.643993    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abc72f3a-6d05-4182-b00b-5bb20815a96e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "abc72f3a-6d05-4182-b00b-5bb20815a96e" (UID: "abc72f3a-6d05-4182-b00b-5bb20815a96e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:04:57.644167 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.644064    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "abc72f3a-6d05-4182-b00b-5bb20815a96e" (UID: "abc72f3a-6d05-4182-b00b-5bb20815a96e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:04:57.645647 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.645625    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-token" (OuterVolumeSpecName: "istio-token") pod "abc72f3a-6d05-4182-b00b-5bb20815a96e" (UID: "abc72f3a-6d05-4182-b00b-5bb20815a96e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:04:57.645795 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.645770    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "abc72f3a-6d05-4182-b00b-5bb20815a96e" (UID: "abc72f3a-6d05-4182-b00b-5bb20815a96e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 12:04:57.646039 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.646013    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "abc72f3a-6d05-4182-b00b-5bb20815a96e" (UID: "abc72f3a-6d05-4182-b00b-5bb20815a96e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:04:57.646039 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.646017    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abc72f3a-6d05-4182-b00b-5bb20815a96e-kube-api-access-7zw46" (OuterVolumeSpecName: "kube-api-access-7zw46") pod "abc72f3a-6d05-4182-b00b-5bb20815a96e" (UID: "abc72f3a-6d05-4182-b00b-5bb20815a96e"). InnerVolumeSpecName "kube-api-access-7zw46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:04:57.745181 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.745149    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-token\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:04:57.745181 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.745175    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-envoy\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:04:57.745181 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.745184    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zw46\" (UniqueName: \"kubernetes.io/projected/abc72f3a-6d05-4182-b00b-5bb20815a96e-kube-api-access-7zw46\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:04:57.745440 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.745193    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-podinfo\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:04:57.745440 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.745202    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abc72f3a-6d05-4182-b00b-5bb20815a96e-istiod-ca-cert\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:04:57.745440 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.745210    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-credential-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:04:57.745440 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:57.745218    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abc72f3a-6d05-4182-b00b-5bb20815a96e-istio-data\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:04:58.106838 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:58.106800    2564 generic.go:356] "Generic (PLEG): container finished" podID="abc72f3a-6d05-4182-b00b-5bb20815a96e" containerID="805a38b7abc40154afaf14dbe07a85cf594f6d02f0826415e2b406e60bbbdf9a" exitCode=0
Sep 15 12:04:58.106838 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:58.106841    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"
Sep 15 12:04:58.107340 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:58.106866    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7" event={"ID":"abc72f3a-6d05-4182-b00b-5bb20815a96e","Type":"ContainerDied","Data":"805a38b7abc40154afaf14dbe07a85cf594f6d02f0826415e2b406e60bbbdf9a"}
Sep 15 12:04:58.107340 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:58.106909    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7" event={"ID":"abc72f3a-6d05-4182-b00b-5bb20815a96e","Type":"ContainerDied","Data":"09de032292d7f3ba1259fdbdf1755d156b204713f8b73c7a85e05e9f3b5e230b"}
Sep 15 12:04:58.107340 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:58.106929    2564 scope.go:117] "RemoveContainer" containerID="805a38b7abc40154afaf14dbe07a85cf594f6d02f0826415e2b406e60bbbdf9a"
Sep 15 12:04:58.117041 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:58.117019    2564 scope.go:117] "RemoveContainer" containerID="a08d7fb7192cf06e04904c4e5500a15b816e1ad1c3005f4a56c734fd5d957154"
Sep 15 12:04:58.126456 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:58.126429    2564 scope.go:117] "RemoveContainer" containerID="805a38b7abc40154afaf14dbe07a85cf594f6d02f0826415e2b406e60bbbdf9a"
Sep 15 12:04:58.126717 ip-10-0-129-183 kubenswrapper[2564]: E0915 12:04:58.126698    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"805a38b7abc40154afaf14dbe07a85cf594f6d02f0826415e2b406e60bbbdf9a\": container with ID starting with 805a38b7abc40154afaf14dbe07a85cf594f6d02f0826415e2b406e60bbbdf9a not found: ID does not exist" containerID="805a38b7abc40154afaf14dbe07a85cf594f6d02f0826415e2b406e60bbbdf9a"
Sep 15 12:04:58.126764 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:58.126728    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"805a38b7abc40154afaf14dbe07a85cf594f6d02f0826415e2b406e60bbbdf9a"} err="failed to get container status \"805a38b7abc40154afaf14dbe07a85cf594f6d02f0826415e2b406e60bbbdf9a\": rpc error: code = NotFound desc = could not find container \"805a38b7abc40154afaf14dbe07a85cf594f6d02f0826415e2b406e60bbbdf9a\": container with ID starting with 805a38b7abc40154afaf14dbe07a85cf594f6d02f0826415e2b406e60bbbdf9a not found: ID does not exist"
Sep 15 12:04:58.126764 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:58.126746    2564 scope.go:117] "RemoveContainer" containerID="a08d7fb7192cf06e04904c4e5500a15b816e1ad1c3005f4a56c734fd5d957154"
Sep 15 12:04:58.126992 ip-10-0-129-183 kubenswrapper[2564]: E0915 12:04:58.126974    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a08d7fb7192cf06e04904c4e5500a15b816e1ad1c3005f4a56c734fd5d957154\": container with ID starting with a08d7fb7192cf06e04904c4e5500a15b816e1ad1c3005f4a56c734fd5d957154 not found: ID does not exist" containerID="a08d7fb7192cf06e04904c4e5500a15b816e1ad1c3005f4a56c734fd5d957154"
Sep 15 12:04:58.127075 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:58.126991    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08d7fb7192cf06e04904c4e5500a15b816e1ad1c3005f4a56c734fd5d957154"} err="failed to get container status \"a08d7fb7192cf06e04904c4e5500a15b816e1ad1c3005f4a56c734fd5d957154\": rpc error: code = NotFound desc = could not find container \"a08d7fb7192cf06e04904c4e5500a15b816e1ad1c3005f4a56c734fd5d957154\": container with ID starting with a08d7fb7192cf06e04904c4e5500a15b816e1ad1c3005f4a56c734fd5d957154 not found: ID does not exist"
Sep 15 12:04:58.130956 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:58.130936    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"]
Sep 15 12:04:58.139573 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:58.139554    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-030981-openshift-default-786fdb6448-hfdg7"]
Sep 15 12:04:59.778642 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:04:59.778607    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abc72f3a-6d05-4182-b00b-5bb20815a96e" path="/var/lib/kubelet/pods/abc72f3a-6d05-4182-b00b-5bb20815a96e/volumes"
Sep 15 12:05:03.421194 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:03.421156    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0249d8-pvqls"]
Sep 15 12:05:03.423417 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:03.423395    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0249d8-pvqls"]
Sep 15 12:05:03.779574 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:03.779499    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9787f928-f79c-4a0f-88f0-ec68e65ce45e" path="/var/lib/kubelet/pods/9787f928-f79c-4a0f-88f0-ec68e65ce45e/volumes"
Sep 15 12:05:06.507563 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:06.507526    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:05:10.287206 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:10.287174    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"]
Sep 15 12:05:10.287731 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:10.287435    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54" podUID="89ffea22-7478-4d02-892c-13fde0efd9f4" containerName="istio-proxy" containerID="cri-o://00428c6014bb881ec1df61b88bd455a0bfd13f533f730d6348522f3e3cca892e" gracePeriod=30
Sep 15 12:05:15.525179 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.525148    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:05:15.608889 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.608858    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-podinfo\") pod \"89ffea22-7478-4d02-892c-13fde0efd9f4\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") "
Sep 15 12:05:15.609079 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.608901    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89ffea22-7478-4d02-892c-13fde0efd9f4-istiod-ca-cert\") pod \"89ffea22-7478-4d02-892c-13fde0efd9f4\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") "
Sep 15 12:05:15.609079 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.608922    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-workload-socket\") pod \"89ffea22-7478-4d02-892c-13fde0efd9f4\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") "
Sep 15 12:05:15.609079 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.608937    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-workload-certs\") pod \"89ffea22-7478-4d02-892c-13fde0efd9f4\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") "
Sep 15 12:05:15.609079 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.609026    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-token\") pod \"89ffea22-7478-4d02-892c-13fde0efd9f4\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") "
Sep 15 12:05:15.609079 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.609070    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-data\") pod \"89ffea22-7478-4d02-892c-13fde0efd9f4\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") "
Sep 15 12:05:15.609396 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.609094    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cq4wh\" (UniqueName: \"kubernetes.io/projected/89ffea22-7478-4d02-892c-13fde0efd9f4-kube-api-access-cq4wh\") pod \"89ffea22-7478-4d02-892c-13fde0efd9f4\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") "
Sep 15 12:05:15.609396 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.609134    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-credential-socket\") pod \"89ffea22-7478-4d02-892c-13fde0efd9f4\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") "
Sep 15 12:05:15.609396 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.609160    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-envoy\") pod \"89ffea22-7478-4d02-892c-13fde0efd9f4\" (UID: \"89ffea22-7478-4d02-892c-13fde0efd9f4\") "
Sep 15 12:05:15.609396 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.609254    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "89ffea22-7478-4d02-892c-13fde0efd9f4" (UID: "89ffea22-7478-4d02-892c-13fde0efd9f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:15.609396 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.609339    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "89ffea22-7478-4d02-892c-13fde0efd9f4" (UID: "89ffea22-7478-4d02-892c-13fde0efd9f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:15.609396 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.609352    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-data" (OuterVolumeSpecName: "istio-data") pod "89ffea22-7478-4d02-892c-13fde0efd9f4" (UID: "89ffea22-7478-4d02-892c-13fde0efd9f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:15.609396 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.609365    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89ffea22-7478-4d02-892c-13fde0efd9f4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "89ffea22-7478-4d02-892c-13fde0efd9f4" (UID: "89ffea22-7478-4d02-892c-13fde0efd9f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:05:15.609691 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.609532    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-data\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:05:15.609691 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.609557    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89ffea22-7478-4d02-892c-13fde0efd9f4-istiod-ca-cert\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:05:15.609691 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.609571    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-workload-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:05:15.609691 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.609586    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-workload-certs\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:05:15.609691 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.609555    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "89ffea22-7478-4d02-892c-13fde0efd9f4" (UID: "89ffea22-7478-4d02-892c-13fde0efd9f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:15.611249 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.611220    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "89ffea22-7478-4d02-892c-13fde0efd9f4" (UID: "89ffea22-7478-4d02-892c-13fde0efd9f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:15.611371 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.611320    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89ffea22-7478-4d02-892c-13fde0efd9f4-kube-api-access-cq4wh" (OuterVolumeSpecName: "kube-api-access-cq4wh") pod "89ffea22-7478-4d02-892c-13fde0efd9f4" (UID: "89ffea22-7478-4d02-892c-13fde0efd9f4"). InnerVolumeSpecName "kube-api-access-cq4wh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:05:15.611531 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.611511    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-token" (OuterVolumeSpecName: "istio-token") pod "89ffea22-7478-4d02-892c-13fde0efd9f4" (UID: "89ffea22-7478-4d02-892c-13fde0efd9f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:05:15.611596 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.611580    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "89ffea22-7478-4d02-892c-13fde0efd9f4" (UID: "89ffea22-7478-4d02-892c-13fde0efd9f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 12:05:15.710838 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.710806    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-token\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:05:15.710838 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.710833    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cq4wh\" (UniqueName: \"kubernetes.io/projected/89ffea22-7478-4d02-892c-13fde0efd9f4-kube-api-access-cq4wh\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:05:15.710838 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.710844    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-credential-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:05:15.711046 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.710853    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-envoy\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:05:15.711046 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:15.710861    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89ffea22-7478-4d02-892c-13fde0efd9f4-istio-podinfo\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:05:16.214615 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:16.214582    2564 generic.go:356] "Generic (PLEG): container finished" podID="89ffea22-7478-4d02-892c-13fde0efd9f4" containerID="00428c6014bb881ec1df61b88bd455a0bfd13f533f730d6348522f3e3cca892e" exitCode=0
Sep 15 12:05:16.214784 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:16.214628    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"
Sep 15 12:05:16.214784 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:16.214670    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54" event={"ID":"89ffea22-7478-4d02-892c-13fde0efd9f4","Type":"ContainerDied","Data":"00428c6014bb881ec1df61b88bd455a0bfd13f533f730d6348522f3e3cca892e"}
Sep 15 12:05:16.214784 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:16.214722    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54" event={"ID":"89ffea22-7478-4d02-892c-13fde0efd9f4","Type":"ContainerDied","Data":"e6f48f6ed0107511a8982e345feed129963f3f64a866cb9fc24626c91ad835e8"}
Sep 15 12:05:16.214784 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:16.214745    2564 scope.go:117] "RemoveContainer" containerID="00428c6014bb881ec1df61b88bd455a0bfd13f533f730d6348522f3e3cca892e"
Sep 15 12:05:16.224027 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:16.224005    2564 scope.go:117] "RemoveContainer" containerID="70a6e2936a9d31c1307f6e8c50ed645ce2b29c3b8b3df1c8fbd4cf3dd3702e8e"
Sep 15 12:05:16.232121 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:16.232105    2564 scope.go:117] "RemoveContainer" containerID="00428c6014bb881ec1df61b88bd455a0bfd13f533f730d6348522f3e3cca892e"
Sep 15 12:05:16.232417 ip-10-0-129-183 kubenswrapper[2564]: E0915 12:05:16.232398    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00428c6014bb881ec1df61b88bd455a0bfd13f533f730d6348522f3e3cca892e\": container with ID starting with 00428c6014bb881ec1df61b88bd455a0bfd13f533f730d6348522f3e3cca892e not found: ID does not exist" containerID="00428c6014bb881ec1df61b88bd455a0bfd13f533f730d6348522f3e3cca892e"
Sep 15 12:05:16.232509 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:16.232424    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00428c6014bb881ec1df61b88bd455a0bfd13f533f730d6348522f3e3cca892e"} err="failed to get container status \"00428c6014bb881ec1df61b88bd455a0bfd13f533f730d6348522f3e3cca892e\": rpc error: code = NotFound desc = could not find container \"00428c6014bb881ec1df61b88bd455a0bfd13f533f730d6348522f3e3cca892e\": container with ID starting with 00428c6014bb881ec1df61b88bd455a0bfd13f533f730d6348522f3e3cca892e not found: ID does not exist"
Sep 15 12:05:16.232509 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:16.232441    2564 scope.go:117] "RemoveContainer" containerID="70a6e2936a9d31c1307f6e8c50ed645ce2b29c3b8b3df1c8fbd4cf3dd3702e8e"
Sep 15 12:05:16.232736 ip-10-0-129-183 kubenswrapper[2564]: E0915 12:05:16.232714    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70a6e2936a9d31c1307f6e8c50ed645ce2b29c3b8b3df1c8fbd4cf3dd3702e8e\": container with ID starting with 70a6e2936a9d31c1307f6e8c50ed645ce2b29c3b8b3df1c8fbd4cf3dd3702e8e not found: ID does not exist" containerID="70a6e2936a9d31c1307f6e8c50ed645ce2b29c3b8b3df1c8fbd4cf3dd3702e8e"
Sep 15 12:05:16.232805 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:16.232745    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70a6e2936a9d31c1307f6e8c50ed645ce2b29c3b8b3df1c8fbd4cf3dd3702e8e"} err="failed to get container status \"70a6e2936a9d31c1307f6e8c50ed645ce2b29c3b8b3df1c8fbd4cf3dd3702e8e\": rpc error: code = NotFound desc = could not find container \"70a6e2936a9d31c1307f6e8c50ed645ce2b29c3b8b3df1c8fbd4cf3dd3702e8e\": container with ID starting with 70a6e2936a9d31c1307f6e8c50ed645ce2b29c3b8b3df1c8fbd4cf3dd3702e8e not found: ID does not exist"
Sep 15 12:05:16.235104 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:16.235079    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"]
Sep 15 12:05:16.237239 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:16.237215    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-0249d8-openshift-default-646fd965c4-x7z54"]
Sep 15 12:05:17.778402 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:17.778368    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89ffea22-7478-4d02-892c-13fde0efd9f4" path="/var/lib/kubelet/pods/89ffea22-7478-4d02-892c-13fde0efd9f4/volumes"
Sep 15 12:05:24.123531 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:24.123495    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:05:39.331848 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:39.331757    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7b7b3c-29824560-xcr7d"]
Sep 15 12:05:39.335415 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:39.335378    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7b7b3c-29824560-xcr7d"]
Sep 15 12:05:39.778804 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:39.778727    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13939405-3459-4bf6-bd40-ced609afc2b2" path="/var/lib/kubelet/pods/13939405-3459-4bf6-bd40-ced609afc2b2/volumes"
Sep 15 12:05:41.817191 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:41.817157    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:05:46.760062 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:46.760021    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"]
Sep 15 12:05:46.760597 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:46.760297    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j" podUID="2afdc252-dfd8-479e-a1da-13ec795d2305" containerName="istio-proxy" containerID="cri-o://419cd430180757f9d911ddf8d220d6f553e36f89080ac17e7dce745716ae1279" gracePeriod=30
Sep 15 12:05:50.800315 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:50.800278    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:05:51.360893 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:51.360850    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 12:05:51.361096 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:51.360920    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j" podUID="2afdc252-dfd8-479e-a1da-13ec795d2305" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 12:05:52.005361 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.005334    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 12:05:52.040521 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.040457    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-credential-socket\") pod \"2afdc252-dfd8-479e-a1da-13ec795d2305\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") "
Sep 15 12:05:52.040641 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.040524    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-workload-certs\") pod \"2afdc252-dfd8-479e-a1da-13ec795d2305\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") "
Sep 15 12:05:52.040641 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.040550    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-podinfo\") pod \"2afdc252-dfd8-479e-a1da-13ec795d2305\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") "
Sep 15 12:05:52.040641 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.040615    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-envoy\") pod \"2afdc252-dfd8-479e-a1da-13ec795d2305\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") "
Sep 15 12:05:52.040796 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.040658    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtcz4\" (UniqueName: \"kubernetes.io/projected/2afdc252-dfd8-479e-a1da-13ec795d2305-kube-api-access-gtcz4\") pod \"2afdc252-dfd8-479e-a1da-13ec795d2305\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") "
Sep 15 12:05:52.040796 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.040694    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-workload-socket\") pod \"2afdc252-dfd8-479e-a1da-13ec795d2305\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") "
Sep 15 12:05:52.040796 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.040715    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-token\") pod \"2afdc252-dfd8-479e-a1da-13ec795d2305\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") "
Sep 15 12:05:52.040796 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.040750    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-data\") pod \"2afdc252-dfd8-479e-a1da-13ec795d2305\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") "
Sep 15 12:05:52.040796 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.040776    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2afdc252-dfd8-479e-a1da-13ec795d2305-istiod-ca-cert\") pod \"2afdc252-dfd8-479e-a1da-13ec795d2305\" (UID: \"2afdc252-dfd8-479e-a1da-13ec795d2305\") "
Sep 15 12:05:52.041054 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.040952    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2afdc252-dfd8-479e-a1da-13ec795d2305" (UID: "2afdc252-dfd8-479e-a1da-13ec795d2305"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:52.041054 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.041047    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-workload-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:05:52.041200 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.041167    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2afdc252-dfd8-479e-a1da-13ec795d2305" (UID: "2afdc252-dfd8-479e-a1da-13ec795d2305"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:52.041312 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.041247    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-data" (OuterVolumeSpecName: "istio-data") pod "2afdc252-dfd8-479e-a1da-13ec795d2305" (UID: "2afdc252-dfd8-479e-a1da-13ec795d2305"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:52.041312 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.041291    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2afdc252-dfd8-479e-a1da-13ec795d2305-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2afdc252-dfd8-479e-a1da-13ec795d2305" (UID: "2afdc252-dfd8-479e-a1da-13ec795d2305"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:05:52.041552 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.041335    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2afdc252-dfd8-479e-a1da-13ec795d2305" (UID: "2afdc252-dfd8-479e-a1da-13ec795d2305"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:52.042962 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.042934    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2afdc252-dfd8-479e-a1da-13ec795d2305" (UID: "2afdc252-dfd8-479e-a1da-13ec795d2305"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 12:05:52.043243 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.043222    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2afdc252-dfd8-479e-a1da-13ec795d2305" (UID: "2afdc252-dfd8-479e-a1da-13ec795d2305"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:52.043314 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.043241    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2afdc252-dfd8-479e-a1da-13ec795d2305-kube-api-access-gtcz4" (OuterVolumeSpecName: "kube-api-access-gtcz4") pod "2afdc252-dfd8-479e-a1da-13ec795d2305" (UID: "2afdc252-dfd8-479e-a1da-13ec795d2305"). InnerVolumeSpecName "kube-api-access-gtcz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:05:52.043369 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.043348    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-token" (OuterVolumeSpecName: "istio-token") pod "2afdc252-dfd8-479e-a1da-13ec795d2305" (UID: "2afdc252-dfd8-479e-a1da-13ec795d2305"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:05:52.142096 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.142062    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-data\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:05:52.142096 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.142090    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2afdc252-dfd8-479e-a1da-13ec795d2305-istiod-ca-cert\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:05:52.142096 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.142099    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-credential-socket\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:05:52.142355 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.142108    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-workload-certs\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:05:52.142355 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.142117    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-podinfo\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:05:52.142355 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.142124    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-envoy\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:05:52.142355 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.142133    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtcz4\" (UniqueName: \"kubernetes.io/projected/2afdc252-dfd8-479e-a1da-13ec795d2305-kube-api-access-gtcz4\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:05:52.142355 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.142141    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2afdc252-dfd8-479e-a1da-13ec795d2305-istio-token\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:05:52.421911 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.421874    2564 generic.go:356] "Generic (PLEG): container finished" podID="2afdc252-dfd8-479e-a1da-13ec795d2305" containerID="419cd430180757f9d911ddf8d220d6f553e36f89080ac17e7dce745716ae1279" exitCode=0
Sep 15 12:05:52.422096 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.421918    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"
Sep 15 12:05:52.422096 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.421958    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j" event={"ID":"2afdc252-dfd8-479e-a1da-13ec795d2305","Type":"ContainerDied","Data":"419cd430180757f9d911ddf8d220d6f553e36f89080ac17e7dce745716ae1279"}
Sep 15 12:05:52.422096 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.422011    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j" event={"ID":"2afdc252-dfd8-479e-a1da-13ec795d2305","Type":"ContainerDied","Data":"80679d17c24abab9fd776b7b35e13f7871a98ce4727a61803b6a0a16a1b49571"}
Sep 15 12:05:52.422096 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.422036    2564 scope.go:117] "RemoveContainer" containerID="419cd430180757f9d911ddf8d220d6f553e36f89080ac17e7dce745716ae1279"
Sep 15 12:05:52.431453 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.431432    2564 scope.go:117] "RemoveContainer" containerID="a58b4528c8cc32fa1288dec4425d34782ad4fb5872aa3be8579d7cffd4eb4b93"
Sep 15 12:05:52.439570 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.439549    2564 scope.go:117] "RemoveContainer" containerID="419cd430180757f9d911ddf8d220d6f553e36f89080ac17e7dce745716ae1279"
Sep 15 12:05:52.439849 ip-10-0-129-183 kubenswrapper[2564]: E0915 12:05:52.439829    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"419cd430180757f9d911ddf8d220d6f553e36f89080ac17e7dce745716ae1279\": container with ID starting with 419cd430180757f9d911ddf8d220d6f553e36f89080ac17e7dce745716ae1279 not found: ID does not exist" containerID="419cd430180757f9d911ddf8d220d6f553e36f89080ac17e7dce745716ae1279"
Sep 15 12:05:52.439913 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.439856    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"419cd430180757f9d911ddf8d220d6f553e36f89080ac17e7dce745716ae1279"} err="failed to get container status \"419cd430180757f9d911ddf8d220d6f553e36f89080ac17e7dce745716ae1279\": rpc error: code = NotFound desc = could not find container \"419cd430180757f9d911ddf8d220d6f553e36f89080ac17e7dce745716ae1279\": container with ID starting with 419cd430180757f9d911ddf8d220d6f553e36f89080ac17e7dce745716ae1279 not found: ID does not exist"
Sep 15 12:05:52.439913 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.439874    2564 scope.go:117] "RemoveContainer" containerID="a58b4528c8cc32fa1288dec4425d34782ad4fb5872aa3be8579d7cffd4eb4b93"
Sep 15 12:05:52.440103 ip-10-0-129-183 kubenswrapper[2564]: E0915 12:05:52.440089    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a58b4528c8cc32fa1288dec4425d34782ad4fb5872aa3be8579d7cffd4eb4b93\": container with ID starting with a58b4528c8cc32fa1288dec4425d34782ad4fb5872aa3be8579d7cffd4eb4b93 not found: ID does not exist" containerID="a58b4528c8cc32fa1288dec4425d34782ad4fb5872aa3be8579d7cffd4eb4b93"
Sep 15 12:05:52.440150 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.440105    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a58b4528c8cc32fa1288dec4425d34782ad4fb5872aa3be8579d7cffd4eb4b93"} err="failed to get container status \"a58b4528c8cc32fa1288dec4425d34782ad4fb5872aa3be8579d7cffd4eb4b93\": rpc error: code = NotFound desc = could not find container \"a58b4528c8cc32fa1288dec4425d34782ad4fb5872aa3be8579d7cffd4eb4b93\": container with ID starting with a58b4528c8cc32fa1288dec4425d34782ad4fb5872aa3be8579d7cffd4eb4b93 not found: ID does not exist"
Sep 15 12:05:52.444570 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.444546    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"]
Sep 15 12:05:52.449891 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:52.449850    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7b7b3c-openshift-default-6d44877fb8-5t42j"]
Sep 15 12:05:53.779190 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:05:53.779153    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2afdc252-dfd8-479e-a1da-13ec795d2305" path="/var/lib/kubelet/pods/2afdc252-dfd8-479e-a1da-13ec795d2305/volumes"
Sep 15 12:06:04.113254 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:06:04.113221    2564 scope.go:117] "RemoveContainer" containerID="4c19d0bf573e8746aee994dd1a86903cfeee28f9fdb37756ab7a750c90c8cff2"
Sep 15 12:06:04.123916 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:06:04.123893    2564 scope.go:117] "RemoveContainer" containerID="022e548aa70969429c215ce23bb91677862ed7d850ee7c90601970fb9a65cd7a"
Sep 15 12:07:10.406553 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:07:10.406518    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:07:36.410476 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:07:36.410437    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:07:44.607423 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:07:44.607390    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:07:53.114763 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:07:53.114722    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:08:04.162778 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:08:04.162739    2564 scope.go:117] "RemoveContainer" containerID="3b8831ab15bdefad065c2bcfb711ab68be8b369f1671323b84a5313a0d25209e"
Sep 15 12:08:04.173298 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:08:04.173207    2564 scope.go:117] "RemoveContainer" containerID="f9cb7a0756e99641451554036a763ed59604629c31977f43369b952c0b19e6d7"
Sep 15 12:08:10.815571 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:08:10.815535    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:08:17.411360 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:08:17.411322    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:08:20.606049 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:08:20.606008    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm"]
Sep 15 12:08:20.608483 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:08:20.606860    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm" podUID="a419373f-88d3-4f88-8b1e-769527b2ad8a" containerName="manager" containerID="cri-o://0e176b3d96f35fad3369c43a58a446d4a8182b547706c8629414bb297f2ccba7" gracePeriod=10
Sep 15 12:08:21.237546 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:08:21.237449    2564 generic.go:356] "Generic (PLEG): container finished" podID="a419373f-88d3-4f88-8b1e-769527b2ad8a" containerID="0e176b3d96f35fad3369c43a58a446d4a8182b547706c8629414bb297f2ccba7" exitCode=0
Sep 15 12:08:21.237546 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:08:21.237521    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm" event={"ID":"a419373f-88d3-4f88-8b1e-769527b2ad8a","Type":"ContainerDied","Data":"0e176b3d96f35fad3369c43a58a446d4a8182b547706c8629414bb297f2ccba7"}
Sep 15 12:08:21.449513 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:08:21.449488    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm"
Sep 15 12:08:21.513084 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:08:21.513001    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a419373f-88d3-4f88-8b1e-769527b2ad8a-extensions-socket-volume\") pod \"a419373f-88d3-4f88-8b1e-769527b2ad8a\" (UID: \"a419373f-88d3-4f88-8b1e-769527b2ad8a\") "
Sep 15 12:08:21.513256 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:08:21.513094    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hcxp\" (UniqueName: \"kubernetes.io/projected/a419373f-88d3-4f88-8b1e-769527b2ad8a-kube-api-access-8hcxp\") pod \"a419373f-88d3-4f88-8b1e-769527b2ad8a\" (UID: \"a419373f-88d3-4f88-8b1e-769527b2ad8a\") "
Sep 15 12:08:21.513446 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:08:21.513422    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a419373f-88d3-4f88-8b1e-769527b2ad8a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a419373f-88d3-4f88-8b1e-769527b2ad8a" (UID: "a419373f-88d3-4f88-8b1e-769527b2ad8a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:08:21.515248 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:08:21.515219    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a419373f-88d3-4f88-8b1e-769527b2ad8a-kube-api-access-8hcxp" (OuterVolumeSpecName: "kube-api-access-8hcxp") pod "a419373f-88d3-4f88-8b1e-769527b2ad8a" (UID: "a419373f-88d3-4f88-8b1e-769527b2ad8a"). InnerVolumeSpecName "kube-api-access-8hcxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:08:21.613794 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:08:21.613752    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a419373f-88d3-4f88-8b1e-769527b2ad8a-extensions-socket-volume\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:08:21.613794 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:08:21.613788    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hcxp\" (UniqueName: \"kubernetes.io/projected/a419373f-88d3-4f88-8b1e-769527b2ad8a-kube-api-access-8hcxp\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\""
Sep 15 12:08:22.244310 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:08:22.244274    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm" event={"ID":"a419373f-88d3-4f88-8b1e-769527b2ad8a","Type":"ContainerDied","Data":"f2c4da69534854d3cc661288c0384e79bb43b0659c95fc028d18bfe826ddef04"}
Sep 15 12:08:22.244488 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:08:22.244335    2564 scope.go:117] "RemoveContainer" containerID="0e176b3d96f35fad3369c43a58a446d4a8182b547706c8629414bb297f2ccba7"
Sep 15 12:08:22.244488 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:08:22.244282    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm"
Sep 15 12:08:22.263762 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:08:22.263739    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm"]
Sep 15 12:08:22.266927 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:08:22.266907    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-czsnm"]
Sep 15 12:08:23.779414 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:08:23.779379    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a419373f-88d3-4f88-8b1e-769527b2ad8a" path="/var/lib/kubelet/pods/a419373f-88d3-4f88-8b1e-769527b2ad8a/volumes"
Sep 15 12:09:04.196216 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:04.196185    2564 scope.go:117] "RemoveContainer" containerID="b24a91e91cde8ace51d98c91c367a049fd9528a7165b5163e5a391bed9282b30"
Sep 15 12:09:21.329926 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.329888    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fk64p"]
Sep 15 12:09:21.330412 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330307    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2afdc252-dfd8-479e-a1da-13ec795d2305" containerName="istio-proxy"
Sep 15 12:09:21.330412 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330321    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2afdc252-dfd8-479e-a1da-13ec795d2305" containerName="istio-proxy"
Sep 15 12:09:21.330412 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330330    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2afdc252-dfd8-479e-a1da-13ec795d2305" containerName="istio-proxy"
Sep 15 12:09:21.330412 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330335    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2afdc252-dfd8-479e-a1da-13ec795d2305" containerName="istio-proxy"
Sep 15 12:09:21.330412 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330342    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abc72f3a-6d05-4182-b00b-5bb20815a96e" containerName="istio-proxy"
Sep 15 12:09:21.330412 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330348    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="abc72f3a-6d05-4182-b00b-5bb20815a96e" containerName="istio-proxy"
Sep 15 12:09:21.330412 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330354    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89ffea22-7478-4d02-892c-13fde0efd9f4" containerName="istio-proxy"
Sep 15 12:09:21.330412 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330359    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="89ffea22-7478-4d02-892c-13fde0efd9f4" containerName="istio-proxy"
Sep 15 12:09:21.330412 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330367    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89ffea22-7478-4d02-892c-13fde0efd9f4" containerName="istio-proxy"
Sep 15 12:09:21.330412 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330371    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="89ffea22-7478-4d02-892c-13fde0efd9f4" containerName="istio-proxy"
Sep 15 12:09:21.330412 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330389    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9787f928-f79c-4a0f-88f0-ec68e65ce45e" containerName="revoke-keys"
Sep 15 12:09:21.330412 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330394    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9787f928-f79c-4a0f-88f0-ec68e65ce45e" containerName="revoke-keys"
Sep 15 12:09:21.330412 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330407    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abc72f3a-6d05-4182-b00b-5bb20815a96e" containerName="istio-proxy"
Sep 15 12:09:21.330412 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330412    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="abc72f3a-6d05-4182-b00b-5bb20815a96e" containerName="istio-proxy"
Sep 15 12:09:21.330412 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330418    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a419373f-88d3-4f88-8b1e-769527b2ad8a" containerName="manager"
Sep 15 12:09:21.330412 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330423    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a419373f-88d3-4f88-8b1e-769527b2ad8a" containerName="manager"
Sep 15 12:09:21.330911 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330477    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2afdc252-dfd8-479e-a1da-13ec795d2305" containerName="istio-proxy"
Sep 15 12:09:21.330911 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330485    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="abc72f3a-6d05-4182-b00b-5bb20815a96e" containerName="istio-proxy"
Sep 15 12:09:21.330911 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330491    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9787f928-f79c-4a0f-88f0-ec68e65ce45e" containerName="revoke-keys"
Sep 15 12:09:21.330911 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330498    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2afdc252-dfd8-479e-a1da-13ec795d2305" containerName="istio-proxy"
Sep 15 12:09:21.330911 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330503    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="abc72f3a-6d05-4182-b00b-5bb20815a96e" containerName="istio-proxy"
Sep 15 12:09:21.330911 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330507    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a419373f-88d3-4f88-8b1e-769527b2ad8a" containerName="manager"
Sep 15 12:09:21.330911 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330513    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="89ffea22-7478-4d02-892c-13fde0efd9f4" containerName="istio-proxy"
Sep 15 12:09:21.330911 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.330519    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="89ffea22-7478-4d02-892c-13fde0efd9f4" containerName="istio-proxy"
Sep 15 12:09:21.333585 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.333564    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fk64p"
Sep 15 12:09:21.336450 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.336422    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mjhnk\""
Sep 15 12:09:21.347879 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.347852    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fk64p"]
Sep 15 12:09:21.389484 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.389455    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d434c64d-7b03-44f7-a34a-1a81259a984e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fk64p\" (UID: \"d434c64d-7b03-44f7-a34a-1a81259a984e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fk64p"
Sep 15 12:09:21.389661 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.389492    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z27gx\" (UniqueName: \"kubernetes.io/projected/d434c64d-7b03-44f7-a34a-1a81259a984e-kube-api-access-z27gx\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fk64p\" (UID: \"d434c64d-7b03-44f7-a34a-1a81259a984e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fk64p"
Sep 15 12:09:21.490483 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.490448    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d434c64d-7b03-44f7-a34a-1a81259a984e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fk64p\" (UID: \"d434c64d-7b03-44f7-a34a-1a81259a984e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fk64p"
Sep 15 12:09:21.490483 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.490487    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z27gx\" (UniqueName: \"kubernetes.io/projected/d434c64d-7b03-44f7-a34a-1a81259a984e-kube-api-access-z27gx\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fk64p\" (UID: \"d434c64d-7b03-44f7-a34a-1a81259a984e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fk64p"
Sep 15 12:09:21.490849 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.490827    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d434c64d-7b03-44f7-a34a-1a81259a984e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fk64p\" (UID: \"d434c64d-7b03-44f7-a34a-1a81259a984e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fk64p"
Sep 15 12:09:21.498932 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.498912    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z27gx\" (UniqueName: \"kubernetes.io/projected/d434c64d-7b03-44f7-a34a-1a81259a984e-kube-api-access-z27gx\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fk64p\" (UID: \"d434c64d-7b03-44f7-a34a-1a81259a984e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fk64p"
Sep 15 12:09:21.650204 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.650128    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fk64p"
Sep 15 12:09:21.927020 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:21.926990    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fk64p"]
Sep 15 12:09:21.928083 ip-10-0-129-183 kubenswrapper[2564]: W0915 12:09:21.928056    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd434c64d_7b03_44f7_a34a_1a81259a984e.slice/crio-9ed8aa8f56dcef2a541a88a2b4cccef0d3be4cd18e79c0f8348fd3eaa2a95049 WatchSource:0}: Error finding container 9ed8aa8f56dcef2a541a88a2b4cccef0d3be4cd18e79c0f8348fd3eaa2a95049: Status 404 returned error can't find the container with id 9ed8aa8f56dcef2a541a88a2b4cccef0d3be4cd18e79c0f8348fd3eaa2a95049
Sep 15 12:09:22.568500 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:22.568463    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fk64p" event={"ID":"d434c64d-7b03-44f7-a34a-1a81259a984e","Type":"ContainerStarted","Data":"86de948fb5206eac6f3618654750497485fb63ef5de130ac22a2ba8ada268b9f"}
Sep 15 12:09:22.568913 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:22.568513    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fk64p" event={"ID":"d434c64d-7b03-44f7-a34a-1a81259a984e","Type":"ContainerStarted","Data":"9ed8aa8f56dcef2a541a88a2b4cccef0d3be4cd18e79c0f8348fd3eaa2a95049"}
Sep 15 12:09:22.568913 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:22.568535    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fk64p"
Sep 15 12:09:22.600999 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:22.600949    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fk64p" podStartSLOduration=1.600936248 podStartE2EDuration="1.600936248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:09:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:09:22.598212657 +0000 UTC m=+1939.315086853" watchObservedRunningTime="2026-09-15 12:09:22.600936248 +0000 UTC m=+1939.317810432"
Sep 15 12:09:33.576648 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:33.576613    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fk64p"
Sep 15 12:09:44.021488 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:44.021449    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:09:50.813048 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:09:50.813007    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:10:04.224404 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:10:04.224324    2564 scope.go:117] "RemoveContainer" containerID="7117a63c0d3ae2226e93dc21cbfddea383ddd884514e99c28bb2969f82d16c43"
Sep 15 12:10:04.232750 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:10:04.232729    2564 scope.go:117] "RemoveContainer" containerID="6336f166068a5f1ede2d43629ba228267cef223f03a33400e37bc423e63275c7"
Sep 15 12:10:05.317595 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:10:05.317560    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:10:16.915437 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:10:16.915402    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:10:38.370375 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:10:38.370336    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:10:47.415122 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:10:47.415088    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:10:53.202363 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:10:53.202328    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:10:59.210983 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:10:59.210943    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:11:04.259439 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:04.259390    2564 scope.go:117] "RemoveContainer" containerID="8060bc5854635e67027d2e416298e6217dea358ee6feafff5acef24fa0705d80"
Sep 15 12:11:05.407122 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:05.407089    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:11:11.107495 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:11.107458    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:11:18.108956 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:18.108918    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sdhz6"]
Sep 15 12:11:25.446470 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:25.446440    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cjpd7_5a85e4fe-60c0-4f4e-8d1f-1e3ebe1a7be3/global-pull-secret-syncer/0.log"
Sep 15 12:11:25.610137 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:25.610107    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lpbsr_a3d23fee-843a-44e5-af4f-692b3efd8f03/konnectivity-agent/0.log"
Sep 15 12:11:25.695718 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:25.695692    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-183.ec2.internal_b39c0b37c0c33603dd2e1954df67bc7d/haproxy/0.log"
Sep 15 12:11:30.557126 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:30.557041    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-4w9b4_c3ae47f3-f49a-4383-8d05-7f3b4cbe8a2d/manager/0.log"
Sep 15 12:11:30.590854 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:30.590823    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-hpj8s_d7adf39a-5b75-47b5-adbd-2323c8d843d1/manager/0.log"
Sep 15 12:11:30.673996 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:30.673963    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-fk64p_d434c64d-7b03-44f7-a34a-1a81259a984e/manager/0.log"
Sep 15 12:11:30.713026 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:30.712995    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-sdhz6_f0336ab1-2036-4228-ab52-a3286a51a247/limitador/0.log"
Sep 15 12:11:32.766188 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:32.766110    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5q5vj_a283a2fb-9b1e-43bb-bc46-6af3dceea706/node-exporter/0.log"
Sep 15 12:11:32.787300 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:32.787276    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5q5vj_a283a2fb-9b1e-43bb-bc46-6af3dceea706/kube-rbac-proxy/0.log"
Sep 15 12:11:32.811398 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:32.811376    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5q5vj_a283a2fb-9b1e-43bb-bc46-6af3dceea706/init-textfile/0.log"
Sep 15 12:11:33.367208 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:33.367174    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-bskmn_559d18ca-4c8d-4037-ad0a-ec7aeacaeafc/prometheus-operator-admission-webhook/0.log"
Sep 15 12:11:36.136457 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:36.136415    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-g8h6x_3203bc5f-50f2-4e46-8781-f67e43ca3120/download-server/0.log"
Sep 15 12:11:37.097067 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:37.097034    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc"]
Sep 15 12:11:37.100546 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:37.100524    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc"
Sep 15 12:11:37.103319 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:37.103300    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5wxhw\"/\"openshift-service-ca.crt\""
Sep 15 12:11:37.104388 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:37.104368    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5wxhw\"/\"kube-root-ca.crt\""
Sep 15 12:11:37.104468 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:37.104384    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5wxhw\"/\"default-dockercfg-lkh2z\""
Sep 15 12:11:37.109508 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:37.109481    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc"]
Sep 15 12:11:37.248020 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:37.247981    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f-sys\") pod \"perf-node-gather-daemonset-bzgvc\" (UID: \"fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc"
Sep 15 12:11:37.248020 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:37.248024    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f-podres\") pod \"perf-node-gather-daemonset-bzgvc\" (UID: \"fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc"
Sep 15 12:11:37.248469 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:37.248041    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f-proc\") pod \"perf-node-gather-daemonset-bzgvc\" (UID: \"fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc"
Sep 15 12:11:37.248469 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:37.248063    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g5ck\" (UniqueName: \"kubernetes.io/projected/fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f-kube-api-access-2g5ck\") pod \"perf-node-gather-daemonset-bzgvc\" (UID: \"fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc"
Sep 15 12:11:37.248469 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:37.248102    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f-lib-modules\") pod \"perf-node-gather-daemonset-bzgvc\" (UID: \"fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc"
Sep 15 12:11:37.349164 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:37.349077    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f-sys\") pod \"perf-node-gather-daemonset-bzgvc\" (UID: \"fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc"
Sep 15 12:11:37.349164 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:37.349118    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f-podres\") pod \"perf-node-gather-daemonset-bzgvc\" (UID: \"fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc"
Sep 15 12:11:37.349164 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:37.349136    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f-proc\") pod \"perf-node-gather-daemonset-bzgvc\" (UID: \"fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc"
Sep 15 12:11:37.349164 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:37.349158    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g5ck\" (UniqueName: \"kubernetes.io/projected/fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f-kube-api-access-2g5ck\") pod \"perf-node-gather-daemonset-bzgvc\" (UID: \"fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc"
Sep 15 12:11:37.349450 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:37.349211    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f-lib-modules\") pod \"perf-node-gather-daemonset-bzgvc\" (UID: \"fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc"
Sep 15 12:11:37.349450 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:37.349224    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f-proc\") pod \"perf-node-gather-daemonset-bzgvc\" (UID: \"fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc"
Sep 15 12:11:37.349450 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:37.349211    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f-sys\") pod \"perf-node-gather-daemonset-bzgvc\" (UID: \"fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc"
Sep 15 12:11:37.349450 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:37.349256    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f-podres\") pod \"perf-node-gather-daemonset-bzgvc\" (UID: \"fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc"
Sep 15 12:11:37.349450 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:37.349372    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f-lib-modules\") pod \"perf-node-gather-daemonset-bzgvc\" (UID: \"fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc"
Sep 15 12:11:37.357483 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:37.357454    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g5ck\" (UniqueName: \"kubernetes.io/projected/fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f-kube-api-access-2g5ck\") pod \"perf-node-gather-daemonset-bzgvc\" (UID: \"fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc"
Sep 15 12:11:37.411499 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:37.411470    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc"
Sep 15 12:11:37.681041 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:37.681019    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc"]
Sep 15 12:11:37.683099 ip-10-0-129-183 kubenswrapper[2564]: W0915 12:11:37.683066    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfd59c7d5_c6a7_4cf2_af3c_d7b749fd344f.slice/crio-c44ceb522764792cce32e7a3edc818e2d46877f3f110abca1a2f7dc12836fe83 WatchSource:0}: Error finding container c44ceb522764792cce32e7a3edc818e2d46877f3f110abca1a2f7dc12836fe83: Status 404 returned error can't find the container with id c44ceb522764792cce32e7a3edc818e2d46877f3f110abca1a2f7dc12836fe83
Sep 15 12:11:38.055106 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:38.055081    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4fnpc_e75d7d12-1d20-4bb8-8ce9-06c56d243f6f/dns/0.log"
Sep 15 12:11:38.079186 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:38.079155    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4fnpc_e75d7d12-1d20-4bb8-8ce9-06c56d243f6f/kube-rbac-proxy/0.log"
Sep 15 12:11:38.190978 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:38.190947    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vhq54_c23245d8-99eb-454d-8be3-d1f6c79c29cd/dns-node-resolver/0.log"
Sep 15 12:11:38.297337 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:38.297295    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc" event={"ID":"fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f","Type":"ContainerStarted","Data":"62ca152d81e856546f9fa8ab7eb9b7c4108cbd435fabec210c0e85c86ace8666"}
Sep 15 12:11:38.297769 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:38.297352    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc" event={"ID":"fd59c7d5-c6a7-4cf2-af3c-d7b749fd344f","Type":"ContainerStarted","Data":"c44ceb522764792cce32e7a3edc818e2d46877f3f110abca1a2f7dc12836fe83"}
Sep 15 12:11:38.297769 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:38.297506    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc"
Sep 15 12:11:38.782528 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:38.782499    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-9474f8bd6-jrsfw_de4f62c6-2da2-42c4-be64-fb64756499ce/registry/0.log"
Sep 15 12:11:38.829943 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:38.829912    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f6lmr_349601b9-3ea8-4c18-b77c-b90cfd48d1e5/node-ca/0.log"
Sep 15 12:11:39.784604 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:39.784572    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4_33915edd-25ec-409a-8fb6-b72807523c29/istio-proxy/0.log"
Sep 15 12:11:40.293430 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:40.293395    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fkggk_a3070a8c-2f61-484e-adf8-6d0243ad51ea/discovery/0.log"
Sep 15 12:11:40.340195 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:40.340166    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-687d9c5d49-wjrp4_0eb32797-63a5-46e2-a2ff-ef5edaadfbd6/kube-auth-proxy/0.log"
Sep 15 12:11:41.379085 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:41.379047    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-whvhb_f7f4d9c5-2ad7-42e9-a43b-4fc2fc50b942/serve-healthcheck-canary/0.log"
Sep 15 12:11:42.001680 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:42.001652    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tztbn_3a391f87-ec3b-410a-be2c-c50acfa599cc/kube-rbac-proxy/0.log"
Sep 15 12:11:42.023971 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:42.023942    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tztbn_3a391f87-ec3b-410a-be2c-c50acfa599cc/exporter/0.log"
Sep 15 12:11:42.045432 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:42.045402    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tztbn_3a391f87-ec3b-410a-be2c-c50acfa599cc/extractor/0.log"
Sep 15 12:11:44.312605 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:44.312566    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc"
Sep 15 12:11:44.331208 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:44.331165    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-bzgvc" podStartSLOduration=7.331149977 podStartE2EDuration="7.331149977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:11:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:11:38.312999008 +0000 UTC m=+2075.029873193" watchObservedRunningTime="2026-09-15 12:11:44.331149977 +0000 UTC m=+2081.048024160"
Sep 15 12:11:44.641841 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:44.641748    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-bcbkp_d44225e9-8154-46c4-a23a-fac7b25977a4/server/0.log"
Sep 15 12:11:44.756895 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:44.756865    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-lh6zp_820182cd-1a7b-40b1-b5de-f7d7f94b798c/manager/0.log"
Sep 15 12:11:44.927404 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:44.927322    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74bdb8b799-q8pl5_050dd032-d747-420a-a6cc-000e17a82e06/manager/0.log"
Sep 15 12:11:44.947164 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:44.947140    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74bdb8b799-q8pl5_050dd032-d747-420a-a6cc-000e17a82e06/copy-manifests/0.log"
Sep 15 12:11:46.124024 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:46.123994    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4_33915edd-25ec-409a-8fb6-b72807523c29/istio-proxy/0.log"
Sep 15 12:11:46.394972 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:46.394939    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-c2m4b_fa1c6ba8-e0ae-4703-9117-e390963be26d/openshift-lws-operator/0.log"
Sep 15 12:11:46.651465 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:46.651381    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fkggk_a3070a8c-2f61-484e-adf8-6d0243ad51ea/discovery/0.log"
Sep 15 12:11:46.679730 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:46.679689    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-687d9c5d49-wjrp4_0eb32797-63a5-46e2-a2ff-ef5edaadfbd6/kube-auth-proxy/0.log"
Sep 15 12:11:48.285137 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:48.285100    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-smtj4_33915edd-25ec-409a-8fb6-b72807523c29/istio-proxy/0.log"
Sep 15 12:11:48.766129 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:48.766044    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fkggk_a3070a8c-2f61-484e-adf8-6d0243ad51ea/discovery/0.log"
Sep 15 12:11:48.917987 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:48.917956    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-687d9c5d49-wjrp4_0eb32797-63a5-46e2-a2ff-ef5edaadfbd6/kube-auth-proxy/0.log"
Sep 15 12:11:51.729219 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:51.729177    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-t5m5q_cd26dc75-00ec-41c7-b33a-9e011324e20c/migrator/0.log"
Sep 15 12:11:51.749253 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:51.749226    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-t5m5q_cd26dc75-00ec-41c7-b33a-9e011324e20c/graceful-termination/0.log"
Sep 15 12:11:53.157349 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:53.157323    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6ldt_403278f4-8eb0-41c6-a45c-1442c188ecd3/kube-multus-additional-cni-plugins/0.log"
Sep 15 12:11:53.181077 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:53.181050    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6ldt_403278f4-8eb0-41c6-a45c-1442c188ecd3/egress-router-binary-copy/0.log"
Sep 15 12:11:53.201182 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:53.201160    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6ldt_403278f4-8eb0-41c6-a45c-1442c188ecd3/cni-plugins/0.log"
Sep 15 12:11:53.222216 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:53.222191    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6ldt_403278f4-8eb0-41c6-a45c-1442c188ecd3/bond-cni-plugin/0.log"
Sep 15 12:11:53.243089 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:53.243054    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6ldt_403278f4-8eb0-41c6-a45c-1442c188ecd3/routeoverride-cni/0.log"
Sep 15 12:11:53.263629 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:53.263605    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6ldt_403278f4-8eb0-41c6-a45c-1442c188ecd3/whereabouts-cni-bincopy/0.log"
Sep 15 12:11:53.283997 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:53.283972    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6ldt_403278f4-8eb0-41c6-a45c-1442c188ecd3/whereabouts-cni/0.log"
Sep 15 12:11:53.696144 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:53.696111    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hrgfl_808cf550-98e0-4b24-b17e-466044b2221b/kube-multus/0.log"
Sep 15 12:11:53.776888 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:53.776862    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4jmmn_fd41f61a-cfbe-43f3-bc25-be3037a81bf2/network-metrics-daemon/0.log"
Sep 15 12:11:53.796139 ip-10-0-129-183 kubenswrapper[2564]: I0915 12:11:53.796115    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4jmmn_fd41f61a-cfbe-43f3-bc25-be3037a81bf2/kube-rbac-proxy/0.log"