Jul 14 17:52:25.644400 ip-10-0-139-216 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 14 17:52:25.644412 ip-10-0-139-216 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 14 17:52:25.644420 ip-10-0-139-216 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 14 17:52:25.644757 ip-10-0-139-216 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 14 17:52:35.840710 ip-10-0-139-216 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 14 17:52:35.840729 ip-10-0-139-216 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 29382f486e4347f18342b3029025b78a --
Jul 14 17:54:41.769943 ip-10-0-139-216 systemd[1]: Starting Kubernetes Kubelet...
Jul 14 17:54:42.180734 ip-10-0-139-216 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 17:54:42.180734 ip-10-0-139-216 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 14 17:54:42.180734 ip-10-0-139-216 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 17:54:42.180734 ip-10-0-139-216 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 14 17:54:42.180734 ip-10-0-139-216 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 17:54:42.181471 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.180794    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 14 17:54:42.190503 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190479    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 17:54:42.190503 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190501    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 17:54:42.190503 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190505    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 17:54:42.190503 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190509    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 17:54:42.190651 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190512    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 17:54:42.190651 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190515    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 17:54:42.190651 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190519    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 17:54:42.190651 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190522    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 17:54:42.190651 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190525    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 17:54:42.190651 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190528    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 17:54:42.190651 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190530    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 17:54:42.190651 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190533    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 17:54:42.190651 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190535    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 17:54:42.190651 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190538    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 17:54:42.190651 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190542    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 17:54:42.190651 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190546    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 17:54:42.190651 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190549    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 17:54:42.190651 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190553    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 17:54:42.190651 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190570    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 17:54:42.190651 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190574    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 17:54:42.190651 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190584    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 17:54:42.190651 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190588    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 17:54:42.190651 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190590    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 17:54:42.191102 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190594    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 17:54:42.191102 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190617    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 17:54:42.191102 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190621    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 17:54:42.191102 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190624    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 17:54:42.191102 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190627    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 17:54:42.191102 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190630    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 17:54:42.191102 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190633    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 17:54:42.191102 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190635    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 17:54:42.191102 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190638    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 17:54:42.191102 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190641    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 17:54:42.191102 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190644    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 17:54:42.191102 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190647    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 17:54:42.191102 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190649    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 17:54:42.191102 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190653    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 17:54:42.191102 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190656    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 17:54:42.191102 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190660    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 17:54:42.191102 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190662    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 17:54:42.191102 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190666    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 17:54:42.191102 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190669    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 17:54:42.191102 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190671    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 17:54:42.191600 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190674    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 17:54:42.191600 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190676    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 17:54:42.191600 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190679    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 17:54:42.191600 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190681    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 17:54:42.191600 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190684    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 17:54:42.191600 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190686    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 17:54:42.191600 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190689    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 17:54:42.191600 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190691    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 17:54:42.191600 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190694    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 17:54:42.191600 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190697    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 17:54:42.191600 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190699    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 17:54:42.191600 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190702    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 17:54:42.191600 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190704    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 17:54:42.191600 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190707    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 17:54:42.191600 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190710    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 17:54:42.191600 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190712    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 17:54:42.191600 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190715    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 17:54:42.191600 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190717    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 17:54:42.191600 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190719    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 17:54:42.191600 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190722    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 17:54:42.192082 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190725    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 17:54:42.192082 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190727    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 17:54:42.192082 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190730    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 17:54:42.192082 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190732    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 17:54:42.192082 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190735    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 17:54:42.192082 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190739    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 17:54:42.192082 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190741    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 17:54:42.192082 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190744    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 17:54:42.192082 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190748    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 17:54:42.192082 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190751    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 17:54:42.192082 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190754    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 17:54:42.192082 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190756    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 17:54:42.192082 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190758    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 17:54:42.192082 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190761    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 17:54:42.192082 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190763    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 17:54:42.192082 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190766    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 17:54:42.192082 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190768    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 17:54:42.192082 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190770    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 17:54:42.192082 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190773    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 17:54:42.192527 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190775    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 17:54:42.192527 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190778    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 17:54:42.192527 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190780    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 17:54:42.192527 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190782    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 17:54:42.192527 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190785    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 17:54:42.192527 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190787    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 17:54:42.192527 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190790    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 17:54:42.192527 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190794    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 17:54:42.192527 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190798    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 17:54:42.192527 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190801    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 17:54:42.192527 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190803    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 17:54:42.192527 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190806    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 17:54:42.192527 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190808    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 17:54:42.192527 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190811    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 17:54:42.192527 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190814    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 17:54:42.192527 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190816    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 17:54:42.192527 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.190819    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 17:54:42.192527 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191624    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 17:54:42.192527 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191633    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 17:54:42.193023 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191638    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 17:54:42.193023 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191642    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 17:54:42.193023 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191645    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 17:54:42.193023 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191648    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 17:54:42.193023 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191650    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 17:54:42.193023 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191654    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 17:54:42.193023 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191656    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 17:54:42.193023 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191659    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 17:54:42.193023 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191662    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 17:54:42.193023 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191664    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 17:54:42.193023 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191667    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 17:54:42.193023 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191669    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 17:54:42.193023 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191672    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 17:54:42.193023 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191674    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 17:54:42.193023 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191676    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 17:54:42.193023 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191679    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 17:54:42.193023 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191682    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 17:54:42.193023 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191684    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 17:54:42.193023 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191687    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 17:54:42.193023 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191689    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 17:54:42.193545 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191692    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 17:54:42.193545 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191695    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 17:54:42.193545 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191697    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 17:54:42.193545 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191699    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 17:54:42.193545 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191702    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 17:54:42.193545 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191704    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 17:54:42.193545 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191708    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 17:54:42.193545 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191710    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 17:54:42.193545 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191713    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 17:54:42.193545 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191716    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 17:54:42.193545 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191720    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 17:54:42.193545 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191724    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 17:54:42.193545 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191727    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 17:54:42.193545 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191730    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 17:54:42.193545 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191733    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 17:54:42.193545 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191735    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 17:54:42.193545 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191738    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 17:54:42.193545 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191740    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 17:54:42.193545 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191743    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 17:54:42.194015 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191746    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 17:54:42.194015 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191749    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 17:54:42.194015 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191752    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 17:54:42.194015 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191754    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 17:54:42.194015 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191757    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 17:54:42.194015 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191759    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 17:54:42.194015 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191762    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 17:54:42.194015 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191765    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 17:54:42.194015 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191767    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 17:54:42.194015 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191770    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 17:54:42.194015 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191772    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 17:54:42.194015 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191775    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 17:54:42.194015 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191777    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 17:54:42.194015 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191780    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 17:54:42.194015 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191783    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 17:54:42.194015 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191785    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 17:54:42.194015 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191788    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 17:54:42.194015 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191790    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 17:54:42.194015 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191793    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 17:54:42.194015 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191796    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 17:54:42.194520 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191799    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 17:54:42.194520 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191802    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 17:54:42.194520 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191805    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 17:54:42.194520 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191807    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 17:54:42.194520 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191809    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 17:54:42.194520 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191812    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 17:54:42.194520 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191815    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 17:54:42.194520 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191817    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 17:54:42.194520 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191820    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 17:54:42.194520 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191822    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 17:54:42.194520 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191824    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 17:54:42.194520 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191827    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 17:54:42.194520 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191830    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 17:54:42.194520 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191832    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 17:54:42.194520 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191836    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 17:54:42.194520 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191839    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 17:54:42.194520 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191842    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 17:54:42.194520 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191845    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 17:54:42.194520 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191847    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 17:54:42.194996 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191850    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 17:54:42.194996 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191853    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 17:54:42.194996 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191855    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 17:54:42.194996 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191858    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 17:54:42.194996 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191861    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 17:54:42.194996 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191864    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 17:54:42.194996 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191866    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 17:54:42.194996 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191869    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 17:54:42.194996 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191871    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 17:54:42.194996 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191874    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 17:54:42.194996 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191877    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 17:54:42.194996 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191879    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 17:54:42.194996 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191882    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 17:54:42.194996 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191899    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 17:54:42.194996 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191902    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 17:54:42.194996 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191905    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 17:54:42.194996 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191908    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 17:54:42.194996 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191911    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 17:54:42.194996 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.191914    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 17:54:42.194996 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192296    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 17:54:42.195472 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192302    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 17:54:42.195472 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192304    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 17:54:42.195472 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192307    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 17:54:42.195472 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192310    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 17:54:42.195472 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192312    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 17:54:42.195472 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192316    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 17:54:42.195472 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192319    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 17:54:42.195472 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192322    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 17:54:42.195472 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192324    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 17:54:42.195472 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192327    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 17:54:42.195472 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192329    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 17:54:42.195472 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192332    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 17:54:42.195472 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192335    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 17:54:42.195472 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192338    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 17:54:42.195472 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192341    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 17:54:42.195472 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192343    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 17:54:42.195472 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192348    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 17:54:42.195472 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192352    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 17:54:42.195472 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192355    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 17:54:42.195472 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192357    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 17:54:42.195971 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192360    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 17:54:42.195971 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192363    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 17:54:42.195971 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192365    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 17:54:42.195971 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192368    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 17:54:42.195971 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192370    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 17:54:42.195971 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192373    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 17:54:42.195971 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192375    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 17:54:42.195971 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192378    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 17:54:42.195971 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192380    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 17:54:42.195971 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192383    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 17:54:42.195971 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192385    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 17:54:42.195971 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192388    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 17:54:42.195971 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192390    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 17:54:42.195971 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192393    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 17:54:42.195971 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192395    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 17:54:42.195971 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192398    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 17:54:42.195971 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192400    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 17:54:42.195971 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192406    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 17:54:42.195971 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192409    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 17:54:42.195971 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192412    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 17:54:42.196456 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192415    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 17:54:42.196456 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192418    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 17:54:42.196456 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192421    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 17:54:42.196456 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192423    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 17:54:42.196456 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192426    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 17:54:42.196456 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192428    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 17:54:42.196456 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192431    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 17:54:42.196456 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192433    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 17:54:42.196456 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192436    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 17:54:42.196456 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192438    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 17:54:42.196456 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192441    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 17:54:42.196456 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192443    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 17:54:42.196456 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192446    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 17:54:42.196456 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192450    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 17:54:42.196456 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192453    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 17:54:42.196456 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192456    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 17:54:42.196456 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192459    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 17:54:42.196456 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192462    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 17:54:42.196456 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192464    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 17:54:42.196965 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192467    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 17:54:42.196965 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192469    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 17:54:42.196965 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192472    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 17:54:42.196965 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192475    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 17:54:42.196965 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192477    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 17:54:42.196965 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192479    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 17:54:42.196965 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192482    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 17:54:42.196965 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192484    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 17:54:42.196965 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192486    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 17:54:42.196965 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192489    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 17:54:42.196965 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192494    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 17:54:42.196965 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192497    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 17:54:42.196965 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192500    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 17:54:42.196965 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192502    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 17:54:42.196965 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192505    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 17:54:42.196965 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192507    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 17:54:42.196965 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192510    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 17:54:42.196965 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192512    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 17:54:42.196965 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192515    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 17:54:42.196965 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192520    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 17:54:42.197451 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192522    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 17:54:42.197451 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192525    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 17:54:42.197451 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192527    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 17:54:42.197451 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192530    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 17:54:42.197451 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192532    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 17:54:42.197451 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192535    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 17:54:42.197451 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192537    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 17:54:42.197451 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192540    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 17:54:42.197451 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192542    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 17:54:42.197451 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192545    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 17:54:42.197451 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192548    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 17:54:42.197451 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192550    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 17:54:42.197451 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192552    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 17:54:42.197451 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192555    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 17:54:42.197451 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192573    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 17:54:42.197451 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192576    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 17:54:42.197451 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192578    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 17:54:42.197451 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192581    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 17:54:42.197451 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.192583    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 17:54:42.197451 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192662    2558 flags.go:64] FLAG: --address="0.0.0.0"
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192670    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192676    2558 flags.go:64] FLAG: --anonymous-auth="true"
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192682    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192686    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192689    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192699    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192707    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192711    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192714    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192717    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192720    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192724    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192727    2558 flags.go:64] FLAG: --cgroup-root=""
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192730    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192732    2558 flags.go:64] FLAG: --client-ca-file=""
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192735    2558 flags.go:64] FLAG: --cloud-provider="external"
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192738    2558 flags.go:64] FLAG: --cluster-dns="[]"
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192742    2558 flags.go:64] FLAG: --cluster-domain=""
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192745    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192748    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192751    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192755    2558 flags.go:64] FLAG: --container-log-max-files="5"
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192758    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 14 17:54:42.197940 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192761    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192764    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192767    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192770    2558 flags.go:64] FLAG: --contention-profiling="false"
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192773    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192776    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192779    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192782    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192786    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192789    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192792    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192795    2558 flags.go:64] FLAG: --enable-load-reader="false"
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192798    2558 flags.go:64] FLAG: --enable-server="true"
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192801    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192805    2558 flags.go:64] FLAG: --event-burst="100"
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192809    2558 flags.go:64] FLAG: --event-qps="50"
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192812    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192815    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192818    2558 flags.go:64] FLAG: --eviction-hard=""
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192822    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192825    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192828    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192831    2558 flags.go:64] FLAG: --eviction-soft=""
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192834    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192837    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 14 17:54:42.198577 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192840    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192843    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192846    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192849    2558 flags.go:64] FLAG: --fail-swap-on="true"
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192852    2558 flags.go:64] FLAG: --feature-gates=""
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192855    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192858    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192861    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192864    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192867    2558 flags.go:64] FLAG: --healthz-port="10248"
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192870    2558 flags.go:64] FLAG: --help="false"
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192873    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-139-216.ec2.internal"
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192876    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192879    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192882    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192885    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192889    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192892    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192896    2558 flags.go:64] FLAG: --image-service-endpoint=""
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192899    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192902    2558 flags.go:64] FLAG: --kube-api-burst="100"
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192905    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192907    2558 flags.go:64] FLAG: --kube-api-qps="50"
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192911    2558 flags.go:64] FLAG: --kube-reserved=""
Jul 14 17:54:42.199195 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192914    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192917    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192920    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192923    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192925    2558 flags.go:64] FLAG: --lock-file=""
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192928    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192931    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192934    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192939    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192941    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192944    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192947    2558 flags.go:64] FLAG: --logging-format="text"
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192950    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192953    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192955    2558 flags.go:64] FLAG: --manifest-url=""
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192958    2558 flags.go:64] FLAG: --manifest-url-header=""
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192962    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192965    2558 flags.go:64] FLAG: --max-open-files="1000000"
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192969    2558 flags.go:64] FLAG: --max-pods="110"
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192972    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192975    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192978    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192980    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192983    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192986    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 14 17:54:42.199793 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192989    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.192998    2558 flags.go:64] FLAG: --node-status-max-images="50"
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193001    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193004    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193007    2558 flags.go:64] FLAG: --pod-cidr=""
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193011    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193017    2558 flags.go:64] FLAG: --pod-manifest-path=""
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193020    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193024    2558 flags.go:64] FLAG: --pods-per-core="0"
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193027    2558 flags.go:64] FLAG: --port="10250"
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193030    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193033    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03832dd7279235493"
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193036    2558 flags.go:64] FLAG: --qos-reserved=""
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193039    2558 flags.go:64] FLAG: --read-only-port="10255"
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193043    2558 flags.go:64] FLAG: --register-node="true"
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193045    2558 flags.go:64] FLAG: --register-with-taints=""
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193049    2558 flags.go:64] FLAG: --registry-burst="10"
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193052    2558 flags.go:64] FLAG: --registry-qps="5"
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193055    2558 flags.go:64] FLAG: --reserved-cpus=""
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193057    2558 flags.go:64] FLAG: --reserved-memory=""
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193061    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193063    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193066    2558 flags.go:64] FLAG: --rotate-certificates="false"
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193069    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193072    2558 flags.go:64] FLAG: --runonce="false"
Jul 14 17:54:42.200725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193075    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193078    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193080    2558 flags.go:64] FLAG: --seccomp-default="false"
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193083    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193086    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193089    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193092    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193094    2558 flags.go:64] FLAG: --storage-driver-password="root"
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193099    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193101    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193104    2558 flags.go:64] FLAG: --storage-driver-user="root"
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193107    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193112    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193115    2558 flags.go:64] FLAG: --system-cgroups=""
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193118    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193124    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193128    2558 flags.go:64] FLAG: --tls-cert-file=""
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193131    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193135    2558 flags.go:64] FLAG: --tls-min-version=""
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193138    2558 flags.go:64] FLAG: --tls-private-key-file=""
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193140    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193143    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193146    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193149    2558 flags.go:64] FLAG: --v="2"
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193153    2558 flags.go:64] FLAG: --version="false"
Jul 14 17:54:42.201801 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193157    2558 flags.go:64] FLAG: --vmodule=""
Jul 14 17:54:42.202847 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193160    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 14 17:54:42.202847 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.193163    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 14 17:54:42.202847 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193279    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 17:54:42.202847 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193283    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 17:54:42.202847 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193286    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 17:54:42.202847 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193289    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 17:54:42.202847 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193291    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 17:54:42.202847 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193294    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 17:54:42.202847 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193297    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 17:54:42.202847 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193299    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 17:54:42.202847 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193302    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 17:54:42.202847 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193304    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 17:54:42.202847 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193307    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 17:54:42.202847 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193310    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 17:54:42.202847 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193314    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 17:54:42.202847 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193316    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 17:54:42.202847 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193319    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 17:54:42.202847 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193321    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 17:54:42.202847 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193325    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 17:54:42.202847 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193328    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 17:54:42.203709 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193330    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 17:54:42.203709 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193333    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 17:54:42.203709 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193336    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 17:54:42.203709 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193338    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 17:54:42.203709 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193341    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 17:54:42.203709 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193343    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 17:54:42.203709 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193345    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 17:54:42.203709 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193348    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 17:54:42.203709 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193350    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 17:54:42.203709 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193353    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 17:54:42.203709 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193355    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 17:54:42.203709 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193358    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 17:54:42.203709 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193360    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 17:54:42.203709 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193363    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 17:54:42.203709 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193366    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 17:54:42.203709 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193368    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 17:54:42.203709 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193371    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 17:54:42.203709 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193373    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 17:54:42.203709 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193376    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 17:54:42.203709 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193378    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 17:54:42.204270 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193380    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 17:54:42.204270 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193383    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 17:54:42.204270 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193385    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 17:54:42.204270 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193388    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 17:54:42.204270 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193390    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 17:54:42.204270 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193393    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 17:54:42.204270 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193398    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 17:54:42.204270 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193401    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 17:54:42.204270 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193404    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 17:54:42.204270 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193407    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 17:54:42.204270 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193411    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 17:54:42.204270 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193414    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 17:54:42.204270 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193417    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 17:54:42.204270 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193419    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 17:54:42.204270 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193422    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 17:54:42.204270 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193428    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 17:54:42.204270 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193431    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 17:54:42.204270 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193434    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 17:54:42.204270 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193437    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 17:54:42.204270 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193440    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 17:54:42.204815 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193443    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 17:54:42.204815 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193446    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 17:54:42.204815 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193448    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 17:54:42.204815 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193451    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 17:54:42.204815 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193454    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 17:54:42.204815 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193456    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 17:54:42.204815 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193459    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 17:54:42.204815 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193461    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 17:54:42.204815 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193464    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 17:54:42.204815 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193466    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 17:54:42.204815 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193468    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 17:54:42.204815 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193471    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 17:54:42.204815 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193473    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 17:54:42.204815 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193476    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 17:54:42.204815 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193478    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 17:54:42.204815 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193481    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 17:54:42.204815 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193483    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 17:54:42.204815 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193486    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 17:54:42.204815 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193490    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 17:54:42.204815 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193492    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 17:54:42.205305 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193494    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 17:54:42.205305 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193497    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 17:54:42.205305 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193500    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 17:54:42.205305 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193503    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 17:54:42.205305 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193505    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 17:54:42.205305 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193508    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 17:54:42.205305 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193510    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 17:54:42.205305 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193513    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 17:54:42.205305 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193516    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 17:54:42.205305 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193519    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 17:54:42.205305 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193523    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 17:54:42.205305 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193526    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 17:54:42.205305 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193529    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 17:54:42.205305 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193532    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 17:54:42.205305 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193535    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 17:54:42.205305 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193537    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 17:54:42.205305 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193540    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 17:54:42.205305 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193543    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 17:54:42.205305 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193547    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 17:54:42.205788 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193551    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 17:54:42.205788 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.193554    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 17:54:42.205788 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.194414    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 17:54:42.205788 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.204472    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 14 17:54:42.205788 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.204492    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 14 17:54:42.205788 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.204507    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 14 17:54:42.205788 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.204513    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 14 17:54:42.205788 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204588    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 17:54:42.205788 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204594    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 17:54:42.205788 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204598    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 17:54:42.205788 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204602    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 17:54:42.205788 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204606    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 17:54:42.205788 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204610    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 17:54:42.205788 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204613    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 17:54:42.206132 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204616    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 17:54:42.206132 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204618    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 17:54:42.206132 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204621    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 17:54:42.206132 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204624    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 17:54:42.206132 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204627    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 17:54:42.206132 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204629    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 17:54:42.206132 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204632    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 17:54:42.206132 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204634    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 17:54:42.206132 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204637    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 17:54:42.206132 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204639    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 17:54:42.206132 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204642    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 17:54:42.206132 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204645    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 17:54:42.206132 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204647    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 17:54:42.206132 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204650    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 17:54:42.206132 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204652    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 17:54:42.206132 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204654    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 17:54:42.206132 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204657    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 17:54:42.206132 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204660    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 17:54:42.206132 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204662    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 17:54:42.206132 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204665    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 17:54:42.206626 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204668    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 17:54:42.206626 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204671    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 17:54:42.206626 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204674    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 17:54:42.206626 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204677    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 17:54:42.206626 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204680    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 17:54:42.206626 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204683    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 17:54:42.206626 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204685    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 17:54:42.206626 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204688    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 17:54:42.206626 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204690    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 17:54:42.206626 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204693    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 17:54:42.206626 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204696    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 17:54:42.206626 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204698    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 17:54:42.206626 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204701    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 17:54:42.206626 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204703    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 17:54:42.206626 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204706    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 17:54:42.206626 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204708    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 17:54:42.206626 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204711    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 17:54:42.206626 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204714    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 17:54:42.206626 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204717    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 17:54:42.207091 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204721    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 17:54:42.207091 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204724    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 17:54:42.207091 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204727    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 17:54:42.207091 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204730    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 17:54:42.207091 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204732    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 17:54:42.207091 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204735    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 17:54:42.207091 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204737    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 17:54:42.207091 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204740    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 17:54:42.207091 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204742    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 17:54:42.207091 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204745    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 17:54:42.207091 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204748    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 17:54:42.207091 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204750    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 17:54:42.207091 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204753    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 17:54:42.207091 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204755    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 17:54:42.207091 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204758    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 17:54:42.207091 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204761    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 17:54:42.207091 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204764    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 17:54:42.207091 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204767    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 17:54:42.207091 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204769    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 17:54:42.207091 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204772    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 17:54:42.207594 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204774    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 17:54:42.207594 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204776    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 17:54:42.207594 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204779    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 17:54:42.207594 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204781    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 17:54:42.207594 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204784    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 17:54:42.207594 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204786    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 17:54:42.207594 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204789    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 17:54:42.207594 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204791    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 17:54:42.207594 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204795    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 17:54:42.207594 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204799    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 17:54:42.207594 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204802    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 17:54:42.207594 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204805    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 17:54:42.207594 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204808    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 17:54:42.207594 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204819    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 17:54:42.207594 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204822    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 17:54:42.207594 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204825    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 17:54:42.207594 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204828    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 17:54:42.207594 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204831    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 17:54:42.207594 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204834    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 17:54:42.208063 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204837    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 17:54:42.208063 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204839    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 17:54:42.208063 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204842    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 17:54:42.208063 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204845    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 17:54:42.208063 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204847    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 17:54:42.208063 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204850    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 17:54:42.208063 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204852    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 17:54:42.208063 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204854    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 17:54:42.208063 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204858    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 17:54:42.208063 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204861    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 17:54:42.208063 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204864    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 17:54:42.208063 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204866    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 17:54:42.208063 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204869    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 17:54:42.208063 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.204871    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 17:54:42.208063 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.204877    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 17:54:42.208437 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205002    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 17:54:42.208437 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205008    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 17:54:42.208437 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205011    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 17:54:42.208437 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205014    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 17:54:42.208437 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205017    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 17:54:42.208437 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205019    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 17:54:42.208437 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205022    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 17:54:42.208437 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205025    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 17:54:42.208437 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205028    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 17:54:42.208437 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205031    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 17:54:42.208437 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205033    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 17:54:42.208437 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205036    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 17:54:42.208437 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205045    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 17:54:42.208437 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205047    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 17:54:42.208437 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205050    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 17:54:42.208437 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205052    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 17:54:42.208437 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205055    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 17:54:42.208437 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205059    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 17:54:42.208437 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205063    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 17:54:42.209034 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205066    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 17:54:42.209034 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205069    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 17:54:42.209034 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205073    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 17:54:42.209034 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205077    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 17:54:42.209034 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205080    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 17:54:42.209034 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205082    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 17:54:42.209034 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205085    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 17:54:42.209034 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205089    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 17:54:42.209034 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205091    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 17:54:42.209034 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205094    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 17:54:42.209034 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205096    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 17:54:42.209034 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205099    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 17:54:42.209034 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205101    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 17:54:42.209034 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205104    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 17:54:42.209034 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205106    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 17:54:42.209034 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205109    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 17:54:42.209034 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205111    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 17:54:42.209034 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205114    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 17:54:42.209034 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205116    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 17:54:42.209484 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205119    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 17:54:42.209484 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205121    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 17:54:42.209484 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205124    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 17:54:42.209484 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205126    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 17:54:42.209484 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205129    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 17:54:42.209484 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205131    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 17:54:42.209484 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205133    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 17:54:42.209484 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205137    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 17:54:42.209484 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205139    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 17:54:42.209484 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205142    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 17:54:42.209484 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205145    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 17:54:42.209484 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205148    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 17:54:42.209484 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205150    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 17:54:42.209484 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205152    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 17:54:42.209484 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205155    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 17:54:42.209484 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205157    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 17:54:42.209484 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205160    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 17:54:42.209484 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205163    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 17:54:42.209484 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205165    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 17:54:42.209484 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205168    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 17:54:42.209977 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205171    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 17:54:42.209977 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205174    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 17:54:42.209977 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205176    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 17:54:42.209977 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205179    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 17:54:42.209977 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205182    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 17:54:42.209977 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205184    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 17:54:42.209977 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205187    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 17:54:42.209977 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205189    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 17:54:42.209977 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205192    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 17:54:42.209977 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205194    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 17:54:42.209977 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205197    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 17:54:42.209977 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205199    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 17:54:42.209977 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205201    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 17:54:42.209977 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205204    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 17:54:42.209977 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205206    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 17:54:42.209977 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205209    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 17:54:42.209977 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205211    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 17:54:42.209977 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205214    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 17:54:42.209977 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205216    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 17:54:42.209977 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205219    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 17:54:42.210474 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205222    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 17:54:42.210474 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205224    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 17:54:42.210474 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205227    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 17:54:42.210474 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205229    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 17:54:42.210474 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205232    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 17:54:42.210474 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205234    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 17:54:42.210474 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205237    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 17:54:42.210474 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205239    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 17:54:42.210474 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205241    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 17:54:42.210474 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205244    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 17:54:42.210474 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205247    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 17:54:42.210474 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205249    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 17:54:42.210474 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205252    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 17:54:42.210474 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205254    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 17:54:42.210474 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205257    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 17:54:42.210474 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205260    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 17:54:42.210474 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205262    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 17:54:42.210474 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205265    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 17:54:42.210474 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205268    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 17:54:42.210474 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205270    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 17:54:42.210974 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:42.205273    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 17:54:42.210974 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.205278    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 17:54:42.210974 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.205423    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 14 17:54:42.210974 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.208536    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 14 17:54:42.210974 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.210175    2558 server.go:1019] "Starting client certificate rotation"
Jul 14 17:54:42.210974 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.210274    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 17:54:42.210974 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.210316    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 17:54:42.212717 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.212703    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 17:54:42.214417 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.214395    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 17:54:42.226428 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.226405    2558 log.go:25] "Validated CRI v1 runtime API"
Jul 14 17:54:42.228735 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.228718    2558 log.go:25] "Validated CRI v1 image API"
Jul 14 17:54:42.229576 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.229549    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 14 17:54:42.234965 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.234938    2558 fs.go:135] Filesystem UUIDs: map[01702aa7-fcf9-441c-a55d-719117bf2b54:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 abaa7378-0eb8-40d5-b335-9aab6b68490b:/dev/nvme0n1p3]
Jul 14 17:54:42.235049 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.234962    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 14 17:54:42.239886 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.239749    2558 manager.go:216] Machine: {Timestamp:2026-07-14 17:54:42.239240038 +0000 UTC m=+0.344350013 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102038 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2552496e9a20da542a182d04d8394f SystemUUID:ec255249-6e9a-20da-542a-182d04d8394f BootID:29382f48-6e43-47f1-8342-b3029025b78a Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:10:a2:fa:d1:cf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:10:a2:fa:d1:cf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:4a:9e:d3:a1:7c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 14 17:54:42.239886 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.239879    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 14 17:54:42.240004 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.239966    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 14 17:54:42.241080 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.241047    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 14 17:54:42.241233 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.241090    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-216.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 14 17:54:42.242390 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.242375    2558 topology_manager.go:138] "Creating topology manager with none policy"
Jul 14 17:54:42.242429 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.242393    2558 container_manager_linux.go:309] "Creating device plugin manager"
Jul 14 17:54:42.242429 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.242405    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 17:54:42.243035 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.243022    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 17:54:42.243964 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.243948    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 14 17:54:42.247053 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.247037    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 17:54:42.247210 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.247200    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 14 17:54:42.247261 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.247239    2558 kubelet.go:486] "Attempting to sync node with API server"
Jul 14 17:54:42.247261 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.247259    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 14 17:54:42.247337 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.247272    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 14 17:54:42.247337 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.247304    2558 kubelet.go:398] "Adding apiserver pod source"
Jul 14 17:54:42.247337 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.247315    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 14 17:54:42.248476 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.248454    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 17:54:42.248588 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.248486    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 17:54:42.248692 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.248660    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 17:54:42.252064 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.252045    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 14 17:54:42.253414 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.253398    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 14 17:54:42.253469 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.253430    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 14 17:54:42.254135 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.254122    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 14 17:54:42.254178 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.254140    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 14 17:54:42.254178 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.254146    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 14 17:54:42.254178 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.254152    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 14 17:54:42.254178 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.254161    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 14 17:54:42.254178 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.254166    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 14 17:54:42.254178 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.254174    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 14 17:54:42.254178 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.254179    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 14 17:54:42.254370 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.254186    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 14 17:54:42.254370 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.254192    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 14 17:54:42.254370 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.254200    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 14 17:54:42.254370 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.254208    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 14 17:54:42.254862 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.254853    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 14 17:54:42.254862 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.254862    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 14 17:54:42.258131 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:42.258103    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-216.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 14 17:54:42.258214 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:42.258198    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 14 17:54:42.258251 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.258221    2558 server.go:1268] "Started kubelet"
Jul 14 17:54:42.258333 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.258295    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 14 17:54:42.258395 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.258327    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 14 17:54:42.258444 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.258411    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 14 17:54:42.259164 ip-10-0-139-216 systemd[1]: Started Kubernetes Kubelet.
Jul 14 17:54:42.260025 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.259635    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 14 17:54:42.260025 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.259781    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-216.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 14 17:54:42.260725 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.260712    2558 server.go:310] "Adding debug handlers to kubelet server"
Jul 14 17:54:42.263650 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:42.262673    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-216.ec2.internal.18c2398d7deffc18  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-216.ec2.internal,UID:ip-10-0-139-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-216.ec2.internal,},FirstTimestamp:2026-07-14 17:54:42.258189336 +0000 UTC m=+0.363299310,LastTimestamp:2026-07-14 17:54:42.258189336 +0000 UTC m=+0.363299310,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-216.ec2.internal,}"
Jul 14 17:54:42.263973 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:42.263954    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 14 17:54:42.265463 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.265442    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 14 17:54:42.265463 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.265457    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 14 17:54:42.265635 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:42.265603    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-216.ec2.internal\" not found"
Jul 14 17:54:42.266338 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.266312    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 14 17:54:42.266449 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.266331    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 14 17:54:42.266690 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.266463    2558 factory.go:55] Registering systemd factory
Jul 14 17:54:42.266780 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.266670    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 14 17:54:42.266780 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.266684    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mx2tf"
Jul 14 17:54:42.266780 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.266695    2558 factory.go:223] Registration of the systemd container factory successfully
Jul 14 17:54:42.266912 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.266851    2558 reconstruct.go:97] "Volume reconstruction finished"
Jul 14 17:54:42.266912 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.266859    2558 reconciler.go:29] "Reconciler: start to sync state"
Jul 14 17:54:42.267020 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.267006    2558 factory.go:153] Registering CRI-O factory
Jul 14 17:54:42.267069 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.267023    2558 factory.go:223] Registration of the crio container factory successfully
Jul 14 17:54:42.267126 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.267073    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 14 17:54:42.267126 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.267092    2558 factory.go:103] Registering Raw factory
Jul 14 17:54:42.267126 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.267101    2558 manager.go:1196] Started watching for new ooms in manager
Jul 14 17:54:42.267828 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.267813    2558 manager.go:349] Starting recovery of all containers
Jul 14 17:54:42.276276 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:42.276241    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-216.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 14 17:54:42.276436 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:42.276391    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 14 17:54:42.276502 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.276440    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mx2tf"
Jul 14 17:54:42.280010 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.279843    2558 manager.go:354] Recovery completed
Jul 14 17:54:42.286510 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.286494    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 17:54:42.288607 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.288587    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 17:54:42.288693 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.288624    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 17:54:42.288693 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.288635    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientPID"
Jul 14 17:54:42.289322 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.289306    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 14 17:54:42.289322 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.289319    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 14 17:54:42.289430 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.289323    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 17:54:42.289430 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.289335    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 17:54:42.290013 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.289997    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 17:54:42.290078 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.290031    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 17:54:42.290078 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.290054    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientPID"
Jul 14 17:54:42.290474 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.290459    2558 policy_none.go:49] "None policy: Start"
Jul 14 17:54:42.290534 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.290491    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 14 17:54:42.290534 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.290505    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 14 17:54:42.291473 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.291463    2558 policy_none.go:47] "Start"
Jul 14 17:54:42.331148 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.331131    2558 manager.go:337] "Starting Device Plugin manager"
Jul 14 17:54:42.331255 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:42.331173    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 14 17:54:42.331255 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.331183    2558 server.go:87] "Starting device plugin registration server"
Jul 14 17:54:42.331653 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.331637    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 14 17:54:42.331755 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.331657    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 14 17:54:42.331807 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.331753    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 14 17:54:42.331857 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.331828    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 14 17:54:42.331857 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.331837    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 14 17:54:42.332352 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:42.332334    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 14 17:54:42.332439 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:42.332379    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-216.ec2.internal\" not found"
Jul 14 17:54:42.432218 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.432141    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 17:54:42.432218 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.432141    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 14 17:54:42.433426 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.433109    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 17:54:42.433426 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.433143    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 17:54:42.433426 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.433157    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientPID"
Jul 14 17:54:42.433426 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.433185    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-216.ec2.internal"
Jul 14 17:54:42.433863 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.433842    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 14 17:54:42.433960 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.433903    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 14 17:54:42.433960 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.433937    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 14 17:54:42.434061 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:42.433969    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 14 17:54:42.436272 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.436257    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 17:54:42.439189 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.439174    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-216.ec2.internal"
Jul 14 17:54:42.439264 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:42.439196    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-216.ec2.internal\": node \"ip-10-0-139-216.ec2.internal\" not found"
Jul 14 17:54:42.500076 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:42.500039    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-216.ec2.internal\" not found"
Jul 14 17:54:42.534090 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.534060    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-216.ec2.internal"]
Jul 14 17:54:42.534168 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.534147    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 17:54:42.535529 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.535507    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 17:54:42.535678 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.535543    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 17:54:42.535678 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.535577    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientPID"
Jul 14 17:54:42.537186 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.537168    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 17:54:42.537348 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.537333    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal"
Jul 14 17:54:42.537402 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.537367    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 17:54:42.538366 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.538335    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 17:54:42.538482 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.538374    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 17:54:42.538482 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.538379    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 17:54:42.538482 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.538400    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 17:54:42.538482 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.538409    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientPID"
Jul 14 17:54:42.538482 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.538384    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientPID"
Jul 14 17:54:42.539746 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.539731    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-216.ec2.internal"
Jul 14 17:54:42.539804 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.539763    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 17:54:42.540545 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.540530    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 17:54:42.540647 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.540551    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 17:54:42.540647 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.540578    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientPID"
Jul 14 17:54:42.561388 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:42.561360    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-216.ec2.internal\" not found" node="ip-10-0-139-216.ec2.internal"
Jul 14 17:54:42.565244 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:42.565223    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-216.ec2.internal\" not found" node="ip-10-0-139-216.ec2.internal"
Jul 14 17:54:42.568440 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.568419    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/282757532e8cff0af802bbd37036b971-config\") pod \"kube-apiserver-proxy-ip-10-0-139-216.ec2.internal\" (UID: \"282757532e8cff0af802bbd37036b971\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-216.ec2.internal"
Jul 14 17:54:42.568510 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.568446    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7f0331335108fd3fdc34cb5591b7fd24-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal\" (UID: \"7f0331335108fd3fdc34cb5591b7fd24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal"
Jul 14 17:54:42.568510 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.568462    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f0331335108fd3fdc34cb5591b7fd24-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal\" (UID: \"7f0331335108fd3fdc34cb5591b7fd24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal"
Jul 14 17:54:42.600426 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:42.600383    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-216.ec2.internal\" not found"
Jul 14 17:54:42.669404 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.669369    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7f0331335108fd3fdc34cb5591b7fd24-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal\" (UID: \"7f0331335108fd3fdc34cb5591b7fd24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal"
Jul 14 17:54:42.669404 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.669403    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f0331335108fd3fdc34cb5591b7fd24-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal\" (UID: \"7f0331335108fd3fdc34cb5591b7fd24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal"
Jul 14 17:54:42.669707 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.669429    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/282757532e8cff0af802bbd37036b971-config\") pod \"kube-apiserver-proxy-ip-10-0-139-216.ec2.internal\" (UID: \"282757532e8cff0af802bbd37036b971\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-216.ec2.internal"
Jul 14 17:54:42.669707 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.669468    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/282757532e8cff0af802bbd37036b971-config\") pod \"kube-apiserver-proxy-ip-10-0-139-216.ec2.internal\" (UID: \"282757532e8cff0af802bbd37036b971\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-216.ec2.internal"
Jul 14 17:54:42.669707 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.669473    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7f0331335108fd3fdc34cb5591b7fd24-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal\" (UID: \"7f0331335108fd3fdc34cb5591b7fd24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal"
Jul 14 17:54:42.669707 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.669478    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f0331335108fd3fdc34cb5591b7fd24-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal\" (UID: \"7f0331335108fd3fdc34cb5591b7fd24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal"
Jul 14 17:54:42.700961 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:42.700888    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-216.ec2.internal\" not found"
Jul 14 17:54:42.801851 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:42.801819    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-216.ec2.internal\" not found"
Jul 14 17:54:42.864052 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.864014    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal"
Jul 14 17:54:42.868710 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:42.868679    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-216.ec2.internal"
Jul 14 17:54:42.902839 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:42.902803    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-216.ec2.internal\" not found"
Jul 14 17:54:43.003493 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:43.003401    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-216.ec2.internal\" not found"
Jul 14 17:54:43.103922 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:43.103898    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-216.ec2.internal\" not found"
Jul 14 17:54:43.206233 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:43.206192    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-216.ec2.internal\" not found"
Jul 14 17:54:43.209464 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.209440    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 14 17:54:43.209670 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.209649    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 17:54:43.233764 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.233730    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 17:54:43.248536 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.248495    2558 apiserver.go:52] "Watching apiserver"
Jul 14 17:54:43.261212 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.261127    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 14 17:54:43.261508 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.261485    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-nlgmj","openshift-network-operator/iptables-alerter-bhpb8","kube-system/global-pull-secret-syncer-khkzc","kube-system/konnectivity-agent-x2hq6","openshift-dns/node-resolver-xdk6j","openshift-image-registry/node-ca-wv4j8","openshift-multus/multus-additional-cni-plugins-8gqm8","openshift-multus/multus-cqr54","openshift-multus/network-metrics-daemon-jxczq","openshift-ovn-kubernetes/ovnkube-node-dkf5f","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz","openshift-cluster-node-tuning-operator/tuned-h2h6f"]
Jul 14 17:54:43.263065 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.263038    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:54:43.263169 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:43.263133    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgmj" podUID="dd5f385d-e137-415f-80a8-0d88d45f56fb"
Jul 14 17:54:43.264104 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.264089    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bhpb8"
Jul 14 17:54:43.265467 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.265447    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:54:43.265588 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:43.265500    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khkzc" podUID="383a3b60-1510-4f9a-9075-16da8bed771e"
Jul 14 17:54:43.265588 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.265537    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 14 17:54:43.265726 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.265692    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal"
Jul 14 17:54:43.269147 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.268757    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 14 17:54:43.269147 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.268786    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 14 17:54:43.269147 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.268759    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 14 17:54:43.269377 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.269355    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x2hq6"
Jul 14 17:54:43.269440 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.269396    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xvpwk\""
Jul 14 17:54:43.271209 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.271107    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xdk6j"
Jul 14 17:54:43.271695 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.271670    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/38b4a869-6295-4e6f-b53e-dd0ec7635b3e-agent-certs\") pod \"konnectivity-agent-x2hq6\" (UID: \"38b4a869-6295-4e6f-b53e-dd0ec7635b3e\") " pod="kube-system/konnectivity-agent-x2hq6"
Jul 14 17:54:43.271804 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.271706    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/38b4a869-6295-4e6f-b53e-dd0ec7635b3e-konnectivity-ca\") pod \"konnectivity-agent-x2hq6\" (UID: \"38b4a869-6295-4e6f-b53e-dd0ec7635b3e\") " pod="kube-system/konnectivity-agent-x2hq6"
Jul 14 17:54:43.271804 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.271734    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sqqq\" (UniqueName: \"kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq\") pod \"network-check-target-nlgmj\" (UID: \"dd5f385d-e137-415f-80a8-0d88d45f56fb\") " pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:54:43.271804 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.271760    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c1aaab9-54d3-4120-85b3-054a3bb0fc84-iptables-alerter-script\") pod \"iptables-alerter-bhpb8\" (UID: \"9c1aaab9-54d3-4120-85b3-054a3bb0fc84\") " pod="openshift-network-operator/iptables-alerter-bhpb8"
Jul 14 17:54:43.271804 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.271784    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7qsv\" (UniqueName: \"kubernetes.io/projected/9c1aaab9-54d3-4120-85b3-054a3bb0fc84-kube-api-access-r7qsv\") pod \"iptables-alerter-bhpb8\" (UID: \"9c1aaab9-54d3-4120-85b3-054a3bb0fc84\") " pod="openshift-network-operator/iptables-alerter-bhpb8"
Jul 14 17:54:43.272010 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.271806    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/383a3b60-1510-4f9a-9075-16da8bed771e-kubelet-config\") pod \"global-pull-secret-syncer-khkzc\" (UID: \"383a3b60-1510-4f9a-9075-16da8bed771e\") " pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:54:43.272010 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.271898    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c1aaab9-54d3-4120-85b3-054a3bb0fc84-host-slash\") pod \"iptables-alerter-bhpb8\" (UID: \"9c1aaab9-54d3-4120-85b3-054a3bb0fc84\") " pod="openshift-network-operator/iptables-alerter-bhpb8"
Jul 14 17:54:43.272010 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.271937    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/383a3b60-1510-4f9a-9075-16da8bed771e-dbus\") pod \"global-pull-secret-syncer-khkzc\" (UID: \"383a3b60-1510-4f9a-9075-16da8bed771e\") " pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:54:43.272010 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.271981    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wv4j8"
Jul 14 17:54:43.272214 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.271980    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret\") pod \"global-pull-secret-syncer-khkzc\" (UID: \"383a3b60-1510-4f9a-9075-16da8bed771e\") " pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:54:43.273009 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.272991    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.273484 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.273443    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 14 17:54:43.273484 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.273480    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xvdbr\""
Jul 14 17:54:43.273667 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.273538    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 14 17:54:43.274059 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.274041    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-b6vtx\""
Jul 14 17:54:43.274133 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.274114    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.274217 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.274200    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 14 17:54:43.274331 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.274315    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 14 17:54:43.274465 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.274448    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 14 17:54:43.274465 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.274462    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z9tts\""
Jul 14 17:54:43.274898 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.274881    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 14 17:54:43.275494 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.275469    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 14 17:54:43.275589 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.275525    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:54:43.275722 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:43.275701    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxczq" podUID="bb8ca4ed-507d-4a63-9c35-795adcf504ad"
Jul 14 17:54:43.276958 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.276942    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.278238 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.278221    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz"
Jul 14 17:54:43.278848 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.278830    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 14 17:54:43.279924 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.279557    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.281215 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.281190    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 17:49:43 +0000 UTC" deadline="2028-01-02 20:26:32.257830535 +0000 UTC"
Jul 14 17:54:43.281215 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.281214    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12890h31m48.976619057s"
Jul 14 17:54:43.282007 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.281990    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 14 17:54:43.282337 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.282320    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 14 17:54:43.282458 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.282440    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 14 17:54:43.282879 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.282859    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 14 17:54:43.282989 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.282937    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tlrs8\""
Jul 14 17:54:43.282989 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.282969    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 14 17:54:43.283083 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.283015    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 14 17:54:43.283083 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.283042    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 14 17:54:43.283176 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.283142    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 14 17:54:43.283176 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.283153    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 14 17:54:43.283365 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.283349    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 14 17:54:43.283415 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.283352    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal"]
Jul 14 17:54:43.283415 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.283391    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 14 17:54:43.283536 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.283522    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-h4m9v\""
Jul 14 17:54:43.283655 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.283623    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tf74j\""
Jul 14 17:54:43.283722 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.283681    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 14 17:54:43.283722 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.283715    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 14 17:54:43.283827 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.283715    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-297lb\""
Jul 14 17:54:43.283827 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.283733    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n4vwf\""
Jul 14 17:54:43.283827 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.283737    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 14 17:54:43.283827 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.283627    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 14 17:54:43.284777 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.284762    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 14 17:54:43.287082 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.287067    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 17:54:43.287152 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.287140    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-216.ec2.internal"
Jul 14 17:54:43.292043 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.292015    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 17:54:43.299266 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.299245    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-216.ec2.internal"]
Jul 14 17:54:43.299367 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.299331    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 17:54:43.304156 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.304139    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 17:54:43.315163 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.315142    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g78xt"
Jul 14 17:54:43.322524 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.322489    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g78xt"
Jul 14 17:54:43.367200 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.367173    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 14 17:54:43.372209 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372188    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3089991f-8aa5-4b20-b767-8b8c8ff17c05-ovnkube-script-lib\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.372303 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372221    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-etc-modprobe-d\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.372303 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372245    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c1aaab9-54d3-4120-85b3-054a3bb0fc84-iptables-alerter-script\") pod \"iptables-alerter-bhpb8\" (UID: \"9c1aaab9-54d3-4120-85b3-054a3bb0fc84\") " pod="openshift-network-operator/iptables-alerter-bhpb8"
Jul 14 17:54:43.372303 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372269    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7qsv\" (UniqueName: \"kubernetes.io/projected/9c1aaab9-54d3-4120-85b3-054a3bb0fc84-kube-api-access-r7qsv\") pod \"iptables-alerter-bhpb8\" (UID: \"9c1aaab9-54d3-4120-85b3-054a3bb0fc84\") " pod="openshift-network-operator/iptables-alerter-bhpb8"
Jul 14 17:54:43.372450 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372292    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-host-run-k8s-cni-cncf-io\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.372450 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372330    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-host-var-lib-cni-bin\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.372450 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372354    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3089991f-8aa5-4b20-b767-8b8c8ff17c05-env-overrides\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.372450 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372380    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-system-cni-dir\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.372676 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372442    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-var-lib-openvswitch\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.372676 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372490    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.372676 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372529    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/38b4a869-6295-4e6f-b53e-dd0ec7635b3e-konnectivity-ca\") pod \"konnectivity-agent-x2hq6\" (UID: \"38b4a869-6295-4e6f-b53e-dd0ec7635b3e\") " pod="kube-system/konnectivity-agent-x2hq6"
Jul 14 17:54:43.372676 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372558    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-os-release\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.372676 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372602    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.372676 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372628    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-run-systemd\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.372935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372675    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3089991f-8aa5-4b20-b767-8b8c8ff17c05-ovn-node-metrics-cert\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.372935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372728    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/250642c0-14e2-4d92-989a-b5765f7d6ec8-etc-tuned\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.372935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372776    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-multus-conf-dir\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.372935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372840    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d634aecb-6ce7-47ef-9639-a209014a498b-multus-daemon-config\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.372935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372869    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/807562d8-2b97-4c0d-9752-aef06e1e80d8-hosts-file\") pod \"node-resolver-xdk6j\" (UID: \"807562d8-2b97-4c0d-9752-aef06e1e80d8\") " pod="openshift-dns/node-resolver-xdk6j"
Jul 14 17:54:43.372935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372886    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-etc-kubernetes\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.372935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372902    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-var-lib-kubelet\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.372935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372923    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c968316-3b97-4c10-84f0-0560cd4bcf20-host\") pod \"node-ca-wv4j8\" (UID: \"4c968316-3b97-4c10-84f0-0560cd4bcf20\") " pod="openshift-image-registry/node-ca-wv4j8"
Jul 14 17:54:43.373333 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372945    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c1aaab9-54d3-4120-85b3-054a3bb0fc84-iptables-alerter-script\") pod \"iptables-alerter-bhpb8\" (UID: \"9c1aaab9-54d3-4120-85b3-054a3bb0fc84\") " pod="openshift-network-operator/iptables-alerter-bhpb8"
Jul 14 17:54:43.373333 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.372951    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-etc-kubernetes\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.373333 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373020    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-etc-systemd\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.373333 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373055    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-run\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.373333 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373081    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-lib-modules\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.373333 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373110    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c1aaab9-54d3-4120-85b3-054a3bb0fc84-host-slash\") pod \"iptables-alerter-bhpb8\" (UID: \"9c1aaab9-54d3-4120-85b3-054a3bb0fc84\") " pod="openshift-network-operator/iptables-alerter-bhpb8"
Jul 14 17:54:43.373333 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373138    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsgmp\" (UniqueName: \"kubernetes.io/projected/4c968316-3b97-4c10-84f0-0560cd4bcf20-kube-api-access-vsgmp\") pod \"node-ca-wv4j8\" (UID: \"4c968316-3b97-4c10-84f0-0560cd4bcf20\") " pod="openshift-image-registry/node-ca-wv4j8"
Jul 14 17:54:43.373333 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373169    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-system-cni-dir\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.373333 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373140    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/38b4a869-6295-4e6f-b53e-dd0ec7635b3e-konnectivity-ca\") pod \"konnectivity-agent-x2hq6\" (UID: \"38b4a869-6295-4e6f-b53e-dd0ec7635b3e\") " pod="kube-system/konnectivity-agent-x2hq6"
Jul 14 17:54:43.373333 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373196    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-run-openvswitch\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.373333 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373221    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/250642c0-14e2-4d92-989a-b5765f7d6ec8-tmp\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.373333 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373227    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c1aaab9-54d3-4120-85b3-054a3bb0fc84-host-slash\") pod \"iptables-alerter-bhpb8\" (UID: \"9c1aaab9-54d3-4120-85b3-054a3bb0fc84\") " pod="openshift-network-operator/iptables-alerter-bhpb8"
Jul 14 17:54:43.373333 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373250    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret\") pod \"global-pull-secret-syncer-khkzc\" (UID: \"383a3b60-1510-4f9a-9075-16da8bed771e\") " pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:54:43.373333 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373276    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-os-release\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.373333 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373303    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-host-kubelet\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.373333 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373338    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-etc-openvswitch\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.374120 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:43.373356    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 17:54:43.374120 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373362    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xsmb\" (UniqueName: \"kubernetes.io/projected/807562d8-2b97-4c0d-9752-aef06e1e80d8-kube-api-access-8xsmb\") pod \"node-resolver-xdk6j\" (UID: \"807562d8-2b97-4c0d-9752-aef06e1e80d8\") " pod="openshift-dns/node-resolver-xdk6j"
Jul 14 17:54:43.374120 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373404    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-cnibin\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.374120 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:43.373437    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret podName:383a3b60-1510-4f9a-9075-16da8bed771e nodeName:}" failed. No retries permitted until 2026-07-14 17:54:43.873414676 +0000 UTC m=+1.978524641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret") pod "global-pull-secret-syncer-khkzc" (UID: "383a3b60-1510-4f9a-9075-16da8bed771e") : object "kube-system"/"original-pull-secret" not registered
Jul 14 17:54:43.374120 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373487    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.374120 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373519    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-host-run-netns\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.374120 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373545    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-host-var-lib-cni-multus\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.374120 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373591    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-host-slash\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.374120 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373618    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c7c1ca09-b30e-4be2-ba78-b0c8177bfab4-device-dir\") pod \"aws-ebs-csi-driver-node-lhnkz\" (UID: \"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz"
Jul 14 17:54:43.374120 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373642    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z258n\" (UniqueName: \"kubernetes.io/projected/250642c0-14e2-4d92-989a-b5765f7d6ec8-kube-api-access-z258n\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.374120 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373671    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/38b4a869-6295-4e6f-b53e-dd0ec7635b3e-agent-certs\") pod \"konnectivity-agent-x2hq6\" (UID: \"38b4a869-6295-4e6f-b53e-dd0ec7635b3e\") " pod="kube-system/konnectivity-agent-x2hq6"
Jul 14 17:54:43.374120 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373699    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sqqq\" (UniqueName: \"kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq\") pod \"network-check-target-nlgmj\" (UID: \"dd5f385d-e137-415f-80a8-0d88d45f56fb\") " pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:54:43.374120 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373759    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/383a3b60-1510-4f9a-9075-16da8bed771e-kubelet-config\") pod \"global-pull-secret-syncer-khkzc\" (UID: \"383a3b60-1510-4f9a-9075-16da8bed771e\") " pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:54:43.374120 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373786    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxvrm\" (UniqueName: \"kubernetes.io/projected/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-kube-api-access-qxvrm\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.374120 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373812    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-multus-cni-dir\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.374120 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373835    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-multus-socket-dir-parent\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.374935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373850    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/383a3b60-1510-4f9a-9075-16da8bed771e-kubelet-config\") pod \"global-pull-secret-syncer-khkzc\" (UID: \"383a3b60-1510-4f9a-9075-16da8bed771e\") " pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:54:43.374935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373873    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hstl5\" (UniqueName: \"kubernetes.io/projected/d634aecb-6ce7-47ef-9639-a209014a498b-kube-api-access-hstl5\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.374935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373924    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-systemd-units\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.374935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373962    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-log-socket\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.374935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.373997    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr6rv\" (UniqueName: \"kubernetes.io/projected/3089991f-8aa5-4b20-b767-8b8c8ff17c05-kube-api-access-lr6rv\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.374935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374033    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-etc-sysctl-conf\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.374935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374062    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/383a3b60-1510-4f9a-9075-16da8bed771e-dbus\") pod \"global-pull-secret-syncer-khkzc\" (UID: \"383a3b60-1510-4f9a-9075-16da8bed771e\") " pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:54:43.374935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374081    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 14 17:54:43.374935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374102    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs\") pod \"network-metrics-daemon-jxczq\" (UID: \"bb8ca4ed-507d-4a63-9c35-795adcf504ad\") " pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:54:43.374935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374127    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-host-cni-netd\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.374935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374152    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c7c1ca09-b30e-4be2-ba78-b0c8177bfab4-sys-fs\") pod \"aws-ebs-csi-driver-node-lhnkz\" (UID: \"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz"
Jul 14 17:54:43.374935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374178    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/807562d8-2b97-4c0d-9752-aef06e1e80d8-tmp-dir\") pod \"node-resolver-xdk6j\" (UID: \"807562d8-2b97-4c0d-9752-aef06e1e80d8\") " pod="openshift-dns/node-resolver-xdk6j"
Jul 14 17:54:43.374935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374201    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-host\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.374935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374206    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/383a3b60-1510-4f9a-9075-16da8bed771e-dbus\") pod \"global-pull-secret-syncer-khkzc\" (UID: \"383a3b60-1510-4f9a-9075-16da8bed771e\") " pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:54:43.374935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374228    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-run-ovn\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.374935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374254    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-etc-sysconfig\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.374935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374282    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-cni-binary-copy\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.375565 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374307    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58mzb\" (UniqueName: \"kubernetes.io/projected/bb8ca4ed-507d-4a63-9c35-795adcf504ad-kube-api-access-58mzb\") pod \"network-metrics-daemon-jxczq\" (UID: \"bb8ca4ed-507d-4a63-9c35-795adcf504ad\") " pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:54:43.375565 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374349    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-host-run-netns\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.375565 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374398    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-node-log\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.375565 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374430    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-host-cni-bin\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.375565 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374455    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c7c1ca09-b30e-4be2-ba78-b0c8177bfab4-socket-dir\") pod \"aws-ebs-csi-driver-node-lhnkz\" (UID: \"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz"
Jul 14 17:54:43.375565 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374482    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-sys\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.375565 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374508    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-host-var-lib-kubelet\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.375565 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374537    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-host-run-multus-certs\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.375565 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374591    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c7c1ca09-b30e-4be2-ba78-b0c8177bfab4-etc-selinux\") pod \"aws-ebs-csi-driver-node-lhnkz\" (UID: \"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz"
Jul 14 17:54:43.375565 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374634    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-etc-sysctl-d\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.375565 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374682    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.375565 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374724    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-cnibin\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.375565 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374754    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d634aecb-6ce7-47ef-9639-a209014a498b-cni-binary-copy\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.375565 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374778    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-hostroot\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.375565 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374802    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c7c1ca09-b30e-4be2-ba78-b0c8177bfab4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lhnkz\" (UID: \"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz"
Jul 14 17:54:43.375565 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374833    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c7c1ca09-b30e-4be2-ba78-b0c8177bfab4-registration-dir\") pod \"aws-ebs-csi-driver-node-lhnkz\" (UID: \"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz"
Jul 14 17:54:43.376182 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374860    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhrst\" (UniqueName: \"kubernetes.io/projected/c7c1ca09-b30e-4be2-ba78-b0c8177bfab4-kube-api-access-bhrst\") pod \"aws-ebs-csi-driver-node-lhnkz\" (UID: \"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz"
Jul 14 17:54:43.376182 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374943    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-host-run-ovn-kubernetes\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.376182 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.374980    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4c968316-3b97-4c10-84f0-0560cd4bcf20-serviceca\") pod \"node-ca-wv4j8\" (UID: \"4c968316-3b97-4c10-84f0-0560cd4bcf20\") " pod="openshift-image-registry/node-ca-wv4j8"
Jul 14 17:54:43.376182 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.375005    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3089991f-8aa5-4b20-b767-8b8c8ff17c05-ovnkube-config\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.378165 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.378145    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/38b4a869-6295-4e6f-b53e-dd0ec7635b3e-agent-certs\") pod \"konnectivity-agent-x2hq6\" (UID: \"38b4a869-6295-4e6f-b53e-dd0ec7635b3e\") " pod="kube-system/konnectivity-agent-x2hq6"
Jul 14 17:54:43.381504 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.381480    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7qsv\" (UniqueName: \"kubernetes.io/projected/9c1aaab9-54d3-4120-85b3-054a3bb0fc84-kube-api-access-r7qsv\") pod \"iptables-alerter-bhpb8\" (UID: \"9c1aaab9-54d3-4120-85b3-054a3bb0fc84\") " pod="openshift-network-operator/iptables-alerter-bhpb8"
Jul 14 17:54:43.381599 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:43.381576    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 17:54:43.381599 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:43.381596    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 17:54:43.381696 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:43.381606    2558 projected.go:196] Error preparing data for projected volume kube-api-access-8sqqq for pod openshift-network-diagnostics/network-check-target-nlgmj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 17:54:43.381696 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:43.381681    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq podName:dd5f385d-e137-415f-80a8-0d88d45f56fb nodeName:}" failed. No retries permitted until 2026-07-14 17:54:43.881666376 +0000 UTC m=+1.986776370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8sqqq" (UniqueName: "kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq") pod "network-check-target-nlgmj" (UID: "dd5f385d-e137-415f-80a8-0d88d45f56fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 17:54:43.465248 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:43.465209    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod282757532e8cff0af802bbd37036b971.slice/crio-b80135087c99697aeba06f13ba9b60ec5f95258bcbacdc361ec186c60986ae2a WatchSource:0}: Error finding container b80135087c99697aeba06f13ba9b60ec5f95258bcbacdc361ec186c60986ae2a: Status 404 returned error can't find the container with id b80135087c99697aeba06f13ba9b60ec5f95258bcbacdc361ec186c60986ae2a
Jul 14 17:54:43.471282 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.471260    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 17:54:43.476221 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476199    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-systemd-units\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.476324 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476227    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-log-socket\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.476324 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476246    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr6rv\" (UniqueName: \"kubernetes.io/projected/3089991f-8aa5-4b20-b767-8b8c8ff17c05-kube-api-access-lr6rv\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.476324 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476265    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-etc-sysctl-conf\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.476324 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476284    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs\") pod \"network-metrics-daemon-jxczq\" (UID: \"bb8ca4ed-507d-4a63-9c35-795adcf504ad\") " pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:54:43.476324 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476316    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-host-cni-netd\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.476662 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476325    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-systemd-units\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.476662 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476348    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c7c1ca09-b30e-4be2-ba78-b0c8177bfab4-sys-fs\") pod \"aws-ebs-csi-driver-node-lhnkz\" (UID: \"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz"
Jul 14 17:54:43.476662 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476374    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/807562d8-2b97-4c0d-9752-aef06e1e80d8-tmp-dir\") pod \"node-resolver-xdk6j\" (UID: \"807562d8-2b97-4c0d-9752-aef06e1e80d8\") " pod="openshift-dns/node-resolver-xdk6j"
Jul 14 17:54:43.476662 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476381    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-host-cni-netd\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.476662 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476396    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-host\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.476662 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476324    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-log-socket\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.476662 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476444    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-run-ovn\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.476662 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476449    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-etc-sysctl-conf\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.476662 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476454    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c7c1ca09-b30e-4be2-ba78-b0c8177bfab4-sys-fs\") pod \"aws-ebs-csi-driver-node-lhnkz\" (UID: \"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz"
Jul 14 17:54:43.476662 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:43.476454    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 17:54:43.476662 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476482    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-etc-sysconfig\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.476662 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476493    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-run-ovn\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.476662 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476518    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-cni-binary-copy\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.476662 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:43.476538    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs podName:bb8ca4ed-507d-4a63-9c35-795adcf504ad nodeName:}" failed. No retries permitted until 2026-07-14 17:54:43.976517203 +0000 UTC m=+2.081627167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs") pod "network-metrics-daemon-jxczq" (UID: "bb8ca4ed-507d-4a63-9c35-795adcf504ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 17:54:43.476662 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476470    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-host\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.476662 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476602    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58mzb\" (UniqueName: \"kubernetes.io/projected/bb8ca4ed-507d-4a63-9c35-795adcf504ad-kube-api-access-58mzb\") pod \"network-metrics-daemon-jxczq\" (UID: \"bb8ca4ed-507d-4a63-9c35-795adcf504ad\") " pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:54:43.476662 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476604    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-etc-sysconfig\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.477473 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476719    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-host-run-netns\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.477473 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476733    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/807562d8-2b97-4c0d-9752-aef06e1e80d8-tmp-dir\") pod \"node-resolver-xdk6j\" (UID: \"807562d8-2b97-4c0d-9752-aef06e1e80d8\") " pod="openshift-dns/node-resolver-xdk6j"
Jul 14 17:54:43.477473 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476748    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-node-log\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.477473 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476775    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-host-cni-bin\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.477473 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476800    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c7c1ca09-b30e-4be2-ba78-b0c8177bfab4-socket-dir\") pod \"aws-ebs-csi-driver-node-lhnkz\" (UID: \"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz"
Jul 14 17:54:43.477473 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476819    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-host-run-netns\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.477473 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476828    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-node-log\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.477473 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476860    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-host-cni-bin\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.477473 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476895    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-sys\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.477473 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476920    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-host-var-lib-kubelet\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.477473 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476928    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c7c1ca09-b30e-4be2-ba78-b0c8177bfab4-socket-dir\") pod \"aws-ebs-csi-driver-node-lhnkz\" (UID: \"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz"
Jul 14 17:54:43.477473 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476941    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-host-run-multus-certs\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.477473 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476960    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-sys\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.477473 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476967    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-host-var-lib-kubelet\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.477473 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.476997    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c7c1ca09-b30e-4be2-ba78-b0c8177bfab4-etc-selinux\") pod \"aws-ebs-csi-driver-node-lhnkz\" (UID: \"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz"
Jul 14 17:54:43.477473 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477004    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-host-run-multus-certs\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.477473 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477023    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-etc-sysctl-d\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.477473 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477027    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-cni-binary-copy\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.478332 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477061    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.478332 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477088    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c7c1ca09-b30e-4be2-ba78-b0c8177bfab4-etc-selinux\") pod \"aws-ebs-csi-driver-node-lhnkz\" (UID: \"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz"
Jul 14 17:54:43.478332 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477104    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-cnibin\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.478332 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477121    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d634aecb-6ce7-47ef-9639-a209014a498b-cni-binary-copy\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.478332 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477143    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-hostroot\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.478332 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477123    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-etc-sysctl-d\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.478332 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477160    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c7c1ca09-b30e-4be2-ba78-b0c8177bfab4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lhnkz\" (UID: \"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz"
Jul 14 17:54:43.478332 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477150    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-cnibin\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.478332 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477176    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c7c1ca09-b30e-4be2-ba78-b0c8177bfab4-registration-dir\") pod \"aws-ebs-csi-driver-node-lhnkz\" (UID: \"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz"
Jul 14 17:54:43.478332 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477194    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhrst\" (UniqueName: \"kubernetes.io/projected/c7c1ca09-b30e-4be2-ba78-b0c8177bfab4-kube-api-access-bhrst\") pod \"aws-ebs-csi-driver-node-lhnkz\" (UID: \"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz"
Jul 14 17:54:43.478332 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477205    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-hostroot\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.478332 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477219    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-host-run-ovn-kubernetes\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.478332 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477244    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c7c1ca09-b30e-4be2-ba78-b0c8177bfab4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lhnkz\" (UID: \"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz"
Jul 14 17:54:43.478332 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477253    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c7c1ca09-b30e-4be2-ba78-b0c8177bfab4-registration-dir\") pod \"aws-ebs-csi-driver-node-lhnkz\" (UID: \"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz"
Jul 14 17:54:43.478332 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477248    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4c968316-3b97-4c10-84f0-0560cd4bcf20-serviceca\") pod \"node-ca-wv4j8\" (UID: \"4c968316-3b97-4c10-84f0-0560cd4bcf20\") " pod="openshift-image-registry/node-ca-wv4j8"
Jul 14 17:54:43.478332 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477288    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3089991f-8aa5-4b20-b767-8b8c8ff17c05-ovnkube-config\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.478332 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477316    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3089991f-8aa5-4b20-b767-8b8c8ff17c05-ovnkube-script-lib\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.479216 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477338    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-host-run-ovn-kubernetes\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.479216 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477342    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-etc-modprobe-d\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.479216 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477392    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-host-run-k8s-cni-cncf-io\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.479216 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477417    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-host-var-lib-cni-bin\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.479216 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477419    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-etc-modprobe-d\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.479216 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477495    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-host-var-lib-cni-bin\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.479216 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477477    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-host-run-k8s-cni-cncf-io\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.479216 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477615    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3089991f-8aa5-4b20-b767-8b8c8ff17c05-env-overrides\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.479216 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477690    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-system-cni-dir\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.479216 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477723    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-var-lib-openvswitch\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.479216 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477750    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.479216 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477793    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4c968316-3b97-4c10-84f0-0560cd4bcf20-serviceca\") pod \"node-ca-wv4j8\" (UID: \"4c968316-3b97-4c10-84f0-0560cd4bcf20\") " pod="openshift-image-registry/node-ca-wv4j8"
Jul 14 17:54:43.479216 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477853    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d634aecb-6ce7-47ef-9639-a209014a498b-cni-binary-copy\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.479216 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477876    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-system-cni-dir\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.479216 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477841    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-os-release\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.479216 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477895    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.479216 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477934    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.480090 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477972    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-run-systemd\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.480090 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.478014    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-var-lib-openvswitch\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.480090 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.477940    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-os-release\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.480090 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.478010    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3089991f-8aa5-4b20-b767-8b8c8ff17c05-ovn-node-metrics-cert\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.480090 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.478621    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3089991f-8aa5-4b20-b767-8b8c8ff17c05-ovnkube-script-lib\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.480090 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.478880    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3089991f-8aa5-4b20-b767-8b8c8ff17c05-ovnkube-config\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.480090 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.478935    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-run-systemd\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.480090 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.478936    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/250642c0-14e2-4d92-989a-b5765f7d6ec8-etc-tuned\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.480090 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.478991    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.480090 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.479146    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-multus-conf-dir\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.480090 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.479193    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d634aecb-6ce7-47ef-9639-a209014a498b-multus-daemon-config\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.480090 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.479218    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3089991f-8aa5-4b20-b767-8b8c8ff17c05-env-overrides\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.480090 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.479344    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/807562d8-2b97-4c0d-9752-aef06e1e80d8-hosts-file\") pod \"node-resolver-xdk6j\" (UID: \"807562d8-2b97-4c0d-9752-aef06e1e80d8\") " pod="openshift-dns/node-resolver-xdk6j"
Jul 14 17:54:43.480090 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.479398    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-etc-kubernetes\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.480090 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.479434    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-var-lib-kubelet\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.480090 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.479497    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c968316-3b97-4c10-84f0-0560cd4bcf20-host\") pod \"node-ca-wv4j8\" (UID: \"4c968316-3b97-4c10-84f0-0560cd4bcf20\") " pod="openshift-image-registry/node-ca-wv4j8"
Jul 14 17:54:43.480090 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.479534    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-etc-kubernetes\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.480090 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.479571    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-etc-systemd\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.480932 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.479627    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-run\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.480932 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.479659    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-lib-modules\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.480932 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.479896    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsgmp\" (UniqueName: \"kubernetes.io/projected/4c968316-3b97-4c10-84f0-0560cd4bcf20-kube-api-access-vsgmp\") pod \"node-ca-wv4j8\" (UID: \"4c968316-3b97-4c10-84f0-0560cd4bcf20\") " pod="openshift-image-registry/node-ca-wv4j8"
Jul 14 17:54:43.480932 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.479928    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-system-cni-dir\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.480932 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.479966    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-run-openvswitch\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.480932 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480017    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/250642c0-14e2-4d92-989a-b5765f7d6ec8-tmp\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.480932 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480066    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-etc-kubernetes\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.480932 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480073    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-os-release\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.480932 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480150    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-os-release\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.480932 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480206    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/807562d8-2b97-4c0d-9752-aef06e1e80d8-hosts-file\") pod \"node-resolver-xdk6j\" (UID: \"807562d8-2b97-4c0d-9752-aef06e1e80d8\") " pod="openshift-dns/node-resolver-xdk6j"
Jul 14 17:54:43.480932 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480220    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-host-kubelet\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.480932 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480287    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-etc-kubernetes\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.480932 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480335    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-multus-conf-dir\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.480932 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480376    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-etc-systemd\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.480932 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480434    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-var-lib-kubelet\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.480932 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480451    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-run\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.480932 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480149    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-host-kubelet\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.480932 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480494    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c968316-3b97-4c10-84f0-0560cd4bcf20-host\") pod \"node-ca-wv4j8\" (UID: \"4c968316-3b97-4c10-84f0-0560cd4bcf20\") " pod="openshift-image-registry/node-ca-wv4j8"
Jul 14 17:54:43.481834 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480510    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-etc-openvswitch\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.481834 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480541    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xsmb\" (UniqueName: \"kubernetes.io/projected/807562d8-2b97-4c0d-9752-aef06e1e80d8-kube-api-access-8xsmb\") pod \"node-resolver-xdk6j\" (UID: \"807562d8-2b97-4c0d-9752-aef06e1e80d8\") " pod="openshift-dns/node-resolver-xdk6j"
Jul 14 17:54:43.481834 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480544    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-system-cni-dir\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.481834 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480576    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-cnibin\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.481834 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480596    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/250642c0-14e2-4d92-989a-b5765f7d6ec8-lib-modules\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.481834 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480613    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-etc-openvswitch\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.481834 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480638    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.481834 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480687    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-host-run-netns\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.481834 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480724    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-host-var-lib-cni-multus\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.481834 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480758    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-host-slash\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.481834 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480792    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.481834 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480869    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c7c1ca09-b30e-4be2-ba78-b0c8177bfab4-device-dir\") pod \"aws-ebs-csi-driver-node-lhnkz\" (UID: \"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz"
Jul 14 17:54:43.481834 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480917    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-host-run-netns\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.481834 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480793    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c7c1ca09-b30e-4be2-ba78-b0c8177bfab4-device-dir\") pod \"aws-ebs-csi-driver-node-lhnkz\" (UID: \"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz"
Jul 14 17:54:43.481834 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480960    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-cnibin\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.481834 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.480978    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z258n\" (UniqueName: \"kubernetes.io/projected/250642c0-14e2-4d92-989a-b5765f7d6ec8-kube-api-access-z258n\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.481834 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.481046    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxvrm\" (UniqueName: \"kubernetes.io/projected/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-kube-api-access-qxvrm\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.482657 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.481084    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-multus-cni-dir\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.482657 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.481114    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-multus-socket-dir-parent\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.482657 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.481151    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hstl5\" (UniqueName: \"kubernetes.io/projected/d634aecb-6ce7-47ef-9639-a209014a498b-kube-api-access-hstl5\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.482657 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.481440    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d634aecb-6ce7-47ef-9639-a209014a498b-multus-daemon-config\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.482657 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.481525    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-host-var-lib-cni-multus\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.482657 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.481584    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-host-slash\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.482657 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.481660    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3089991f-8aa5-4b20-b767-8b8c8ff17c05-run-openvswitch\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.482657 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.481841    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.482657 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.482011    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-multus-cni-dir\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.482657 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.482029    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/250642c0-14e2-4d92-989a-b5765f7d6ec8-etc-tuned\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.482657 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.482206    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d634aecb-6ce7-47ef-9639-a209014a498b-multus-socket-dir-parent\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.482657 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.482226    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3089991f-8aa5-4b20-b767-8b8c8ff17c05-ovn-node-metrics-cert\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.483483 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.483450    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/250642c0-14e2-4d92-989a-b5765f7d6ec8-tmp\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.486754 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.486733    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhrst\" (UniqueName: \"kubernetes.io/projected/c7c1ca09-b30e-4be2-ba78-b0c8177bfab4-kube-api-access-bhrst\") pod \"aws-ebs-csi-driver-node-lhnkz\" (UID: \"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz"
Jul 14 17:54:43.486842 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.486814    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr6rv\" (UniqueName: \"kubernetes.io/projected/3089991f-8aa5-4b20-b767-8b8c8ff17c05-kube-api-access-lr6rv\") pod \"ovnkube-node-dkf5f\" (UID: \"3089991f-8aa5-4b20-b767-8b8c8ff17c05\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.486986 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.486968    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58mzb\" (UniqueName: \"kubernetes.io/projected/bb8ca4ed-507d-4a63-9c35-795adcf504ad-kube-api-access-58mzb\") pod \"network-metrics-daemon-jxczq\" (UID: \"bb8ca4ed-507d-4a63-9c35-795adcf504ad\") " pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:54:43.494092 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.494064    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hstl5\" (UniqueName: \"kubernetes.io/projected/d634aecb-6ce7-47ef-9639-a209014a498b-kube-api-access-hstl5\") pod \"multus-cqr54\" (UID: \"d634aecb-6ce7-47ef-9639-a209014a498b\") " pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.494671 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.494628    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z258n\" (UniqueName: \"kubernetes.io/projected/250642c0-14e2-4d92-989a-b5765f7d6ec8-kube-api-access-z258n\") pod \"tuned-h2h6f\" (UID: \"250642c0-14e2-4d92-989a-b5765f7d6ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.495241 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.495212    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsgmp\" (UniqueName: \"kubernetes.io/projected/4c968316-3b97-4c10-84f0-0560cd4bcf20-kube-api-access-vsgmp\") pod \"node-ca-wv4j8\" (UID: \"4c968316-3b97-4c10-84f0-0560cd4bcf20\") " pod="openshift-image-registry/node-ca-wv4j8"
Jul 14 17:54:43.496468 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.496450    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xsmb\" (UniqueName: \"kubernetes.io/projected/807562d8-2b97-4c0d-9752-aef06e1e80d8-kube-api-access-8xsmb\") pod \"node-resolver-xdk6j\" (UID: \"807562d8-2b97-4c0d-9752-aef06e1e80d8\") " pod="openshift-dns/node-resolver-xdk6j"
Jul 14 17:54:43.497041 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.497018    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxvrm\" (UniqueName: \"kubernetes.io/projected/1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81-kube-api-access-qxvrm\") pod \"multus-additional-cni-plugins-8gqm8\" (UID: \"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81\") " pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.536760 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:43.536729    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f0331335108fd3fdc34cb5591b7fd24.slice/crio-e59e791814eb474fc619286ec4528ffc3e874dcd5bfade0d40476700e5045dad WatchSource:0}: Error finding container e59e791814eb474fc619286ec4528ffc3e874dcd5bfade0d40476700e5045dad: Status 404 returned error can't find the container with id e59e791814eb474fc619286ec4528ffc3e874dcd5bfade0d40476700e5045dad
Jul 14 17:54:43.593837 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.593797    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bhpb8"
Jul 14 17:54:43.598321 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.598298    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x2hq6"
Jul 14 17:54:43.602374 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:43.602340    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c1aaab9_54d3_4120_85b3_054a3bb0fc84.slice/crio-a2f1033a0b328664f69869bc4ce60cd681c33e1ad5b0cc6fee31499c12a2cab6 WatchSource:0}: Error finding container a2f1033a0b328664f69869bc4ce60cd681c33e1ad5b0cc6fee31499c12a2cab6: Status 404 returned error can't find the container with id a2f1033a0b328664f69869bc4ce60cd681c33e1ad5b0cc6fee31499c12a2cab6
Jul 14 17:54:43.608601 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:43.608575    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38b4a869_6295_4e6f_b53e_dd0ec7635b3e.slice/crio-652d4e2afbe464e3354667e38bf912a7f20b28b4c9ff1a51fb0974a9a0dbdd56 WatchSource:0}: Error finding container 652d4e2afbe464e3354667e38bf912a7f20b28b4c9ff1a51fb0974a9a0dbdd56: Status 404 returned error can't find the container with id 652d4e2afbe464e3354667e38bf912a7f20b28b4c9ff1a51fb0974a9a0dbdd56
Jul 14 17:54:43.613943 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.613923    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xdk6j"
Jul 14 17:54:43.633338 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.633307    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wv4j8"
Jul 14 17:54:43.642031 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:43.642007    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c968316_3b97_4c10_84f0_0560cd4bcf20.slice/crio-792df906c3306ffe59cabb5cea537b11848e0c7d7328838b8c25c3837c3118c1 WatchSource:0}: Error finding container 792df906c3306ffe59cabb5cea537b11848e0c7d7328838b8c25c3837c3118c1: Status 404 returned error can't find the container with id 792df906c3306ffe59cabb5cea537b11848e0c7d7328838b8c25c3837c3118c1
Jul 14 17:54:43.655698 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.655676    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8gqm8"
Jul 14 17:54:43.662730 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.662698    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cqr54"
Jul 14 17:54:43.663441 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:43.663419    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1c8eb9_ca38_4ffe_ab2d_8cd7899b6d81.slice/crio-e515aeaf57fcf2669988ca706ee35cf064490aa4bafdb07558ce3597eb980c98 WatchSource:0}: Error finding container e515aeaf57fcf2669988ca706ee35cf064490aa4bafdb07558ce3597eb980c98: Status 404 returned error can't find the container with id e515aeaf57fcf2669988ca706ee35cf064490aa4bafdb07558ce3597eb980c98
Jul 14 17:54:43.670353 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:43.670330    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd634aecb_6ce7_47ef_9639_a209014a498b.slice/crio-672ca5cd954752bfdd091c5229a1981d4199c9b0b7c2c2e0e3034080b25909df WatchSource:0}: Error finding container 672ca5cd954752bfdd091c5229a1981d4199c9b0b7c2c2e0e3034080b25909df: Status 404 returned error can't find the container with id 672ca5cd954752bfdd091c5229a1981d4199c9b0b7c2c2e0e3034080b25909df
Jul 14 17:54:43.682822 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.682804    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:54:43.690172 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:43.690149    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3089991f_8aa5_4b20_b767_8b8c8ff17c05.slice/crio-0c16640a1177fd48990de3fb9d69714b9980d00746958638c97ac2c79300d8a8 WatchSource:0}: Error finding container 0c16640a1177fd48990de3fb9d69714b9980d00746958638c97ac2c79300d8a8: Status 404 returned error can't find the container with id 0c16640a1177fd48990de3fb9d69714b9980d00746958638c97ac2c79300d8a8
Jul 14 17:54:43.709340 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.709318    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz"
Jul 14 17:54:43.714537 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.714516    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h2h6f"
Jul 14 17:54:43.718039 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:43.718013    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7c1ca09_b30e_4be2_ba78_b0c8177bfab4.slice/crio-6f0f7201b8f5b8c16ce785f5f1b525a45b47d3789b02d15a1dc400dba94b9427 WatchSource:0}: Error finding container 6f0f7201b8f5b8c16ce785f5f1b525a45b47d3789b02d15a1dc400dba94b9427: Status 404 returned error can't find the container with id 6f0f7201b8f5b8c16ce785f5f1b525a45b47d3789b02d15a1dc400dba94b9427
Jul 14 17:54:43.722837 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:54:43.722814    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod250642c0_14e2_4d92_989a_b5765f7d6ec8.slice/crio-6c29f7e6755fe8accd4f9630264e4dc75d30c6b6d1970abd887c52d193b64efe WatchSource:0}: Error finding container 6c29f7e6755fe8accd4f9630264e4dc75d30c6b6d1970abd887c52d193b64efe: Status 404 returned error can't find the container with id 6c29f7e6755fe8accd4f9630264e4dc75d30c6b6d1970abd887c52d193b64efe
Jul 14 17:54:43.767145 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.767116    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 17:54:43.883033 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.882997    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret\") pod \"global-pull-secret-syncer-khkzc\" (UID: \"383a3b60-1510-4f9a-9075-16da8bed771e\") " pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:54:43.883033 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.883034    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sqqq\" (UniqueName: \"kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq\") pod \"network-check-target-nlgmj\" (UID: \"dd5f385d-e137-415f-80a8-0d88d45f56fb\") " pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:54:43.883304 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:43.883149    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 17:54:43.883304 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:43.883164    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 17:54:43.883304 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:43.883168    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 17:54:43.883304 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:43.883175    2558 projected.go:196] Error preparing data for projected volume kube-api-access-8sqqq for pod openshift-network-diagnostics/network-check-target-nlgmj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 17:54:43.883304 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:43.883235    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq podName:dd5f385d-e137-415f-80a8-0d88d45f56fb nodeName:}" failed. No retries permitted until 2026-07-14 17:54:44.88322127 +0000 UTC m=+2.988331234 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8sqqq" (UniqueName: "kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq") pod "network-check-target-nlgmj" (UID: "dd5f385d-e137-415f-80a8-0d88d45f56fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 17:54:43.883304 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:43.883262    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret podName:383a3b60-1510-4f9a-9075-16da8bed771e nodeName:}" failed. No retries permitted until 2026-07-14 17:54:44.883243521 +0000 UTC m=+2.988353485 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret") pod "global-pull-secret-syncer-khkzc" (UID: "383a3b60-1510-4f9a-9075-16da8bed771e") : object "kube-system"/"original-pull-secret" not registered
Jul 14 17:54:43.983438 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:43.983408    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs\") pod \"network-metrics-daemon-jxczq\" (UID: \"bb8ca4ed-507d-4a63-9c35-795adcf504ad\") " pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:54:43.983649 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:43.983596    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 17:54:43.983704 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:43.983667    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs podName:bb8ca4ed-507d-4a63-9c35-795adcf504ad nodeName:}" failed. No retries permitted until 2026-07-14 17:54:44.983650509 +0000 UTC m=+3.088760478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs") pod "network-metrics-daemon-jxczq" (UID: "bb8ca4ed-507d-4a63-9c35-795adcf504ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 17:54:44.135995 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:44.135721    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 17:54:44.326067 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:44.325968    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 17:49:44 +0000 UTC" deadline="2028-04-02 20:21:00.250978214 +0000 UTC"
Jul 14 17:54:44.326067 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:44.326002    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15074h26m15.924981255s"
Jul 14 17:54:44.440285 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:44.440199    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:54:44.440464 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:44.440341    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khkzc" podUID="383a3b60-1510-4f9a-9075-16da8bed771e"
Jul 14 17:54:44.452163 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:44.452096    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xdk6j" event={"ID":"807562d8-2b97-4c0d-9752-aef06e1e80d8","Type":"ContainerStarted","Data":"40c69df8caf041c70985b22ced37442352217067a5e5201459afd256ddd539ff"}
Jul 14 17:54:44.454051 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:44.454019    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x2hq6" event={"ID":"38b4a869-6295-4e6f-b53e-dd0ec7635b3e","Type":"ContainerStarted","Data":"652d4e2afbe464e3354667e38bf912a7f20b28b4c9ff1a51fb0974a9a0dbdd56"}
Jul 14 17:54:44.459763 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:44.459731    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h2h6f" event={"ID":"250642c0-14e2-4d92-989a-b5765f7d6ec8","Type":"ContainerStarted","Data":"6c29f7e6755fe8accd4f9630264e4dc75d30c6b6d1970abd887c52d193b64efe"}
Jul 14 17:54:44.485163 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:44.485122    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz" event={"ID":"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4","Type":"ContainerStarted","Data":"6f0f7201b8f5b8c16ce785f5f1b525a45b47d3789b02d15a1dc400dba94b9427"}
Jul 14 17:54:44.494171 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:44.494133    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gqm8" event={"ID":"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81","Type":"ContainerStarted","Data":"e515aeaf57fcf2669988ca706ee35cf064490aa4bafdb07558ce3597eb980c98"}
Jul 14 17:54:44.504907 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:44.504856    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wv4j8" event={"ID":"4c968316-3b97-4c10-84f0-0560cd4bcf20","Type":"ContainerStarted","Data":"792df906c3306ffe59cabb5cea537b11848e0c7d7328838b8c25c3837c3118c1"}
Jul 14 17:54:44.511709 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:44.511672    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bhpb8" event={"ID":"9c1aaab9-54d3-4120-85b3-054a3bb0fc84","Type":"ContainerStarted","Data":"a2f1033a0b328664f69869bc4ce60cd681c33e1ad5b0cc6fee31499c12a2cab6"}
Jul 14 17:54:44.516207 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:44.516169    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal" event={"ID":"7f0331335108fd3fdc34cb5591b7fd24","Type":"ContainerStarted","Data":"e59e791814eb474fc619286ec4528ffc3e874dcd5bfade0d40476700e5045dad"}
Jul 14 17:54:44.519824 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:44.519735    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-216.ec2.internal" event={"ID":"282757532e8cff0af802bbd37036b971","Type":"ContainerStarted","Data":"b80135087c99697aeba06f13ba9b60ec5f95258bcbacdc361ec186c60986ae2a"}
Jul 14 17:54:44.526104 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:44.525961    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f" event={"ID":"3089991f-8aa5-4b20-b767-8b8c8ff17c05","Type":"ContainerStarted","Data":"0c16640a1177fd48990de3fb9d69714b9980d00746958638c97ac2c79300d8a8"}
Jul 14 17:54:44.533196 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:44.533142    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cqr54" event={"ID":"d634aecb-6ce7-47ef-9639-a209014a498b","Type":"ContainerStarted","Data":"672ca5cd954752bfdd091c5229a1981d4199c9b0b7c2c2e0e3034080b25909df"}
Jul 14 17:54:44.892316 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:44.892270    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret\") pod \"global-pull-secret-syncer-khkzc\" (UID: \"383a3b60-1510-4f9a-9075-16da8bed771e\") " pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:54:44.892530 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:44.892329    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sqqq\" (UniqueName: \"kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq\") pod \"network-check-target-nlgmj\" (UID: \"dd5f385d-e137-415f-80a8-0d88d45f56fb\") " pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:54:44.892530 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:44.892516    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 17:54:44.892680 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:44.892537    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 17:54:44.892680 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:44.892551    2558 projected.go:196] Error preparing data for projected volume kube-api-access-8sqqq for pod openshift-network-diagnostics/network-check-target-nlgmj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 17:54:44.892680 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:44.892632    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq podName:dd5f385d-e137-415f-80a8-0d88d45f56fb nodeName:}" failed. No retries permitted until 2026-07-14 17:54:46.892592242 +0000 UTC m=+4.997702212 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8sqqq" (UniqueName: "kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq") pod "network-check-target-nlgmj" (UID: "dd5f385d-e137-415f-80a8-0d88d45f56fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 17:54:44.893106 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:44.893070    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 17:54:44.893186 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:44.893133    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret podName:383a3b60-1510-4f9a-9075-16da8bed771e nodeName:}" failed. No retries permitted until 2026-07-14 17:54:46.893116385 +0000 UTC m=+4.998226353 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret") pod "global-pull-secret-syncer-khkzc" (UID: "383a3b60-1510-4f9a-9075-16da8bed771e") : object "kube-system"/"original-pull-secret" not registered
Jul 14 17:54:44.993690 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:44.993646    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs\") pod \"network-metrics-daemon-jxczq\" (UID: \"bb8ca4ed-507d-4a63-9c35-795adcf504ad\") " pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:54:44.993874 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:44.993841    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 17:54:44.993933 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:44.993908    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs podName:bb8ca4ed-507d-4a63-9c35-795adcf504ad nodeName:}" failed. No retries permitted until 2026-07-14 17:54:46.993888923 +0000 UTC m=+5.098998891 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs") pod "network-metrics-daemon-jxczq" (UID: "bb8ca4ed-507d-4a63-9c35-795adcf504ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 17:54:45.326973 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:45.326813    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 17:49:44 +0000 UTC" deadline="2027-12-09 04:24:09.331492611 +0000 UTC"
Jul 14 17:54:45.326973 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:45.326881    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12298h29m24.004617064s"
Jul 14 17:54:45.434848 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:45.434818    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:54:45.435074 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:45.434953    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgmj" podUID="dd5f385d-e137-415f-80a8-0d88d45f56fb"
Jul 14 17:54:45.435409 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:45.435387    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:54:45.435577 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:45.435527    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxczq" podUID="bb8ca4ed-507d-4a63-9c35-795adcf504ad"
Jul 14 17:54:46.445208 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:46.445173    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:54:46.445743 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:46.445314    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khkzc" podUID="383a3b60-1510-4f9a-9075-16da8bed771e"
Jul 14 17:54:46.911058 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:46.911015    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret\") pod \"global-pull-secret-syncer-khkzc\" (UID: \"383a3b60-1510-4f9a-9075-16da8bed771e\") " pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:54:46.911261 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:46.911081    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sqqq\" (UniqueName: \"kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq\") pod \"network-check-target-nlgmj\" (UID: \"dd5f385d-e137-415f-80a8-0d88d45f56fb\") " pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:54:46.911355 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:46.911258    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 17:54:46.911355 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:46.911279    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 17:54:46.911355 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:46.911292    2558 projected.go:196] Error preparing data for projected volume kube-api-access-8sqqq for pod openshift-network-diagnostics/network-check-target-nlgmj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 17:54:46.911505 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:46.911356    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq podName:dd5f385d-e137-415f-80a8-0d88d45f56fb nodeName:}" failed. No retries permitted until 2026-07-14 17:54:50.911334679 +0000 UTC m=+9.016444658 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8sqqq" (UniqueName: "kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq") pod "network-check-target-nlgmj" (UID: "dd5f385d-e137-415f-80a8-0d88d45f56fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 17:54:46.911855 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:46.911828    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 17:54:46.911980 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:46.911890    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret podName:383a3b60-1510-4f9a-9075-16da8bed771e nodeName:}" failed. No retries permitted until 2026-07-14 17:54:50.911873607 +0000 UTC m=+9.016983571 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret") pod "global-pull-secret-syncer-khkzc" (UID: "383a3b60-1510-4f9a-9075-16da8bed771e") : object "kube-system"/"original-pull-secret" not registered
Jul 14 17:54:47.012265 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:47.012228    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs\") pod \"network-metrics-daemon-jxczq\" (UID: \"bb8ca4ed-507d-4a63-9c35-795adcf504ad\") " pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:54:47.012463 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:47.012377    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 17:54:47.012463 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:47.012462    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs podName:bb8ca4ed-507d-4a63-9c35-795adcf504ad nodeName:}" failed. No retries permitted until 2026-07-14 17:54:51.012430931 +0000 UTC m=+9.117540894 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs") pod "network-metrics-daemon-jxczq" (UID: "bb8ca4ed-507d-4a63-9c35-795adcf504ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 17:54:47.435046 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:47.435005    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:54:47.435265 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:47.435162    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgmj" podUID="dd5f385d-e137-415f-80a8-0d88d45f56fb"
Jul 14 17:54:47.435614 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:47.435588    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:54:47.435757 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:47.435733    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxczq" podUID="bb8ca4ed-507d-4a63-9c35-795adcf504ad"
Jul 14 17:54:48.434705 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:48.434669    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:54:48.435183 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:48.434817    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khkzc" podUID="383a3b60-1510-4f9a-9075-16da8bed771e"
Jul 14 17:54:49.434431 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:49.434375    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:54:49.434651 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:49.434551    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgmj" podUID="dd5f385d-e137-415f-80a8-0d88d45f56fb"
Jul 14 17:54:49.435105 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:49.435076    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:54:49.435552 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:49.435206    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxczq" podUID="bb8ca4ed-507d-4a63-9c35-795adcf504ad"
Jul 14 17:54:50.434409 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:50.434368    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:54:50.434618 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:50.434509    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khkzc" podUID="383a3b60-1510-4f9a-9075-16da8bed771e"
Jul 14 17:54:50.949097 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:50.948070    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret\") pod \"global-pull-secret-syncer-khkzc\" (UID: \"383a3b60-1510-4f9a-9075-16da8bed771e\") " pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:54:50.949097 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:50.948132    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sqqq\" (UniqueName: \"kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq\") pod \"network-check-target-nlgmj\" (UID: \"dd5f385d-e137-415f-80a8-0d88d45f56fb\") " pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:54:50.949097 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:50.948341    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 17:54:50.949097 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:50.948366    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 17:54:50.949097 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:50.948382    2558 projected.go:196] Error preparing data for projected volume kube-api-access-8sqqq for pod openshift-network-diagnostics/network-check-target-nlgmj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 17:54:50.949097 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:50.948457    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq podName:dd5f385d-e137-415f-80a8-0d88d45f56fb nodeName:}" failed. No retries permitted until 2026-07-14 17:54:58.948435392 +0000 UTC m=+17.053545372 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8sqqq" (UniqueName: "kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq") pod "network-check-target-nlgmj" (UID: "dd5f385d-e137-415f-80a8-0d88d45f56fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 17:54:50.949097 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:50.948972    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 17:54:50.949097 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:50.949056    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret podName:383a3b60-1510-4f9a-9075-16da8bed771e nodeName:}" failed. No retries permitted until 2026-07-14 17:54:58.94903774 +0000 UTC m=+17.054147705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret") pod "global-pull-secret-syncer-khkzc" (UID: "383a3b60-1510-4f9a-9075-16da8bed771e") : object "kube-system"/"original-pull-secret" not registered
Jul 14 17:54:51.048934 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:51.048891    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs\") pod \"network-metrics-daemon-jxczq\" (UID: \"bb8ca4ed-507d-4a63-9c35-795adcf504ad\") " pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:54:51.049127 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:51.049091    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 17:54:51.049198 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:51.049162    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs podName:bb8ca4ed-507d-4a63-9c35-795adcf504ad nodeName:}" failed. No retries permitted until 2026-07-14 17:54:59.049140376 +0000 UTC m=+17.154250345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs") pod "network-metrics-daemon-jxczq" (UID: "bb8ca4ed-507d-4a63-9c35-795adcf504ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 17:54:51.435363 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:51.434864    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:54:51.435363 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:51.434970    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgmj" podUID="dd5f385d-e137-415f-80a8-0d88d45f56fb"
Jul 14 17:54:51.435363 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:51.435298    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:54:51.435363 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:51.435371    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxczq" podUID="bb8ca4ed-507d-4a63-9c35-795adcf504ad"
Jul 14 17:54:52.438151 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:52.438119    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:54:52.438665 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:52.438242    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khkzc" podUID="383a3b60-1510-4f9a-9075-16da8bed771e"
Jul 14 17:54:53.435190 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:53.434905    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:54:53.435190 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:53.435140    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:54:53.435369 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:53.435244    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgmj" podUID="dd5f385d-e137-415f-80a8-0d88d45f56fb"
Jul 14 17:54:53.435672 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:53.435642    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxczq" podUID="bb8ca4ed-507d-4a63-9c35-795adcf504ad"
Jul 14 17:54:54.438491 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:54.438439    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:54:54.438949 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:54.438600    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khkzc" podUID="383a3b60-1510-4f9a-9075-16da8bed771e"
Jul 14 17:54:55.435036 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:55.435003    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:54:55.435196 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:55.434999    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:54:55.435196 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:55.435130    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxczq" podUID="bb8ca4ed-507d-4a63-9c35-795adcf504ad"
Jul 14 17:54:55.435196 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:55.435178    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgmj" podUID="dd5f385d-e137-415f-80a8-0d88d45f56fb"
Jul 14 17:54:56.435224 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:56.435191    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:54:56.435599 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:56.435299    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khkzc" podUID="383a3b60-1510-4f9a-9075-16da8bed771e"
Jul 14 17:54:57.434158 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:57.434117    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:54:57.434335 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:57.434126    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:54:57.434335 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:57.434268    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgmj" podUID="dd5f385d-e137-415f-80a8-0d88d45f56fb"
Jul 14 17:54:57.434461 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:57.434326    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxczq" podUID="bb8ca4ed-507d-4a63-9c35-795adcf504ad"
Jul 14 17:54:58.434781 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:58.434744    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:54:58.435223 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:58.434870    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khkzc" podUID="383a3b60-1510-4f9a-9075-16da8bed771e"
Jul 14 17:54:59.015550 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:59.015505    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret\") pod \"global-pull-secret-syncer-khkzc\" (UID: \"383a3b60-1510-4f9a-9075-16da8bed771e\") " pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:54:59.015792 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:59.015591    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sqqq\" (UniqueName: \"kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq\") pod \"network-check-target-nlgmj\" (UID: \"dd5f385d-e137-415f-80a8-0d88d45f56fb\") " pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:54:59.015792 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:59.015667    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 17:54:59.015792 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:59.015745    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret podName:383a3b60-1510-4f9a-9075-16da8bed771e nodeName:}" failed. No retries permitted until 2026-07-14 17:55:15.015726378 +0000 UTC m=+33.120836344 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret") pod "global-pull-secret-syncer-khkzc" (UID: "383a3b60-1510-4f9a-9075-16da8bed771e") : object "kube-system"/"original-pull-secret" not registered
Jul 14 17:54:59.015792 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:59.015745    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 17:54:59.015792 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:59.015768    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 17:54:59.015792 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:59.015777    2558 projected.go:196] Error preparing data for projected volume kube-api-access-8sqqq for pod openshift-network-diagnostics/network-check-target-nlgmj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 17:54:59.016114 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:59.015816    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq podName:dd5f385d-e137-415f-80a8-0d88d45f56fb nodeName:}" failed. No retries permitted until 2026-07-14 17:55:15.01580498 +0000 UTC m=+33.120914942 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8sqqq" (UniqueName: "kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq") pod "network-check-target-nlgmj" (UID: "dd5f385d-e137-415f-80a8-0d88d45f56fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 17:54:59.116109 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:59.116076    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs\") pod \"network-metrics-daemon-jxczq\" (UID: \"bb8ca4ed-507d-4a63-9c35-795adcf504ad\") " pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:54:59.116329 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:59.116247    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 17:54:59.116329 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:59.116321    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs podName:bb8ca4ed-507d-4a63-9c35-795adcf504ad nodeName:}" failed. No retries permitted until 2026-07-14 17:55:15.116305134 +0000 UTC m=+33.221415096 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs") pod "network-metrics-daemon-jxczq" (UID: "bb8ca4ed-507d-4a63-9c35-795adcf504ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 17:54:59.434496 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:59.434454    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:54:59.434729 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:59.434583    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgmj" podUID="dd5f385d-e137-415f-80a8-0d88d45f56fb"
Jul 14 17:54:59.434729 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:54:59.434630    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:54:59.434820 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:54:59.434753    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxczq" podUID="bb8ca4ed-507d-4a63-9c35-795adcf504ad"
Jul 14 17:55:00.434681 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:00.434646    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:55:00.434845 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:00.434791    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khkzc" podUID="383a3b60-1510-4f9a-9075-16da8bed771e"
Jul 14 17:55:01.434887 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:01.434843    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:55:01.435369 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:01.434850    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:55:01.435369 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:01.434988    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgmj" podUID="dd5f385d-e137-415f-80a8-0d88d45f56fb"
Jul 14 17:55:01.435369 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:01.435067    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxczq" podUID="bb8ca4ed-507d-4a63-9c35-795adcf504ad"
Jul 14 17:55:02.435297 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:02.435258    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:55:02.435783 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:02.435377    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khkzc" podUID="383a3b60-1510-4f9a-9075-16da8bed771e"
Jul 14 17:55:03.434679 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:03.434642    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:55:03.434871 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:03.434788    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxczq" podUID="bb8ca4ed-507d-4a63-9c35-795adcf504ad"
Jul 14 17:55:03.434871 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:03.434844    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:55:03.434972 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:03.434937    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgmj" podUID="dd5f385d-e137-415f-80a8-0d88d45f56fb"
Jul 14 17:55:04.435163 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:04.435128    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:55:04.435672 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:04.435248    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khkzc" podUID="383a3b60-1510-4f9a-9075-16da8bed771e"
Jul 14 17:55:05.434694 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.434662    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:55:05.434860 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.434712    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:55:05.434860 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:05.434790    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgmj" podUID="dd5f385d-e137-415f-80a8-0d88d45f56fb"
Jul 14 17:55:05.434973 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:05.434902    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxczq" podUID="bb8ca4ed-507d-4a63-9c35-795adcf504ad"
Jul 14 17:55:05.594218 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.593960    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h2h6f" event={"ID":"250642c0-14e2-4d92-989a-b5765f7d6ec8","Type":"ContainerStarted","Data":"ac86742801d1e8fcb25f8df690e55f0be103746c83f939a25c3e04631cf70155"}
Jul 14 17:55:05.595323 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.595299    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz" event={"ID":"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4","Type":"ContainerStarted","Data":"d165839169258a41372b95f4ea3693e73c37f042533dc6e17223c356e78be1f9"}
Jul 14 17:55:05.596507 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.596485    2558 generic.go:356] "Generic (PLEG): container finished" podID="1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81" containerID="11880746e860020b6bd708fdce3bf8a3cb0d3a92e860c599fc1dd11b6a7ffbe8" exitCode=0
Jul 14 17:55:05.596641 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.596549    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gqm8" event={"ID":"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81","Type":"ContainerDied","Data":"11880746e860020b6bd708fdce3bf8a3cb0d3a92e860c599fc1dd11b6a7ffbe8"}
Jul 14 17:55:05.598078 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.598052    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wv4j8" event={"ID":"4c968316-3b97-4c10-84f0-0560cd4bcf20","Type":"ContainerStarted","Data":"300de4d242974c22786dc06d798ae3a89bc2a2bde1ce96f3a9fb610548c66564"}
Jul 14 17:55:05.599598 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.599577    2558 generic.go:356] "Generic (PLEG): container finished" podID="7f0331335108fd3fdc34cb5591b7fd24" containerID="dceae3c151318f56abc331639e342214af5bfeed611ec011db06e3906efdd5f2" exitCode=0
Jul 14 17:55:05.599703 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.599648    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal" event={"ID":"7f0331335108fd3fdc34cb5591b7fd24","Type":"ContainerDied","Data":"dceae3c151318f56abc331639e342214af5bfeed611ec011db06e3906efdd5f2"}
Jul 14 17:55:05.601133 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.601113    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-216.ec2.internal" event={"ID":"282757532e8cff0af802bbd37036b971","Type":"ContainerStarted","Data":"604e2f0e69b91bd16f7afbc6bb550b341b42d6b65491a3d9844d75be2fe2d87c"}
Jul 14 17:55:05.603309 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.603292    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 17:55:05.603621 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.603601    2558 generic.go:356] "Generic (PLEG): container finished" podID="3089991f-8aa5-4b20-b767-8b8c8ff17c05" containerID="1084065823f6af5a761c038f9f7d2b421d79dcce3ac5ddcd33813954e86c55d2" exitCode=1
Jul 14 17:55:05.603706 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.603666    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f" event={"ID":"3089991f-8aa5-4b20-b767-8b8c8ff17c05","Type":"ContainerStarted","Data":"df68f5b17840c9a684435c2c584796366b600f7f94f93cedfa2b364186328aaa"}
Jul 14 17:55:05.603750 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.603720    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f" event={"ID":"3089991f-8aa5-4b20-b767-8b8c8ff17c05","Type":"ContainerStarted","Data":"3fab18121b2fb9c49bef620b4990e0b4580b967b09379b1f47a672c3ab65b70d"}
Jul 14 17:55:05.603785 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.603764    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f" event={"ID":"3089991f-8aa5-4b20-b767-8b8c8ff17c05","Type":"ContainerDied","Data":"1084065823f6af5a761c038f9f7d2b421d79dcce3ac5ddcd33813954e86c55d2"}
Jul 14 17:55:05.603821 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.603812    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f" event={"ID":"3089991f-8aa5-4b20-b767-8b8c8ff17c05","Type":"ContainerStarted","Data":"0b63c48bb2c333d2a60fad122005cc240c23faac0710c3eab96f390ad9703aae"}
Jul 14 17:55:05.605103 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.605084    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cqr54" event={"ID":"d634aecb-6ce7-47ef-9639-a209014a498b","Type":"ContainerStarted","Data":"e8e8fd82f24b66a7bdfaae2c5cef615f1a7df19ecedcee716996f543f89c7235"}
Jul 14 17:55:05.606527 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.606361    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xdk6j" event={"ID":"807562d8-2b97-4c0d-9752-aef06e1e80d8","Type":"ContainerStarted","Data":"bbb72ff1e742372e39f44463e883f934ebb1e6d4a3fdb05107bb00b67f072f8a"}
Jul 14 17:55:05.607681 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.607658    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x2hq6" event={"ID":"38b4a869-6295-4e6f-b53e-dd0ec7635b3e","Type":"ContainerStarted","Data":"ca3204d3388dd97afd0052e5eb9a5be26f9eaa211bb86399748c36adfa186013"}
Jul 14 17:55:05.612301 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.612256    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h2h6f" podStartSLOduration=1.434990511 podStartE2EDuration="22.612244841s" totalImagesPullingTime="21.17725433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:55:05.61160013 +0000 UTC m=+23.716710113" watchObservedRunningTime="2026-07-14 17:55:05.612244841 +0000 UTC m=+23.717354826"
Jul 14 17:55:05.627523 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.627478    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-216.ec2.internal" podStartSLOduration=21.627462312 podStartE2EDuration="21.627462312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:54:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:55:05.627025208 +0000 UTC m=+23.732135191" watchObservedRunningTime="2026-07-14 17:55:05.627462312 +0000 UTC m=+23.732572304"
Jul 14 17:55:05.657862 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.657673    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x2hq6" podStartSLOduration=9.922112253 podStartE2EDuration="22.657583017s" totalImagesPullingTime="12.735470764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:55:05.652705432 +0000 UTC m=+23.757815416" watchObservedRunningTime="2026-07-14 17:55:05.657583017 +0000 UTC m=+23.762692995"
Jul 14 17:55:05.718218 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.718149    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xdk6j" podStartSLOduration=1.444652825 podStartE2EDuration="22.718135138s" totalImagesPullingTime="21.273482313s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:55:05.717994529 +0000 UTC m=+23.823104513" watchObservedRunningTime="2026-07-14 17:55:05.718135138 +0000 UTC m=+23.823245122"
Jul 14 17:55:05.748931 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.748874    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wv4j8" podStartSLOduration=1.496316379 podStartE2EDuration="22.748852853s" totalImagesPullingTime="21.252536474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:55:05.748651068 +0000 UTC m=+23.853761055" watchObservedRunningTime="2026-07-14 17:55:05.748852853 +0000 UTC m=+23.853962839"
Jul 14 17:55:05.771773 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:05.771713    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cqr54" podStartSLOduration=1.492268618 podStartE2EDuration="22.77169641s" totalImagesPullingTime="21.279427792s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:55:05.770759294 +0000 UTC m=+23.875869279" watchObservedRunningTime="2026-07-14 17:55:05.77169641 +0000 UTC m=+23.876806394"
Jul 14 17:55:06.435187 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:06.435153    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:55:06.435347 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:06.435269    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khkzc" podUID="383a3b60-1510-4f9a-9075-16da8bed771e"
Jul 14 17:55:06.585263 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:06.585234    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 14 17:55:06.611165 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:06.611132    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz" event={"ID":"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4","Type":"ContainerStarted","Data":"dca2823b96a5d834ca671f06ce0d657f95bbae13d8ddbd1653df39f507ca46b6"}
Jul 14 17:55:06.612499 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:06.612472    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bhpb8" event={"ID":"9c1aaab9-54d3-4120-85b3-054a3bb0fc84","Type":"ContainerStarted","Data":"11b52faf51711173390a49dfb232ce426a90b85160acc0cdf641651c6f2479f9"}
Jul 14 17:55:06.614146 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:06.614126    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal" event={"ID":"7f0331335108fd3fdc34cb5591b7fd24","Type":"ContainerStarted","Data":"d566d48febcfd55efe9215542af2161e64dc91b0fe24cd09ba17d75e1c314bc1"}
Jul 14 17:55:06.616960 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:06.616943    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 17:55:06.617359 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:06.617326    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f" event={"ID":"3089991f-8aa5-4b20-b767-8b8c8ff17c05","Type":"ContainerStarted","Data":"89799727badcbae36fb22d262796d603340da692f037beb9ae9bf0d360891cc4"}
Jul 14 17:55:06.617466 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:06.617401    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f" event={"ID":"3089991f-8aa5-4b20-b767-8b8c8ff17c05","Type":"ContainerStarted","Data":"4dd38c227cc759a86e46267f6a161c0c0e424f5fedd46397126f69ed6c84703a"}
Jul 14 17:55:06.630123 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:06.630077    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bhpb8" podStartSLOduration=2.333906505 podStartE2EDuration="23.630061251s" totalImagesPullingTime="21.296154746s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:55:06.629730637 +0000 UTC m=+24.734840622" watchObservedRunningTime="2026-07-14 17:55:06.630061251 +0000 UTC m=+24.735171235"
Jul 14 17:55:06.648259 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:06.648212    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal" podStartSLOduration=22.648195503 podStartE2EDuration="22.648195503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:54:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:55:06.647513709 +0000 UTC m=+24.752623707" watchObservedRunningTime="2026-07-14 17:55:06.648195503 +0000 UTC m=+24.753305487"
Jul 14 17:55:07.346250 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:07.346128    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T17:55:06.58525671Z","UUID":"c87cde8b-c7b9-4c95-90a3-e6bcc258aaaf","Handler":null,"Name":"","Endpoint":""}
Jul 14 17:55:07.348710 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:07.348678    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 14 17:55:07.348855 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:07.348740    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 14 17:55:07.434323 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:07.434286    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:55:07.434480 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:07.434286    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:55:07.434480 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:07.434405    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxczq" podUID="bb8ca4ed-507d-4a63-9c35-795adcf504ad"
Jul 14 17:55:07.434585 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:07.434481    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgmj" podUID="dd5f385d-e137-415f-80a8-0d88d45f56fb"
Jul 14 17:55:07.621279 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:07.621249    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz" event={"ID":"c7c1ca09-b30e-4be2-ba78-b0c8177bfab4","Type":"ContainerStarted","Data":"0f7ecde5aac9cb5a0cad1d98993ef25fcd7073ea06e862dfe7b9a625268db4aa"}
Jul 14 17:55:08.435043 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:08.434870    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:55:08.435213 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:08.435128    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khkzc" podUID="383a3b60-1510-4f9a-9075-16da8bed771e"
Jul 14 17:55:08.625877 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:08.625848    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x2hq6"
Jul 14 17:55:08.626486 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:08.626468    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x2hq6"
Jul 14 17:55:08.626831 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:08.626813    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 17:55:08.627228 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:08.627205    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f" event={"ID":"3089991f-8aa5-4b20-b767-8b8c8ff17c05","Type":"ContainerStarted","Data":"4c365e8684a6176d2356fbc20b8dd4cbd1f4306b70e12b0a55714c3ee9f486fd"}
Jul 14 17:55:08.671373 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:08.671321    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhnkz" podStartSLOduration=2.439279302 podStartE2EDuration="25.671305283s" totalImagesPullingTime="23.232025981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:54:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:55:08.670965424 +0000 UTC m=+26.776075407" watchObservedRunningTime="2026-07-14 17:55:08.671305283 +0000 UTC m=+26.776415267"
Jul 14 17:55:09.434574 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:09.434542    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:55:09.434765 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:09.434658    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgmj" podUID="dd5f385d-e137-415f-80a8-0d88d45f56fb"
Jul 14 17:55:09.434765 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:09.434719    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:55:09.434884 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:09.434840    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxczq" podUID="bb8ca4ed-507d-4a63-9c35-795adcf504ad"
Jul 14 17:55:09.629380 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:09.629345    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x2hq6"
Jul 14 17:55:09.629935 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:09.629919    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x2hq6"
Jul 14 17:55:10.435252 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:10.435045    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:55:10.435414 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:10.435356    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khkzc" podUID="383a3b60-1510-4f9a-9075-16da8bed771e"
Jul 14 17:55:10.636544 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:10.636516    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 17:55:10.637294 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:10.636951    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f" event={"ID":"3089991f-8aa5-4b20-b767-8b8c8ff17c05","Type":"ContainerStarted","Data":"0c4039185fc6ccc502d3d35c9f63e3bfa061a53bb5e6eea1911e70a33b505468"}
Jul 14 17:55:10.637294 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:10.637233    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:55:10.637422 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:10.637303    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:55:10.637480 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:10.637468    2558 scope.go:117] "RemoveContainer" containerID="1084065823f6af5a761c038f9f7d2b421d79dcce3ac5ddcd33813954e86c55d2"
Jul 14 17:55:10.658842 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:10.658749    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:55:11.434279 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:11.434239    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:55:11.434466 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:11.434376    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgmj" podUID="dd5f385d-e137-415f-80a8-0d88d45f56fb"
Jul 14 17:55:11.434466 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:11.434454    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:55:11.434603 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:11.434533    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxczq" podUID="bb8ca4ed-507d-4a63-9c35-795adcf504ad"
Jul 14 17:55:11.643544 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:11.643513    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 17:55:11.644296 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:11.644259    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f" event={"ID":"3089991f-8aa5-4b20-b767-8b8c8ff17c05","Type":"ContainerStarted","Data":"e4c96b518d5959c74111d68a60a8c6a5a023f7b1d754f0efcf2df1b942bddcb7"}
Jul 14 17:55:11.644686 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:11.644659    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:55:11.663692 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:11.663665    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:55:11.678674 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:11.678624    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f" podStartSLOduration=7.38926133 podStartE2EDuration="28.678609763s" totalImagesPullingTime="21.289348433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:55:11.677997775 +0000 UTC m=+29.783107761" watchObservedRunningTime="2026-07-14 17:55:11.678609763 +0000 UTC m=+29.783719746"
Jul 14 17:55:12.092205 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:12.092156    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nlgmj"]
Jul 14 17:55:12.092375 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:12.092312    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:55:12.092451 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:12.092427    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgmj" podUID="dd5f385d-e137-415f-80a8-0d88d45f56fb"
Jul 14 17:55:12.093019 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:12.092969    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jxczq"]
Jul 14 17:55:12.093164 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:12.093077    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:55:12.093230 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:12.093177    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxczq" podUID="bb8ca4ed-507d-4a63-9c35-795adcf504ad"
Jul 14 17:55:12.093805 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:12.093784    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-khkzc"]
Jul 14 17:55:12.093928 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:12.093879    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:55:12.094001 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:12.093978    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khkzc" podUID="383a3b60-1510-4f9a-9075-16da8bed771e"
Jul 14 17:55:13.434637 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:13.434587    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:55:13.434637 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:13.434623    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:55:13.435208 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:13.434599    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:55:13.435208 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:13.434734    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khkzc" podUID="383a3b60-1510-4f9a-9075-16da8bed771e"
Jul 14 17:55:13.435208 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:13.434836    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxczq" podUID="bb8ca4ed-507d-4a63-9c35-795adcf504ad"
Jul 14 17:55:13.435208 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:13.434926    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgmj" podUID="dd5f385d-e137-415f-80a8-0d88d45f56fb"
Jul 14 17:55:14.653314 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:14.653145    2558 generic.go:356] "Generic (PLEG): container finished" podID="1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81" containerID="d342fb8fb1f3a483e298e40846e4935a8da30a3127c0bcc60c1efd64be30b55d" exitCode=0
Jul 14 17:55:14.653314 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:14.653195    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gqm8" event={"ID":"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81","Type":"ContainerDied","Data":"d342fb8fb1f3a483e298e40846e4935a8da30a3127c0bcc60c1efd64be30b55d"}
Jul 14 17:55:15.035690 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:15.035592    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret\") pod \"global-pull-secret-syncer-khkzc\" (UID: \"383a3b60-1510-4f9a-9075-16da8bed771e\") " pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:55:15.035690 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:15.035632    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sqqq\" (UniqueName: \"kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq\") pod \"network-check-target-nlgmj\" (UID: \"dd5f385d-e137-415f-80a8-0d88d45f56fb\") " pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:55:15.035922 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:15.035742    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 17:55:15.035922 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:15.035752    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 17:55:15.035922 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:15.035828    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret podName:383a3b60-1510-4f9a-9075-16da8bed771e nodeName:}" failed. No retries permitted until 2026-07-14 17:55:47.035807949 +0000 UTC m=+65.140917924 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret") pod "global-pull-secret-syncer-khkzc" (UID: "383a3b60-1510-4f9a-9075-16da8bed771e") : object "kube-system"/"original-pull-secret" not registered
Jul 14 17:55:15.035922 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:15.035757    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 17:55:15.035922 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:15.035861    2558 projected.go:196] Error preparing data for projected volume kube-api-access-8sqqq for pod openshift-network-diagnostics/network-check-target-nlgmj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 17:55:15.035922 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:15.035901    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq podName:dd5f385d-e137-415f-80a8-0d88d45f56fb nodeName:}" failed. No retries permitted until 2026-07-14 17:55:47.035890001 +0000 UTC m=+65.140999963 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8sqqq" (UniqueName: "kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq") pod "network-check-target-nlgmj" (UID: "dd5f385d-e137-415f-80a8-0d88d45f56fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 17:55:15.136824 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:15.136793    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs\") pod \"network-metrics-daemon-jxczq\" (UID: \"bb8ca4ed-507d-4a63-9c35-795adcf504ad\") " pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:55:15.137002 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:15.136898    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 17:55:15.137002 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:15.136964    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs podName:bb8ca4ed-507d-4a63-9c35-795adcf504ad nodeName:}" failed. No retries permitted until 2026-07-14 17:55:47.136947061 +0000 UTC m=+65.242057042 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs") pod "network-metrics-daemon-jxczq" (UID: "bb8ca4ed-507d-4a63-9c35-795adcf504ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 17:55:15.434437 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:15.434411    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:55:15.434437 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:15.434430    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:55:15.434573 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:15.434426    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:55:15.434573 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:15.434512    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khkzc" podUID="383a3b60-1510-4f9a-9075-16da8bed771e"
Jul 14 17:55:15.434658 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:15.434585    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgmj" podUID="dd5f385d-e137-415f-80a8-0d88d45f56fb"
Jul 14 17:55:15.434658 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:15.434650    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxczq" podUID="bb8ca4ed-507d-4a63-9c35-795adcf504ad"
Jul 14 17:55:15.657393 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:15.657358    2558 generic.go:356] "Generic (PLEG): container finished" podID="1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81" containerID="ade737bfada332c3ca10a8df7b565dd5d3539d072c196a3902fbf2497aaeca95" exitCode=0
Jul 14 17:55:15.657943 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:15.657423    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gqm8" event={"ID":"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81","Type":"ContainerDied","Data":"ade737bfada332c3ca10a8df7b565dd5d3539d072c196a3902fbf2497aaeca95"}
Jul 14 17:55:16.662532 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:16.662499    2558 generic.go:356] "Generic (PLEG): container finished" podID="1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81" containerID="040d1c83222e432cd871387abaad5d4742c5a5529fa7010ae00a7e65e6bf7b1f" exitCode=0
Jul 14 17:55:16.662989 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:16.662553    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gqm8" event={"ID":"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81","Type":"ContainerDied","Data":"040d1c83222e432cd871387abaad5d4742c5a5529fa7010ae00a7e65e6bf7b1f"}
Jul 14 17:55:17.434790 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:17.434752    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:55:17.434962 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:17.434752    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:55:17.434962 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:17.434872    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgmj" podUID="dd5f385d-e137-415f-80a8-0d88d45f56fb"
Jul 14 17:55:17.434962 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:17.434949    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khkzc" podUID="383a3b60-1510-4f9a-9075-16da8bed771e"
Jul 14 17:55:17.435124 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:17.434763    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:55:17.435124 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:17.435055    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxczq" podUID="bb8ca4ed-507d-4a63-9c35-795adcf504ad"
Jul 14 17:55:18.669015 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.668984    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeReady"
Jul 14 17:55:18.669497 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.669146    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 14 17:55:18.741204 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.741123    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tfgds"]
Jul 14 17:55:18.743205 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.743185    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tfgds"
Jul 14 17:55:18.753572 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.753525    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 14 17:55:18.753707 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.753620    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ljwn8\""
Jul 14 17:55:18.753768 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.753529    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 14 17:55:18.765483 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.765455    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6gdbj"]
Jul 14 17:55:18.767493 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.767472    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6gdbj"
Jul 14 17:55:18.774088 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.774065    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tfgds"]
Jul 14 17:55:18.777331 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.777306    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 14 17:55:18.777574 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.777545    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 14 17:55:18.780476 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.780460    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 14 17:55:18.781508 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.781493    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pcnzx\""
Jul 14 17:55:18.785207 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.785185    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6gdbj"]
Jul 14 17:55:18.861411 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.861381    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhpd6\" (UniqueName: \"kubernetes.io/projected/89451cd2-2887-4999-962c-156d3b2a6043-kube-api-access-dhpd6\") pod \"dns-default-tfgds\" (UID: \"89451cd2-2887-4999-962c-156d3b2a6043\") " pod="openshift-dns/dns-default-tfgds"
Jul 14 17:55:18.861411 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.861420    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvl6l\" (UniqueName: \"kubernetes.io/projected/69e043c1-b897-4005-964a-b4febac67de7-kube-api-access-qvl6l\") pod \"ingress-canary-6gdbj\" (UID: \"69e043c1-b897-4005-964a-b4febac67de7\") " pod="openshift-ingress-canary/ingress-canary-6gdbj"
Jul 14 17:55:18.861703 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.861467    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89451cd2-2887-4999-962c-156d3b2a6043-tmp-dir\") pod \"dns-default-tfgds\" (UID: \"89451cd2-2887-4999-962c-156d3b2a6043\") " pod="openshift-dns/dns-default-tfgds"
Jul 14 17:55:18.861703 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.861517    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls\") pod \"dns-default-tfgds\" (UID: \"89451cd2-2887-4999-962c-156d3b2a6043\") " pod="openshift-dns/dns-default-tfgds"
Jul 14 17:55:18.861703 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.861611    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/89451cd2-2887-4999-962c-156d3b2a6043-config-volume\") pod \"dns-default-tfgds\" (UID: \"89451cd2-2887-4999-962c-156d3b2a6043\") " pod="openshift-dns/dns-default-tfgds"
Jul 14 17:55:18.861703 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.861659    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69e043c1-b897-4005-964a-b4febac67de7-cert\") pod \"ingress-canary-6gdbj\" (UID: \"69e043c1-b897-4005-964a-b4febac67de7\") " pod="openshift-ingress-canary/ingress-canary-6gdbj"
Jul 14 17:55:18.962743 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.962705    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/89451cd2-2887-4999-962c-156d3b2a6043-config-volume\") pod \"dns-default-tfgds\" (UID: \"89451cd2-2887-4999-962c-156d3b2a6043\") " pod="openshift-dns/dns-default-tfgds"
Jul 14 17:55:18.962934 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.962753    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69e043c1-b897-4005-964a-b4febac67de7-cert\") pod \"ingress-canary-6gdbj\" (UID: \"69e043c1-b897-4005-964a-b4febac67de7\") " pod="openshift-ingress-canary/ingress-canary-6gdbj"
Jul 14 17:55:18.962934 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.962784    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhpd6\" (UniqueName: \"kubernetes.io/projected/89451cd2-2887-4999-962c-156d3b2a6043-kube-api-access-dhpd6\") pod \"dns-default-tfgds\" (UID: \"89451cd2-2887-4999-962c-156d3b2a6043\") " pod="openshift-dns/dns-default-tfgds"
Jul 14 17:55:18.962934 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.962812    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvl6l\" (UniqueName: \"kubernetes.io/projected/69e043c1-b897-4005-964a-b4febac67de7-kube-api-access-qvl6l\") pod \"ingress-canary-6gdbj\" (UID: \"69e043c1-b897-4005-964a-b4febac67de7\") " pod="openshift-ingress-canary/ingress-canary-6gdbj"
Jul 14 17:55:18.962934 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.962848    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89451cd2-2887-4999-962c-156d3b2a6043-tmp-dir\") pod \"dns-default-tfgds\" (UID: \"89451cd2-2887-4999-962c-156d3b2a6043\") " pod="openshift-dns/dns-default-tfgds"
Jul 14 17:55:18.962934 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.962878    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls\") pod \"dns-default-tfgds\" (UID: \"89451cd2-2887-4999-962c-156d3b2a6043\") " pod="openshift-dns/dns-default-tfgds"
Jul 14 17:55:18.963196 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:18.962978    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 17:55:18.963196 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:18.963035    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls podName:89451cd2-2887-4999-962c-156d3b2a6043 nodeName:}" failed. No retries permitted until 2026-07-14 17:55:19.463016232 +0000 UTC m=+37.568126198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls") pod "dns-default-tfgds" (UID: "89451cd2-2887-4999-962c-156d3b2a6043") : secret "dns-default-metrics-tls" not found
Jul 14 17:55:18.963524 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.963491    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/89451cd2-2887-4999-962c-156d3b2a6043-config-volume\") pod \"dns-default-tfgds\" (UID: \"89451cd2-2887-4999-962c-156d3b2a6043\") " pod="openshift-dns/dns-default-tfgds"
Jul 14 17:55:18.963698 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.963676    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89451cd2-2887-4999-962c-156d3b2a6043-tmp-dir\") pod \"dns-default-tfgds\" (UID: \"89451cd2-2887-4999-962c-156d3b2a6043\") " pod="openshift-dns/dns-default-tfgds"
Jul 14 17:55:18.967960 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.967935    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69e043c1-b897-4005-964a-b4febac67de7-cert\") pod \"ingress-canary-6gdbj\" (UID: \"69e043c1-b897-4005-964a-b4febac67de7\") " pod="openshift-ingress-canary/ingress-canary-6gdbj"
Jul 14 17:55:18.976087 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.976063    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhpd6\" (UniqueName: \"kubernetes.io/projected/89451cd2-2887-4999-962c-156d3b2a6043-kube-api-access-dhpd6\") pod \"dns-default-tfgds\" (UID: \"89451cd2-2887-4999-962c-156d3b2a6043\") " pod="openshift-dns/dns-default-tfgds"
Jul 14 17:55:18.976229 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:18.976194    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvl6l\" (UniqueName: \"kubernetes.io/projected/69e043c1-b897-4005-964a-b4febac67de7-kube-api-access-qvl6l\") pod \"ingress-canary-6gdbj\" (UID: \"69e043c1-b897-4005-964a-b4febac67de7\") " pod="openshift-ingress-canary/ingress-canary-6gdbj"
Jul 14 17:55:19.078461 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:19.078375    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6gdbj"
Jul 14 17:55:19.235824 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:19.235651    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6gdbj"]
Jul 14 17:55:19.435243 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:19.435203    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:55:19.435428 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:19.435257    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:55:19.435428 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:19.435203    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:55:19.444848 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:19.444825    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 17:55:19.444848 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:19.444830    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9r7mf\""
Jul 14 17:55:19.445050 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:19.444896    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 17:55:19.445050 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:19.444813    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 17:55:19.445050 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:19.444958    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2kndq\""
Jul 14 17:55:19.445050 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:19.444830    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 17:55:19.465495 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:19.465470    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls\") pod \"dns-default-tfgds\" (UID: \"89451cd2-2887-4999-962c-156d3b2a6043\") " pod="openshift-dns/dns-default-tfgds"
Jul 14 17:55:19.465672 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:19.465658    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 17:55:19.465744 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:19.465732    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls podName:89451cd2-2887-4999-962c-156d3b2a6043 nodeName:}" failed. No retries permitted until 2026-07-14 17:55:20.465710463 +0000 UTC m=+38.570820432 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls") pod "dns-default-tfgds" (UID: "89451cd2-2887-4999-962c-156d3b2a6043") : secret "dns-default-metrics-tls" not found
Jul 14 17:55:20.474296 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:20.474259    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls\") pod \"dns-default-tfgds\" (UID: \"89451cd2-2887-4999-962c-156d3b2a6043\") " pod="openshift-dns/dns-default-tfgds"
Jul 14 17:55:20.474788 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:20.474410    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 17:55:20.474788 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:20.474487    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls podName:89451cd2-2887-4999-962c-156d3b2a6043 nodeName:}" failed. No retries permitted until 2026-07-14 17:55:22.474466147 +0000 UTC m=+40.579576123 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls") pod "dns-default-tfgds" (UID: "89451cd2-2887-4999-962c-156d3b2a6043") : secret "dns-default-metrics-tls" not found
Jul 14 17:55:20.823246 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:55:20.823170    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69e043c1_b897_4005_964a_b4febac67de7.slice/crio-6028e24b247a8ee3db0b935dcf5f6a9c375b3d01ae712c91de595db17fd2d2d8 WatchSource:0}: Error finding container 6028e24b247a8ee3db0b935dcf5f6a9c375b3d01ae712c91de595db17fd2d2d8: Status 404 returned error can't find the container with id 6028e24b247a8ee3db0b935dcf5f6a9c375b3d01ae712c91de595db17fd2d2d8
Jul 14 17:55:21.678547 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:21.678509    2558 generic.go:356] "Generic (PLEG): container finished" podID="1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81" containerID="afda49d3066933e19bcf6912f510f71d942784e00ff9ef7ba77c21665bcb8595" exitCode=0
Jul 14 17:55:21.679079 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:21.678648    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gqm8" event={"ID":"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81","Type":"ContainerDied","Data":"afda49d3066933e19bcf6912f510f71d942784e00ff9ef7ba77c21665bcb8595"}
Jul 14 17:55:21.680169 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:21.680116    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6gdbj" event={"ID":"69e043c1-b897-4005-964a-b4febac67de7","Type":"ContainerStarted","Data":"6028e24b247a8ee3db0b935dcf5f6a9c375b3d01ae712c91de595db17fd2d2d8"}
Jul 14 17:55:22.492412 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:22.492198    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls\") pod \"dns-default-tfgds\" (UID: \"89451cd2-2887-4999-962c-156d3b2a6043\") " pod="openshift-dns/dns-default-tfgds"
Jul 14 17:55:22.492602 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:22.492362    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 17:55:22.492602 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:22.492521    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls podName:89451cd2-2887-4999-962c-156d3b2a6043 nodeName:}" failed. No retries permitted until 2026-07-14 17:55:26.492503316 +0000 UTC m=+44.597613280 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls") pod "dns-default-tfgds" (UID: "89451cd2-2887-4999-962c-156d3b2a6043") : secret "dns-default-metrics-tls" not found
Jul 14 17:55:22.686699 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:22.686664    2558 generic.go:356] "Generic (PLEG): container finished" podID="1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81" containerID="1ee1832aecda973d99d17af238cf8beb18543ecc9c69b48bceb92df34366b901" exitCode=0
Jul 14 17:55:22.687107 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:22.686712    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gqm8" event={"ID":"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81","Type":"ContainerDied","Data":"1ee1832aecda973d99d17af238cf8beb18543ecc9c69b48bceb92df34366b901"}
Jul 14 17:55:23.692038 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:23.691993    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gqm8" event={"ID":"1f1c8eb9-ca38-4ffe-ab2d-8cd7899b6d81","Type":"ContainerStarted","Data":"98473dd6d8f93161378a72bf075e1a1d20547d5d2f609c3258cb2f1f7556c988"}
Jul 14 17:55:23.693325 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:23.693296    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6gdbj" event={"ID":"69e043c1-b897-4005-964a-b4febac67de7","Type":"ContainerStarted","Data":"464d500f4b73b441efbaca55333ec8d3fb7e95db4b9615884af47e36ee4b6bc6"}
Jul 14 17:55:23.718120 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:23.718071    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8gqm8" podStartSLOduration=5.912603953 podStartE2EDuration="40.718056593s" totalImagesPullingTime="34.80545264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:54:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:55:23.716420377 +0000 UTC m=+41.821530361" watchObservedRunningTime="2026-07-14 17:55:23.718056593 +0000 UTC m=+41.823166576"
Jul 14 17:55:23.738368 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:23.738310    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6gdbj" podStartSLOduration=3.151886595 podStartE2EDuration="5.738292243s" totalImagesPullingTime="2.586405648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:55:23.737389031 +0000 UTC m=+41.842499016" watchObservedRunningTime="2026-07-14 17:55:23.738292243 +0000 UTC m=+41.843402228"
Jul 14 17:55:26.521436 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:26.521396    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls\") pod \"dns-default-tfgds\" (UID: \"89451cd2-2887-4999-962c-156d3b2a6043\") " pod="openshift-dns/dns-default-tfgds"
Jul 14 17:55:26.521864 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:26.521550    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 17:55:26.521864 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:26.521637    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls podName:89451cd2-2887-4999-962c-156d3b2a6043 nodeName:}" failed. No retries permitted until 2026-07-14 17:55:34.521621743 +0000 UTC m=+52.626731705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls") pod "dns-default-tfgds" (UID: "89451cd2-2887-4999-962c-156d3b2a6043") : secret "dns-default-metrics-tls" not found
Jul 14 17:55:34.581293 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:34.581246    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls\") pod \"dns-default-tfgds\" (UID: \"89451cd2-2887-4999-962c-156d3b2a6043\") " pod="openshift-dns/dns-default-tfgds"
Jul 14 17:55:34.581870 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:34.581429    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 17:55:34.581870 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:34.581516    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls podName:89451cd2-2887-4999-962c-156d3b2a6043 nodeName:}" failed. No retries permitted until 2026-07-14 17:55:50.581498961 +0000 UTC m=+68.686608924 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls") pod "dns-default-tfgds" (UID: "89451cd2-2887-4999-962c-156d3b2a6043") : secret "dns-default-metrics-tls" not found
Jul 14 17:55:43.663735 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:43.663703    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkf5f"
Jul 14 17:55:47.065537 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:47.065476    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret\") pod \"global-pull-secret-syncer-khkzc\" (UID: \"383a3b60-1510-4f9a-9075-16da8bed771e\") " pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:55:47.066001 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:47.065555    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sqqq\" (UniqueName: \"kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq\") pod \"network-check-target-nlgmj\" (UID: \"dd5f385d-e137-415f-80a8-0d88d45f56fb\") " pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:55:47.072967 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:47.072932    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 17:55:47.073098 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:47.073025    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 17:55:47.078727 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:47.078709    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 17:55:47.079949 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:47.079926    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/383a3b60-1510-4f9a-9075-16da8bed771e-original-pull-secret\") pod \"global-pull-secret-syncer-khkzc\" (UID: \"383a3b60-1510-4f9a-9075-16da8bed771e\") " pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:55:47.088866 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:47.088845    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sqqq\" (UniqueName: \"kubernetes.io/projected/dd5f385d-e137-415f-80a8-0d88d45f56fb-kube-api-access-8sqqq\") pod \"network-check-target-nlgmj\" (UID: \"dd5f385d-e137-415f-80a8-0d88d45f56fb\") " pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:55:47.165948 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:47.165909    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs\") pod \"network-metrics-daemon-jxczq\" (UID: \"bb8ca4ed-507d-4a63-9c35-795adcf504ad\") " pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:55:47.169747 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:47.169726    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 17:55:47.176369 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:47.176347    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 14 17:55:47.176458 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:47.176425    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs podName:bb8ca4ed-507d-4a63-9c35-795adcf504ad nodeName:}" failed. No retries permitted until 2026-07-14 17:56:51.17640246 +0000 UTC m=+129.281512439 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs") pod "network-metrics-daemon-jxczq" (UID: "bb8ca4ed-507d-4a63-9c35-795adcf504ad") : secret "metrics-daemon-secret" not found
Jul 14 17:55:47.350063 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:47.350027    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9r7mf\""
Jul 14 17:55:47.358358 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:47.358329    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:55:47.359527 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:47.359499    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khkzc"
Jul 14 17:55:47.497281 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:47.497121    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nlgmj"]
Jul 14 17:55:47.499806 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:55:47.499778    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd5f385d_e137_415f_80a8_0d88d45f56fb.slice/crio-6dcfb42e01b69e34eac4aa2160eb55559cdd202342668333a09ecb15d14ead20 WatchSource:0}: Error finding container 6dcfb42e01b69e34eac4aa2160eb55559cdd202342668333a09ecb15d14ead20: Status 404 returned error can't find the container with id 6dcfb42e01b69e34eac4aa2160eb55559cdd202342668333a09ecb15d14ead20
Jul 14 17:55:47.508530 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:47.508499    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-khkzc"]
Jul 14 17:55:47.511732 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:55:47.511704    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod383a3b60_1510_4f9a_9075_16da8bed771e.slice/crio-cf315248b4f89cec8bc511fdbd4f29e5382f728034e4640964e0ea02316485f9 WatchSource:0}: Error finding container cf315248b4f89cec8bc511fdbd4f29e5382f728034e4640964e0ea02316485f9: Status 404 returned error can't find the container with id cf315248b4f89cec8bc511fdbd4f29e5382f728034e4640964e0ea02316485f9
Jul 14 17:55:47.750859 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:47.750766    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-khkzc" event={"ID":"383a3b60-1510-4f9a-9075-16da8bed771e","Type":"ContainerStarted","Data":"cf315248b4f89cec8bc511fdbd4f29e5382f728034e4640964e0ea02316485f9"}
Jul 14 17:55:47.751780 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:47.751759    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nlgmj" event={"ID":"dd5f385d-e137-415f-80a8-0d88d45f56fb","Type":"ContainerStarted","Data":"6dcfb42e01b69e34eac4aa2160eb55559cdd202342668333a09ecb15d14ead20"}
Jul 14 17:55:50.590164 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:50.590126    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls\") pod \"dns-default-tfgds\" (UID: \"89451cd2-2887-4999-962c-156d3b2a6043\") " pod="openshift-dns/dns-default-tfgds"
Jul 14 17:55:50.590656 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:50.590312    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 17:55:50.590656 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:55:50.590391    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls podName:89451cd2-2887-4999-962c-156d3b2a6043 nodeName:}" failed. No retries permitted until 2026-07-14 17:56:22.590368643 +0000 UTC m=+100.695478628 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls") pod "dns-default-tfgds" (UID: "89451cd2-2887-4999-962c-156d3b2a6043") : secret "dns-default-metrics-tls" not found
Jul 14 17:55:52.766645 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:52.766606    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nlgmj" event={"ID":"dd5f385d-e137-415f-80a8-0d88d45f56fb","Type":"ContainerStarted","Data":"adc1a4710ae400b029b5b0d8e5599c1f3a9980fed43c668c02dbb1a59e4c5cc9"}
Jul 14 17:55:52.767111 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:52.766676    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:55:52.768046 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:52.768024    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-khkzc" event={"ID":"383a3b60-1510-4f9a-9075-16da8bed771e","Type":"ContainerStarted","Data":"adfaab7af95fba49578543b3658693c5fa6b233960addee9d9d40be36bd06d5a"}
Jul 14 17:55:52.783958 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:52.783904    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nlgmj" podStartSLOduration=65.372934278 podStartE2EDuration="1m9.783889652s" totalImagesPullingTime="4.410955374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:55:52.783618391 +0000 UTC m=+70.888728385" watchObservedRunningTime="2026-07-14 17:55:52.783889652 +0000 UTC m=+70.888999636"
Jul 14 17:55:52.798811 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:55:52.798750    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-khkzc" podStartSLOduration=65.394956807 podStartE2EDuration="1m9.798735597s" totalImagesPullingTime="4.40377879s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:55:52.798419891 +0000 UTC m=+70.903529878" watchObservedRunningTime="2026-07-14 17:55:52.798735597 +0000 UTC m=+70.903845582"
Jul 14 17:56:22.598976 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:56:22.598922    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls\") pod \"dns-default-tfgds\" (UID: \"89451cd2-2887-4999-962c-156d3b2a6043\") " pod="openshift-dns/dns-default-tfgds"
Jul 14 17:56:22.599411 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:56:22.599101    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 17:56:22.599411 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:56:22.599198    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls podName:89451cd2-2887-4999-962c-156d3b2a6043 nodeName:}" failed. No retries permitted until 2026-07-14 17:57:26.599181364 +0000 UTC m=+164.704291326 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls") pod "dns-default-tfgds" (UID: "89451cd2-2887-4999-962c-156d3b2a6043") : secret "dns-default-metrics-tls" not found
Jul 14 17:56:23.773137 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:56:23.773098    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nlgmj"
Jul 14 17:56:51.198167 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:56:51.198127    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs\") pod \"network-metrics-daemon-jxczq\" (UID: \"bb8ca4ed-507d-4a63-9c35-795adcf504ad\") " pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:56:51.198666 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:56:51.198258    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 14 17:56:51.198666 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:56:51.198330    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs podName:bb8ca4ed-507d-4a63-9c35-795adcf504ad nodeName:}" failed. No retries permitted until 2026-07-14 17:58:53.198315244 +0000 UTC m=+251.303425206 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs") pod "network-metrics-daemon-jxczq" (UID: "bb8ca4ed-507d-4a63-9c35-795adcf504ad") : secret "metrics-daemon-secret" not found
Jul 14 17:57:21.754255 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:57:21.754209    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tfgds" podUID="89451cd2-2887-4999-962c-156d3b2a6043"
Jul 14 17:57:21.984771 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:57:21.984696    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tfgds"
Jul 14 17:57:22.453621 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:57:22.453555    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jxczq" podUID="bb8ca4ed-507d-4a63-9c35-795adcf504ad"
Jul 14 17:57:26.646795 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:57:26.646751    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls\") pod \"dns-default-tfgds\" (UID: \"89451cd2-2887-4999-962c-156d3b2a6043\") " pod="openshift-dns/dns-default-tfgds"
Jul 14 17:57:26.647189 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:57:26.646913    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 17:57:26.647189 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:57:26.646988    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls podName:89451cd2-2887-4999-962c-156d3b2a6043 nodeName:}" failed. No retries permitted until 2026-07-14 17:59:28.646969041 +0000 UTC m=+286.752079007 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls") pod "dns-default-tfgds" (UID: "89451cd2-2887-4999-962c-156d3b2a6043") : secret "dns-default-metrics-tls" not found
Jul 14 17:57:36.434747 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:57:36.434658    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:58:22.248494 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.248424    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vlrwr"]
Jul 14 17:58:22.250442 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.250419    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5c4wc"]
Jul 14 17:58:22.250595 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.250537    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vlrwr"
Jul 14 17:58:22.252104 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.252086    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5c4wc"
Jul 14 17:58:22.253537 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.253518    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-lq2xj\""
Jul 14 17:58:22.253904 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.253882    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 14 17:58:22.254603 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.254585    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 14 17:58:22.254685 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.254622    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-kcxcx\""
Jul 14 17:58:22.254685 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.254649    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 14 17:58:22.254928 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.254915    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 14 17:58:22.254971 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.254950    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 14 17:58:22.255086 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.255068    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 14 17:58:22.277516 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.277487    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5c4wc"]
Jul 14 17:58:22.281833 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.281768    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vlrwr"]
Jul 14 17:58:22.327391 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.327351    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/59860f6c-ab8e-4218-b5d9-d9b1246c81f6-config\") pod \"service-ca-operator-7695fc6c8c-5c4wc\" (UID: \"59860f6c-ab8e-4218-b5d9-d9b1246c81f6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5c4wc"
Jul 14 17:58:22.327391 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.327386    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsrx8\" (UniqueName: \"kubernetes.io/projected/59860f6c-ab8e-4218-b5d9-d9b1246c81f6-kube-api-access-gsrx8\") pod \"service-ca-operator-7695fc6c8c-5c4wc\" (UID: \"59860f6c-ab8e-4218-b5d9-d9b1246c81f6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5c4wc"
Jul 14 17:58:22.327661 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.327421    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/59860f6c-ab8e-4218-b5d9-d9b1246c81f6-serving-cert\") pod \"service-ca-operator-7695fc6c8c-5c4wc\" (UID: \"59860f6c-ab8e-4218-b5d9-d9b1246c81f6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5c4wc"
Jul 14 17:58:22.327661 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.327474    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmd4j\" (UniqueName: \"kubernetes.io/projected/a0358384-d357-4d5c-9ebe-e0afcee0707b-kube-api-access-mmd4j\") pod \"volume-data-source-validator-78495597f6-vlrwr\" (UID: \"a0358384-d357-4d5c-9ebe-e0afcee0707b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vlrwr"
Jul 14 17:58:22.428066 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.428033    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsrx8\" (UniqueName: \"kubernetes.io/projected/59860f6c-ab8e-4218-b5d9-d9b1246c81f6-kube-api-access-gsrx8\") pod \"service-ca-operator-7695fc6c8c-5c4wc\" (UID: \"59860f6c-ab8e-4218-b5d9-d9b1246c81f6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5c4wc"
Jul 14 17:58:22.428275 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.428093    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/59860f6c-ab8e-4218-b5d9-d9b1246c81f6-serving-cert\") pod \"service-ca-operator-7695fc6c8c-5c4wc\" (UID: \"59860f6c-ab8e-4218-b5d9-d9b1246c81f6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5c4wc"
Jul 14 17:58:22.428275 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.428117    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmd4j\" (UniqueName: \"kubernetes.io/projected/a0358384-d357-4d5c-9ebe-e0afcee0707b-kube-api-access-mmd4j\") pod \"volume-data-source-validator-78495597f6-vlrwr\" (UID: \"a0358384-d357-4d5c-9ebe-e0afcee0707b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vlrwr"
Jul 14 17:58:22.428275 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.428171    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/59860f6c-ab8e-4218-b5d9-d9b1246c81f6-config\") pod \"service-ca-operator-7695fc6c8c-5c4wc\" (UID: \"59860f6c-ab8e-4218-b5d9-d9b1246c81f6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5c4wc"
Jul 14 17:58:22.428848 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.428778    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/59860f6c-ab8e-4218-b5d9-d9b1246c81f6-config\") pod \"service-ca-operator-7695fc6c8c-5c4wc\" (UID: \"59860f6c-ab8e-4218-b5d9-d9b1246c81f6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5c4wc"
Jul 14 17:58:22.430603 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.430579    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/59860f6c-ab8e-4218-b5d9-d9b1246c81f6-serving-cert\") pod \"service-ca-operator-7695fc6c8c-5c4wc\" (UID: \"59860f6c-ab8e-4218-b5d9-d9b1246c81f6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5c4wc"
Jul 14 17:58:22.450136 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.450103    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsrx8\" (UniqueName: \"kubernetes.io/projected/59860f6c-ab8e-4218-b5d9-d9b1246c81f6-kube-api-access-gsrx8\") pod \"service-ca-operator-7695fc6c8c-5c4wc\" (UID: \"59860f6c-ab8e-4218-b5d9-d9b1246c81f6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5c4wc"
Jul 14 17:58:22.454297 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.454269    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmd4j\" (UniqueName: \"kubernetes.io/projected/a0358384-d357-4d5c-9ebe-e0afcee0707b-kube-api-access-mmd4j\") pod \"volume-data-source-validator-78495597f6-vlrwr\" (UID: \"a0358384-d357-4d5c-9ebe-e0afcee0707b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vlrwr"
Jul 14 17:58:22.457404 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.457378    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9c87cfb6d-hrppd"]
Jul 14 17:58:22.460027 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.460011    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.462735 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.462716    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 14 17:58:22.462891 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.462872    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rr2k7\""
Jul 14 17:58:22.463147 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.463129    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 14 17:58:22.463217 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.463136    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 14 17:58:22.471788 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.471762    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 14 17:58:22.480321 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.480298    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9c87cfb6d-hrppd"]
Jul 14 17:58:22.528693 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.528592    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3a201636-c630-4278-af8a-38cacc25be3c-image-registry-private-configuration\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.528693 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.528631    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3a201636-c630-4278-af8a-38cacc25be3c-ca-trust-extracted\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.528693 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.528651    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-registry-tls\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.528693 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.528668    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a201636-c630-4278-af8a-38cacc25be3c-trusted-ca\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.528693 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.528683    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l479x\" (UniqueName: \"kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-kube-api-access-l479x\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.528693 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.528699    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3a201636-c630-4278-af8a-38cacc25be3c-registry-certificates\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.529042 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.528714    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3a201636-c630-4278-af8a-38cacc25be3c-installation-pull-secrets\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.529042 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.528838    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-bound-sa-token\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.560056 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.560002    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vlrwr"
Jul 14 17:58:22.565187 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.565167    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5c4wc"
Jul 14 17:58:22.631642 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.629708    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3a201636-c630-4278-af8a-38cacc25be3c-image-registry-private-configuration\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.631642 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.629761    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3a201636-c630-4278-af8a-38cacc25be3c-ca-trust-extracted\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.631642 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.629792    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-registry-tls\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.631642 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.629817    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a201636-c630-4278-af8a-38cacc25be3c-trusted-ca\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.631642 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.629863    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l479x\" (UniqueName: \"kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-kube-api-access-l479x\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.631642 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.629894    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3a201636-c630-4278-af8a-38cacc25be3c-registry-certificates\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.631642 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.629919    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3a201636-c630-4278-af8a-38cacc25be3c-installation-pull-secrets\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.631642 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.630010    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-bound-sa-token\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.631642 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.631248    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3a201636-c630-4278-af8a-38cacc25be3c-registry-certificates\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.631642 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.631468    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a201636-c630-4278-af8a-38cacc25be3c-trusted-ca\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.632347 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:22.631896    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 17:58:22.632347 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:22.631920    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9c87cfb6d-hrppd: secret "image-registry-tls" not found
Jul 14 17:58:22.632347 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:22.631995    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-registry-tls podName:3a201636-c630-4278-af8a-38cacc25be3c nodeName:}" failed. No retries permitted until 2026-07-14 17:58:23.131974577 +0000 UTC m=+221.237084557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-registry-tls") pod "image-registry-9c87cfb6d-hrppd" (UID: "3a201636-c630-4278-af8a-38cacc25be3c") : secret "image-registry-tls" not found
Jul 14 17:58:22.632347 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.632042    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3a201636-c630-4278-af8a-38cacc25be3c-ca-trust-extracted\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.635257 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.635224    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3a201636-c630-4278-af8a-38cacc25be3c-image-registry-private-configuration\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.635257 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.635235    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3a201636-c630-4278-af8a-38cacc25be3c-installation-pull-secrets\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.639759 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.639730    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l479x\" (UniqueName: \"kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-kube-api-access-l479x\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.641277 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.641243    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-bound-sa-token\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:22.698655 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.698622    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vlrwr"]
Jul 14 17:58:22.702027 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:58:22.701998    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0358384_d357_4d5c_9ebe_e0afcee0707b.slice/crio-87b99efa1b05902d6e26eca9baed4a494f0af7e3270921f7cc72c2a0ee684de4 WatchSource:0}: Error finding container 87b99efa1b05902d6e26eca9baed4a494f0af7e3270921f7cc72c2a0ee684de4: Status 404 returned error can't find the container with id 87b99efa1b05902d6e26eca9baed4a494f0af7e3270921f7cc72c2a0ee684de4
Jul 14 17:58:22.711995 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:22.711969    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5c4wc"]
Jul 14 17:58:22.714777 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:58:22.714749    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59860f6c_ab8e_4218_b5d9_d9b1246c81f6.slice/crio-8ed2f9d2d24daf87d2adb19b01400f2df259f082f2cd579671ed15506a8a4a08 WatchSource:0}: Error finding container 8ed2f9d2d24daf87d2adb19b01400f2df259f082f2cd579671ed15506a8a4a08: Status 404 returned error can't find the container with id 8ed2f9d2d24daf87d2adb19b01400f2df259f082f2cd579671ed15506a8a4a08
Jul 14 17:58:23.132697 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:23.132669    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-registry-tls\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:23.132895 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:23.132810    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 17:58:23.132895 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:23.132830    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9c87cfb6d-hrppd: secret "image-registry-tls" not found
Jul 14 17:58:23.132895 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:23.132882    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-registry-tls podName:3a201636-c630-4278-af8a-38cacc25be3c nodeName:}" failed. No retries permitted until 2026-07-14 17:58:24.132861934 +0000 UTC m=+222.237971901 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-registry-tls") pod "image-registry-9c87cfb6d-hrppd" (UID: "3a201636-c630-4278-af8a-38cacc25be3c") : secret "image-registry-tls" not found
Jul 14 17:58:23.133551 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:23.133527    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vlrwr" event={"ID":"a0358384-d357-4d5c-9ebe-e0afcee0707b","Type":"ContainerStarted","Data":"87b99efa1b05902d6e26eca9baed4a494f0af7e3270921f7cc72c2a0ee684de4"}
Jul 14 17:58:23.134524 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:23.134505    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5c4wc" event={"ID":"59860f6c-ab8e-4218-b5d9-d9b1246c81f6","Type":"ContainerStarted","Data":"8ed2f9d2d24daf87d2adb19b01400f2df259f082f2cd579671ed15506a8a4a08"}
Jul 14 17:58:24.139873 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:24.139838    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-registry-tls\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:24.140369 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:24.140007    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 17:58:24.140369 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:24.140033    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9c87cfb6d-hrppd: secret "image-registry-tls" not found
Jul 14 17:58:24.140369 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:24.140104    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-registry-tls podName:3a201636-c630-4278-af8a-38cacc25be3c nodeName:}" failed. No retries permitted until 2026-07-14 17:58:26.140083116 +0000 UTC m=+224.245193078 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-registry-tls") pod "image-registry-9c87cfb6d-hrppd" (UID: "3a201636-c630-4278-af8a-38cacc25be3c") : secret "image-registry-tls" not found
Jul 14 17:58:25.140843 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:25.140802    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5c4wc" event={"ID":"59860f6c-ab8e-4218-b5d9-d9b1246c81f6","Type":"ContainerStarted","Data":"38cd9d88f5855beb04cbcee348256f5d13ab5eda60c248e71cdfa1678b0b5175"}
Jul 14 17:58:25.158810 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:25.158758    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5c4wc" podStartSLOduration=0.966007117 podStartE2EDuration="3.158741123s" totalImagesPullingTime="2.192734006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:58:25.157806207 +0000 UTC m=+223.262916193" watchObservedRunningTime="2026-07-14 17:58:25.158741123 +0000 UTC m=+223.263851085"
Jul 14 17:58:26.156938 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:26.156904    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-registry-tls\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:26.157270 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:26.157019    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 17:58:26.157270 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:26.157040    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9c87cfb6d-hrppd: secret "image-registry-tls" not found
Jul 14 17:58:26.157270 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:26.157104    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-registry-tls podName:3a201636-c630-4278-af8a-38cacc25be3c nodeName:}" failed. No retries permitted until 2026-07-14 17:58:30.157083286 +0000 UTC m=+228.262193266 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-registry-tls") pod "image-registry-9c87cfb6d-hrppd" (UID: "3a201636-c630-4278-af8a-38cacc25be3c") : secret "image-registry-tls" not found
Jul 14 17:58:26.397091 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:26.397006    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g95qt"]
Jul 14 17:58:26.399274 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:26.399255    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g95qt"
Jul 14 17:58:26.401939 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:26.401918    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 14 17:58:26.402076 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:26.401969    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 14 17:58:26.402975 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:26.402954    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-w8f4b\""
Jul 14 17:58:26.408949 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:26.408924    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g95qt"]
Jul 14 17:58:26.459403 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:26.459374    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f64mz\" (UniqueName: \"kubernetes.io/projected/115dc574-dc3a-45a6-ba2b-bcc30fd15fa7-kube-api-access-f64mz\") pod \"migrator-7f59b54f6c-g95qt\" (UID: \"115dc574-dc3a-45a6-ba2b-bcc30fd15fa7\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g95qt"
Jul 14 17:58:26.560096 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:26.560064    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f64mz\" (UniqueName: \"kubernetes.io/projected/115dc574-dc3a-45a6-ba2b-bcc30fd15fa7-kube-api-access-f64mz\") pod \"migrator-7f59b54f6c-g95qt\" (UID: \"115dc574-dc3a-45a6-ba2b-bcc30fd15fa7\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g95qt"
Jul 14 17:58:26.569873 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:26.569843    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f64mz\" (UniqueName: \"kubernetes.io/projected/115dc574-dc3a-45a6-ba2b-bcc30fd15fa7-kube-api-access-f64mz\") pod \"migrator-7f59b54f6c-g95qt\" (UID: \"115dc574-dc3a-45a6-ba2b-bcc30fd15fa7\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g95qt"
Jul 14 17:58:26.709282 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:26.709195    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g95qt"
Jul 14 17:58:26.845444 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:26.845413    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g95qt"]
Jul 14 17:58:26.848505 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:58:26.848475    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod115dc574_dc3a_45a6_ba2b_bcc30fd15fa7.slice/crio-9936445f9c8744f7a418e13ed9059a96c72f99ce65351c8e8059e01b453c6342 WatchSource:0}: Error finding container 9936445f9c8744f7a418e13ed9059a96c72f99ce65351c8e8059e01b453c6342: Status 404 returned error can't find the container with id 9936445f9c8744f7a418e13ed9059a96c72f99ce65351c8e8059e01b453c6342
Jul 14 17:58:27.152428 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.152393    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vlrwr" event={"ID":"a0358384-d357-4d5c-9ebe-e0afcee0707b","Type":"ContainerStarted","Data":"eb925f12d226967d4c6ee29b5ba58cb44b51d5c0829f4395bf346bda04e9110d"}
Jul 14 17:58:27.153703 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.153675    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g95qt" event={"ID":"115dc574-dc3a-45a6-ba2b-bcc30fd15fa7","Type":"ContainerStarted","Data":"9936445f9c8744f7a418e13ed9059a96c72f99ce65351c8e8059e01b453c6342"}
Jul 14 17:58:27.168061 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.168026    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vlrwr" podStartSLOduration=1.754737441 podStartE2EDuration="5.168012669s" totalImagesPullingTime="3.413275228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:58:27.167977682 +0000 UTC m=+225.273087657" watchObservedRunningTime="2026-07-14 17:58:27.168012669 +0000 UTC m=+225.273122643"
Jul 14 17:58:27.321663 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.321624    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vcngd"]
Jul 14 17:58:27.324179 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.324161    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:27.327226 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.327198    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 14 17:58:27.327441 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.327209    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 14 17:58:27.327441 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.327253    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 14 17:58:27.327441 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.327288    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5r9n7\""
Jul 14 17:58:27.327663 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.327648    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 14 17:58:27.347622 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.347589    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vcngd"]
Jul 14 17:58:27.366312 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.366275    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04732bec-9669-48a8-8eb9-c50fbaac502e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:27.366312 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.366314    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnwc8\" (UniqueName: \"kubernetes.io/projected/04732bec-9669-48a8-8eb9-c50fbaac502e-kube-api-access-mnwc8\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:27.366529 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.366342    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/04732bec-9669-48a8-8eb9-c50fbaac502e-crio-socket\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:27.366529 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.366379    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/04732bec-9669-48a8-8eb9-c50fbaac502e-data-volume\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:27.366529 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.366404    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04732bec-9669-48a8-8eb9-c50fbaac502e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:27.467525 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.467431    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04732bec-9669-48a8-8eb9-c50fbaac502e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:27.467525 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.467464    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnwc8\" (UniqueName: \"kubernetes.io/projected/04732bec-9669-48a8-8eb9-c50fbaac502e-kube-api-access-mnwc8\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:27.467525 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.467486    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/04732bec-9669-48a8-8eb9-c50fbaac502e-crio-socket\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:27.467525 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.467505    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/04732bec-9669-48a8-8eb9-c50fbaac502e-data-volume\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:27.467525 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.467520    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04732bec-9669-48a8-8eb9-c50fbaac502e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:27.467829 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.467624    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/04732bec-9669-48a8-8eb9-c50fbaac502e-crio-socket\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:27.467829 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:27.467628    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 17:58:27.467829 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:27.467675    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 17:58:27.467829 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:27.467718    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04732bec-9669-48a8-8eb9-c50fbaac502e-insights-runtime-extractor-tls podName:04732bec-9669-48a8-8eb9-c50fbaac502e nodeName:}" failed. No retries permitted until 2026-07-14 17:58:27.967698517 +0000 UTC m=+226.072808500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/04732bec-9669-48a8-8eb9-c50fbaac502e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vcngd" (UID: "04732bec-9669-48a8-8eb9-c50fbaac502e") : secret "insights-runtime-extractor-tls" not found
Jul 14 17:58:27.467829 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:27.467737    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04732bec-9669-48a8-8eb9-c50fbaac502e-kube-rbac-proxy-cm podName:04732bec-9669-48a8-8eb9-c50fbaac502e nodeName:}" failed. No retries permitted until 2026-07-14 17:58:27.967727438 +0000 UTC m=+226.072837401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/04732bec-9669-48a8-8eb9-c50fbaac502e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vcngd" (UID: "04732bec-9669-48a8-8eb9-c50fbaac502e") : configmap "kube-rbac-proxy" not found
Jul 14 17:58:27.467829 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.467821    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/04732bec-9669-48a8-8eb9-c50fbaac502e-data-volume\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:27.477062 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.477037    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnwc8\" (UniqueName: \"kubernetes.io/projected/04732bec-9669-48a8-8eb9-c50fbaac502e-kube-api-access-mnwc8\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:27.971937 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.971891    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04732bec-9669-48a8-8eb9-c50fbaac502e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:27.971937 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:27.971942    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04732bec-9669-48a8-8eb9-c50fbaac502e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:27.972230 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:27.972019    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 17:58:27.972230 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:27.972053    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 17:58:27.972230 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:27.972081    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04732bec-9669-48a8-8eb9-c50fbaac502e-kube-rbac-proxy-cm podName:04732bec-9669-48a8-8eb9-c50fbaac502e nodeName:}" failed. No retries permitted until 2026-07-14 17:58:28.972067943 +0000 UTC m=+227.077177905 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/04732bec-9669-48a8-8eb9-c50fbaac502e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vcngd" (UID: "04732bec-9669-48a8-8eb9-c50fbaac502e") : configmap "kube-rbac-proxy" not found
Jul 14 17:58:27.972230 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:27.972110    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04732bec-9669-48a8-8eb9-c50fbaac502e-insights-runtime-extractor-tls podName:04732bec-9669-48a8-8eb9-c50fbaac502e nodeName:}" failed. No retries permitted until 2026-07-14 17:58:28.972097264 +0000 UTC m=+227.077207226 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/04732bec-9669-48a8-8eb9-c50fbaac502e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vcngd" (UID: "04732bec-9669-48a8-8eb9-c50fbaac502e") : secret "insights-runtime-extractor-tls" not found
Jul 14 17:58:28.980005 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:28.979967    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04732bec-9669-48a8-8eb9-c50fbaac502e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:28.980005 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:28.980009    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04732bec-9669-48a8-8eb9-c50fbaac502e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:28.980463 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:28.980089    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 17:58:28.980463 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:28.980130    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 17:58:28.980463 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:28.980142    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04732bec-9669-48a8-8eb9-c50fbaac502e-kube-rbac-proxy-cm podName:04732bec-9669-48a8-8eb9-c50fbaac502e nodeName:}" failed. No retries permitted until 2026-07-14 17:58:30.980128457 +0000 UTC m=+229.085238420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/04732bec-9669-48a8-8eb9-c50fbaac502e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vcngd" (UID: "04732bec-9669-48a8-8eb9-c50fbaac502e") : configmap "kube-rbac-proxy" not found
Jul 14 17:58:28.980463 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:28.980207    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04732bec-9669-48a8-8eb9-c50fbaac502e-insights-runtime-extractor-tls podName:04732bec-9669-48a8-8eb9-c50fbaac502e nodeName:}" failed. No retries permitted until 2026-07-14 17:58:30.980185406 +0000 UTC m=+229.085295379 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/04732bec-9669-48a8-8eb9-c50fbaac502e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vcngd" (UID: "04732bec-9669-48a8-8eb9-c50fbaac502e") : secret "insights-runtime-extractor-tls" not found
Jul 14 17:58:30.190205 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:30.190166    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-registry-tls\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:30.190711 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:30.190331    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 17:58:30.190711 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:30.190351    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9c87cfb6d-hrppd: secret "image-registry-tls" not found
Jul 14 17:58:30.190711 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:30.190411    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-registry-tls podName:3a201636-c630-4278-af8a-38cacc25be3c nodeName:}" failed. No retries permitted until 2026-07-14 17:58:38.19039386 +0000 UTC m=+236.295503824 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-registry-tls") pod "image-registry-9c87cfb6d-hrppd" (UID: "3a201636-c630-4278-af8a-38cacc25be3c") : secret "image-registry-tls" not found
Jul 14 17:58:30.300755 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:30.300729    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xdk6j_807562d8-2b97-4c0d-9752-aef06e1e80d8/dns-node-resolver/0.log"
Jul 14 17:58:30.996009 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:30.995949    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04732bec-9669-48a8-8eb9-c50fbaac502e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:30.996009 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:30.996008    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04732bec-9669-48a8-8eb9-c50fbaac502e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:30.996259 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:30.996099    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 17:58:30.996259 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:30.996164    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04732bec-9669-48a8-8eb9-c50fbaac502e-insights-runtime-extractor-tls podName:04732bec-9669-48a8-8eb9-c50fbaac502e nodeName:}" failed. No retries permitted until 2026-07-14 17:58:34.996149927 +0000 UTC m=+233.101259888 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/04732bec-9669-48a8-8eb9-c50fbaac502e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vcngd" (UID: "04732bec-9669-48a8-8eb9-c50fbaac502e") : secret "insights-runtime-extractor-tls" not found
Jul 14 17:58:30.996259 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:30.996102    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 17:58:30.996259 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:30.996229    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04732bec-9669-48a8-8eb9-c50fbaac502e-kube-rbac-proxy-cm podName:04732bec-9669-48a8-8eb9-c50fbaac502e nodeName:}" failed. No retries permitted until 2026-07-14 17:58:34.996217377 +0000 UTC m=+233.101327342 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/04732bec-9669-48a8-8eb9-c50fbaac502e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vcngd" (UID: "04732bec-9669-48a8-8eb9-c50fbaac502e") : configmap "kube-rbac-proxy" not found
Jul 14 17:58:31.168961 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:31.168918    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g95qt" event={"ID":"115dc574-dc3a-45a6-ba2b-bcc30fd15fa7","Type":"ContainerStarted","Data":"fc14dc5e4c5e72b7f0f9eac0bbd066c964d60002bfdef3c598cf5d40f79967d1"}
Jul 14 17:58:31.169123 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:31.168982    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g95qt" event={"ID":"115dc574-dc3a-45a6-ba2b-bcc30fd15fa7","Type":"ContainerStarted","Data":"e48cfd0eb51e64bfd523df8be04b90bff36fec6ecb1258484536f163846012a7"}
Jul 14 17:58:31.190205 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:31.190159    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g95qt" podStartSLOduration=1.723191716 podStartE2EDuration="5.190144756s" totalImagesPullingTime="3.46695304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:58:31.189093907 +0000 UTC m=+229.294203892" watchObservedRunningTime="2026-07-14 17:58:31.190144756 +0000 UTC m=+229.295254740"
Jul 14 17:58:31.301501 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:31.301420    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wv4j8_4c968316-3b97-4c10-84f0-0560cd4bcf20/node-ca/0.log"
Jul 14 17:58:31.700945 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:31.700915    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6gdbj_69e043c1-b897-4005-964a-b4febac67de7/serve-healthcheck-canary/0.log"
Jul 14 17:58:32.301341 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:32.301310    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-g95qt_115dc574-dc3a-45a6-ba2b-bcc30fd15fa7/migrator/0.log"
Jul 14 17:58:32.500412 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:32.500385    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-g95qt_115dc574-dc3a-45a6-ba2b-bcc30fd15fa7/graceful-termination/0.log"
Jul 14 17:58:35.028838 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:35.028803    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04732bec-9669-48a8-8eb9-c50fbaac502e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:35.028838 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:35.028840    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04732bec-9669-48a8-8eb9-c50fbaac502e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:35.029289 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:35.028934    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 17:58:35.029289 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:35.028960    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 17:58:35.029289 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:35.028988    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04732bec-9669-48a8-8eb9-c50fbaac502e-kube-rbac-proxy-cm podName:04732bec-9669-48a8-8eb9-c50fbaac502e nodeName:}" failed. No retries permitted until 2026-07-14 17:58:43.028975045 +0000 UTC m=+241.134085007 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/04732bec-9669-48a8-8eb9-c50fbaac502e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vcngd" (UID: "04732bec-9669-48a8-8eb9-c50fbaac502e") : configmap "kube-rbac-proxy" not found
Jul 14 17:58:35.029289 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:58:35.029026    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04732bec-9669-48a8-8eb9-c50fbaac502e-insights-runtime-extractor-tls podName:04732bec-9669-48a8-8eb9-c50fbaac502e nodeName:}" failed. No retries permitted until 2026-07-14 17:58:43.029009659 +0000 UTC m=+241.134119620 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/04732bec-9669-48a8-8eb9-c50fbaac502e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vcngd" (UID: "04732bec-9669-48a8-8eb9-c50fbaac502e") : secret "insights-runtime-extractor-tls" not found
Jul 14 17:58:38.255711 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:38.255663    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-registry-tls\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:38.258277 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:38.258255    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-registry-tls\") pod \"image-registry-9c87cfb6d-hrppd\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") " pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:38.369582 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:38.369512    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:38.517781 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:38.517646    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9c87cfb6d-hrppd"]
Jul 14 17:58:38.520416 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:58:38.520377    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a201636_c630_4278_af8a_38cacc25be3c.slice/crio-3b865868cae019d4f925be14dce7c86bf6b15099928694ee4695601324980dc7 WatchSource:0}: Error finding container 3b865868cae019d4f925be14dce7c86bf6b15099928694ee4695601324980dc7: Status 404 returned error can't find the container with id 3b865868cae019d4f925be14dce7c86bf6b15099928694ee4695601324980dc7
Jul 14 17:58:39.193397 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:39.193358    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd" event={"ID":"3a201636-c630-4278-af8a-38cacc25be3c","Type":"ContainerStarted","Data":"5dcab8062d18027a9d3e2f3929560273ff2340585810b70fa858058542e3c24a"}
Jul 14 17:58:39.193601 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:39.193410    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd" event={"ID":"3a201636-c630-4278-af8a-38cacc25be3c","Type":"ContainerStarted","Data":"3b865868cae019d4f925be14dce7c86bf6b15099928694ee4695601324980dc7"}
Jul 14 17:58:39.193601 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:39.193478    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:58:39.216880 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:39.216829    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd" podStartSLOduration=17.216814895 podStartE2EDuration="17.216814895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:58:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:58:39.215811209 +0000 UTC m=+237.320921192" watchObservedRunningTime="2026-07-14 17:58:39.216814895 +0000 UTC m=+237.321924879"
Jul 14 17:58:43.093383 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:43.093341    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04732bec-9669-48a8-8eb9-c50fbaac502e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:43.093383 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:43.093382    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04732bec-9669-48a8-8eb9-c50fbaac502e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:43.093915 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:43.093896    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04732bec-9669-48a8-8eb9-c50fbaac502e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:43.095844 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:43.095819    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04732bec-9669-48a8-8eb9-c50fbaac502e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vcngd\" (UID: \"04732bec-9669-48a8-8eb9-c50fbaac502e\") " pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:43.236591 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:43.236526    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5r9n7\""
Jul 14 17:58:43.243876 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:43.243851    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vcngd"
Jul 14 17:58:43.375278 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:43.375206    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vcngd"]
Jul 14 17:58:43.378699 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:58:43.378665    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04732bec_9669_48a8_8eb9_c50fbaac502e.slice/crio-a941de41c3f9c1872c175c5aa0060ce2162a4b97676e4e7cf18b425f0bfc251d WatchSource:0}: Error finding container a941de41c3f9c1872c175c5aa0060ce2162a4b97676e4e7cf18b425f0bfc251d: Status 404 returned error can't find the container with id a941de41c3f9c1872c175c5aa0060ce2162a4b97676e4e7cf18b425f0bfc251d
Jul 14 17:58:44.212005 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:44.211958    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vcngd" event={"ID":"04732bec-9669-48a8-8eb9-c50fbaac502e","Type":"ContainerStarted","Data":"a941de41c3f9c1872c175c5aa0060ce2162a4b97676e4e7cf18b425f0bfc251d"}
Jul 14 17:58:47.224268 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:47.224239    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vcngd" event={"ID":"04732bec-9669-48a8-8eb9-c50fbaac502e","Type":"ContainerStarted","Data":"72a22bae8036636c281302dfc5f6927f4c0bc2dbc15d9c1aecf50809931c0817"}
Jul 14 17:58:48.228484 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:48.228452    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vcngd" event={"ID":"04732bec-9669-48a8-8eb9-c50fbaac502e","Type":"ContainerStarted","Data":"dccc2934fb9cf28f37be82685a46f9605a821c077c4a2ea851cf42c846cfa325"}
Jul 14 17:58:51.240700 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:51.240665    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vcngd" event={"ID":"04732bec-9669-48a8-8eb9-c50fbaac502e","Type":"ContainerStarted","Data":"0a43664fa495d6e506493d3a1bbd219fcaeee661ab6fc2bf4584962e8f650062"}
Jul 14 17:58:51.264001 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:51.263955    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vcngd" podStartSLOduration=17.431855148 podStartE2EDuration="24.263942245s" totalImagesPullingTime="6.832087097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:58:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:58:51.262841605 +0000 UTC m=+249.367951590" watchObservedRunningTime="2026-07-14 17:58:51.263942245 +0000 UTC m=+249.369052230"
Jul 14 17:58:53.274337 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:53.274307    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs\") pod \"network-metrics-daemon-jxczq\" (UID: \"bb8ca4ed-507d-4a63-9c35-795adcf504ad\") " pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:58:53.276640 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:53.276622    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb8ca4ed-507d-4a63-9c35-795adcf504ad-metrics-certs\") pod \"network-metrics-daemon-jxczq\" (UID: \"bb8ca4ed-507d-4a63-9c35-795adcf504ad\") " pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:58:53.538629 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:53.538536    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2kndq\""
Jul 14 17:58:53.546189 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:53.546164    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxczq"
Jul 14 17:58:53.676674 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:53.676639    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jxczq"]
Jul 14 17:58:53.679524 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:58:53.679503    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb8ca4ed_507d_4a63_9c35_795adcf504ad.slice/crio-19b7a956037988972c821573c1f65d537b5e754740e31ae248bda9021973db85 WatchSource:0}: Error finding container 19b7a956037988972c821573c1f65d537b5e754740e31ae248bda9021973db85: Status 404 returned error can't find the container with id 19b7a956037988972c821573c1f65d537b5e754740e31ae248bda9021973db85
Jul 14 17:58:54.252578 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:54.252526    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jxczq" event={"ID":"bb8ca4ed-507d-4a63-9c35-795adcf504ad","Type":"ContainerStarted","Data":"19b7a956037988972c821573c1f65d537b5e754740e31ae248bda9021973db85"}
Jul 14 17:58:55.257420 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:55.257385    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jxczq" event={"ID":"bb8ca4ed-507d-4a63-9c35-795adcf504ad","Type":"ContainerStarted","Data":"8af201874d645f652b8530cd871c1dc0e99ad5cbc29ecbf31c505490cfd74b19"}
Jul 14 17:58:55.257813 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:55.257440    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jxczq" event={"ID":"bb8ca4ed-507d-4a63-9c35-795adcf504ad","Type":"ContainerStarted","Data":"2cb2a96faf269dc6c5408b5c26b92dcb518d8a93675c64d1dc6f71531529f853"}
Jul 14 17:58:55.276064 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:55.276017    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jxczq" podStartSLOduration=251.462954906 podStartE2EDuration="4m12.275998398s" totalImagesPullingTime="813.043492ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:58:55.274682947 +0000 UTC m=+253.379792933" watchObservedRunningTime="2026-07-14 17:58:55.275998398 +0000 UTC m=+253.381108378"
Jul 14 17:58:58.375776 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:58.375731    2558 patch_prober.go:28] interesting pod/image-registry-9c87cfb6d-hrppd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 14 17:58:58.376186 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:58:58.375803    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd" podUID="3a201636-c630-4278-af8a-38cacc25be3c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 17:59:00.200303 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:00.200269    2558 patch_prober.go:28] interesting pod/image-registry-9c87cfb6d-hrppd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 14 17:59:00.200809 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:00.200321    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd" podUID="3a201636-c630-4278-af8a-38cacc25be3c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 17:59:08.373991 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:08.373903    2558 patch_prober.go:28] interesting pod/image-registry-9c87cfb6d-hrppd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 14 17:59:08.373991 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:08.373965    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd" podUID="3a201636-c630-4278-af8a-38cacc25be3c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 17:59:10.200752 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:10.200711    2558 patch_prober.go:28] interesting pod/image-registry-9c87cfb6d-hrppd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 14 17:59:10.201142 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:10.200764    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd" podUID="3a201636-c630-4278-af8a-38cacc25be3c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 17:59:18.373869 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:18.373830    2558 patch_prober.go:28] interesting pod/image-registry-9c87cfb6d-hrppd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 14 17:59:18.374306 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:18.373891    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd" podUID="3a201636-c630-4278-af8a-38cacc25be3c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 17:59:18.374306 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:18.373934    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:59:18.374553 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:18.374500    2558 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"5dcab8062d18027a9d3e2f3929560273ff2340585810b70fa858058542e3c24a"} pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd" containerMessage="Container registry failed liveness probe, will be restarted"
Jul 14 17:59:18.378087 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:18.378064    2558 patch_prober.go:28] interesting pod/image-registry-9c87cfb6d-hrppd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 14 17:59:18.378190 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:18.378112    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd" podUID="3a201636-c630-4278-af8a-38cacc25be3c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 17:59:24.986112 ip-10-0-139-216 kubenswrapper[2558]: E0714 17:59:24.986059    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tfgds" podUID="89451cd2-2887-4999-962c-156d3b2a6043"
Jul 14 17:59:25.350139 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:25.350106    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tfgds"
Jul 14 17:59:28.378630 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:28.378596    2558 patch_prober.go:28] interesting pod/image-registry-9c87cfb6d-hrppd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 14 17:59:28.379022 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:28.378648    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd" podUID="3a201636-c630-4278-af8a-38cacc25be3c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 17:59:28.728095 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:28.727998    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls\") pod \"dns-default-tfgds\" (UID: \"89451cd2-2887-4999-962c-156d3b2a6043\") " pod="openshift-dns/dns-default-tfgds"
Jul 14 17:59:28.730447 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:28.730427    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89451cd2-2887-4999-962c-156d3b2a6043-metrics-tls\") pod \"dns-default-tfgds\" (UID: \"89451cd2-2887-4999-962c-156d3b2a6043\") " pod="openshift-dns/dns-default-tfgds"
Jul 14 17:59:28.954194 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:28.954159    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ljwn8\""
Jul 14 17:59:28.961491 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:28.961463    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tfgds"
Jul 14 17:59:29.120381 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:29.120342    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tfgds"]
Jul 14 17:59:29.123466 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:59:29.123440    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89451cd2_2887_4999_962c_156d3b2a6043.slice/crio-81c98a05472cdd44bc49cc1f2b4285d6b2624039bbdcebaa0891c75044cfd5c8 WatchSource:0}: Error finding container 81c98a05472cdd44bc49cc1f2b4285d6b2624039bbdcebaa0891c75044cfd5c8: Status 404 returned error can't find the container with id 81c98a05472cdd44bc49cc1f2b4285d6b2624039bbdcebaa0891c75044cfd5c8
Jul 14 17:59:29.364632 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:29.364597    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tfgds" event={"ID":"89451cd2-2887-4999-962c-156d3b2a6043","Type":"ContainerStarted","Data":"81c98a05472cdd44bc49cc1f2b4285d6b2624039bbdcebaa0891c75044cfd5c8"}
Jul 14 17:59:31.372007 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:31.371971    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tfgds" event={"ID":"89451cd2-2887-4999-962c-156d3b2a6043","Type":"ContainerStarted","Data":"bce9a5d1c7ac802b888ec4e984dc00960b589e1cb73fce8eccc19191b1eb5f47"}
Jul 14 17:59:31.372422 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:31.372023    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tfgds" event={"ID":"89451cd2-2887-4999-962c-156d3b2a6043","Type":"ContainerStarted","Data":"95d8f4f37d11b7cb4424eb366cd0ae59add83f0281f027bbbdb37f780462ebf0"}
Jul 14 17:59:31.372422 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:31.372106    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tfgds"
Jul 14 17:59:31.391040 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:31.390988    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tfgds" podStartSLOduration=251.847170229 podStartE2EDuration="4m13.390970861s" totalImagesPullingTime="1.543800632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:59:31.390213218 +0000 UTC m=+289.495323203" watchObservedRunningTime="2026-07-14 17:59:31.390970861 +0000 UTC m=+289.496080844"
Jul 14 17:59:38.378475 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:38.378438    2558 patch_prober.go:28] interesting pod/image-registry-9c87cfb6d-hrppd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 14 17:59:38.378903 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:38.378492    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd" podUID="3a201636-c630-4278-af8a-38cacc25be3c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 17:59:41.377228 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:41.377195    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tfgds"
Jul 14 17:59:42.277110 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:42.277079    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 17:59:42.278183 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:42.278149    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 17:59:42.282285 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:42.282263    2558 kubelet.go:1648] "Image garbage collection succeeded"
Jul 14 17:59:43.394380 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:43.394328    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd" podUID="3a201636-c630-4278-af8a-38cacc25be3c" containerName="registry" containerID="cri-o://5dcab8062d18027a9d3e2f3929560273ff2340585810b70fa858058542e3c24a" gracePeriod=30
Jul 14 17:59:44.412603 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:44.412540    2558 generic.go:356] "Generic (PLEG): container finished" podID="3a201636-c630-4278-af8a-38cacc25be3c" containerID="5dcab8062d18027a9d3e2f3929560273ff2340585810b70fa858058542e3c24a" exitCode=0
Jul 14 17:59:44.412990 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:44.412620    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd" event={"ID":"3a201636-c630-4278-af8a-38cacc25be3c","Type":"ContainerDied","Data":"5dcab8062d18027a9d3e2f3929560273ff2340585810b70fa858058542e3c24a"}
Jul 14 17:59:44.412990 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:44.412706    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd" event={"ID":"3a201636-c630-4278-af8a-38cacc25be3c","Type":"ContainerStarted","Data":"e618af2a3653128ab4695d2a0148ccdd817ab94eaa0b4081c597daa748a8c356"}
Jul 14 17:59:44.412990 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:44.412876    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 17:59:54.285510 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:54.285447    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sjmkv"]
Jul 14 17:59:54.290186 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:54.290158    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-shcnm"]
Jul 14 17:59:54.290347 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:54.290277    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sjmkv"
Jul 14 17:59:54.293036 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:54.293011    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 14 17:59:54.293219 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:54.293194    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-shcnm"
Jul 14 17:59:54.295292 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:54.295268    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-l8xgz\""
Jul 14 17:59:54.296156 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:54.296134    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6m9q7\""
Jul 14 17:59:54.296285 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:54.296190    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 14 17:59:54.296994 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:54.296971    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 14 17:59:54.300031 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:54.300001    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/87dd818d-53dd-4962-a61f-4b90fd4e11e7-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-sjmkv\" (UID: \"87dd818d-53dd-4962-a61f-4b90fd4e11e7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sjmkv"
Jul 14 17:59:54.306031 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:54.305407    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-shcnm"]
Jul 14 17:59:54.306589 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:54.306540    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9c87cfb6d-hrppd"]
Jul 14 17:59:54.307824 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:54.307797    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sjmkv"]
Jul 14 17:59:54.401002 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:54.400963    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/87dd818d-53dd-4962-a61f-4b90fd4e11e7-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-sjmkv\" (UID: \"87dd818d-53dd-4962-a61f-4b90fd4e11e7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sjmkv"
Jul 14 17:59:54.401183 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:54.401022    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48grn\" (UniqueName: \"kubernetes.io/projected/c05507a8-89d3-40a2-900a-fe47242d023b-kube-api-access-48grn\") pod \"downloads-68c9cbb497-shcnm\" (UID: \"c05507a8-89d3-40a2-900a-fe47242d023b\") " pod="openshift-console/downloads-68c9cbb497-shcnm"
Jul 14 17:59:54.403604 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:54.403556    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/87dd818d-53dd-4962-a61f-4b90fd4e11e7-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-sjmkv\" (UID: \"87dd818d-53dd-4962-a61f-4b90fd4e11e7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sjmkv"
Jul 14 17:59:54.502082 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:54.502036    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48grn\" (UniqueName: \"kubernetes.io/projected/c05507a8-89d3-40a2-900a-fe47242d023b-kube-api-access-48grn\") pod \"downloads-68c9cbb497-shcnm\" (UID: \"c05507a8-89d3-40a2-900a-fe47242d023b\") " pod="openshift-console/downloads-68c9cbb497-shcnm"
Jul 14 17:59:54.511866 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:54.511835    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48grn\" (UniqueName: \"kubernetes.io/projected/c05507a8-89d3-40a2-900a-fe47242d023b-kube-api-access-48grn\") pod \"downloads-68c9cbb497-shcnm\" (UID: \"c05507a8-89d3-40a2-900a-fe47242d023b\") " pod="openshift-console/downloads-68c9cbb497-shcnm"
Jul 14 17:59:54.602036 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:54.602002    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sjmkv"
Jul 14 17:59:54.609023 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:54.609000    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-shcnm"
Jul 14 17:59:54.745831 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:54.745788    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sjmkv"]
Jul 14 17:59:54.750259 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:59:54.750231    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87dd818d_53dd_4962_a61f_4b90fd4e11e7.slice/crio-8af421d83ea5c127557a96e80dbbd1d0fe9b608bf63498d317bca02bf74590e7 WatchSource:0}: Error finding container 8af421d83ea5c127557a96e80dbbd1d0fe9b608bf63498d317bca02bf74590e7: Status 404 returned error can't find the container with id 8af421d83ea5c127557a96e80dbbd1d0fe9b608bf63498d317bca02bf74590e7
Jul 14 17:59:54.752082 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:54.752068    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 17:59:54.763771 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:54.763743    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-shcnm"]
Jul 14 17:59:54.766345 ip-10-0-139-216 kubenswrapper[2558]: W0714 17:59:54.766312    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc05507a8_89d3_40a2_900a_fe47242d023b.slice/crio-16ac00fd75cc403744ef22ded046a7c6a978769800ea36c5452b87a5d106c96d WatchSource:0}: Error finding container 16ac00fd75cc403744ef22ded046a7c6a978769800ea36c5452b87a5d106c96d: Status 404 returned error can't find the container with id 16ac00fd75cc403744ef22ded046a7c6a978769800ea36c5452b87a5d106c96d
Jul 14 17:59:55.450511 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:55.450467    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sjmkv" event={"ID":"87dd818d-53dd-4962-a61f-4b90fd4e11e7","Type":"ContainerStarted","Data":"8af421d83ea5c127557a96e80dbbd1d0fe9b608bf63498d317bca02bf74590e7"}
Jul 14 17:59:55.452625 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:55.452523    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-shcnm" event={"ID":"c05507a8-89d3-40a2-900a-fe47242d023b","Type":"ContainerStarted","Data":"16ac00fd75cc403744ef22ded046a7c6a978769800ea36c5452b87a5d106c96d"}
Jul 14 17:59:56.458796 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:56.458754    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sjmkv" event={"ID":"87dd818d-53dd-4962-a61f-4b90fd4e11e7","Type":"ContainerStarted","Data":"088115d1213c8b078f616318d5492af878dc21e2cde33d5092918a87dfd78ba5"}
Jul 14 17:59:56.459269 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:56.458923    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sjmkv"
Jul 14 17:59:56.460611 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:56.460549    2558 generic.go:356] "Generic (PLEG): container finished" podID="59860f6c-ab8e-4218-b5d9-d9b1246c81f6" containerID="38cd9d88f5855beb04cbcee348256f5d13ab5eda60c248e71cdfa1678b0b5175" exitCode=0
Jul 14 17:59:56.460611 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:56.460597    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5c4wc" event={"ID":"59860f6c-ab8e-4218-b5d9-d9b1246c81f6","Type":"ContainerDied","Data":"38cd9d88f5855beb04cbcee348256f5d13ab5eda60c248e71cdfa1678b0b5175"}
Jul 14 17:59:56.460947 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:56.460930    2558 scope.go:117] "RemoveContainer" containerID="38cd9d88f5855beb04cbcee348256f5d13ab5eda60c248e71cdfa1678b0b5175"
Jul 14 17:59:56.464325 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:56.464305    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sjmkv"
Jul 14 17:59:56.475805 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:56.475751    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sjmkv" podStartSLOduration=1.39923723 podStartE2EDuration="2.475730839s" totalImagesPullingTime="1.076493609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:59:56.475410101 +0000 UTC m=+314.580520088" watchObservedRunningTime="2026-07-14 17:59:56.475730839 +0000 UTC m=+314.580840823"
Jul 14 17:59:57.467834 ip-10-0-139-216 kubenswrapper[2558]: I0714 17:59:57.467725    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5c4wc" event={"ID":"59860f6c-ab8e-4218-b5d9-d9b1246c81f6","Type":"ContainerStarted","Data":"704df2a75a5c6d6aaa65770c5df688f728825c28ebd5253d0f7c4d05c8c6a29e"}
Jul 14 18:00:00.559537 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.559480    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9gqhz"]
Jul 14 18:00:00.564328 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.564298    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.568004 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.567974    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 14 18:00:00.570754 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.570724    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 14 18:00:00.570894 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.570773    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 14 18:00:00.570894 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.570725    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 14 18:00:00.570894 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.570780    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 14 18:00:00.571063 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.570724    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7kfx4\""
Jul 14 18:00:00.571208 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.571193    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 14 18:00:00.648957 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.648924    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-node-exporter-accelerators-collector-config\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.648957 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.648965    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-metrics-client-ca\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.649181 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.648996    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-sys\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.649181 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.649103    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.649181 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.649146    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-root\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.649312 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.649192    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmdlc\" (UniqueName: \"kubernetes.io/projected/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-kube-api-access-cmdlc\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.649312 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.649228    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-node-exporter-wtmp\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.649312 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.649263    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-node-exporter-textfile\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.649312 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.649288    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-node-exporter-tls\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.749813 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.749778    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-node-exporter-wtmp\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.749813 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.749825    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-node-exporter-textfile\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.750060 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.749850    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-node-exporter-tls\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.750060 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.749879    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-node-exporter-accelerators-collector-config\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.750060 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.749905    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-metrics-client-ca\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.750060 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.749937    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-sys\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.750060 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.749972    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.750060 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.749982    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-node-exporter-wtmp\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.750060 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.750003    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-root\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.750060 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.750053    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-root\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.750474 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.750061    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmdlc\" (UniqueName: \"kubernetes.io/projected/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-kube-api-access-cmdlc\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.750474 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.750122    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-sys\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.750474 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.750326    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-node-exporter-textfile\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.750797 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.750749    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-node-exporter-accelerators-collector-config\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.750924 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.750818    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-metrics-client-ca\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.752748 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.752725    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-node-exporter-tls\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.753011 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.752991    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.764983 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.764958    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmdlc\" (UniqueName: \"kubernetes.io/projected/a0b5b6ad-4dae-4201-9e27-0c6ed022247b-kube-api-access-cmdlc\") pod \"node-exporter-9gqhz\" (UID: \"a0b5b6ad-4dae-4201-9e27-0c6ed022247b\") " pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.876266 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:00.876228    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9gqhz"
Jul 14 18:00:00.890325 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:00:00.890288    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0b5b6ad_4dae_4201_9e27_0c6ed022247b.slice/crio-8ba33c136682559df74697fd12a45e5dfcd785156dddb79a208118395dcfcba9 WatchSource:0}: Error finding container 8ba33c136682559df74697fd12a45e5dfcd785156dddb79a208118395dcfcba9: Status 404 returned error can't find the container with id 8ba33c136682559df74697fd12a45e5dfcd785156dddb79a208118395dcfcba9
Jul 14 18:00:01.485707 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:01.485670    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9gqhz" event={"ID":"a0b5b6ad-4dae-4201-9e27-0c6ed022247b","Type":"ContainerStarted","Data":"8ba33c136682559df74697fd12a45e5dfcd785156dddb79a208118395dcfcba9"}
Jul 14 18:00:02.491409 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:02.491364    2558 generic.go:356] "Generic (PLEG): container finished" podID="a0b5b6ad-4dae-4201-9e27-0c6ed022247b" containerID="9aeaad225027e86d8b0ceab84936dfbeff6b36be66d4f521febe973c3e9b07a0" exitCode=0
Jul 14 18:00:02.491900 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:02.491451    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9gqhz" event={"ID":"a0b5b6ad-4dae-4201-9e27-0c6ed022247b","Type":"ContainerDied","Data":"9aeaad225027e86d8b0ceab84936dfbeff6b36be66d4f521febe973c3e9b07a0"}
Jul 14 18:00:03.497702 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.497657    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9gqhz" event={"ID":"a0b5b6ad-4dae-4201-9e27-0c6ed022247b","Type":"ContainerStarted","Data":"4c5672826b36ddb1761d6bc96bfc0d2f5a6c5d40b47a00d3b1e254699e4044c8"}
Jul 14 18:00:03.498160 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.497730    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9gqhz" event={"ID":"a0b5b6ad-4dae-4201-9e27-0c6ed022247b","Type":"ContainerStarted","Data":"89cf37398b326a0c846f4d2c721bb4d9f6953ab08ea94bd6ce6537d53e9bf118"}
Jul 14 18:00:03.521101 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.521036    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9gqhz" podStartSLOduration=2.060707514 podStartE2EDuration="3.521014867s" totalImagesPullingTime="1.377542383s" totalInitContainerRuntime="82.76497ms" isStatefulPod=true podCreationTimestamp="2026-07-14 18:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:00:03.519652219 +0000 UTC m=+321.624762202" watchObservedRunningTime="2026-07-14 18:00:03.521014867 +0000 UTC m=+321.626124852"
Jul 14 18:00:03.614272 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.614235    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-69fb87c44-2vlpk"]
Jul 14 18:00:03.616789 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.616762    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.619586 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.619543    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 14 18:00:03.619736 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.619679    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-5dx6p\""
Jul 14 18:00:03.619860 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.619819    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 14 18:00:03.619929 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.619909    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 14 18:00:03.620042 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.620027    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 14 18:00:03.620183 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.620100    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 14 18:00:03.620183 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.620133    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a7377n4pmvkic\""
Jul 14 18:00:03.631720 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.631693    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69fb87c44-2vlpk"]
Jul 14 18:00:03.675316 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.675278    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/54a469e3-9929-45b8-90e9-6facd3f90aa6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.675316 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.675326    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/54a469e3-9929-45b8-90e9-6facd3f90aa6-secret-thanos-querier-tls\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.675535 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.675365    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54a469e3-9929-45b8-90e9-6facd3f90aa6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.675535 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.675386    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ppp4\" (UniqueName: \"kubernetes.io/projected/54a469e3-9929-45b8-90e9-6facd3f90aa6-kube-api-access-5ppp4\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.675535 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.675403    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54a469e3-9929-45b8-90e9-6facd3f90aa6-metrics-client-ca\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.675535 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.675424    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/54a469e3-9929-45b8-90e9-6facd3f90aa6-secret-grpc-tls\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.675535 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.675507    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54a469e3-9929-45b8-90e9-6facd3f90aa6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.675535 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.675533    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/54a469e3-9929-45b8-90e9-6facd3f90aa6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.776403 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.776311    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/54a469e3-9929-45b8-90e9-6facd3f90aa6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.776403 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.776351    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/54a469e3-9929-45b8-90e9-6facd3f90aa6-secret-thanos-querier-tls\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.776654 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.776548    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54a469e3-9929-45b8-90e9-6facd3f90aa6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.776654 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.776610    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ppp4\" (UniqueName: \"kubernetes.io/projected/54a469e3-9929-45b8-90e9-6facd3f90aa6-kube-api-access-5ppp4\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.776654 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.776645    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54a469e3-9929-45b8-90e9-6facd3f90aa6-metrics-client-ca\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.776774 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.776673    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/54a469e3-9929-45b8-90e9-6facd3f90aa6-secret-grpc-tls\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.776774 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.776726    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54a469e3-9929-45b8-90e9-6facd3f90aa6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.776774 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.776752    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/54a469e3-9929-45b8-90e9-6facd3f90aa6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.777696 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.777663    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54a469e3-9929-45b8-90e9-6facd3f90aa6-metrics-client-ca\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.779624 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.779575    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/54a469e3-9929-45b8-90e9-6facd3f90aa6-secret-thanos-querier-tls\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.779784 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.779759    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/54a469e3-9929-45b8-90e9-6facd3f90aa6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.779857 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.779768    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/54a469e3-9929-45b8-90e9-6facd3f90aa6-secret-grpc-tls\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.779857 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.779801    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/54a469e3-9929-45b8-90e9-6facd3f90aa6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.781004 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.780982    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54a469e3-9929-45b8-90e9-6facd3f90aa6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.781286 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.781264    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54a469e3-9929-45b8-90e9-6facd3f90aa6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.788836 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.788809    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ppp4\" (UniqueName: \"kubernetes.io/projected/54a469e3-9929-45b8-90e9-6facd3f90aa6-kube-api-access-5ppp4\") pod \"thanos-querier-69fb87c44-2vlpk\" (UID: \"54a469e3-9929-45b8-90e9-6facd3f90aa6\") " pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:03.927937 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:03.927891    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:04.095758 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:04.095709    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69fb87c44-2vlpk"]
Jul 14 18:00:04.100051 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:00:04.100022    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54a469e3_9929_45b8_90e9_6facd3f90aa6.slice/crio-ab415a02f60dde7a1ed3326bd83bcb5b3b00753561fac53b38a73ad6d1c7b204 WatchSource:0}: Error finding container ab415a02f60dde7a1ed3326bd83bcb5b3b00753561fac53b38a73ad6d1c7b204: Status 404 returned error can't find the container with id ab415a02f60dde7a1ed3326bd83bcb5b3b00753561fac53b38a73ad6d1c7b204
Jul 14 18:00:04.313509 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:04.313482    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 18:00:04.502937 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:04.502846    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk" event={"ID":"54a469e3-9929-45b8-90e9-6facd3f90aa6","Type":"ContainerStarted","Data":"ab415a02f60dde7a1ed3326bd83bcb5b3b00753561fac53b38a73ad6d1c7b204"}
Jul 14 18:00:04.981350 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:04.981317    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-c766fdf6c-x4nk2"]
Jul 14 18:00:04.986132 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:04.986108    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:04.989105 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:04.989077    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 14 18:00:04.989251 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:04.989077    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 14 18:00:04.990136 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:04.990105    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-flokn1deoapkg\""
Jul 14 18:00:04.990248 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:04.990232    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jc2n6\""
Jul 14 18:00:04.990312 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:04.990247    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 14 18:00:04.990312 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:04.990267    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 14 18:00:04.997799 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:04.997777    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c766fdf6c-x4nk2"]
Jul 14 18:00:05.088655 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.088618    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f62d258d-1509-4057-994c-1aac4a86be2c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c766fdf6c-x4nk2\" (UID: \"f62d258d-1509-4057-994c-1aac4a86be2c\") " pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:05.088833 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.088666    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f62d258d-1509-4057-994c-1aac4a86be2c-client-ca-bundle\") pod \"metrics-server-c766fdf6c-x4nk2\" (UID: \"f62d258d-1509-4057-994c-1aac4a86be2c\") " pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:05.088833 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.088699    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f62d258d-1509-4057-994c-1aac4a86be2c-metrics-server-audit-profiles\") pod \"metrics-server-c766fdf6c-x4nk2\" (UID: \"f62d258d-1509-4057-994c-1aac4a86be2c\") " pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:05.088833 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.088805    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f62d258d-1509-4057-994c-1aac4a86be2c-secret-metrics-server-tls\") pod \"metrics-server-c766fdf6c-x4nk2\" (UID: \"f62d258d-1509-4057-994c-1aac4a86be2c\") " pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:05.088958 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.088847    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbndh\" (UniqueName: \"kubernetes.io/projected/f62d258d-1509-4057-994c-1aac4a86be2c-kube-api-access-zbndh\") pod \"metrics-server-c766fdf6c-x4nk2\" (UID: \"f62d258d-1509-4057-994c-1aac4a86be2c\") " pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:05.088958 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.088901    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f62d258d-1509-4057-994c-1aac4a86be2c-audit-log\") pod \"metrics-server-c766fdf6c-x4nk2\" (UID: \"f62d258d-1509-4057-994c-1aac4a86be2c\") " pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:05.088958 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.088933    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f62d258d-1509-4057-994c-1aac4a86be2c-secret-metrics-server-client-certs\") pod \"metrics-server-c766fdf6c-x4nk2\" (UID: \"f62d258d-1509-4057-994c-1aac4a86be2c\") " pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:05.189976 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.189936    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbndh\" (UniqueName: \"kubernetes.io/projected/f62d258d-1509-4057-994c-1aac4a86be2c-kube-api-access-zbndh\") pod \"metrics-server-c766fdf6c-x4nk2\" (UID: \"f62d258d-1509-4057-994c-1aac4a86be2c\") " pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:05.190134 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.189988    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f62d258d-1509-4057-994c-1aac4a86be2c-audit-log\") pod \"metrics-server-c766fdf6c-x4nk2\" (UID: \"f62d258d-1509-4057-994c-1aac4a86be2c\") " pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:05.190134 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.190034    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f62d258d-1509-4057-994c-1aac4a86be2c-secret-metrics-server-client-certs\") pod \"metrics-server-c766fdf6c-x4nk2\" (UID: \"f62d258d-1509-4057-994c-1aac4a86be2c\") " pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:05.190134 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.190056    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f62d258d-1509-4057-994c-1aac4a86be2c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c766fdf6c-x4nk2\" (UID: \"f62d258d-1509-4057-994c-1aac4a86be2c\") " pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:05.190134 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.190083    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f62d258d-1509-4057-994c-1aac4a86be2c-client-ca-bundle\") pod \"metrics-server-c766fdf6c-x4nk2\" (UID: \"f62d258d-1509-4057-994c-1aac4a86be2c\") " pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:05.190134 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.190111    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f62d258d-1509-4057-994c-1aac4a86be2c-metrics-server-audit-profiles\") pod \"metrics-server-c766fdf6c-x4nk2\" (UID: \"f62d258d-1509-4057-994c-1aac4a86be2c\") " pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:05.190377 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.190171    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f62d258d-1509-4057-994c-1aac4a86be2c-secret-metrics-server-tls\") pod \"metrics-server-c766fdf6c-x4nk2\" (UID: \"f62d258d-1509-4057-994c-1aac4a86be2c\") " pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:05.190524 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.190501    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f62d258d-1509-4057-994c-1aac4a86be2c-audit-log\") pod \"metrics-server-c766fdf6c-x4nk2\" (UID: \"f62d258d-1509-4057-994c-1aac4a86be2c\") " pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:05.191237 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.191156    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f62d258d-1509-4057-994c-1aac4a86be2c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c766fdf6c-x4nk2\" (UID: \"f62d258d-1509-4057-994c-1aac4a86be2c\") " pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:05.191348 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.191247    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f62d258d-1509-4057-994c-1aac4a86be2c-metrics-server-audit-profiles\") pod \"metrics-server-c766fdf6c-x4nk2\" (UID: \"f62d258d-1509-4057-994c-1aac4a86be2c\") " pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:05.193200 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.193156    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f62d258d-1509-4057-994c-1aac4a86be2c-secret-metrics-server-tls\") pod \"metrics-server-c766fdf6c-x4nk2\" (UID: \"f62d258d-1509-4057-994c-1aac4a86be2c\") " pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:05.193368 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.193347    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f62d258d-1509-4057-994c-1aac4a86be2c-client-ca-bundle\") pod \"metrics-server-c766fdf6c-x4nk2\" (UID: \"f62d258d-1509-4057-994c-1aac4a86be2c\") " pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:05.193513 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.193491    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f62d258d-1509-4057-994c-1aac4a86be2c-secret-metrics-server-client-certs\") pod \"metrics-server-c766fdf6c-x4nk2\" (UID: \"f62d258d-1509-4057-994c-1aac4a86be2c\") " pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:05.199295 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.199274    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbndh\" (UniqueName: \"kubernetes.io/projected/f62d258d-1509-4057-994c-1aac4a86be2c-kube-api-access-zbndh\") pod \"metrics-server-c766fdf6c-x4nk2\" (UID: \"f62d258d-1509-4057-994c-1aac4a86be2c\") " pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:05.296996 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.296907    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:05.301452 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.301418    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57fc4c646-2qq64"]
Jul 14 18:00:05.305981 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.305958    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-2wxlx"]
Jul 14 18:00:05.306110 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.306087    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:05.308892 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.308869    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 14 18:00:05.309015 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.308992    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 14 18:00:05.309166 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.309151    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 14 18:00:05.309218 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.309166    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 14 18:00:05.309410 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.309390    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 14 18:00:05.309620 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.309602    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tqzm2\""
Jul 14 18:00:05.310156 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.310138    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2wxlx"
Jul 14 18:00:05.313077 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.312873    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 14 18:00:05.313499 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.313458    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ccqzz\""
Jul 14 18:00:05.316097 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.315502    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 14 18:00:05.318763 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.318714    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-2wxlx"]
Jul 14 18:00:05.320434 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.320412    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57fc4c646-2qq64"]
Jul 14 18:00:05.391550 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.391509    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-console-config\") pod \"console-57fc4c646-2qq64\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") " pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:05.391738 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.391590    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27354305-11e3-4589-bcdd-8d70b53b5d8a-console-serving-cert\") pod \"console-57fc4c646-2qq64\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") " pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:05.391738 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.391634    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf4pj\" (UniqueName: \"kubernetes.io/projected/b58d02dc-8106-4059-9e14-09624f38e02d-kube-api-access-tf4pj\") pod \"monitoring-plugin-5f68df7f58-2wxlx\" (UID: \"b58d02dc-8106-4059-9e14-09624f38e02d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2wxlx"
Jul 14 18:00:05.391738 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.391675    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng2kb\" (UniqueName: \"kubernetes.io/projected/27354305-11e3-4589-bcdd-8d70b53b5d8a-kube-api-access-ng2kb\") pod \"console-57fc4c646-2qq64\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") " pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:05.391738 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.391705    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27354305-11e3-4589-bcdd-8d70b53b5d8a-console-oauth-config\") pod \"console-57fc4c646-2qq64\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") " pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:05.391924 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.391739    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-oauth-serving-cert\") pod \"console-57fc4c646-2qq64\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") " pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:05.391924 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.391775    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b58d02dc-8106-4059-9e14-09624f38e02d-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-2wxlx\" (UID: \"b58d02dc-8106-4059-9e14-09624f38e02d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2wxlx"
Jul 14 18:00:05.391924 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.391800    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-service-ca\") pod \"console-57fc4c646-2qq64\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") " pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:05.391924 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.391826    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-trusted-ca-bundle\") pod \"console-57fc4c646-2qq64\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") " pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:05.492903 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.492860    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b58d02dc-8106-4059-9e14-09624f38e02d-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-2wxlx\" (UID: \"b58d02dc-8106-4059-9e14-09624f38e02d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2wxlx"
Jul 14 18:00:05.492903 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.492914    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-service-ca\") pod \"console-57fc4c646-2qq64\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") " pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:05.493150 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.492943    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-trusted-ca-bundle\") pod \"console-57fc4c646-2qq64\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") " pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:05.493150 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.493008    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-console-config\") pod \"console-57fc4c646-2qq64\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") " pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:05.493254 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.493210    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27354305-11e3-4589-bcdd-8d70b53b5d8a-console-serving-cert\") pod \"console-57fc4c646-2qq64\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") " pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:05.493308 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.493257    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf4pj\" (UniqueName: \"kubernetes.io/projected/b58d02dc-8106-4059-9e14-09624f38e02d-kube-api-access-tf4pj\") pod \"monitoring-plugin-5f68df7f58-2wxlx\" (UID: \"b58d02dc-8106-4059-9e14-09624f38e02d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2wxlx"
Jul 14 18:00:05.493308 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.493300    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng2kb\" (UniqueName: \"kubernetes.io/projected/27354305-11e3-4589-bcdd-8d70b53b5d8a-kube-api-access-ng2kb\") pod \"console-57fc4c646-2qq64\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") " pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:05.493399 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.493334    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27354305-11e3-4589-bcdd-8d70b53b5d8a-console-oauth-config\") pod \"console-57fc4c646-2qq64\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") " pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:05.493399 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.493370    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-oauth-serving-cert\") pod \"console-57fc4c646-2qq64\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") " pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:05.493866 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.493775    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-service-ca\") pod \"console-57fc4c646-2qq64\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") " pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:05.493866 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.493750    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-console-config\") pod \"console-57fc4c646-2qq64\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") " pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:05.494074 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.493957    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-trusted-ca-bundle\") pod \"console-57fc4c646-2qq64\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") " pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:05.494074 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.494021    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-oauth-serving-cert\") pod \"console-57fc4c646-2qq64\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") " pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:05.496090 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.496040    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b58d02dc-8106-4059-9e14-09624f38e02d-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-2wxlx\" (UID: \"b58d02dc-8106-4059-9e14-09624f38e02d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2wxlx"
Jul 14 18:00:05.496317 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.496297    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27354305-11e3-4589-bcdd-8d70b53b5d8a-console-serving-cert\") pod \"console-57fc4c646-2qq64\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") " pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:05.496499 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.496477    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27354305-11e3-4589-bcdd-8d70b53b5d8a-console-oauth-config\") pod \"console-57fc4c646-2qq64\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") " pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:05.502776 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.502743    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf4pj\" (UniqueName: \"kubernetes.io/projected/b58d02dc-8106-4059-9e14-09624f38e02d-kube-api-access-tf4pj\") pod \"monitoring-plugin-5f68df7f58-2wxlx\" (UID: \"b58d02dc-8106-4059-9e14-09624f38e02d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2wxlx"
Jul 14 18:00:05.502912 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.502847    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng2kb\" (UniqueName: \"kubernetes.io/projected/27354305-11e3-4589-bcdd-8d70b53b5d8a-kube-api-access-ng2kb\") pod \"console-57fc4c646-2qq64\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") " pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:05.620274 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.620238    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:05.628062 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:05.628031    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2wxlx"
Jul 14 18:00:11.387988 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:11.387841    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c766fdf6c-x4nk2"]
Jul 14 18:00:11.390484 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:00:11.390449    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf62d258d_1509_4057_994c_1aac4a86be2c.slice/crio-557ff9851f484f531880342417ce658b639cdb0b0075c50ee305461c3817eb2c WatchSource:0}: Error finding container 557ff9851f484f531880342417ce658b639cdb0b0075c50ee305461c3817eb2c: Status 404 returned error can't find the container with id 557ff9851f484f531880342417ce658b639cdb0b0075c50ee305461c3817eb2c
Jul 14 18:00:11.409500 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:11.409461    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-2wxlx"]
Jul 14 18:00:11.413035 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:00:11.413003    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58d02dc_8106_4059_9e14_09624f38e02d.slice/crio-f825caca70bc77f1a794aca9c8d1d47473635ee7d171c0f7e366950b329b4d94 WatchSource:0}: Error finding container f825caca70bc77f1a794aca9c8d1d47473635ee7d171c0f7e366950b329b4d94: Status 404 returned error can't find the container with id f825caca70bc77f1a794aca9c8d1d47473635ee7d171c0f7e366950b329b4d94
Jul 14 18:00:11.423968 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:11.423940    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57fc4c646-2qq64"]
Jul 14 18:00:11.427958 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:00:11.427927    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27354305_11e3_4589_bcdd_8d70b53b5d8a.slice/crio-fcf2c2bd580c04fa9a3cde9368c004f856c10349425b25d753650cb03fb1b6e2 WatchSource:0}: Error finding container fcf2c2bd580c04fa9a3cde9368c004f856c10349425b25d753650cb03fb1b6e2: Status 404 returned error can't find the container with id fcf2c2bd580c04fa9a3cde9368c004f856c10349425b25d753650cb03fb1b6e2
Jul 14 18:00:11.532047 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:11.531971    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2" event={"ID":"f62d258d-1509-4057-994c-1aac4a86be2c","Type":"ContainerStarted","Data":"557ff9851f484f531880342417ce658b639cdb0b0075c50ee305461c3817eb2c"}
Jul 14 18:00:11.533377 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:11.533342    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2wxlx" event={"ID":"b58d02dc-8106-4059-9e14-09624f38e02d","Type":"ContainerStarted","Data":"f825caca70bc77f1a794aca9c8d1d47473635ee7d171c0f7e366950b329b4d94"}
Jul 14 18:00:11.535033 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:11.535007    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-shcnm" event={"ID":"c05507a8-89d3-40a2-900a-fe47242d023b","Type":"ContainerStarted","Data":"89a8994c32eb04cdd0b2d3a9c6684b29319a68140b49e78e9f3c337dbdd07220"}
Jul 14 18:00:11.535484 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:11.535402    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-shcnm"
Jul 14 18:00:11.536929 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:11.536895    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fc4c646-2qq64" event={"ID":"27354305-11e3-4589-bcdd-8d70b53b5d8a","Type":"ContainerStarted","Data":"fcf2c2bd580c04fa9a3cde9368c004f856c10349425b25d753650cb03fb1b6e2"}
Jul 14 18:00:11.537013 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:11.536940    2558 patch_prober.go:28] interesting pod/downloads-68c9cbb497-shcnm container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.13:8080/\": dial tcp 10.134.0.13:8080: connect: connection refused" start-of-body=
Jul 14 18:00:11.537013 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:11.536989    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-68c9cbb497-shcnm" podUID="c05507a8-89d3-40a2-900a-fe47242d023b" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.13:8080/\": dial tcp 10.134.0.13:8080: connect: connection refused"
Jul 14 18:00:11.557584 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:11.557490    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-shcnm" podStartSLOduration=0.979343494 podStartE2EDuration="17.557469799s" totalImagesPullingTime="16.578126305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:00:11.556831853 +0000 UTC m=+329.661941837" watchObservedRunningTime="2026-07-14 18:00:11.557469799 +0000 UTC m=+329.662579783"
Jul 14 18:00:12.557253 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:12.557207    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-shcnm"
Jul 14 18:00:15.566309 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:15.566235    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2" event={"ID":"f62d258d-1509-4057-994c-1aac4a86be2c","Type":"ContainerStarted","Data":"4e524ec40d7ac49799b1a990d247e7d1f8982cd791d8df92f98c64e7301b58e1"}
Jul 14 18:00:15.570429 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:15.569816    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2wxlx" event={"ID":"b58d02dc-8106-4059-9e14-09624f38e02d","Type":"ContainerStarted","Data":"3f4d9c5dd5f4d7c151d0ac4526506f7b324e1d1e387256ac61f4e3f87900ca23"}
Jul 14 18:00:15.570429 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:15.570384    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2wxlx"
Jul 14 18:00:15.574197 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:15.574023    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk" event={"ID":"54a469e3-9929-45b8-90e9-6facd3f90aa6","Type":"ContainerStarted","Data":"e863e4c89a30d7868e72124423cf22ad16036ff92f5e25b6c550e7bd53a4295d"}
Jul 14 18:00:15.574197 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:15.574096    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk" event={"ID":"54a469e3-9929-45b8-90e9-6facd3f90aa6","Type":"ContainerStarted","Data":"3d74b85e9669f88411884ad0a304086423897891a6bfa1e758f9d272fcfa0d5f"}
Jul 14 18:00:15.574197 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:15.574141    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk" event={"ID":"54a469e3-9929-45b8-90e9-6facd3f90aa6","Type":"ContainerStarted","Data":"241b163e39c3f2d7acf0c53f71663d7d69143377a2a4e75692d8752240e9137b"}
Jul 14 18:00:15.578041 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:15.577997    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2wxlx"
Jul 14 18:00:15.597874 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:15.597659    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2" podStartSLOduration=7.846397596 podStartE2EDuration="11.597637544s" totalImagesPullingTime="3.751239948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:00:15.595973646 +0000 UTC m=+333.701083655" watchObservedRunningTime="2026-07-14 18:00:15.597637544 +0000 UTC m=+333.702747529"
Jul 14 18:00:15.616747 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:15.616686    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2wxlx" podStartSLOduration=6.886269028 podStartE2EDuration="10.616665348s" totalImagesPullingTime="3.73039632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:00:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:00:15.613926398 +0000 UTC m=+333.719036384" watchObservedRunningTime="2026-07-14 18:00:15.616665348 +0000 UTC m=+333.721775333"
Jul 14 18:00:19.328637 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.328524    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd" podUID="3a201636-c630-4278-af8a-38cacc25be3c" containerName="registry" containerID="cri-o://e618af2a3653128ab4695d2a0148ccdd817ab94eaa0b4081c597daa748a8c356" gracePeriod=30
Jul 14 18:00:19.596080 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.595584    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fc4c646-2qq64" event={"ID":"27354305-11e3-4589-bcdd-8d70b53b5d8a","Type":"ContainerStarted","Data":"0e69ab33ab8c0700e6b47e08f95857bdd89287caa2c6d3990330483577bb0113"}
Jul 14 18:00:19.597720 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.597693    2558 generic.go:356] "Generic (PLEG): container finished" podID="3a201636-c630-4278-af8a-38cacc25be3c" containerID="e618af2a3653128ab4695d2a0148ccdd817ab94eaa0b4081c597daa748a8c356" exitCode=0
Jul 14 18:00:19.597876 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.597782    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd" event={"ID":"3a201636-c630-4278-af8a-38cacc25be3c","Type":"ContainerDied","Data":"e618af2a3653128ab4695d2a0148ccdd817ab94eaa0b4081c597daa748a8c356"}
Jul 14 18:00:19.597876 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.597854    2558 scope.go:117] "RemoveContainer" containerID="5dcab8062d18027a9d3e2f3929560273ff2340585810b70fa858058542e3c24a"
Jul 14 18:00:19.602590 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.602527    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk" event={"ID":"54a469e3-9929-45b8-90e9-6facd3f90aa6","Type":"ContainerStarted","Data":"fb4444ab0b01122dac3f8c894762d26d5e8608f44da9a68df253d25eceec80a0"}
Jul 14 18:00:19.602714 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.602631    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk" event={"ID":"54a469e3-9929-45b8-90e9-6facd3f90aa6","Type":"ContainerStarted","Data":"799ae3ac765b2895a5652a65455ce5592fbe3e959561f437f62e6632e42dccb1"}
Jul 14 18:00:19.602714 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.602676    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk" event={"ID":"54a469e3-9929-45b8-90e9-6facd3f90aa6","Type":"ContainerStarted","Data":"5701f3a328cd70902fa4ede5cedfa0a483f3d63b9b02bfa0568c08fc978e197e"}
Jul 14 18:00:19.603040 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.603018    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:19.620581 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.620504    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57fc4c646-2qq64" podStartSLOduration=6.983047172 podStartE2EDuration="14.620485551s" totalImagesPullingTime="7.637438379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:00:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:00:19.617954138 +0000 UTC m=+337.723064124" watchObservedRunningTime="2026-07-14 18:00:19.620485551 +0000 UTC m=+337.725595536"
Jul 14 18:00:19.627420 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.627391    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 18:00:19.651223 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.651158    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk" podStartSLOduration=2.511266385 podStartE2EDuration="16.651140159s" totalImagesPullingTime="14.139873774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:00:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:00:19.649284705 +0000 UTC m=+337.754394728" watchObservedRunningTime="2026-07-14 18:00:19.651140159 +0000 UTC m=+337.756250147"
Jul 14 18:00:19.728807 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.728774    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3a201636-c630-4278-af8a-38cacc25be3c-installation-pull-secrets\") pod \"3a201636-c630-4278-af8a-38cacc25be3c\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") "
Jul 14 18:00:19.728992 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.728823    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3a201636-c630-4278-af8a-38cacc25be3c-ca-trust-extracted\") pod \"3a201636-c630-4278-af8a-38cacc25be3c\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") "
Jul 14 18:00:19.728992 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.728862    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3a201636-c630-4278-af8a-38cacc25be3c-registry-certificates\") pod \"3a201636-c630-4278-af8a-38cacc25be3c\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") "
Jul 14 18:00:19.728992 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.728895    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a201636-c630-4278-af8a-38cacc25be3c-trusted-ca\") pod \"3a201636-c630-4278-af8a-38cacc25be3c\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") "
Jul 14 18:00:19.728992 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.728928    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l479x\" (UniqueName: \"kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-kube-api-access-l479x\") pod \"3a201636-c630-4278-af8a-38cacc25be3c\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") "
Jul 14 18:00:19.728992 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.728987    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-bound-sa-token\") pod \"3a201636-c630-4278-af8a-38cacc25be3c\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") "
Jul 14 18:00:19.729273 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.729254    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-registry-tls\") pod \"3a201636-c630-4278-af8a-38cacc25be3c\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") "
Jul 14 18:00:19.729330 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.729300    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3a201636-c630-4278-af8a-38cacc25be3c-image-registry-private-configuration\") pod \"3a201636-c630-4278-af8a-38cacc25be3c\" (UID: \"3a201636-c630-4278-af8a-38cacc25be3c\") "
Jul 14 18:00:19.732058 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.729303    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a201636-c630-4278-af8a-38cacc25be3c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3a201636-c630-4278-af8a-38cacc25be3c" (UID: "3a201636-c630-4278-af8a-38cacc25be3c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:00:19.732058 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.732024    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a201636-c630-4278-af8a-38cacc25be3c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3a201636-c630-4278-af8a-38cacc25be3c" (UID: "3a201636-c630-4278-af8a-38cacc25be3c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:00:19.733553 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.733514    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3a201636-c630-4278-af8a-38cacc25be3c" (UID: "3a201636-c630-4278-af8a-38cacc25be3c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:00:19.733553 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.733537    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3a201636-c630-4278-af8a-38cacc25be3c" (UID: "3a201636-c630-4278-af8a-38cacc25be3c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:00:19.733553 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.733753    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a201636-c630-4278-af8a-38cacc25be3c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3a201636-c630-4278-af8a-38cacc25be3c" (UID: "3a201636-c630-4278-af8a-38cacc25be3c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 18:00:19.734991 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.734965    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a201636-c630-4278-af8a-38cacc25be3c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3a201636-c630-4278-af8a-38cacc25be3c" (UID: "3a201636-c630-4278-af8a-38cacc25be3c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 18:00:19.735215 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.735196    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-kube-api-access-l479x" (OuterVolumeSpecName: "kube-api-access-l479x") pod "3a201636-c630-4278-af8a-38cacc25be3c" (UID: "3a201636-c630-4278-af8a-38cacc25be3c"). InnerVolumeSpecName "kube-api-access-l479x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:00:19.748769 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.748738    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a201636-c630-4278-af8a-38cacc25be3c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3a201636-c630-4278-af8a-38cacc25be3c" (UID: "3a201636-c630-4278-af8a-38cacc25be3c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:00:19.830702 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.830659    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-registry-tls\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:00:19.830702 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.830697    2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3a201636-c630-4278-af8a-38cacc25be3c-image-registry-private-configuration\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:00:19.830919 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.830712    2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3a201636-c630-4278-af8a-38cacc25be3c-installation-pull-secrets\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:00:19.830919 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.830727    2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3a201636-c630-4278-af8a-38cacc25be3c-ca-trust-extracted\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:00:19.830919 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.830743    2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3a201636-c630-4278-af8a-38cacc25be3c-registry-certificates\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:00:19.830919 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.830758    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a201636-c630-4278-af8a-38cacc25be3c-trusted-ca\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:00:19.830919 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.830768    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l479x\" (UniqueName: \"kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-kube-api-access-l479x\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:00:19.830919 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:19.830779    2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a201636-c630-4278-af8a-38cacc25be3c-bound-sa-token\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:00:20.612997 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:20.612958    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd"
Jul 14 18:00:20.612997 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:20.612981    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9c87cfb6d-hrppd" event={"ID":"3a201636-c630-4278-af8a-38cacc25be3c","Type":"ContainerDied","Data":"3b865868cae019d4f925be14dce7c86bf6b15099928694ee4695601324980dc7"}
Jul 14 18:00:20.613516 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:20.613061    2558 scope.go:117] "RemoveContainer" containerID="e618af2a3653128ab4695d2a0148ccdd817ab94eaa0b4081c597daa748a8c356"
Jul 14 18:00:20.620465 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:20.620438    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-69fb87c44-2vlpk"
Jul 14 18:00:20.660309 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:20.660273    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9c87cfb6d-hrppd"]
Jul 14 18:00:20.664940 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:20.664908    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-9c87cfb6d-hrppd"]
Jul 14 18:00:22.439530 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:22.439497    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a201636-c630-4278-af8a-38cacc25be3c" path="/var/lib/kubelet/pods/3a201636-c630-4278-af8a-38cacc25be3c/volumes"
Jul 14 18:00:25.297929 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:25.297896    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:25.298519 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:25.298002    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:25.620553 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:25.620518    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:25.620796 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:25.620609    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:25.625133 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:25.625110    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:25.635899 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:25.635872    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:00:45.302325 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:45.302293    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:00:45.306327 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:00:45.306298    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-c766fdf6c-x4nk2"
Jul 14 18:01:31.955667 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:31.955630    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6495cffcbf-vq9fk"]
Jul 14 18:01:31.956142 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:31.955940    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a201636-c630-4278-af8a-38cacc25be3c" containerName="registry"
Jul 14 18:01:31.956142 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:31.955952    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a201636-c630-4278-af8a-38cacc25be3c" containerName="registry"
Jul 14 18:01:31.956142 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:31.956007    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a201636-c630-4278-af8a-38cacc25be3c" containerName="registry"
Jul 14 18:01:31.956142 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:31.956014    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a201636-c630-4278-af8a-38cacc25be3c" containerName="registry"
Jul 14 18:01:31.958037 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:31.958019    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:31.970304 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:31.970256    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6495cffcbf-vq9fk"]
Jul 14 18:01:32.088152 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.088115    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-console-config\") pod \"console-6495cffcbf-vq9fk\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") " pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:32.088152 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.088160    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-oauth-serving-cert\") pod \"console-6495cffcbf-vq9fk\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") " pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:32.088379 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.088192    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcf72e27-7317-418f-bd07-1d240e64af6f-console-serving-cert\") pod \"console-6495cffcbf-vq9fk\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") " pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:32.088379 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.088305    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcf72e27-7317-418f-bd07-1d240e64af6f-console-oauth-config\") pod \"console-6495cffcbf-vq9fk\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") " pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:32.088379 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.088346    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcl5n\" (UniqueName: \"kubernetes.io/projected/bcf72e27-7317-418f-bd07-1d240e64af6f-kube-api-access-jcl5n\") pod \"console-6495cffcbf-vq9fk\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") " pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:32.088379 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.088370    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-service-ca\") pod \"console-6495cffcbf-vq9fk\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") " pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:32.088504 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.088396    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-trusted-ca-bundle\") pod \"console-6495cffcbf-vq9fk\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") " pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:32.189477 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.189438    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-trusted-ca-bundle\") pod \"console-6495cffcbf-vq9fk\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") " pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:32.189692 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.189490    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-console-config\") pod \"console-6495cffcbf-vq9fk\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") " pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:32.189692 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.189607    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-oauth-serving-cert\") pod \"console-6495cffcbf-vq9fk\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") " pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:32.189692 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.189647    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcf72e27-7317-418f-bd07-1d240e64af6f-console-serving-cert\") pod \"console-6495cffcbf-vq9fk\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") " pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:32.189859 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.189768    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcf72e27-7317-418f-bd07-1d240e64af6f-console-oauth-config\") pod \"console-6495cffcbf-vq9fk\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") " pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:32.189859 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.189817    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcl5n\" (UniqueName: \"kubernetes.io/projected/bcf72e27-7317-418f-bd07-1d240e64af6f-kube-api-access-jcl5n\") pod \"console-6495cffcbf-vq9fk\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") " pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:32.189962 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.189892    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-service-ca\") pod \"console-6495cffcbf-vq9fk\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") " pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:32.190264 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.190239    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-console-config\") pod \"console-6495cffcbf-vq9fk\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") " pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:32.190448 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.190355    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-trusted-ca-bundle\") pod \"console-6495cffcbf-vq9fk\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") " pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:32.190448 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.190383    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-oauth-serving-cert\") pod \"console-6495cffcbf-vq9fk\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") " pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:32.190597 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.190460    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-service-ca\") pod \"console-6495cffcbf-vq9fk\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") " pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:32.192410 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.192386    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcf72e27-7317-418f-bd07-1d240e64af6f-console-oauth-config\") pod \"console-6495cffcbf-vq9fk\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") " pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:32.192490 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.192451    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcf72e27-7317-418f-bd07-1d240e64af6f-console-serving-cert\") pod \"console-6495cffcbf-vq9fk\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") " pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:32.200261 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.200229    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcl5n\" (UniqueName: \"kubernetes.io/projected/bcf72e27-7317-418f-bd07-1d240e64af6f-kube-api-access-jcl5n\") pod \"console-6495cffcbf-vq9fk\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") " pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:32.266795 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.266690    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:32.403977 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.403949    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6495cffcbf-vq9fk"]
Jul 14 18:01:32.406344 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:01:32.406314    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcf72e27_7317_418f_bd07_1d240e64af6f.slice/crio-6021695ee66e8b5026cfe3a2a74376e0c0d2f13449102cd111e3a218b4400cd2 WatchSource:0}: Error finding container 6021695ee66e8b5026cfe3a2a74376e0c0d2f13449102cd111e3a218b4400cd2: Status 404 returned error can't find the container with id 6021695ee66e8b5026cfe3a2a74376e0c0d2f13449102cd111e3a218b4400cd2
Jul 14 18:01:32.875770 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.875726    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6495cffcbf-vq9fk" event={"ID":"bcf72e27-7317-418f-bd07-1d240e64af6f","Type":"ContainerStarted","Data":"7af71aca09887054d35590ad794bfd44e4b0c1e6989a994d7895a462ab64aa74"}
Jul 14 18:01:32.875945 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:32.875791    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6495cffcbf-vq9fk" event={"ID":"bcf72e27-7317-418f-bd07-1d240e64af6f","Type":"ContainerStarted","Data":"6021695ee66e8b5026cfe3a2a74376e0c0d2f13449102cd111e3a218b4400cd2"}
Jul 14 18:01:42.267664 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.267623    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:42.268086 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.267765    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:42.272530 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.272510    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:42.305612 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.302596    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6495cffcbf-vq9fk" podStartSLOduration=11.302578156 podStartE2EDuration="11.302578156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:01:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:01:32.902103912 +0000 UTC m=+411.007213895" watchObservedRunningTime="2026-07-14 18:01:42.302578156 +0000 UTC m=+420.407688139"
Jul 14 18:01:42.429511 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.429471    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6495cffcbf-vq9fk"]
Jul 14 18:01:42.492738 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.492697    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67c966d67-wgckh"]
Jul 14 18:01:42.492995 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.492983    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a201636-c630-4278-af8a-38cacc25be3c" containerName="registry"
Jul 14 18:01:42.493042 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.492997    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a201636-c630-4278-af8a-38cacc25be3c" containerName="registry"
Jul 14 18:01:42.495087 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.495071    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:42.512472 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.512444    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67c966d67-wgckh"]
Jul 14 18:01:42.574376 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.574285    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e430bd4f-2534-4678-8b24-f7dd4047e2d0-console-oauth-config\") pod \"console-67c966d67-wgckh\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") " pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:42.574376 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.574341    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-service-ca\") pod \"console-67c966d67-wgckh\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") " pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:42.574376 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.574364    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-trusted-ca-bundle\") pod \"console-67c966d67-wgckh\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") " pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:42.574637 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.574392    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-console-config\") pod \"console-67c966d67-wgckh\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") " pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:42.574637 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.574410    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e430bd4f-2534-4678-8b24-f7dd4047e2d0-console-serving-cert\") pod \"console-67c966d67-wgckh\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") " pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:42.574637 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.574491    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfpdg\" (UniqueName: \"kubernetes.io/projected/e430bd4f-2534-4678-8b24-f7dd4047e2d0-kube-api-access-nfpdg\") pod \"console-67c966d67-wgckh\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") " pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:42.574637 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.574522    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-oauth-serving-cert\") pod \"console-67c966d67-wgckh\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") " pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:42.675245 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.675203    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfpdg\" (UniqueName: \"kubernetes.io/projected/e430bd4f-2534-4678-8b24-f7dd4047e2d0-kube-api-access-nfpdg\") pod \"console-67c966d67-wgckh\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") " pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:42.675245 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.675251    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-oauth-serving-cert\") pod \"console-67c966d67-wgckh\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") " pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:42.675498 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.675289    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e430bd4f-2534-4678-8b24-f7dd4047e2d0-console-oauth-config\") pod \"console-67c966d67-wgckh\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") " pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:42.675498 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.675330    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-service-ca\") pod \"console-67c966d67-wgckh\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") " pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:42.675498 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.675351    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-trusted-ca-bundle\") pod \"console-67c966d67-wgckh\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") " pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:42.675498 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.675374    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-console-config\") pod \"console-67c966d67-wgckh\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") " pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:42.675498 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.675398    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e430bd4f-2534-4678-8b24-f7dd4047e2d0-console-serving-cert\") pod \"console-67c966d67-wgckh\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") " pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:42.676261 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.676192    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-oauth-serving-cert\") pod \"console-67c966d67-wgckh\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") " pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:42.676364 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.676216    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-service-ca\") pod \"console-67c966d67-wgckh\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") " pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:42.676364 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.676216    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-console-config\") pod \"console-67c966d67-wgckh\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") " pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:42.676364 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.676223    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-trusted-ca-bundle\") pod \"console-67c966d67-wgckh\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") " pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:42.678025 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.678005    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e430bd4f-2534-4678-8b24-f7dd4047e2d0-console-serving-cert\") pod \"console-67c966d67-wgckh\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") " pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:42.678025 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.678024    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e430bd4f-2534-4678-8b24-f7dd4047e2d0-console-oauth-config\") pod \"console-67c966d67-wgckh\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") " pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:42.685503 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.685478    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfpdg\" (UniqueName: \"kubernetes.io/projected/e430bd4f-2534-4678-8b24-f7dd4047e2d0-kube-api-access-nfpdg\") pod \"console-67c966d67-wgckh\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") " pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:42.804049 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.804003    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:42.921335 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.921310    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:01:42.940878 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:42.940801    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67c966d67-wgckh"]
Jul 14 18:01:42.944433 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:01:42.944393    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode430bd4f_2534_4678_8b24_f7dd4047e2d0.slice/crio-007a6c380cb7cfb4c7261ee3e146618f38dc12183a61563088e222590a49d598 WatchSource:0}: Error finding container 007a6c380cb7cfb4c7261ee3e146618f38dc12183a61563088e222590a49d598: Status 404 returned error can't find the container with id 007a6c380cb7cfb4c7261ee3e146618f38dc12183a61563088e222590a49d598
Jul 14 18:01:43.922286 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:43.922244    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67c966d67-wgckh" event={"ID":"e430bd4f-2534-4678-8b24-f7dd4047e2d0","Type":"ContainerStarted","Data":"2c5bb1260b6c70b7409399ea2b1953ebabde15508d93bbefd5c9aa88b4759599"}
Jul 14 18:01:43.922728 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:43.922309    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67c966d67-wgckh" event={"ID":"e430bd4f-2534-4678-8b24-f7dd4047e2d0","Type":"ContainerStarted","Data":"007a6c380cb7cfb4c7261ee3e146618f38dc12183a61563088e222590a49d598"}
Jul 14 18:01:43.964671 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:43.964615    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67c966d67-wgckh" podStartSLOduration=1.9645956 podStartE2EDuration="1.9645956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:01:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:01:43.963056804 +0000 UTC m=+422.068166789" watchObservedRunningTime="2026-07-14 18:01:43.9645956 +0000 UTC m=+422.069705580"
Jul 14 18:01:52.804634 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:52.804585    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:52.805100 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:52.804661    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:52.809755 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:52.809728    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:52.959006 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:52.958976    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:01:53.008794 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:01:53.008761    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57fc4c646-2qq64"]
Jul 14 18:02:08.942450 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:08.942328    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6495cffcbf-vq9fk" podUID="bcf72e27-7317-418f-bd07-1d240e64af6f" containerName="console" containerID="cri-o://7af71aca09887054d35590ad794bfd44e4b0c1e6989a994d7895a462ab64aa74" gracePeriod=15
Jul 14 18:02:09.192935 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:09.192862    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:02:09.276938 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:09.276902    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-service-ca\") pod \"bcf72e27-7317-418f-bd07-1d240e64af6f\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") "
Jul 14 18:02:09.276938 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:09.276944    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-console-config\") pod \"bcf72e27-7317-418f-bd07-1d240e64af6f\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") "
Jul 14 18:02:09.277162 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:09.276983    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-oauth-serving-cert\") pod \"bcf72e27-7317-418f-bd07-1d240e64af6f\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") "
Jul 14 18:02:09.277315 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:09.277292    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-service-ca" (OuterVolumeSpecName: "service-ca") pod "bcf72e27-7317-418f-bd07-1d240e64af6f" (UID: "bcf72e27-7317-418f-bd07-1d240e64af6f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:02:09.277428 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:09.277406    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-console-config" (OuterVolumeSpecName: "console-config") pod "bcf72e27-7317-418f-bd07-1d240e64af6f" (UID: "bcf72e27-7317-418f-bd07-1d240e64af6f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:02:09.277467 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:09.277441    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bcf72e27-7317-418f-bd07-1d240e64af6f" (UID: "bcf72e27-7317-418f-bd07-1d240e64af6f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:02:09.377930 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:09.377895    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcf72e27-7317-418f-bd07-1d240e64af6f-console-serving-cert\") pod \"bcf72e27-7317-418f-bd07-1d240e64af6f\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") "
Jul 14 18:02:09.377930 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:09.377931    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcl5n\" (UniqueName: \"kubernetes.io/projected/bcf72e27-7317-418f-bd07-1d240e64af6f-kube-api-access-jcl5n\") pod \"bcf72e27-7317-418f-bd07-1d240e64af6f\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") "
Jul 14 18:02:09.378148 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:09.377958    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-trusted-ca-bundle\") pod \"bcf72e27-7317-418f-bd07-1d240e64af6f\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") "
Jul 14 18:02:09.378148 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:09.377976    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcf72e27-7317-418f-bd07-1d240e64af6f-console-oauth-config\") pod \"bcf72e27-7317-418f-bd07-1d240e64af6f\" (UID: \"bcf72e27-7317-418f-bd07-1d240e64af6f\") "
Jul 14 18:02:09.378148 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:09.378114    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-console-config\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:02:09.378148 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:09.378124    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-oauth-serving-cert\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:02:09.378148 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:09.378134    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-service-ca\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:02:09.378413 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:09.378374    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bcf72e27-7317-418f-bd07-1d240e64af6f" (UID: "bcf72e27-7317-418f-bd07-1d240e64af6f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:02:09.380338 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:09.380308    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcf72e27-7317-418f-bd07-1d240e64af6f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bcf72e27-7317-418f-bd07-1d240e64af6f" (UID: "bcf72e27-7317-418f-bd07-1d240e64af6f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 18:02:09.380428 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:09.380342    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcf72e27-7317-418f-bd07-1d240e64af6f-kube-api-access-jcl5n" (OuterVolumeSpecName: "kube-api-access-jcl5n") pod "bcf72e27-7317-418f-bd07-1d240e64af6f" (UID: "bcf72e27-7317-418f-bd07-1d240e64af6f"). InnerVolumeSpecName "kube-api-access-jcl5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:02:09.380428 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:09.380391    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcf72e27-7317-418f-bd07-1d240e64af6f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bcf72e27-7317-418f-bd07-1d240e64af6f" (UID: "bcf72e27-7317-418f-bd07-1d240e64af6f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 18:02:09.479019 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:09.478924    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcf72e27-7317-418f-bd07-1d240e64af6f-console-serving-cert\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:02:09.479019 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:09.478959    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcl5n\" (UniqueName: \"kubernetes.io/projected/bcf72e27-7317-418f-bd07-1d240e64af6f-kube-api-access-jcl5n\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:02:09.479019 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:09.478968    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcf72e27-7317-418f-bd07-1d240e64af6f-trusted-ca-bundle\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:02:09.479019 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:09.478977    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcf72e27-7317-418f-bd07-1d240e64af6f-console-oauth-config\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:02:10.024216 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:10.024171    2558 generic.go:356] "Generic (PLEG): container finished" podID="bcf72e27-7317-418f-bd07-1d240e64af6f" containerID="7af71aca09887054d35590ad794bfd44e4b0c1e6989a994d7895a462ab64aa74" exitCode=0
Jul 14 18:02:10.024216 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:10.024218    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6495cffcbf-vq9fk"
Jul 14 18:02:10.024722 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:10.024259    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6495cffcbf-vq9fk" event={"ID":"bcf72e27-7317-418f-bd07-1d240e64af6f","Type":"ContainerDied","Data":"7af71aca09887054d35590ad794bfd44e4b0c1e6989a994d7895a462ab64aa74"}
Jul 14 18:02:10.024722 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:10.024311    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6495cffcbf-vq9fk" event={"ID":"bcf72e27-7317-418f-bd07-1d240e64af6f","Type":"ContainerDied","Data":"6021695ee66e8b5026cfe3a2a74376e0c0d2f13449102cd111e3a218b4400cd2"}
Jul 14 18:02:10.024722 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:10.024335    2558 scope.go:117] "RemoveContainer" containerID="7af71aca09887054d35590ad794bfd44e4b0c1e6989a994d7895a462ab64aa74"
Jul 14 18:02:10.033753 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:10.033727    2558 scope.go:117] "RemoveContainer" containerID="7af71aca09887054d35590ad794bfd44e4b0c1e6989a994d7895a462ab64aa74"
Jul 14 18:02:10.034056 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:02:10.034038    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7af71aca09887054d35590ad794bfd44e4b0c1e6989a994d7895a462ab64aa74\": container with ID starting with 7af71aca09887054d35590ad794bfd44e4b0c1e6989a994d7895a462ab64aa74 not found: ID does not exist" containerID="7af71aca09887054d35590ad794bfd44e4b0c1e6989a994d7895a462ab64aa74"
Jul 14 18:02:10.034113 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:10.034064    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7af71aca09887054d35590ad794bfd44e4b0c1e6989a994d7895a462ab64aa74"} err="failed to get container status \"7af71aca09887054d35590ad794bfd44e4b0c1e6989a994d7895a462ab64aa74\": rpc error: code = NotFound desc = could not find container \"7af71aca09887054d35590ad794bfd44e4b0c1e6989a994d7895a462ab64aa74\": container with ID starting with 7af71aca09887054d35590ad794bfd44e4b0c1e6989a994d7895a462ab64aa74 not found: ID does not exist"
Jul 14 18:02:10.046025 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:10.045995    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6495cffcbf-vq9fk"]
Jul 14 18:02:10.050338 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:10.050314    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6495cffcbf-vq9fk"]
Jul 14 18:02:10.439600 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:10.439547    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcf72e27-7317-418f-bd07-1d240e64af6f" path="/var/lib/kubelet/pods/bcf72e27-7317-418f-bd07-1d240e64af6f/volumes"
Jul 14 18:02:18.030012 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:18.029966    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57fc4c646-2qq64" podUID="27354305-11e3-4589-bcdd-8d70b53b5d8a" containerName="console" containerID="cri-o://0e69ab33ab8c0700e6b47e08f95857bdd89287caa2c6d3990330483577bb0113" gracePeriod=15
Jul 14 18:02:18.269984 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:18.269958    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:02:18.335125 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:18.335036    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ng2kb\" (UniqueName: \"kubernetes.io/projected/27354305-11e3-4589-bcdd-8d70b53b5d8a-kube-api-access-ng2kb\") pod \"27354305-11e3-4589-bcdd-8d70b53b5d8a\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") "
Jul 14 18:02:18.335125 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:18.335074    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27354305-11e3-4589-bcdd-8d70b53b5d8a-console-oauth-config\") pod \"27354305-11e3-4589-bcdd-8d70b53b5d8a\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") "
Jul 14 18:02:18.335125 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:18.335096    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-console-config\") pod \"27354305-11e3-4589-bcdd-8d70b53b5d8a\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") "
Jul 14 18:02:18.335125 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:18.335119    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-oauth-serving-cert\") pod \"27354305-11e3-4589-bcdd-8d70b53b5d8a\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") "
Jul 14 18:02:18.335432 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:18.335170    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-service-ca\") pod \"27354305-11e3-4589-bcdd-8d70b53b5d8a\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") "
Jul 14 18:02:18.335432 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:18.335186    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-trusted-ca-bundle\") pod \"27354305-11e3-4589-bcdd-8d70b53b5d8a\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") "
Jul 14 18:02:18.335432 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:18.335209    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27354305-11e3-4589-bcdd-8d70b53b5d8a-console-serving-cert\") pod \"27354305-11e3-4589-bcdd-8d70b53b5d8a\" (UID: \"27354305-11e3-4589-bcdd-8d70b53b5d8a\") "
Jul 14 18:02:18.335697 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:18.335657    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-service-ca" (OuterVolumeSpecName: "service-ca") pod "27354305-11e3-4589-bcdd-8d70b53b5d8a" (UID: "27354305-11e3-4589-bcdd-8d70b53b5d8a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:02:18.335772 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:18.335688    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "27354305-11e3-4589-bcdd-8d70b53b5d8a" (UID: "27354305-11e3-4589-bcdd-8d70b53b5d8a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:02:18.335772 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:18.335697    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "27354305-11e3-4589-bcdd-8d70b53b5d8a" (UID: "27354305-11e3-4589-bcdd-8d70b53b5d8a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:02:18.335772 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:18.335706    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-console-config" (OuterVolumeSpecName: "console-config") pod "27354305-11e3-4589-bcdd-8d70b53b5d8a" (UID: "27354305-11e3-4589-bcdd-8d70b53b5d8a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:02:18.337373 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:18.337352    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27354305-11e3-4589-bcdd-8d70b53b5d8a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "27354305-11e3-4589-bcdd-8d70b53b5d8a" (UID: "27354305-11e3-4589-bcdd-8d70b53b5d8a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 18:02:18.337444 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:18.337403    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27354305-11e3-4589-bcdd-8d70b53b5d8a-kube-api-access-ng2kb" (OuterVolumeSpecName: "kube-api-access-ng2kb") pod "27354305-11e3-4589-bcdd-8d70b53b5d8a" (UID: "27354305-11e3-4589-bcdd-8d70b53b5d8a"). InnerVolumeSpecName "kube-api-access-ng2kb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:02:18.337541 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:18.337502    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27354305-11e3-4589-bcdd-8d70b53b5d8a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "27354305-11e3-4589-bcdd-8d70b53b5d8a" (UID: "27354305-11e3-4589-bcdd-8d70b53b5d8a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 18:02:18.436390 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:18.436352    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-service-ca\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:02:18.436390 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:18.436377    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-trusted-ca-bundle\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:02:18.436390 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:18.436387    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27354305-11e3-4589-bcdd-8d70b53b5d8a-console-serving-cert\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:02:18.436390 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:18.436398    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ng2kb\" (UniqueName: \"kubernetes.io/projected/27354305-11e3-4589-bcdd-8d70b53b5d8a-kube-api-access-ng2kb\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:02:18.436703 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:18.436406    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27354305-11e3-4589-bcdd-8d70b53b5d8a-console-oauth-config\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:02:18.436703 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:18.436416    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-console-config\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:02:18.436703 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:18.436424    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27354305-11e3-4589-bcdd-8d70b53b5d8a-oauth-serving-cert\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:02:19.061914 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:19.061878    2558 generic.go:356] "Generic (PLEG): container finished" podID="27354305-11e3-4589-bcdd-8d70b53b5d8a" containerID="0e69ab33ab8c0700e6b47e08f95857bdd89287caa2c6d3990330483577bb0113" exitCode=0
Jul 14 18:02:19.062321 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:19.061925    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fc4c646-2qq64"
Jul 14 18:02:19.062321 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:19.061937    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fc4c646-2qq64" event={"ID":"27354305-11e3-4589-bcdd-8d70b53b5d8a","Type":"ContainerDied","Data":"0e69ab33ab8c0700e6b47e08f95857bdd89287caa2c6d3990330483577bb0113"}
Jul 14 18:02:19.062321 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:19.061986    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fc4c646-2qq64" event={"ID":"27354305-11e3-4589-bcdd-8d70b53b5d8a","Type":"ContainerDied","Data":"fcf2c2bd580c04fa9a3cde9368c004f856c10349425b25d753650cb03fb1b6e2"}
Jul 14 18:02:19.062321 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:19.062013    2558 scope.go:117] "RemoveContainer" containerID="0e69ab33ab8c0700e6b47e08f95857bdd89287caa2c6d3990330483577bb0113"
Jul 14 18:02:19.070051 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:19.070030    2558 scope.go:117] "RemoveContainer" containerID="0e69ab33ab8c0700e6b47e08f95857bdd89287caa2c6d3990330483577bb0113"
Jul 14 18:02:19.070319 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:02:19.070298    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e69ab33ab8c0700e6b47e08f95857bdd89287caa2c6d3990330483577bb0113\": container with ID starting with 0e69ab33ab8c0700e6b47e08f95857bdd89287caa2c6d3990330483577bb0113 not found: ID does not exist" containerID="0e69ab33ab8c0700e6b47e08f95857bdd89287caa2c6d3990330483577bb0113"
Jul 14 18:02:19.070370 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:19.070328    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e69ab33ab8c0700e6b47e08f95857bdd89287caa2c6d3990330483577bb0113"} err="failed to get container status \"0e69ab33ab8c0700e6b47e08f95857bdd89287caa2c6d3990330483577bb0113\": rpc error: code = NotFound desc = could not find container \"0e69ab33ab8c0700e6b47e08f95857bdd89287caa2c6d3990330483577bb0113\": container with ID starting with 0e69ab33ab8c0700e6b47e08f95857bdd89287caa2c6d3990330483577bb0113 not found: ID does not exist"
Jul 14 18:02:19.082529 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:19.082496    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57fc4c646-2qq64"]
Jul 14 18:02:19.085022 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:19.084997    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57fc4c646-2qq64"]
Jul 14 18:02:20.439473 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:20.439435    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27354305-11e3-4589-bcdd-8d70b53b5d8a" path="/var/lib/kubelet/pods/27354305-11e3-4589-bcdd-8d70b53b5d8a/volumes"
Jul 14 18:02:29.900935 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:29.900902    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99"]
Jul 14 18:02:29.901312 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:29.901184    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcf72e27-7317-418f-bd07-1d240e64af6f" containerName="console"
Jul 14 18:02:29.901312 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:29.901195    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcf72e27-7317-418f-bd07-1d240e64af6f" containerName="console"
Jul 14 18:02:29.901312 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:29.901205    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27354305-11e3-4589-bcdd-8d70b53b5d8a" containerName="console"
Jul 14 18:02:29.901312 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:29.901210    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="27354305-11e3-4589-bcdd-8d70b53b5d8a" containerName="console"
Jul 14 18:02:29.901312 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:29.901256    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="27354305-11e3-4589-bcdd-8d70b53b5d8a" containerName="console"
Jul 14 18:02:29.901312 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:29.901266    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcf72e27-7317-418f-bd07-1d240e64af6f" containerName="console"
Jul 14 18:02:29.903888 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:29.903870    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99"
Jul 14 18:02:29.907743 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:29.907712    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 14 18:02:29.907743 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:29.907712    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 14 18:02:29.907925 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:29.907809    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9xg8s\""
Jul 14 18:02:29.919265 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:29.919240    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99"]
Jul 14 18:02:29.922228 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:29.922205    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2000e464-8dd1-420b-ad74-0d39302e3ff4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99\" (UID: \"2000e464-8dd1-420b-ad74-0d39302e3ff4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99"
Jul 14 18:02:29.922336 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:29.922241    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7jcp\" (UniqueName: \"kubernetes.io/projected/2000e464-8dd1-420b-ad74-0d39302e3ff4-kube-api-access-t7jcp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99\" (UID: \"2000e464-8dd1-420b-ad74-0d39302e3ff4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99"
Jul 14 18:02:29.922336 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:29.922271    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2000e464-8dd1-420b-ad74-0d39302e3ff4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99\" (UID: \"2000e464-8dd1-420b-ad74-0d39302e3ff4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99"
Jul 14 18:02:30.023687 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:30.023642    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2000e464-8dd1-420b-ad74-0d39302e3ff4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99\" (UID: \"2000e464-8dd1-420b-ad74-0d39302e3ff4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99"
Jul 14 18:02:30.023687 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:30.023682    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7jcp\" (UniqueName: \"kubernetes.io/projected/2000e464-8dd1-420b-ad74-0d39302e3ff4-kube-api-access-t7jcp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99\" (UID: \"2000e464-8dd1-420b-ad74-0d39302e3ff4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99"
Jul 14 18:02:30.023904 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:30.023704    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2000e464-8dd1-420b-ad74-0d39302e3ff4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99\" (UID: \"2000e464-8dd1-420b-ad74-0d39302e3ff4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99"
Jul 14 18:02:30.024048 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:30.024030    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2000e464-8dd1-420b-ad74-0d39302e3ff4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99\" (UID: \"2000e464-8dd1-420b-ad74-0d39302e3ff4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99"
Jul 14 18:02:30.024088 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:30.024049    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2000e464-8dd1-420b-ad74-0d39302e3ff4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99\" (UID: \"2000e464-8dd1-420b-ad74-0d39302e3ff4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99"
Jul 14 18:02:30.033612 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:30.033581    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7jcp\" (UniqueName: \"kubernetes.io/projected/2000e464-8dd1-420b-ad74-0d39302e3ff4-kube-api-access-t7jcp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99\" (UID: \"2000e464-8dd1-420b-ad74-0d39302e3ff4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99"
Jul 14 18:02:30.213186 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:30.213087    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99"
Jul 14 18:02:30.346865 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:30.346828    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99"]
Jul 14 18:02:30.349664 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:02:30.349638    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2000e464_8dd1_420b_ad74_0d39302e3ff4.slice/crio-69bc20a2f8e58ca5fb7d07802153bff487396e0446198c581adbd519c3662378 WatchSource:0}: Error finding container 69bc20a2f8e58ca5fb7d07802153bff487396e0446198c581adbd519c3662378: Status 404 returned error can't find the container with id 69bc20a2f8e58ca5fb7d07802153bff487396e0446198c581adbd519c3662378
Jul 14 18:02:31.107629 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:31.107590    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99" event={"ID":"2000e464-8dd1-420b-ad74-0d39302e3ff4","Type":"ContainerStarted","Data":"69bc20a2f8e58ca5fb7d07802153bff487396e0446198c581adbd519c3662378"}
Jul 14 18:02:40.144467 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:40.144433    2558 generic.go:356] "Generic (PLEG): container finished" podID="2000e464-8dd1-420b-ad74-0d39302e3ff4" containerID="caabb23e9a763e711e9cdf80268dd243370106c15a5550e79426689837bc9cdc" exitCode=0
Jul 14 18:02:40.144945 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:40.144511    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99" event={"ID":"2000e464-8dd1-420b-ad74-0d39302e3ff4","Type":"ContainerDied","Data":"caabb23e9a763e711e9cdf80268dd243370106c15a5550e79426689837bc9cdc"}
Jul 14 18:02:42.154236 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:42.154201    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99" event={"ID":"2000e464-8dd1-420b-ad74-0d39302e3ff4","Type":"ContainerStarted","Data":"5b92af60c92636a2586d5f8e1012bc250ee2e773a6187071f3a33227648d9324"}
Jul 14 18:02:43.159950 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:43.159913    2558 generic.go:356] "Generic (PLEG): container finished" podID="2000e464-8dd1-420b-ad74-0d39302e3ff4" containerID="5b92af60c92636a2586d5f8e1012bc250ee2e773a6187071f3a33227648d9324" exitCode=0
Jul 14 18:02:43.160435 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:43.159972    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99" event={"ID":"2000e464-8dd1-420b-ad74-0d39302e3ff4","Type":"ContainerDied","Data":"5b92af60c92636a2586d5f8e1012bc250ee2e773a6187071f3a33227648d9324"}
Jul 14 18:02:47.656829 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:47.656793    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b4b5797d-pvn6s"]
Jul 14 18:02:47.660544 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:47.660526    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b4b5797d-pvn6s"
Jul 14 18:02:47.663427 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:47.663404    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 14 18:02:47.664475 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:47.664448    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 14 18:02:47.664475 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:47.664468    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-z9fp8\""
Jul 14 18:02:47.664661 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:47.664468    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 14 18:02:47.664661 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:47.664489    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 14 18:02:47.670487 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:47.670465    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b4b5797d-pvn6s"]
Jul 14 18:02:47.783244 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:47.783204    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b52f73ae-3bbc-4222-88a4-95089e5a14dd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-56b4b5797d-pvn6s\" (UID: \"b52f73ae-3bbc-4222-88a4-95089e5a14dd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b4b5797d-pvn6s"
Jul 14 18:02:47.783420 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:47.783257    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d784w\" (UniqueName: \"kubernetes.io/projected/b52f73ae-3bbc-4222-88a4-95089e5a14dd-kube-api-access-d784w\") pod \"managed-serviceaccount-addon-agent-56b4b5797d-pvn6s\" (UID: \"b52f73ae-3bbc-4222-88a4-95089e5a14dd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b4b5797d-pvn6s"
Jul 14 18:02:47.884508 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:47.884467    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b52f73ae-3bbc-4222-88a4-95089e5a14dd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-56b4b5797d-pvn6s\" (UID: \"b52f73ae-3bbc-4222-88a4-95089e5a14dd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b4b5797d-pvn6s"
Jul 14 18:02:47.884692 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:47.884518    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d784w\" (UniqueName: \"kubernetes.io/projected/b52f73ae-3bbc-4222-88a4-95089e5a14dd-kube-api-access-d784w\") pod \"managed-serviceaccount-addon-agent-56b4b5797d-pvn6s\" (UID: \"b52f73ae-3bbc-4222-88a4-95089e5a14dd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b4b5797d-pvn6s"
Jul 14 18:02:47.887500 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:47.887475    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b52f73ae-3bbc-4222-88a4-95089e5a14dd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-56b4b5797d-pvn6s\" (UID: \"b52f73ae-3bbc-4222-88a4-95089e5a14dd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b4b5797d-pvn6s"
Jul 14 18:02:47.897109 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:47.897078    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d784w\" (UniqueName: \"kubernetes.io/projected/b52f73ae-3bbc-4222-88a4-95089e5a14dd-kube-api-access-d784w\") pod \"managed-serviceaccount-addon-agent-56b4b5797d-pvn6s\" (UID: \"b52f73ae-3bbc-4222-88a4-95089e5a14dd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b4b5797d-pvn6s"
Jul 14 18:02:47.982360 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:47.982266    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b4b5797d-pvn6s"
Jul 14 18:02:48.138793 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:48.138761    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b4b5797d-pvn6s"]
Jul 14 18:02:48.141266 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:02:48.141228    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb52f73ae_3bbc_4222_88a4_95089e5a14dd.slice/crio-e0aea9df2d6832281ad985213f718ba723c3f094c201a68cfe5673047e9be4d1 WatchSource:0}: Error finding container e0aea9df2d6832281ad985213f718ba723c3f094c201a68cfe5673047e9be4d1: Status 404 returned error can't find the container with id e0aea9df2d6832281ad985213f718ba723c3f094c201a68cfe5673047e9be4d1
Jul 14 18:02:48.181271 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:48.181232    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b4b5797d-pvn6s" event={"ID":"b52f73ae-3bbc-4222-88a4-95089e5a14dd","Type":"ContainerStarted","Data":"e0aea9df2d6832281ad985213f718ba723c3f094c201a68cfe5673047e9be4d1"}
Jul 14 18:02:53.204879 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:53.204842    2558 generic.go:356] "Generic (PLEG): container finished" podID="2000e464-8dd1-420b-ad74-0d39302e3ff4" containerID="4a9eb71be4b9f8a1db4107ede0170093b86f5d22721c6c7f8f1ed290ecd3feaa" exitCode=0
Jul 14 18:02:53.205329 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:53.204929    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99" event={"ID":"2000e464-8dd1-420b-ad74-0d39302e3ff4","Type":"ContainerDied","Data":"4a9eb71be4b9f8a1db4107ede0170093b86f5d22721c6c7f8f1ed290ecd3feaa"}
Jul 14 18:02:53.206411 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:53.206384    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b4b5797d-pvn6s" event={"ID":"b52f73ae-3bbc-4222-88a4-95089e5a14dd","Type":"ContainerStarted","Data":"bf24c14542f3bc1bad902e61202a74dfe8bb0db834f28c1ff7de12b86fb65f3a"}
Jul 14 18:02:53.249972 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:53.249903    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b4b5797d-pvn6s" podStartSLOduration=1.737384287 podStartE2EDuration="6.249878945s" totalImagesPullingTime="4.512494658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:02:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:02:53.248077418 +0000 UTC m=+491.353187402" watchObservedRunningTime="2026-07-14 18:02:53.249878945 +0000 UTC m=+491.354988929"
Jul 14 18:02:54.334924 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:54.334899    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99"
Jul 14 18:02:54.436675 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:54.436633    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2000e464-8dd1-420b-ad74-0d39302e3ff4-util\") pod \"2000e464-8dd1-420b-ad74-0d39302e3ff4\" (UID: \"2000e464-8dd1-420b-ad74-0d39302e3ff4\") "
Jul 14 18:02:54.436873 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:54.436703    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7jcp\" (UniqueName: \"kubernetes.io/projected/2000e464-8dd1-420b-ad74-0d39302e3ff4-kube-api-access-t7jcp\") pod \"2000e464-8dd1-420b-ad74-0d39302e3ff4\" (UID: \"2000e464-8dd1-420b-ad74-0d39302e3ff4\") "
Jul 14 18:02:54.436873 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:54.436735    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2000e464-8dd1-420b-ad74-0d39302e3ff4-bundle\") pod \"2000e464-8dd1-420b-ad74-0d39302e3ff4\" (UID: \"2000e464-8dd1-420b-ad74-0d39302e3ff4\") "
Jul 14 18:02:54.437460 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:54.437429    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2000e464-8dd1-420b-ad74-0d39302e3ff4-bundle" (OuterVolumeSpecName: "bundle") pod "2000e464-8dd1-420b-ad74-0d39302e3ff4" (UID: "2000e464-8dd1-420b-ad74-0d39302e3ff4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:02:54.439388 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:54.439357    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2000e464-8dd1-420b-ad74-0d39302e3ff4-kube-api-access-t7jcp" (OuterVolumeSpecName: "kube-api-access-t7jcp") pod "2000e464-8dd1-420b-ad74-0d39302e3ff4" (UID: "2000e464-8dd1-420b-ad74-0d39302e3ff4"). InnerVolumeSpecName "kube-api-access-t7jcp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:02:54.441362 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:54.441337    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2000e464-8dd1-420b-ad74-0d39302e3ff4-util" (OuterVolumeSpecName: "util") pod "2000e464-8dd1-420b-ad74-0d39302e3ff4" (UID: "2000e464-8dd1-420b-ad74-0d39302e3ff4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:02:54.537666 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:54.537541    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7jcp\" (UniqueName: \"kubernetes.io/projected/2000e464-8dd1-420b-ad74-0d39302e3ff4-kube-api-access-t7jcp\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:02:54.537666 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:54.537611    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2000e464-8dd1-420b-ad74-0d39302e3ff4-bundle\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:02:54.537666 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:54.537621    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2000e464-8dd1-420b-ad74-0d39302e3ff4-util\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:02:55.217357 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:55.217329    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99"
Jul 14 18:02:55.217540 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:55.217320    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klx99" event={"ID":"2000e464-8dd1-420b-ad74-0d39302e3ff4","Type":"ContainerDied","Data":"69bc20a2f8e58ca5fb7d07802153bff487396e0446198c581adbd519c3662378"}
Jul 14 18:02:55.217540 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:02:55.217449    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69bc20a2f8e58ca5fb7d07802153bff487396e0446198c581adbd519c3662378"
Jul 14 18:03:03.660700 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:03.660658    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whxbc"]
Jul 14 18:03:03.661276 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:03.661065    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2000e464-8dd1-420b-ad74-0d39302e3ff4" containerName="extract"
Jul 14 18:03:03.661276 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:03.661083    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2000e464-8dd1-420b-ad74-0d39302e3ff4" containerName="extract"
Jul 14 18:03:03.661276 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:03.661095    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2000e464-8dd1-420b-ad74-0d39302e3ff4" containerName="util"
Jul 14 18:03:03.661276 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:03.661106    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2000e464-8dd1-420b-ad74-0d39302e3ff4" containerName="util"
Jul 14 18:03:03.661276 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:03.661122    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2000e464-8dd1-420b-ad74-0d39302e3ff4" containerName="pull"
Jul 14 18:03:03.661276 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:03.661129    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2000e464-8dd1-420b-ad74-0d39302e3ff4" containerName="pull"
Jul 14 18:03:03.661276 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:03.661194    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2000e464-8dd1-420b-ad74-0d39302e3ff4" containerName="extract"
Jul 14 18:03:03.666505 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:03.664235    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whxbc"
Jul 14 18:03:03.667725 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:03.667696    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-cvsgh\""
Jul 14 18:03:03.667842 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:03.667814    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 14 18:03:03.668131 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:03.668114    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 14 18:03:03.687809 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:03.687779    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whxbc"]
Jul 14 18:03:03.811390 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:03.811352    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f585839-95d2-4c38-b3e2-ccfd1fb5c545-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-whxbc\" (UID: \"0f585839-95d2-4c38-b3e2-ccfd1fb5c545\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whxbc"
Jul 14 18:03:03.811588 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:03.811424    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vpzh\" (UniqueName: \"kubernetes.io/projected/0f585839-95d2-4c38-b3e2-ccfd1fb5c545-kube-api-access-4vpzh\") pod \"cert-manager-operator-controller-manager-55c444bf86-whxbc\" (UID: \"0f585839-95d2-4c38-b3e2-ccfd1fb5c545\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whxbc"
Jul 14 18:03:03.912772 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:03.912674    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f585839-95d2-4c38-b3e2-ccfd1fb5c545-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-whxbc\" (UID: \"0f585839-95d2-4c38-b3e2-ccfd1fb5c545\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whxbc"
Jul 14 18:03:03.912772 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:03.912758    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vpzh\" (UniqueName: \"kubernetes.io/projected/0f585839-95d2-4c38-b3e2-ccfd1fb5c545-kube-api-access-4vpzh\") pod \"cert-manager-operator-controller-manager-55c444bf86-whxbc\" (UID: \"0f585839-95d2-4c38-b3e2-ccfd1fb5c545\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whxbc"
Jul 14 18:03:03.913065 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:03.913044    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f585839-95d2-4c38-b3e2-ccfd1fb5c545-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-whxbc\" (UID: \"0f585839-95d2-4c38-b3e2-ccfd1fb5c545\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whxbc"
Jul 14 18:03:03.946020 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:03.945979    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vpzh\" (UniqueName: \"kubernetes.io/projected/0f585839-95d2-4c38-b3e2-ccfd1fb5c545-kube-api-access-4vpzh\") pod \"cert-manager-operator-controller-manager-55c444bf86-whxbc\" (UID: \"0f585839-95d2-4c38-b3e2-ccfd1fb5c545\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whxbc"
Jul 14 18:03:03.975800 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:03.975763    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whxbc"
Jul 14 18:03:04.123387 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:04.123355    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whxbc"]
Jul 14 18:03:04.126682 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:03:04.126651    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f585839_95d2_4c38_b3e2_ccfd1fb5c545.slice/crio-c2485eeb1741f31a08d1fd6567c4b545c15e843a096171e6cfa92a2e9c131e78 WatchSource:0}: Error finding container c2485eeb1741f31a08d1fd6567c4b545c15e843a096171e6cfa92a2e9c131e78: Status 404 returned error can't find the container with id c2485eeb1741f31a08d1fd6567c4b545c15e843a096171e6cfa92a2e9c131e78
Jul 14 18:03:04.252026 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:04.251939    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whxbc" event={"ID":"0f585839-95d2-4c38-b3e2-ccfd1fb5c545","Type":"ContainerStarted","Data":"c2485eeb1741f31a08d1fd6567c4b545c15e843a096171e6cfa92a2e9c131e78"}
Jul 14 18:03:07.268034 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:07.267995    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whxbc" event={"ID":"0f585839-95d2-4c38-b3e2-ccfd1fb5c545","Type":"ContainerStarted","Data":"1f1582f416c739ff3282d2c0db6e25dcb6717f94991cef44e2b0c408b2defdc2"}
Jul 14 18:03:07.292900 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:07.292850    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whxbc" podStartSLOduration=1.802000054 podStartE2EDuration="4.292834433s" totalImagesPullingTime="2.490834379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:03:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:03:07.290654067 +0000 UTC m=+505.395764052" watchObservedRunningTime="2026-07-14 18:03:07.292834433 +0000 UTC m=+505.397944417"
Jul 14 18:03:08.092741 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.092706    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844"]
Jul 14 18:03:08.095190 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.095168    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844"
Jul 14 18:03:08.098014 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.097990    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 14 18:03:08.098014 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.098003    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 14 18:03:08.098932 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.098919    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9xg8s\""
Jul 14 18:03:08.109015 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.108993    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844"]
Jul 14 18:03:08.249754 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.249714    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb4dbd5a-326c-4679-8c26-a394175057c4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844\" (UID: \"fb4dbd5a-326c-4679-8c26-a394175057c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844"
Jul 14 18:03:08.249933 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.249763    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88jzq\" (UniqueName: \"kubernetes.io/projected/fb4dbd5a-326c-4679-8c26-a394175057c4-kube-api-access-88jzq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844\" (UID: \"fb4dbd5a-326c-4679-8c26-a394175057c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844"
Jul 14 18:03:08.249933 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.249815    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb4dbd5a-326c-4679-8c26-a394175057c4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844\" (UID: \"fb4dbd5a-326c-4679-8c26-a394175057c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844"
Jul 14 18:03:08.350462 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.350369    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb4dbd5a-326c-4679-8c26-a394175057c4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844\" (UID: \"fb4dbd5a-326c-4679-8c26-a394175057c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844"
Jul 14 18:03:08.350462 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.350415    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88jzq\" (UniqueName: \"kubernetes.io/projected/fb4dbd5a-326c-4679-8c26-a394175057c4-kube-api-access-88jzq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844\" (UID: \"fb4dbd5a-326c-4679-8c26-a394175057c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844"
Jul 14 18:03:08.350462 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.350455    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb4dbd5a-326c-4679-8c26-a394175057c4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844\" (UID: \"fb4dbd5a-326c-4679-8c26-a394175057c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844"
Jul 14 18:03:08.350937 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.350892    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb4dbd5a-326c-4679-8c26-a394175057c4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844\" (UID: \"fb4dbd5a-326c-4679-8c26-a394175057c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844"
Jul 14 18:03:08.350937 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.350903    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb4dbd5a-326c-4679-8c26-a394175057c4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844\" (UID: \"fb4dbd5a-326c-4679-8c26-a394175057c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844"
Jul 14 18:03:08.366336 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.366304    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88jzq\" (UniqueName: \"kubernetes.io/projected/fb4dbd5a-326c-4679-8c26-a394175057c4-kube-api-access-88jzq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844\" (UID: \"fb4dbd5a-326c-4679-8c26-a394175057c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844"
Jul 14 18:03:08.404704 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.404662    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844"
Jul 14 18:03:08.546094 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.546067    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844"]
Jul 14 18:03:08.548219 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:03:08.548191    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb4dbd5a_326c_4679_8c26_a394175057c4.slice/crio-e6b690e908571fec864d5c79618ddb8cde64f085faef4ae0778ae1f61ed05b00 WatchSource:0}: Error finding container e6b690e908571fec864d5c79618ddb8cde64f085faef4ae0778ae1f61ed05b00: Status 404 returned error can't find the container with id e6b690e908571fec864d5c79618ddb8cde64f085faef4ae0778ae1f61ed05b00
Jul 14 18:03:08.748490 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.748455    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6v98k"]
Jul 14 18:03:08.750622 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.750606    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-6v98k"
Jul 14 18:03:08.753396 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.753373    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-d2n55\""
Jul 14 18:03:08.753951 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.753931    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 14 18:03:08.754548 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.754532    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 14 18:03:08.772452 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.772417    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6v98k"]
Jul 14 18:03:08.854793 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.854756    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx8c4\" (UniqueName: \"kubernetes.io/projected/4c5ef034-af46-4018-9a8f-c73dd2221dc9-kube-api-access-xx8c4\") pod \"cert-manager-webhook-6486ffd997-6v98k\" (UID: \"4c5ef034-af46-4018-9a8f-c73dd2221dc9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6v98k"
Jul 14 18:03:08.854793 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.854803    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c5ef034-af46-4018-9a8f-c73dd2221dc9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6v98k\" (UID: \"4c5ef034-af46-4018-9a8f-c73dd2221dc9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6v98k"
Jul 14 18:03:08.955625 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.955514    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx8c4\" (UniqueName: \"kubernetes.io/projected/4c5ef034-af46-4018-9a8f-c73dd2221dc9-kube-api-access-xx8c4\") pod \"cert-manager-webhook-6486ffd997-6v98k\" (UID: \"4c5ef034-af46-4018-9a8f-c73dd2221dc9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6v98k"
Jul 14 18:03:08.955625 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.955587    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c5ef034-af46-4018-9a8f-c73dd2221dc9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6v98k\" (UID: \"4c5ef034-af46-4018-9a8f-c73dd2221dc9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6v98k"
Jul 14 18:03:08.966910 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.966880    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c5ef034-af46-4018-9a8f-c73dd2221dc9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6v98k\" (UID: \"4c5ef034-af46-4018-9a8f-c73dd2221dc9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6v98k"
Jul 14 18:03:08.967337 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:08.967314    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx8c4\" (UniqueName: \"kubernetes.io/projected/4c5ef034-af46-4018-9a8f-c73dd2221dc9-kube-api-access-xx8c4\") pod \"cert-manager-webhook-6486ffd997-6v98k\" (UID: \"4c5ef034-af46-4018-9a8f-c73dd2221dc9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6v98k"
Jul 14 18:03:09.060413 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:09.060379    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-6v98k"
Jul 14 18:03:09.194790 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:09.194764    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6v98k"]
Jul 14 18:03:09.195544 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:03:09.195522    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c5ef034_af46_4018_9a8f_c73dd2221dc9.slice/crio-386e09ca59b3fbba6e7c9ca1d5f9542e066189cd95adabb86d24aa3f37ad52a3 WatchSource:0}: Error finding container 386e09ca59b3fbba6e7c9ca1d5f9542e066189cd95adabb86d24aa3f37ad52a3: Status 404 returned error can't find the container with id 386e09ca59b3fbba6e7c9ca1d5f9542e066189cd95adabb86d24aa3f37ad52a3
Jul 14 18:03:09.278055 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:09.277962    2558 generic.go:356] "Generic (PLEG): container finished" podID="fb4dbd5a-326c-4679-8c26-a394175057c4" containerID="8c8aa4c3ce425cb2da7c9c53952f1d696fe39e4c811db7b6c5e23530a56e29a0" exitCode=0
Jul 14 18:03:09.278055 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:09.278006    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844" event={"ID":"fb4dbd5a-326c-4679-8c26-a394175057c4","Type":"ContainerDied","Data":"8c8aa4c3ce425cb2da7c9c53952f1d696fe39e4c811db7b6c5e23530a56e29a0"}
Jul 14 18:03:09.278255 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:09.278062    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844" event={"ID":"fb4dbd5a-326c-4679-8c26-a394175057c4","Type":"ContainerStarted","Data":"e6b690e908571fec864d5c79618ddb8cde64f085faef4ae0778ae1f61ed05b00"}
Jul 14 18:03:09.279340 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:09.279314    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-6v98k" event={"ID":"4c5ef034-af46-4018-9a8f-c73dd2221dc9","Type":"ContainerStarted","Data":"386e09ca59b3fbba6e7c9ca1d5f9542e066189cd95adabb86d24aa3f37ad52a3"}
Jul 14 18:03:10.623778 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:10.623645    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d89gp"]
Jul 14 18:03:10.626290 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:10.626267    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d89gp"
Jul 14 18:03:10.631076 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:10.631052    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-9cbpg\""
Jul 14 18:03:10.645606 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:10.645555    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d89gp"]
Jul 14 18:03:10.770265 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:10.770223    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99c08713-9f50-4abe-b413-51afe9011c6d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d89gp\" (UID: \"99c08713-9f50-4abe-b413-51afe9011c6d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d89gp"
Jul 14 18:03:10.770447 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:10.770299    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mgkv\" (UniqueName: \"kubernetes.io/projected/99c08713-9f50-4abe-b413-51afe9011c6d-kube-api-access-8mgkv\") pod \"cert-manager-cainjector-559cdd8c87-d89gp\" (UID: \"99c08713-9f50-4abe-b413-51afe9011c6d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d89gp"
Jul 14 18:03:10.871462 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:10.871425    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99c08713-9f50-4abe-b413-51afe9011c6d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d89gp\" (UID: \"99c08713-9f50-4abe-b413-51afe9011c6d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d89gp"
Jul 14 18:03:10.871713 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:10.871496    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mgkv\" (UniqueName: \"kubernetes.io/projected/99c08713-9f50-4abe-b413-51afe9011c6d-kube-api-access-8mgkv\") pod \"cert-manager-cainjector-559cdd8c87-d89gp\" (UID: \"99c08713-9f50-4abe-b413-51afe9011c6d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d89gp"
Jul 14 18:03:10.883051 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:10.882949    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99c08713-9f50-4abe-b413-51afe9011c6d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d89gp\" (UID: \"99c08713-9f50-4abe-b413-51afe9011c6d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d89gp"
Jul 14 18:03:10.883179 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:10.883063    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mgkv\" (UniqueName: \"kubernetes.io/projected/99c08713-9f50-4abe-b413-51afe9011c6d-kube-api-access-8mgkv\") pod \"cert-manager-cainjector-559cdd8c87-d89gp\" (UID: \"99c08713-9f50-4abe-b413-51afe9011c6d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d89gp"
Jul 14 18:03:10.937962 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:10.937923    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d89gp"
Jul 14 18:03:11.122001 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:11.121891    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d89gp"]
Jul 14 18:03:11.761929 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:03:11.761891    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99c08713_9f50_4abe_b413_51afe9011c6d.slice/crio-e60b0c2bb3a9398834f70a7ffdef92152d9834620fee27b9d75eaf7ae3666211 WatchSource:0}: Error finding container e60b0c2bb3a9398834f70a7ffdef92152d9834620fee27b9d75eaf7ae3666211: Status 404 returned error can't find the container with id e60b0c2bb3a9398834f70a7ffdef92152d9834620fee27b9d75eaf7ae3666211
Jul 14 18:03:12.297286 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:12.297243    2558 generic.go:356] "Generic (PLEG): container finished" podID="fb4dbd5a-326c-4679-8c26-a394175057c4" containerID="24c1a28d9cb9c464347d9f8f102ed1f7c06c5c89d2982f68496104fdc3bb7a0a" exitCode=0
Jul 14 18:03:12.297613 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:12.297543    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844" event={"ID":"fb4dbd5a-326c-4679-8c26-a394175057c4","Type":"ContainerDied","Data":"24c1a28d9cb9c464347d9f8f102ed1f7c06c5c89d2982f68496104fdc3bb7a0a"}
Jul 14 18:03:12.299635 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:12.299607    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d89gp" event={"ID":"99c08713-9f50-4abe-b413-51afe9011c6d","Type":"ContainerStarted","Data":"e60b0c2bb3a9398834f70a7ffdef92152d9834620fee27b9d75eaf7ae3666211"}
Jul 14 18:03:13.307127 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:13.307093    2558 generic.go:356] "Generic (PLEG): container finished" podID="fb4dbd5a-326c-4679-8c26-a394175057c4" containerID="6db36b2e2e8180d5c469c23f2b1e9ab7aa7a04b1e08a895d08cbcbe424a835fe" exitCode=0
Jul 14 18:03:13.307625 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:13.307176    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844" event={"ID":"fb4dbd5a-326c-4679-8c26-a394175057c4","Type":"ContainerDied","Data":"6db36b2e2e8180d5c469c23f2b1e9ab7aa7a04b1e08a895d08cbcbe424a835fe"}
Jul 14 18:03:14.312643 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:14.312603    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-6v98k" event={"ID":"4c5ef034-af46-4018-9a8f-c73dd2221dc9","Type":"ContainerStarted","Data":"10d6a4dd6e720ef785925a2b44919029a520001726b39e849afa7364070cc854"}
Jul 14 18:03:14.313106 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:14.312708    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-6v98k"
Jul 14 18:03:14.314175 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:14.314151    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d89gp" event={"ID":"99c08713-9f50-4abe-b413-51afe9011c6d","Type":"ContainerStarted","Data":"1c36d8c1b5697bfa18c78f6fe6980e6e30637366ab61fb5fa86e2176187afcb3"}
Jul 14 18:03:14.333333 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:14.333282    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-6v98k" podStartSLOduration=1.930935734 podStartE2EDuration="6.333264569s" totalImagesPullingTime="4.402328835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:03:14.33253672 +0000 UTC m=+512.437646699" watchObservedRunningTime="2026-07-14 18:03:14.333264569 +0000 UTC m=+512.438374552"
Jul 14 18:03:14.358252 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:14.358177    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d89gp" podStartSLOduration=2.513839618 podStartE2EDuration="4.358155411s" totalImagesPullingTime="1.844315793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:03:14.356795283 +0000 UTC m=+512.461905270" watchObservedRunningTime="2026-07-14 18:03:14.358155411 +0000 UTC m=+512.463265397"
Jul 14 18:03:14.445947 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:14.445910    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844"
Jul 14 18:03:14.603907 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:14.603867    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb4dbd5a-326c-4679-8c26-a394175057c4-bundle\") pod \"fb4dbd5a-326c-4679-8c26-a394175057c4\" (UID: \"fb4dbd5a-326c-4679-8c26-a394175057c4\") "
Jul 14 18:03:14.604102 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:14.603967    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb4dbd5a-326c-4679-8c26-a394175057c4-util\") pod \"fb4dbd5a-326c-4679-8c26-a394175057c4\" (UID: \"fb4dbd5a-326c-4679-8c26-a394175057c4\") "
Jul 14 18:03:14.604102 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:14.604024    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88jzq\" (UniqueName: \"kubernetes.io/projected/fb4dbd5a-326c-4679-8c26-a394175057c4-kube-api-access-88jzq\") pod \"fb4dbd5a-326c-4679-8c26-a394175057c4\" (UID: \"fb4dbd5a-326c-4679-8c26-a394175057c4\") "
Jul 14 18:03:14.604368 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:14.604342    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb4dbd5a-326c-4679-8c26-a394175057c4-bundle" (OuterVolumeSpecName: "bundle") pod "fb4dbd5a-326c-4679-8c26-a394175057c4" (UID: "fb4dbd5a-326c-4679-8c26-a394175057c4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:03:14.606396 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:14.606367    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb4dbd5a-326c-4679-8c26-a394175057c4-kube-api-access-88jzq" (OuterVolumeSpecName: "kube-api-access-88jzq") pod "fb4dbd5a-326c-4679-8c26-a394175057c4" (UID: "fb4dbd5a-326c-4679-8c26-a394175057c4"). InnerVolumeSpecName "kube-api-access-88jzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:03:14.608456 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:14.608437    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb4dbd5a-326c-4679-8c26-a394175057c4-util" (OuterVolumeSpecName: "util") pod "fb4dbd5a-326c-4679-8c26-a394175057c4" (UID: "fb4dbd5a-326c-4679-8c26-a394175057c4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:03:14.705333 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:14.705284    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb4dbd5a-326c-4679-8c26-a394175057c4-util\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:03:14.705333 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:14.705327    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88jzq\" (UniqueName: \"kubernetes.io/projected/fb4dbd5a-326c-4679-8c26-a394175057c4-kube-api-access-88jzq\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:03:14.705333 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:14.705341    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb4dbd5a-326c-4679-8c26-a394175057c4-bundle\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:03:15.319632 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:15.319554    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844"
Jul 14 18:03:15.319632 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:15.319589    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx6844" event={"ID":"fb4dbd5a-326c-4679-8c26-a394175057c4","Type":"ContainerDied","Data":"e6b690e908571fec864d5c79618ddb8cde64f085faef4ae0778ae1f61ed05b00"}
Jul 14 18:03:15.320163 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:15.319658    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6b690e908571fec864d5c79618ddb8cde64f085faef4ae0778ae1f61ed05b00"
Jul 14 18:03:18.327384 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:18.327352    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-h886g"]
Jul 14 18:03:18.327784 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:18.327680    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb4dbd5a-326c-4679-8c26-a394175057c4" containerName="util"
Jul 14 18:03:18.327784 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:18.327692    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb4dbd5a-326c-4679-8c26-a394175057c4" containerName="util"
Jul 14 18:03:18.327784 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:18.327706    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb4dbd5a-326c-4679-8c26-a394175057c4" containerName="pull"
Jul 14 18:03:18.327784 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:18.327716    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb4dbd5a-326c-4679-8c26-a394175057c4" containerName="pull"
Jul 14 18:03:18.327784 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:18.327730    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb4dbd5a-326c-4679-8c26-a394175057c4" containerName="extract"
Jul 14 18:03:18.327784 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:18.327737    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb4dbd5a-326c-4679-8c26-a394175057c4" containerName="extract"
Jul 14 18:03:18.327784 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:18.327785    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb4dbd5a-326c-4679-8c26-a394175057c4" containerName="extract"
Jul 14 18:03:18.331512 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:18.331487    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-h886g"
Jul 14 18:03:18.335038 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:18.335017    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-jcjgk\""
Jul 14 18:03:18.374543 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:18.374504    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-h886g"]
Jul 14 18:03:18.433005 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:18.432974    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/adec82bf-28af-400a-9a3d-ed27b7f7ca5f-bound-sa-token\") pod \"cert-manager-55b4d954d5-h886g\" (UID: \"adec82bf-28af-400a-9a3d-ed27b7f7ca5f\") " pod="cert-manager/cert-manager-55b4d954d5-h886g"
Jul 14 18:03:18.433187 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:18.433022    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q2f8\" (UniqueName: \"kubernetes.io/projected/adec82bf-28af-400a-9a3d-ed27b7f7ca5f-kube-api-access-5q2f8\") pod \"cert-manager-55b4d954d5-h886g\" (UID: \"adec82bf-28af-400a-9a3d-ed27b7f7ca5f\") " pod="cert-manager/cert-manager-55b4d954d5-h886g"
Jul 14 18:03:18.533796 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:18.533756    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q2f8\" (UniqueName: \"kubernetes.io/projected/adec82bf-28af-400a-9a3d-ed27b7f7ca5f-kube-api-access-5q2f8\") pod \"cert-manager-55b4d954d5-h886g\" (UID: \"adec82bf-28af-400a-9a3d-ed27b7f7ca5f\") " pod="cert-manager/cert-manager-55b4d954d5-h886g"
Jul 14 18:03:18.533955 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:18.533833    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/adec82bf-28af-400a-9a3d-ed27b7f7ca5f-bound-sa-token\") pod \"cert-manager-55b4d954d5-h886g\" (UID: \"adec82bf-28af-400a-9a3d-ed27b7f7ca5f\") " pod="cert-manager/cert-manager-55b4d954d5-h886g"
Jul 14 18:03:18.563179 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:18.563145    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/adec82bf-28af-400a-9a3d-ed27b7f7ca5f-bound-sa-token\") pod \"cert-manager-55b4d954d5-h886g\" (UID: \"adec82bf-28af-400a-9a3d-ed27b7f7ca5f\") " pod="cert-manager/cert-manager-55b4d954d5-h886g"
Jul 14 18:03:18.564520 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:18.564502    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q2f8\" (UniqueName: \"kubernetes.io/projected/adec82bf-28af-400a-9a3d-ed27b7f7ca5f-kube-api-access-5q2f8\") pod \"cert-manager-55b4d954d5-h886g\" (UID: \"adec82bf-28af-400a-9a3d-ed27b7f7ca5f\") " pod="cert-manager/cert-manager-55b4d954d5-h886g"
Jul 14 18:03:18.639984 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:18.639952    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-h886g"
Jul 14 18:03:18.792479 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:18.792450    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-h886g"]
Jul 14 18:03:18.795123 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:03:18.795086    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podadec82bf_28af_400a_9a3d_ed27b7f7ca5f.slice/crio-224500282d99ad28eac3908d6d9be3403e0c9ec7e56722d4aa89565cb1765f50 WatchSource:0}: Error finding container 224500282d99ad28eac3908d6d9be3403e0c9ec7e56722d4aa89565cb1765f50: Status 404 returned error can't find the container with id 224500282d99ad28eac3908d6d9be3403e0c9ec7e56722d4aa89565cb1765f50
Jul 14 18:03:19.336696 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:19.336661    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-h886g" event={"ID":"adec82bf-28af-400a-9a3d-ed27b7f7ca5f","Type":"ContainerStarted","Data":"d0f6b2cbb83ac1de6a1e98b4affa7e750d33767e3fafee968c72eeff9e26c413"}
Jul 14 18:03:19.336696 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:19.336701    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-h886g" event={"ID":"adec82bf-28af-400a-9a3d-ed27b7f7ca5f","Type":"ContainerStarted","Data":"224500282d99ad28eac3908d6d9be3403e0c9ec7e56722d4aa89565cb1765f50"}
Jul 14 18:03:19.358948 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:19.358889    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-h886g" podStartSLOduration=1.358870282 podStartE2EDuration="1.358870282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:03:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:03:19.357750965 +0000 UTC m=+517.462860948" watchObservedRunningTime="2026-07-14 18:03:19.358870282 +0000 UTC m=+517.463980265"
Jul 14 18:03:20.322008 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:20.321978    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-6v98k"
Jul 14 18:03:26.364766 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:26.364733    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8"]
Jul 14 18:03:26.447276 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:26.447241    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8"
Jul 14 18:03:26.450295 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:26.450260    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9xg8s\""
Jul 14 18:03:26.451230 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:26.451204    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 14 18:03:26.451342 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:26.451210    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 14 18:03:26.453254 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:26.453232    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8"]
Jul 14 18:03:26.497044 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:26.497004    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82c59678-4f07-4338-b9c1-e7e66d4ad912-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8\" (UID: \"82c59678-4f07-4338-b9c1-e7e66d4ad912\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8"
Jul 14 18:03:26.497044 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:26.497050    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82c59678-4f07-4338-b9c1-e7e66d4ad912-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8\" (UID: \"82c59678-4f07-4338-b9c1-e7e66d4ad912\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8"
Jul 14 18:03:26.497256 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:26.497074    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gks2q\" (UniqueName: \"kubernetes.io/projected/82c59678-4f07-4338-b9c1-e7e66d4ad912-kube-api-access-gks2q\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8\" (UID: \"82c59678-4f07-4338-b9c1-e7e66d4ad912\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8"
Jul 14 18:03:26.598091 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:26.598052    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82c59678-4f07-4338-b9c1-e7e66d4ad912-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8\" (UID: \"82c59678-4f07-4338-b9c1-e7e66d4ad912\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8"
Jul 14 18:03:26.598091 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:26.598093    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gks2q\" (UniqueName: \"kubernetes.io/projected/82c59678-4f07-4338-b9c1-e7e66d4ad912-kube-api-access-gks2q\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8\" (UID: \"82c59678-4f07-4338-b9c1-e7e66d4ad912\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8"
Jul 14 18:03:26.598287 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:26.598160    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82c59678-4f07-4338-b9c1-e7e66d4ad912-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8\" (UID: \"82c59678-4f07-4338-b9c1-e7e66d4ad912\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8"
Jul 14 18:03:26.598447 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:26.598427    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82c59678-4f07-4338-b9c1-e7e66d4ad912-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8\" (UID: \"82c59678-4f07-4338-b9c1-e7e66d4ad912\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8"
Jul 14 18:03:26.598483 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:26.598454    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82c59678-4f07-4338-b9c1-e7e66d4ad912-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8\" (UID: \"82c59678-4f07-4338-b9c1-e7e66d4ad912\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8"
Jul 14 18:03:26.608257 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:26.608231    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gks2q\" (UniqueName: \"kubernetes.io/projected/82c59678-4f07-4338-b9c1-e7e66d4ad912-kube-api-access-gks2q\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8\" (UID: \"82c59678-4f07-4338-b9c1-e7e66d4ad912\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8"
Jul 14 18:03:26.757626 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:26.757500    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8"
Jul 14 18:03:26.914899 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:26.914874    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8"]
Jul 14 18:03:26.916785 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:03:26.916756    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82c59678_4f07_4338_b9c1_e7e66d4ad912.slice/crio-8794b5f51136da6719dcc9d530ea247c63706032d734b3b183d3807355fc734a WatchSource:0}: Error finding container 8794b5f51136da6719dcc9d530ea247c63706032d734b3b183d3807355fc734a: Status 404 returned error can't find the container with id 8794b5f51136da6719dcc9d530ea247c63706032d734b3b183d3807355fc734a
Jul 14 18:03:27.373297 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:27.373269    2558 generic.go:356] "Generic (PLEG): container finished" podID="82c59678-4f07-4338-b9c1-e7e66d4ad912" containerID="79ae7e497bac32739188e21566e1d87193694920629c5966d907b813760ac3be" exitCode=0
Jul 14 18:03:27.373716 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:27.373332    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8" event={"ID":"82c59678-4f07-4338-b9c1-e7e66d4ad912","Type":"ContainerDied","Data":"79ae7e497bac32739188e21566e1d87193694920629c5966d907b813760ac3be"}
Jul 14 18:03:27.373716 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:27.373374    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8" event={"ID":"82c59678-4f07-4338-b9c1-e7e66d4ad912","Type":"ContainerStarted","Data":"8794b5f51136da6719dcc9d530ea247c63706032d734b3b183d3807355fc734a"}
Jul 14 18:03:28.380369 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:28.380333    2558 generic.go:356] "Generic (PLEG): container finished" podID="82c59678-4f07-4338-b9c1-e7e66d4ad912" containerID="7a5c13201c4acb5143727d938e3daadfde6171a32ce7e7e029b99aca06d3af6c" exitCode=0
Jul 14 18:03:28.380797 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:28.380398    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8" event={"ID":"82c59678-4f07-4338-b9c1-e7e66d4ad912","Type":"ContainerDied","Data":"7a5c13201c4acb5143727d938e3daadfde6171a32ce7e7e029b99aca06d3af6c"}
Jul 14 18:03:29.386582 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:29.386539    2558 generic.go:356] "Generic (PLEG): container finished" podID="82c59678-4f07-4338-b9c1-e7e66d4ad912" containerID="ead27d240e35b6535fec7f10a812764283718b2cb9df4b58fc61b7cc5d255f63" exitCode=0
Jul 14 18:03:29.386943 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:29.386613    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8" event={"ID":"82c59678-4f07-4338-b9c1-e7e66d4ad912","Type":"ContainerDied","Data":"ead27d240e35b6535fec7f10a812764283718b2cb9df4b58fc61b7cc5d255f63"}
Jul 14 18:03:30.525946 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:30.525923    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8"
Jul 14 18:03:30.630344 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:30.630306    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gks2q\" (UniqueName: \"kubernetes.io/projected/82c59678-4f07-4338-b9c1-e7e66d4ad912-kube-api-access-gks2q\") pod \"82c59678-4f07-4338-b9c1-e7e66d4ad912\" (UID: \"82c59678-4f07-4338-b9c1-e7e66d4ad912\") "
Jul 14 18:03:30.630537 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:30.630358    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82c59678-4f07-4338-b9c1-e7e66d4ad912-util\") pod \"82c59678-4f07-4338-b9c1-e7e66d4ad912\" (UID: \"82c59678-4f07-4338-b9c1-e7e66d4ad912\") "
Jul 14 18:03:30.630537 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:30.630401    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82c59678-4f07-4338-b9c1-e7e66d4ad912-bundle\") pod \"82c59678-4f07-4338-b9c1-e7e66d4ad912\" (UID: \"82c59678-4f07-4338-b9c1-e7e66d4ad912\") "
Jul 14 18:03:30.631146 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:30.631119    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82c59678-4f07-4338-b9c1-e7e66d4ad912-bundle" (OuterVolumeSpecName: "bundle") pod "82c59678-4f07-4338-b9c1-e7e66d4ad912" (UID: "82c59678-4f07-4338-b9c1-e7e66d4ad912"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:03:30.632633 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:30.632602    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82c59678-4f07-4338-b9c1-e7e66d4ad912-kube-api-access-gks2q" (OuterVolumeSpecName: "kube-api-access-gks2q") pod "82c59678-4f07-4338-b9c1-e7e66d4ad912" (UID: "82c59678-4f07-4338-b9c1-e7e66d4ad912"). InnerVolumeSpecName "kube-api-access-gks2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:03:30.636220 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:30.636180    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82c59678-4f07-4338-b9c1-e7e66d4ad912-util" (OuterVolumeSpecName: "util") pod "82c59678-4f07-4338-b9c1-e7e66d4ad912" (UID: "82c59678-4f07-4338-b9c1-e7e66d4ad912"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:03:30.731182 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:30.731089    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gks2q\" (UniqueName: \"kubernetes.io/projected/82c59678-4f07-4338-b9c1-e7e66d4ad912-kube-api-access-gks2q\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:03:30.731182 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:30.731124    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82c59678-4f07-4338-b9c1-e7e66d4ad912-util\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:03:30.731182 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:30.731136    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82c59678-4f07-4338-b9c1-e7e66d4ad912-bundle\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:03:31.397786 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:31.397746    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8" event={"ID":"82c59678-4f07-4338-b9c1-e7e66d4ad912","Type":"ContainerDied","Data":"8794b5f51136da6719dcc9d530ea247c63706032d734b3b183d3807355fc734a"}
Jul 14 18:03:31.397941 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:31.397802    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8bl8"
Jul 14 18:03:31.397941 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:31.397811    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8794b5f51136da6719dcc9d530ea247c63706032d734b3b183d3807355fc734a"
Jul 14 18:03:41.645486 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.645454    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8"]
Jul 14 18:03:41.645928 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.645784    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82c59678-4f07-4338-b9c1-e7e66d4ad912" containerName="extract"
Jul 14 18:03:41.645928 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.645796    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="82c59678-4f07-4338-b9c1-e7e66d4ad912" containerName="extract"
Jul 14 18:03:41.645928 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.645822    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82c59678-4f07-4338-b9c1-e7e66d4ad912" containerName="util"
Jul 14 18:03:41.645928 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.645830    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="82c59678-4f07-4338-b9c1-e7e66d4ad912" containerName="util"
Jul 14 18:03:41.645928 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.645841    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82c59678-4f07-4338-b9c1-e7e66d4ad912" containerName="pull"
Jul 14 18:03:41.645928 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.645846    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="82c59678-4f07-4338-b9c1-e7e66d4ad912" containerName="pull"
Jul 14 18:03:41.645928 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.645898    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="82c59678-4f07-4338-b9c1-e7e66d4ad912" containerName="extract"
Jul 14 18:03:41.647959 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.647932    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8"
Jul 14 18:03:41.650551 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.650530    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 14 18:03:41.650683 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.650530    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vfmqw\""
Jul 14 18:03:41.650683 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.650597    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 14 18:03:41.650931 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.650912    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 14 18:03:41.651011 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.650961    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 14 18:03:41.672384 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.672358    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8"]
Jul 14 18:03:41.720126 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.719823    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08e673a6-1903-455e-ba64-436947d58a68-webhook-cert\") pod \"opendatahub-operator-controller-manager-67c464fdbc-wcgr8\" (UID: \"08e673a6-1903-455e-ba64-436947d58a68\") " pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8"
Jul 14 18:03:41.720126 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.719887    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ml5v\" (UniqueName: \"kubernetes.io/projected/08e673a6-1903-455e-ba64-436947d58a68-kube-api-access-5ml5v\") pod \"opendatahub-operator-controller-manager-67c464fdbc-wcgr8\" (UID: \"08e673a6-1903-455e-ba64-436947d58a68\") " pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8"
Jul 14 18:03:41.720126 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.719938    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/08e673a6-1903-455e-ba64-436947d58a68-manifests\") pod \"opendatahub-operator-controller-manager-67c464fdbc-wcgr8\" (UID: \"08e673a6-1903-455e-ba64-436947d58a68\") " pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8"
Jul 14 18:03:41.720126 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.719990    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08e673a6-1903-455e-ba64-436947d58a68-tmp\") pod \"opendatahub-operator-controller-manager-67c464fdbc-wcgr8\" (UID: \"08e673a6-1903-455e-ba64-436947d58a68\") " pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8"
Jul 14 18:03:41.720126 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.720059    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/08e673a6-1903-455e-ba64-436947d58a68-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67c464fdbc-wcgr8\" (UID: \"08e673a6-1903-455e-ba64-436947d58a68\") " pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8"
Jul 14 18:03:41.820884 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.820848    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ml5v\" (UniqueName: \"kubernetes.io/projected/08e673a6-1903-455e-ba64-436947d58a68-kube-api-access-5ml5v\") pod \"opendatahub-operator-controller-manager-67c464fdbc-wcgr8\" (UID: \"08e673a6-1903-455e-ba64-436947d58a68\") " pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8"
Jul 14 18:03:41.821037 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.820891    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/08e673a6-1903-455e-ba64-436947d58a68-manifests\") pod \"opendatahub-operator-controller-manager-67c464fdbc-wcgr8\" (UID: \"08e673a6-1903-455e-ba64-436947d58a68\") " pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8"
Jul 14 18:03:41.821037 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.821014    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08e673a6-1903-455e-ba64-436947d58a68-tmp\") pod \"opendatahub-operator-controller-manager-67c464fdbc-wcgr8\" (UID: \"08e673a6-1903-455e-ba64-436947d58a68\") " pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8"
Jul 14 18:03:41.821164 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.821071    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/08e673a6-1903-455e-ba64-436947d58a68-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67c464fdbc-wcgr8\" (UID: \"08e673a6-1903-455e-ba64-436947d58a68\") " pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8"
Jul 14 18:03:41.821164 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.821113    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08e673a6-1903-455e-ba64-436947d58a68-webhook-cert\") pod \"opendatahub-operator-controller-manager-67c464fdbc-wcgr8\" (UID: \"08e673a6-1903-455e-ba64-436947d58a68\") " pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8"
Jul 14 18:03:41.821329 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.821198    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/08e673a6-1903-455e-ba64-436947d58a68-manifests\") pod \"opendatahub-operator-controller-manager-67c464fdbc-wcgr8\" (UID: \"08e673a6-1903-455e-ba64-436947d58a68\") " pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8"
Jul 14 18:03:41.823551 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.823527    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08e673a6-1903-455e-ba64-436947d58a68-tmp\") pod \"opendatahub-operator-controller-manager-67c464fdbc-wcgr8\" (UID: \"08e673a6-1903-455e-ba64-436947d58a68\") " pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8"
Jul 14 18:03:41.823729 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.823658    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/08e673a6-1903-455e-ba64-436947d58a68-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67c464fdbc-wcgr8\" (UID: \"08e673a6-1903-455e-ba64-436947d58a68\") " pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8"
Jul 14 18:03:41.823798 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.823752    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08e673a6-1903-455e-ba64-436947d58a68-webhook-cert\") pod \"opendatahub-operator-controller-manager-67c464fdbc-wcgr8\" (UID: \"08e673a6-1903-455e-ba64-436947d58a68\") " pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8"
Jul 14 18:03:41.832422 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.832400    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ml5v\" (UniqueName: \"kubernetes.io/projected/08e673a6-1903-455e-ba64-436947d58a68-kube-api-access-5ml5v\") pod \"opendatahub-operator-controller-manager-67c464fdbc-wcgr8\" (UID: \"08e673a6-1903-455e-ba64-436947d58a68\") " pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8"
Jul 14 18:03:41.959301 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:41.959208    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8"
Jul 14 18:03:42.116714 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:42.116609    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8"]
Jul 14 18:03:42.119471 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:03:42.119444    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08e673a6_1903_455e_ba64_436947d58a68.slice/crio-27e4f3e2eb79ad4e26b86fbe4dc13fe0d66ac9c8a14cea1fcb3b52ef66086b7c WatchSource:0}: Error finding container 27e4f3e2eb79ad4e26b86fbe4dc13fe0d66ac9c8a14cea1fcb3b52ef66086b7c: Status 404 returned error can't find the container with id 27e4f3e2eb79ad4e26b86fbe4dc13fe0d66ac9c8a14cea1fcb3b52ef66086b7c
Jul 14 18:03:42.446193 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:42.446154    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8" event={"ID":"08e673a6-1903-455e-ba64-436947d58a68","Type":"ContainerStarted","Data":"27e4f3e2eb79ad4e26b86fbe4dc13fe0d66ac9c8a14cea1fcb3b52ef66086b7c"}
Jul 14 18:03:46.469519 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:46.469478    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8" event={"ID":"08e673a6-1903-455e-ba64-436947d58a68","Type":"ContainerStarted","Data":"3dfb432c76500d853a78c40d70b853a136abf98a50ed8de9e8355ee229af0c7a"}
Jul 14 18:03:47.476492 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:47.476454    2558 generic.go:356] "Generic (PLEG): container finished" podID="08e673a6-1903-455e-ba64-436947d58a68" containerID="3dfb432c76500d853a78c40d70b853a136abf98a50ed8de9e8355ee229af0c7a" exitCode=0
Jul 14 18:03:47.476950 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:47.476546    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8" event={"ID":"08e673a6-1903-455e-ba64-436947d58a68","Type":"ContainerDied","Data":"3dfb432c76500d853a78c40d70b853a136abf98a50ed8de9e8355ee229af0c7a"}
Jul 14 18:03:48.482879 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:48.482839    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8" event={"ID":"08e673a6-1903-455e-ba64-436947d58a68","Type":"ContainerStarted","Data":"b24336a925092180e3780a06779b9943d5e60cd4e9a6fc08bc026c8f05a3995d"}
Jul 14 18:03:48.483279 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:48.482970    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8"
Jul 14 18:03:48.523365 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:48.523307    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8" podStartSLOduration=2.471479873 podStartE2EDuration="7.523287473s" totalImagesPullingTime="3.996062698s" totalInitContainerRuntime="1.055744902s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:03:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:03:48.514472283 +0000 UTC m=+546.619582268" watchObservedRunningTime="2026-07-14 18:03:48.523287473 +0000 UTC m=+546.628397452"
Jul 14 18:03:59.490880 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:03:59.490850    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67c464fdbc-wcgr8"
Jul 14 18:04:05.171011 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:05.170976    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2nbrx"]
Jul 14 18:04:05.173609 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:05.173590    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2nbrx"
Jul 14 18:04:05.177161 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:05.177139    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 14 18:04:05.177880 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:05.177867    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-r9ndg\""
Jul 14 18:04:05.194454 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:05.194426    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2nbrx"]
Jul 14 18:04:05.329810 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:05.329775    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8qw8\" (UniqueName: \"kubernetes.io/projected/7af7b6d6-0424-42fa-a852-f747cbc071dd-kube-api-access-j8qw8\") pod \"odh-model-controller-7998c67dc4-2nbrx\" (UID: \"7af7b6d6-0424-42fa-a852-f747cbc071dd\") " pod="opendatahub/odh-model-controller-7998c67dc4-2nbrx"
Jul 14 18:04:05.330004 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:05.329841    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7af7b6d6-0424-42fa-a852-f747cbc071dd-cert\") pod \"odh-model-controller-7998c67dc4-2nbrx\" (UID: \"7af7b6d6-0424-42fa-a852-f747cbc071dd\") " pod="opendatahub/odh-model-controller-7998c67dc4-2nbrx"
Jul 14 18:04:05.430721 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:05.430624    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8qw8\" (UniqueName: \"kubernetes.io/projected/7af7b6d6-0424-42fa-a852-f747cbc071dd-kube-api-access-j8qw8\") pod \"odh-model-controller-7998c67dc4-2nbrx\" (UID: \"7af7b6d6-0424-42fa-a852-f747cbc071dd\") " pod="opendatahub/odh-model-controller-7998c67dc4-2nbrx"
Jul 14 18:04:05.430895 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:05.430760    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7af7b6d6-0424-42fa-a852-f747cbc071dd-cert\") pod \"odh-model-controller-7998c67dc4-2nbrx\" (UID: \"7af7b6d6-0424-42fa-a852-f747cbc071dd\") " pod="opendatahub/odh-model-controller-7998c67dc4-2nbrx"
Jul 14 18:04:05.430963 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:04:05.430893    2558 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 14 18:04:05.431028 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:04:05.430975    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7af7b6d6-0424-42fa-a852-f747cbc071dd-cert podName:7af7b6d6-0424-42fa-a852-f747cbc071dd nodeName:}" failed. No retries permitted until 2026-07-14 18:04:05.930954135 +0000 UTC m=+564.036064098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7af7b6d6-0424-42fa-a852-f747cbc071dd-cert") pod "odh-model-controller-7998c67dc4-2nbrx" (UID: "7af7b6d6-0424-42fa-a852-f747cbc071dd") : secret "odh-model-controller-webhook-cert" not found
Jul 14 18:04:05.450183 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:05.450155    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8qw8\" (UniqueName: \"kubernetes.io/projected/7af7b6d6-0424-42fa-a852-f747cbc071dd-kube-api-access-j8qw8\") pod \"odh-model-controller-7998c67dc4-2nbrx\" (UID: \"7af7b6d6-0424-42fa-a852-f747cbc071dd\") " pod="opendatahub/odh-model-controller-7998c67dc4-2nbrx"
Jul 14 18:04:05.934356 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:05.934317    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7af7b6d6-0424-42fa-a852-f747cbc071dd-cert\") pod \"odh-model-controller-7998c67dc4-2nbrx\" (UID: \"7af7b6d6-0424-42fa-a852-f747cbc071dd\") " pod="opendatahub/odh-model-controller-7998c67dc4-2nbrx"
Jul 14 18:04:05.937085 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:05.937057    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7af7b6d6-0424-42fa-a852-f747cbc071dd-cert\") pod \"odh-model-controller-7998c67dc4-2nbrx\" (UID: \"7af7b6d6-0424-42fa-a852-f747cbc071dd\") " pod="opendatahub/odh-model-controller-7998c67dc4-2nbrx"
Jul 14 18:04:06.083581 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.083525    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2nbrx"
Jul 14 18:04:06.186546 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.186460    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dzfh2"]
Jul 14 18:04:06.189533 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.189507    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-dzfh2"
Jul 14 18:04:06.193777 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.193748    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 14 18:04:06.207925 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.207889    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dzfh2"]
Jul 14 18:04:06.237733 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.237684    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfv2c\" (UniqueName: \"kubernetes.io/projected/4cc23c90-470d-4a2d-8d4f-09ae7e6b6751-kube-api-access-rfv2c\") pod \"model-serving-api-54d89bd5fc-dzfh2\" (UID: \"4cc23c90-470d-4a2d-8d4f-09ae7e6b6751\") " pod="opendatahub/model-serving-api-54d89bd5fc-dzfh2"
Jul 14 18:04:06.237941 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.237805    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cc23c90-470d-4a2d-8d4f-09ae7e6b6751-tls-certs\") pod \"model-serving-api-54d89bd5fc-dzfh2\" (UID: \"4cc23c90-470d-4a2d-8d4f-09ae7e6b6751\") " pod="opendatahub/model-serving-api-54d89bd5fc-dzfh2"
Jul 14 18:04:06.245119 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.245099    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2nbrx"]
Jul 14 18:04:06.248187 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:04:06.248157    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af7b6d6_0424_42fa_a852_f747cbc071dd.slice/crio-ea4a2dc400a0745278aa4e39cb668e32ffab617548ec31ac692d3a9b27c5f4ad WatchSource:0}: Error finding container ea4a2dc400a0745278aa4e39cb668e32ffab617548ec31ac692d3a9b27c5f4ad: Status 404 returned error can't find the container with id ea4a2dc400a0745278aa4e39cb668e32ffab617548ec31ac692d3a9b27c5f4ad
Jul 14 18:04:06.338723 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.338681    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfv2c\" (UniqueName: \"kubernetes.io/projected/4cc23c90-470d-4a2d-8d4f-09ae7e6b6751-kube-api-access-rfv2c\") pod \"model-serving-api-54d89bd5fc-dzfh2\" (UID: \"4cc23c90-470d-4a2d-8d4f-09ae7e6b6751\") " pod="opendatahub/model-serving-api-54d89bd5fc-dzfh2"
Jul 14 18:04:06.338929 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.338766    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cc23c90-470d-4a2d-8d4f-09ae7e6b6751-tls-certs\") pod \"model-serving-api-54d89bd5fc-dzfh2\" (UID: \"4cc23c90-470d-4a2d-8d4f-09ae7e6b6751\") " pod="opendatahub/model-serving-api-54d89bd5fc-dzfh2"
Jul 14 18:04:06.338929 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:04:06.338889    2558 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 14 18:04:06.339051 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:04:06.338957    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cc23c90-470d-4a2d-8d4f-09ae7e6b6751-tls-certs podName:4cc23c90-470d-4a2d-8d4f-09ae7e6b6751 nodeName:}" failed. No retries permitted until 2026-07-14 18:04:06.8389371 +0000 UTC m=+564.944047061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4cc23c90-470d-4a2d-8d4f-09ae7e6b6751-tls-certs") pod "model-serving-api-54d89bd5fc-dzfh2" (UID: "4cc23c90-470d-4a2d-8d4f-09ae7e6b6751") : secret "model-serving-api-tls" not found
Jul 14 18:04:06.356316 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.356213    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfv2c\" (UniqueName: \"kubernetes.io/projected/4cc23c90-470d-4a2d-8d4f-09ae7e6b6751-kube-api-access-rfv2c\") pod \"model-serving-api-54d89bd5fc-dzfh2\" (UID: \"4cc23c90-470d-4a2d-8d4f-09ae7e6b6751\") " pod="opendatahub/model-serving-api-54d89bd5fc-dzfh2"
Jul 14 18:04:06.564965 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.564871    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2nbrx" event={"ID":"7af7b6d6-0424-42fa-a852-f747cbc071dd","Type":"ContainerStarted","Data":"ea4a2dc400a0745278aa4e39cb668e32ffab617548ec31ac692d3a9b27c5f4ad"}
Jul 14 18:04:06.701038 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.700990    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5979cf877b-djrtg"]
Jul 14 18:04:06.703973 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.703948    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5979cf877b-djrtg"
Jul 14 18:04:06.710921 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.710889    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 14 18:04:06.711066 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.710903    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 14 18:04:06.711938 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.711908    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 14 18:04:06.712081 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.711937    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wtbc8\""
Jul 14 18:04:06.715112 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.715084    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 14 18:04:06.721587 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.719420    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5979cf877b-djrtg"]
Jul 14 18:04:06.742149 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.742107    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkxq4\" (UniqueName: \"kubernetes.io/projected/cc905b62-2b1d-4b83-9139-866c53a9b5a3-kube-api-access-fkxq4\") pod \"kube-auth-proxy-5979cf877b-djrtg\" (UID: \"cc905b62-2b1d-4b83-9139-866c53a9b5a3\") " pod="openshift-ingress/kube-auth-proxy-5979cf877b-djrtg"
Jul 14 18:04:06.742331 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.742174    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc905b62-2b1d-4b83-9139-866c53a9b5a3-tls-certs\") pod \"kube-auth-proxy-5979cf877b-djrtg\" (UID: \"cc905b62-2b1d-4b83-9139-866c53a9b5a3\") " pod="openshift-ingress/kube-auth-proxy-5979cf877b-djrtg"
Jul 14 18:04:06.742331 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.742280    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc905b62-2b1d-4b83-9139-866c53a9b5a3-tmp\") pod \"kube-auth-proxy-5979cf877b-djrtg\" (UID: \"cc905b62-2b1d-4b83-9139-866c53a9b5a3\") " pod="openshift-ingress/kube-auth-proxy-5979cf877b-djrtg"
Jul 14 18:04:06.843490 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.843443    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc905b62-2b1d-4b83-9139-866c53a9b5a3-tmp\") pod \"kube-auth-proxy-5979cf877b-djrtg\" (UID: \"cc905b62-2b1d-4b83-9139-866c53a9b5a3\") " pod="openshift-ingress/kube-auth-proxy-5979cf877b-djrtg"
Jul 14 18:04:06.843740 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.843510    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cc23c90-470d-4a2d-8d4f-09ae7e6b6751-tls-certs\") pod \"model-serving-api-54d89bd5fc-dzfh2\" (UID: \"4cc23c90-470d-4a2d-8d4f-09ae7e6b6751\") " pod="opendatahub/model-serving-api-54d89bd5fc-dzfh2"
Jul 14 18:04:06.843740 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.843551    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkxq4\" (UniqueName: \"kubernetes.io/projected/cc905b62-2b1d-4b83-9139-866c53a9b5a3-kube-api-access-fkxq4\") pod \"kube-auth-proxy-5979cf877b-djrtg\" (UID: \"cc905b62-2b1d-4b83-9139-866c53a9b5a3\") " pod="openshift-ingress/kube-auth-proxy-5979cf877b-djrtg"
Jul 14 18:04:06.843874 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.843734    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc905b62-2b1d-4b83-9139-866c53a9b5a3-tls-certs\") pod \"kube-auth-proxy-5979cf877b-djrtg\" (UID: \"cc905b62-2b1d-4b83-9139-866c53a9b5a3\") " pod="openshift-ingress/kube-auth-proxy-5979cf877b-djrtg"
Jul 14 18:04:06.846022 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.845986    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc905b62-2b1d-4b83-9139-866c53a9b5a3-tmp\") pod \"kube-auth-proxy-5979cf877b-djrtg\" (UID: \"cc905b62-2b1d-4b83-9139-866c53a9b5a3\") " pod="openshift-ingress/kube-auth-proxy-5979cf877b-djrtg"
Jul 14 18:04:06.846259 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.846239    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cc23c90-470d-4a2d-8d4f-09ae7e6b6751-tls-certs\") pod \"model-serving-api-54d89bd5fc-dzfh2\" (UID: \"4cc23c90-470d-4a2d-8d4f-09ae7e6b6751\") " pod="opendatahub/model-serving-api-54d89bd5fc-dzfh2"
Jul 14 18:04:06.846375 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.846350    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc905b62-2b1d-4b83-9139-866c53a9b5a3-tls-certs\") pod \"kube-auth-proxy-5979cf877b-djrtg\" (UID: \"cc905b62-2b1d-4b83-9139-866c53a9b5a3\") " pod="openshift-ingress/kube-auth-proxy-5979cf877b-djrtg"
Jul 14 18:04:06.855461 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:06.855434    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkxq4\" (UniqueName: \"kubernetes.io/projected/cc905b62-2b1d-4b83-9139-866c53a9b5a3-kube-api-access-fkxq4\") pod \"kube-auth-proxy-5979cf877b-djrtg\" (UID: \"cc905b62-2b1d-4b83-9139-866c53a9b5a3\") " pod="openshift-ingress/kube-auth-proxy-5979cf877b-djrtg"
Jul 14 18:04:07.014691 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:07.014633    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5979cf877b-djrtg"
Jul 14 18:04:07.104670 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:07.104272    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-dzfh2"
Jul 14 18:04:07.203855 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:07.203618    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5979cf877b-djrtg"]
Jul 14 18:04:07.206616 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:04:07.206578    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc905b62_2b1d_4b83_9139_866c53a9b5a3.slice/crio-de9d42e1389a9733a440439b8cae9cfd4037f4a2e31c8441b12412bac6a10714 WatchSource:0}: Error finding container de9d42e1389a9733a440439b8cae9cfd4037f4a2e31c8441b12412bac6a10714: Status 404 returned error can't find the container with id de9d42e1389a9733a440439b8cae9cfd4037f4a2e31c8441b12412bac6a10714
Jul 14 18:04:07.318502 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:07.318462    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dzfh2"]
Jul 14 18:04:07.320167 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:04:07.320113    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cc23c90_470d_4a2d_8d4f_09ae7e6b6751.slice/crio-c16b4facc250c2f6831843f0b7184ca9e7b83ffb6dd2b78a4bfe6c8a018fad7d WatchSource:0}: Error finding container c16b4facc250c2f6831843f0b7184ca9e7b83ffb6dd2b78a4bfe6c8a018fad7d: Status 404 returned error can't find the container with id c16b4facc250c2f6831843f0b7184ca9e7b83ffb6dd2b78a4bfe6c8a018fad7d
Jul 14 18:04:07.573052 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:07.572948    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-dzfh2" event={"ID":"4cc23c90-470d-4a2d-8d4f-09ae7e6b6751","Type":"ContainerStarted","Data":"c16b4facc250c2f6831843f0b7184ca9e7b83ffb6dd2b78a4bfe6c8a018fad7d"}
Jul 14 18:04:07.574322 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:07.574286    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5979cf877b-djrtg" event={"ID":"cc905b62-2b1d-4b83-9139-866c53a9b5a3","Type":"ContainerStarted","Data":"de9d42e1389a9733a440439b8cae9cfd4037f4a2e31c8441b12412bac6a10714"}
Jul 14 18:04:11.598846 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:11.598808    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-dzfh2" event={"ID":"4cc23c90-470d-4a2d-8d4f-09ae7e6b6751","Type":"ContainerStarted","Data":"404fe89d8b21c6cc318efc93444324e64015543d492ccbfa7a2a19a0cae0aac2"}
Jul 14 18:04:11.599291 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:11.598910    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-dzfh2"
Jul 14 18:04:11.600500 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:11.600474    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2nbrx" event={"ID":"7af7b6d6-0424-42fa-a852-f747cbc071dd","Type":"ContainerStarted","Data":"5e5601292e7e82396a9f0be51807a5ea58b6aba1b6fea8040887687709d48c91"}
Jul 14 18:04:11.600985 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:11.600965    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-2nbrx"
Jul 14 18:04:11.602419 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:11.602393    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5979cf877b-djrtg" event={"ID":"cc905b62-2b1d-4b83-9139-866c53a9b5a3","Type":"ContainerStarted","Data":"651c24c49890c97e977929a828148987401a59a7597d761c778902888954697f"}
Jul 14 18:04:11.643689 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:11.643631    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-dzfh2" podStartSLOduration=2.050024739 podStartE2EDuration="5.643614648s" totalImagesPullingTime="3.593589909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:04:11.641194564 +0000 UTC m=+569.746304547" watchObservedRunningTime="2026-07-14 18:04:11.643614648 +0000 UTC m=+569.748724631"
Jul 14 18:04:11.727281 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:11.727225    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5979cf877b-djrtg" podStartSLOduration=2.011379274 podStartE2EDuration="5.727205997s" totalImagesPullingTime="3.715826723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:04:11.674527555 +0000 UTC m=+569.779637538" watchObservedRunningTime="2026-07-14 18:04:11.727205997 +0000 UTC m=+569.832315984"
Jul 14 18:04:11.728689 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:11.728655    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-2nbrx" podStartSLOduration=2.064278724 podStartE2EDuration="6.728639597s" totalImagesPullingTime="4.664360873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:04:11.724938222 +0000 UTC m=+569.830048207" watchObservedRunningTime="2026-07-14 18:04:11.728639597 +0000 UTC m=+569.833749580"
Jul 14 18:04:12.621659 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.621632    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"]
Jul 14 18:04:12.624051 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.624034    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.629852 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.629827    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-f7hzn\""
Jul 14 18:04:12.630138 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.630118    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 14 18:04:12.684969 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.684936    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"]
Jul 14 18:04:12.700247 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.700210    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d38a3503-f76c-460d-8bec-0a098f690f2f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.700407 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.700285    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d38a3503-f76c-460d-8bec-0a098f690f2f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.700407 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.700314    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d38a3503-f76c-460d-8bec-0a098f690f2f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.700510 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.700451    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d38a3503-f76c-460d-8bec-0a098f690f2f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.700615 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.700596    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d38a3503-f76c-460d-8bec-0a098f690f2f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.700659 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.700643    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d38a3503-f76c-460d-8bec-0a098f690f2f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.700707 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.700664    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d38a3503-f76c-460d-8bec-0a098f690f2f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.700757 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.700742    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d38a3503-f76c-460d-8bec-0a098f690f2f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.700802 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.700791    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wng67\" (UniqueName: \"kubernetes.io/projected/d38a3503-f76c-460d-8bec-0a098f690f2f-kube-api-access-wng67\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.801471 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.801435    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wng67\" (UniqueName: \"kubernetes.io/projected/d38a3503-f76c-460d-8bec-0a098f690f2f-kube-api-access-wng67\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.801693 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.801481    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d38a3503-f76c-460d-8bec-0a098f690f2f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.801693 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.801523    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d38a3503-f76c-460d-8bec-0a098f690f2f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.801693 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.801539    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d38a3503-f76c-460d-8bec-0a098f690f2f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.801693 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.801592    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d38a3503-f76c-460d-8bec-0a098f690f2f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.801693 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.801644    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d38a3503-f76c-460d-8bec-0a098f690f2f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.801693 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.801675    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d38a3503-f76c-460d-8bec-0a098f690f2f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.802009 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.801697    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d38a3503-f76c-460d-8bec-0a098f690f2f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.802009 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.801881    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d38a3503-f76c-460d-8bec-0a098f690f2f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.802009 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.801985    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d38a3503-f76c-460d-8bec-0a098f690f2f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.802170 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.802045    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d38a3503-f76c-460d-8bec-0a098f690f2f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.802170 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.802086    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d38a3503-f76c-460d-8bec-0a098f690f2f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.802265 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.802190    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d38a3503-f76c-460d-8bec-0a098f690f2f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.802374 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.802356    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d38a3503-f76c-460d-8bec-0a098f690f2f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.804205 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.804182    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d38a3503-f76c-460d-8bec-0a098f690f2f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.804477 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.804459    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d38a3503-f76c-460d-8bec-0a098f690f2f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.823137 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.823101    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d38a3503-f76c-460d-8bec-0a098f690f2f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.823428 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.823409    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wng67\" (UniqueName: \"kubernetes.io/projected/d38a3503-f76c-460d-8bec-0a098f690f2f-kube-api-access-wng67\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qm5zw\" (UID: \"d38a3503-f76c-460d-8bec-0a098f690f2f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:12.934835 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:12.934736    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:13.086276 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:13.086251    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"]
Jul 14 18:04:13.088278 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:04:13.088250    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd38a3503_f76c_460d_8bec_0a098f690f2f.slice/crio-c13695e8aab768314f55e372cfa22eaea1736cfbeaa986fbdda4aff676b79004 WatchSource:0}: Error finding container c13695e8aab768314f55e372cfa22eaea1736cfbeaa986fbdda4aff676b79004: Status 404 returned error can't find the container with id c13695e8aab768314f55e372cfa22eaea1736cfbeaa986fbdda4aff676b79004
Jul 14 18:04:13.611771 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:13.611727    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw" event={"ID":"d38a3503-f76c-460d-8bec-0a098f690f2f","Type":"ContainerStarted","Data":"c13695e8aab768314f55e372cfa22eaea1736cfbeaa986fbdda4aff676b79004"}
Jul 14 18:04:15.297514 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.297474    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"]
Jul 14 18:04:15.303820 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.303792    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:15.309443 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.309416    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 14 18:04:15.309759 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.309740    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 14 18:04:15.310423 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.310406    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fbktg\""
Jul 14 18:04:15.325774 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.325736    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/721caaf1-0bea-446f-bad6-d3b7855daab0-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-n744r\" (UID: \"721caaf1-0bea-446f-bad6-d3b7855daab0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:15.325774 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.325778    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/721caaf1-0bea-446f-bad6-d3b7855daab0-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-n744r\" (UID: \"721caaf1-0bea-446f-bad6-d3b7855daab0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:15.325984 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.325824    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/721caaf1-0bea-446f-bad6-d3b7855daab0-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-n744r\" (UID: \"721caaf1-0bea-446f-bad6-d3b7855daab0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:15.325984 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.325845    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/721caaf1-0bea-446f-bad6-d3b7855daab0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-n744r\" (UID: \"721caaf1-0bea-446f-bad6-d3b7855daab0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:15.325984 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.325963    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6sd8\" (UniqueName: \"kubernetes.io/projected/721caaf1-0bea-446f-bad6-d3b7855daab0-kube-api-access-f6sd8\") pod \"istiod-openshift-gateway-94bb8fbfd-n744r\" (UID: \"721caaf1-0bea-446f-bad6-d3b7855daab0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:15.326084 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.326017    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/721caaf1-0bea-446f-bad6-d3b7855daab0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-n744r\" (UID: \"721caaf1-0bea-446f-bad6-d3b7855daab0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:15.326084 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.326056    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/721caaf1-0bea-446f-bad6-d3b7855daab0-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-n744r\" (UID: \"721caaf1-0bea-446f-bad6-d3b7855daab0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:15.326740 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.326709    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 14 18:04:15.359694 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.359657    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"]
Jul 14 18:04:15.427332 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.427289    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/721caaf1-0bea-446f-bad6-d3b7855daab0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-n744r\" (UID: \"721caaf1-0bea-446f-bad6-d3b7855daab0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:15.427512 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.427343    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/721caaf1-0bea-446f-bad6-d3b7855daab0-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-n744r\" (UID: \"721caaf1-0bea-446f-bad6-d3b7855daab0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:15.427512 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.427394    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/721caaf1-0bea-446f-bad6-d3b7855daab0-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-n744r\" (UID: \"721caaf1-0bea-446f-bad6-d3b7855daab0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:15.427679 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.427588    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/721caaf1-0bea-446f-bad6-d3b7855daab0-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-n744r\" (UID: \"721caaf1-0bea-446f-bad6-d3b7855daab0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:15.427679 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.427644    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/721caaf1-0bea-446f-bad6-d3b7855daab0-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-n744r\" (UID: \"721caaf1-0bea-446f-bad6-d3b7855daab0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:15.427679 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.427668    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/721caaf1-0bea-446f-bad6-d3b7855daab0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-n744r\" (UID: \"721caaf1-0bea-446f-bad6-d3b7855daab0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:15.427840 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.427762    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6sd8\" (UniqueName: \"kubernetes.io/projected/721caaf1-0bea-446f-bad6-d3b7855daab0-kube-api-access-f6sd8\") pod \"istiod-openshift-gateway-94bb8fbfd-n744r\" (UID: \"721caaf1-0bea-446f-bad6-d3b7855daab0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:15.428314 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.428265    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/721caaf1-0bea-446f-bad6-d3b7855daab0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-n744r\" (UID: \"721caaf1-0bea-446f-bad6-d3b7855daab0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:15.430455 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.430429    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/721caaf1-0bea-446f-bad6-d3b7855daab0-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-n744r\" (UID: \"721caaf1-0bea-446f-bad6-d3b7855daab0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:15.430608 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.430485    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/721caaf1-0bea-446f-bad6-d3b7855daab0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-n744r\" (UID: \"721caaf1-0bea-446f-bad6-d3b7855daab0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:15.430608 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.430554    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/721caaf1-0bea-446f-bad6-d3b7855daab0-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-n744r\" (UID: \"721caaf1-0bea-446f-bad6-d3b7855daab0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:15.430881 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.430852    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/721caaf1-0bea-446f-bad6-d3b7855daab0-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-n744r\" (UID: \"721caaf1-0bea-446f-bad6-d3b7855daab0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:15.439671 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.439645    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/721caaf1-0bea-446f-bad6-d3b7855daab0-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-n744r\" (UID: \"721caaf1-0bea-446f-bad6-d3b7855daab0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:15.439824 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.439684    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6sd8\" (UniqueName: \"kubernetes.io/projected/721caaf1-0bea-446f-bad6-d3b7855daab0-kube-api-access-f6sd8\") pod \"istiod-openshift-gateway-94bb8fbfd-n744r\" (UID: \"721caaf1-0bea-446f-bad6-d3b7855daab0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:15.615098 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.615066    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:15.697013 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.696976    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:04:15.697093 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.697050    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:04:15.697093 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.697080    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:04:15.850331 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:15.850300    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"]
Jul 14 18:04:15.853773 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:04:15.853746    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod721caaf1_0bea_446f_bad6_d3b7855daab0.slice/crio-0c1fadd5d6864f24da49506ea71a58d65a98686a6f404d7aed55e951d50d0766 WatchSource:0}: Error finding container 0c1fadd5d6864f24da49506ea71a58d65a98686a6f404d7aed55e951d50d0766: Status 404 returned error can't find the container with id 0c1fadd5d6864f24da49506ea71a58d65a98686a6f404d7aed55e951d50d0766
Jul 14 18:04:16.630687 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:16.630638    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw" event={"ID":"d38a3503-f76c-460d-8bec-0a098f690f2f","Type":"ContainerStarted","Data":"763189827cc7c2c884887e47f1eaa59ee1de24b0415056c71e0632238b744c6b"}
Jul 14 18:04:16.631998 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:16.631976    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r" event={"ID":"721caaf1-0bea-446f-bad6-d3b7855daab0","Type":"ContainerStarted","Data":"0c1fadd5d6864f24da49506ea71a58d65a98686a6f404d7aed55e951d50d0766"}
Jul 14 18:04:16.721916 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:16.721865    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw" podStartSLOduration=2.115464453 podStartE2EDuration="4.72184701s" totalImagesPullingTime="2.606382557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:04:16.720791977 +0000 UTC m=+574.825901976" watchObservedRunningTime="2026-07-14 18:04:16.72184701 +0000 UTC m=+574.826956994"
Jul 14 18:04:16.936069 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:16.935976    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:16.942132 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:16.942103    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:17.638186 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:17.638155    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:17.639264 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:17.639242    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qm5zw"
Jul 14 18:04:17.910794 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:17.910710    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ljt47"]
Jul 14 18:04:17.917231 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:17.917205    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ljt47"
Jul 14 18:04:17.920786 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:17.920762    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 14 18:04:17.920786 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:17.920780    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-42xkc\""
Jul 14 18:04:17.940783 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:17.940755    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-nkvlx"]
Jul 14 18:04:17.944370 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:17.944340    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ljt47"]
Jul 14 18:04:17.944599 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:17.944474    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nkvlx"
Jul 14 18:04:17.948283 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:17.948257    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-dnbnx\""
Jul 14 18:04:17.948442 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:17.948388    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 14 18:04:17.951216 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:17.951193    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6357a700-67b5-4d69-baf1-d59a52d072f7-cert\") pod \"kserve-controller-manager-d6f4b65b8-ljt47\" (UID: \"6357a700-67b5-4d69-baf1-d59a52d072f7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ljt47"
Jul 14 18:04:17.951349 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:17.951271    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfdzg\" (UniqueName: \"kubernetes.io/projected/6357a700-67b5-4d69-baf1-d59a52d072f7-kube-api-access-qfdzg\") pod \"kserve-controller-manager-d6f4b65b8-ljt47\" (UID: \"6357a700-67b5-4d69-baf1-d59a52d072f7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ljt47"
Jul 14 18:04:17.951910 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:17.951885    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-nkvlx"]
Jul 14 18:04:18.052197 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:18.052165    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znmtp\" (UniqueName: \"kubernetes.io/projected/3d1ff281-472d-43df-af26-0acbbda45926-kube-api-access-znmtp\") pod \"llmisvc-controller-manager-777c6bd7d5-nkvlx\" (UID: \"3d1ff281-472d-43df-af26-0acbbda45926\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nkvlx"
Jul 14 18:04:18.052372 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:18.052252    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6357a700-67b5-4d69-baf1-d59a52d072f7-cert\") pod \"kserve-controller-manager-d6f4b65b8-ljt47\" (UID: \"6357a700-67b5-4d69-baf1-d59a52d072f7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ljt47"
Jul 14 18:04:18.052372 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:18.052303    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d1ff281-472d-43df-af26-0acbbda45926-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-nkvlx\" (UID: \"3d1ff281-472d-43df-af26-0acbbda45926\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nkvlx"
Jul 14 18:04:18.052372 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:18.052355    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfdzg\" (UniqueName: \"kubernetes.io/projected/6357a700-67b5-4d69-baf1-d59a52d072f7-kube-api-access-qfdzg\") pod \"kserve-controller-manager-d6f4b65b8-ljt47\" (UID: \"6357a700-67b5-4d69-baf1-d59a52d072f7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ljt47"
Jul 14 18:04:18.052533 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:04:18.052428    2558 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 14 18:04:18.052533 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:04:18.052514    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6357a700-67b5-4d69-baf1-d59a52d072f7-cert podName:6357a700-67b5-4d69-baf1-d59a52d072f7 nodeName:}" failed. No retries permitted until 2026-07-14 18:04:18.552482847 +0000 UTC m=+576.657592812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6357a700-67b5-4d69-baf1-d59a52d072f7-cert") pod "kserve-controller-manager-d6f4b65b8-ljt47" (UID: "6357a700-67b5-4d69-baf1-d59a52d072f7") : secret "kserve-webhook-server-cert" not found
Jul 14 18:04:18.065675 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:18.065647    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfdzg\" (UniqueName: \"kubernetes.io/projected/6357a700-67b5-4d69-baf1-d59a52d072f7-kube-api-access-qfdzg\") pod \"kserve-controller-manager-d6f4b65b8-ljt47\" (UID: \"6357a700-67b5-4d69-baf1-d59a52d072f7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ljt47"
Jul 14 18:04:18.152934 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:18.152892    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d1ff281-472d-43df-af26-0acbbda45926-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-nkvlx\" (UID: \"3d1ff281-472d-43df-af26-0acbbda45926\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nkvlx"
Jul 14 18:04:18.153119 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:18.152958    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znmtp\" (UniqueName: \"kubernetes.io/projected/3d1ff281-472d-43df-af26-0acbbda45926-kube-api-access-znmtp\") pod \"llmisvc-controller-manager-777c6bd7d5-nkvlx\" (UID: \"3d1ff281-472d-43df-af26-0acbbda45926\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nkvlx"
Jul 14 18:04:18.153119 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:04:18.153065    2558 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 14 18:04:18.153240 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:04:18.153134    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d1ff281-472d-43df-af26-0acbbda45926-cert podName:3d1ff281-472d-43df-af26-0acbbda45926 nodeName:}" failed. No retries permitted until 2026-07-14 18:04:18.653113621 +0000 UTC m=+576.758223583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3d1ff281-472d-43df-af26-0acbbda45926-cert") pod "llmisvc-controller-manager-777c6bd7d5-nkvlx" (UID: "3d1ff281-472d-43df-af26-0acbbda45926") : secret "llmisvc-webhook-server-cert" not found
Jul 14 18:04:18.166886 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:18.166803    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znmtp\" (UniqueName: \"kubernetes.io/projected/3d1ff281-472d-43df-af26-0acbbda45926-kube-api-access-znmtp\") pod \"llmisvc-controller-manager-777c6bd7d5-nkvlx\" (UID: \"3d1ff281-472d-43df-af26-0acbbda45926\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nkvlx"
Jul 14 18:04:18.267122 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:18.267081    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:04:18.267506 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:18.267162    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:04:18.557231 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:18.557145    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6357a700-67b5-4d69-baf1-d59a52d072f7-cert\") pod \"kserve-controller-manager-d6f4b65b8-ljt47\" (UID: \"6357a700-67b5-4d69-baf1-d59a52d072f7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ljt47"
Jul 14 18:04:18.559956 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:18.559932    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6357a700-67b5-4d69-baf1-d59a52d072f7-cert\") pod \"kserve-controller-manager-d6f4b65b8-ljt47\" (UID: \"6357a700-67b5-4d69-baf1-d59a52d072f7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ljt47"
Jul 14 18:04:18.644020 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:18.643981    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r" event={"ID":"721caaf1-0bea-446f-bad6-d3b7855daab0","Type":"ContainerStarted","Data":"30b916c983727a3f9586d3f51e8fbcbc90e4e165e87ae3589db92f6fc0c25663"}
Jul 14 18:04:18.644369 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:18.644118    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:18.657961 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:18.657927    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d1ff281-472d-43df-af26-0acbbda45926-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-nkvlx\" (UID: \"3d1ff281-472d-43df-af26-0acbbda45926\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nkvlx"
Jul 14 18:04:18.660502 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:18.660481    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d1ff281-472d-43df-af26-0acbbda45926-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-nkvlx\" (UID: \"3d1ff281-472d-43df-af26-0acbbda45926\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nkvlx"
Jul 14 18:04:18.829489 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:18.829397    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ljt47"
Jul 14 18:04:18.860725 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:18.860690    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nkvlx"
Jul 14 18:04:19.035118 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:19.035053    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r" podStartSLOduration=1.624769733 podStartE2EDuration="4.035028509s" totalImagesPullingTime="2.410258776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:04:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:04:18.703703812 +0000 UTC m=+576.808813809" watchObservedRunningTime="2026-07-14 18:04:19.035028509 +0000 UTC m=+577.140138495"
Jul 14 18:04:19.035841 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:19.035819    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ljt47"]
Jul 14 18:04:19.039084 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:04:19.039060    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6357a700_67b5_4d69_baf1_d59a52d072f7.slice/crio-d110d738234d9f2d21d3d5c10e23db925aa1d52a02468ea2c27c1dbff42a6dea WatchSource:0}: Error finding container d110d738234d9f2d21d3d5c10e23db925aa1d52a02468ea2c27c1dbff42a6dea: Status 404 returned error can't find the container with id d110d738234d9f2d21d3d5c10e23db925aa1d52a02468ea2c27c1dbff42a6dea
Jul 14 18:04:19.071471 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:19.071437    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-nkvlx"]
Jul 14 18:04:19.073932 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:04:19.073903    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3d1ff281_472d_43df_af26_0acbbda45926.slice/crio-9af4cc6462b367943dd4504474cc15b445b9111d23d47b42fb5329d9e6bcf677 WatchSource:0}: Error finding container 9af4cc6462b367943dd4504474cc15b445b9111d23d47b42fb5329d9e6bcf677: Status 404 returned error can't find the container with id 9af4cc6462b367943dd4504474cc15b445b9111d23d47b42fb5329d9e6bcf677
Jul 14 18:04:19.649726 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:19.649691    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nkvlx" event={"ID":"3d1ff281-472d-43df-af26-0acbbda45926","Type":"ContainerStarted","Data":"9af4cc6462b367943dd4504474cc15b445b9111d23d47b42fb5329d9e6bcf677"}
Jul 14 18:04:19.650998 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:19.650969    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ljt47" event={"ID":"6357a700-67b5-4d69-baf1-d59a52d072f7","Type":"ContainerStarted","Data":"d110d738234d9f2d21d3d5c10e23db925aa1d52a02468ea2c27c1dbff42a6dea"}
Jul 14 18:04:19.653115 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:19.653090    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n744r"
Jul 14 18:04:22.611570 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:22.611539    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-dzfh2"
Jul 14 18:04:22.670934 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:22.670896    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ljt47" event={"ID":"6357a700-67b5-4d69-baf1-d59a52d072f7","Type":"ContainerStarted","Data":"21a25ef41a634aad5e59bfd231447b2f3a9da6c3f9ea07e71e759e1f87ea16f3"}
Jul 14 18:04:22.671218 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:22.671195    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ljt47"
Jul 14 18:04:22.704980 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:22.704921    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ljt47" podStartSLOduration=2.576519286 podStartE2EDuration="5.704899554s" totalImagesPullingTime="3.128380268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:04:22.703746169 +0000 UTC m=+580.808856154" watchObservedRunningTime="2026-07-14 18:04:22.704899554 +0000 UTC m=+580.810009539"
Jul 14 18:04:23.614185 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:23.614152    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-2nbrx"
Jul 14 18:04:23.678189 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:23.678152    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nkvlx" event={"ID":"3d1ff281-472d-43df-af26-0acbbda45926","Type":"ContainerStarted","Data":"94e6757ba01544a3929296ee4be1b70085343724e447228b545fcbd454d47c59"}
Jul 14 18:04:23.700995 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:23.700933    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nkvlx" podStartSLOduration=2.453260903 podStartE2EDuration="6.700912492s" totalImagesPullingTime="4.247651589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:04:23.699708936 +0000 UTC m=+581.804818913" watchObservedRunningTime="2026-07-14 18:04:23.700912492 +0000 UTC m=+581.806022477"
Jul 14 18:04:24.683525 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:24.683491    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nkvlx"
Jul 14 18:04:42.321986 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:42.321953    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 18:04:42.322823 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:42.322801    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 18:04:53.684575 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:53.684520    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ljt47"
Jul 14 18:04:55.690550 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:04:55.690518    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nkvlx"
Jul 14 18:05:21.344644 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.344548    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw"]
Jul 14 18:05:21.347190 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.347171    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw"
Jul 14 18:05:21.351531 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.351512    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 14 18:05:21.351864 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.351848    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mh459\""
Jul 14 18:05:21.352329 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.352314    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 14 18:05:21.363090 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.363065    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw"]
Jul 14 18:05:21.429365 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.429330    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf2xp\" (UniqueName: \"kubernetes.io/projected/2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853-kube-api-access-wf2xp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw\" (UID: \"2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw"
Jul 14 18:05:21.429623 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.429403    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw\" (UID: \"2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw"
Jul 14 18:05:21.429623 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.429429    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw\" (UID: \"2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw"
Jul 14 18:05:21.530897 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.530851    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw\" (UID: \"2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw"
Jul 14 18:05:21.530897 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.530893    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw\" (UID: \"2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw"
Jul 14 18:05:21.531105 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.530951    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf2xp\" (UniqueName: \"kubernetes.io/projected/2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853-kube-api-access-wf2xp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw\" (UID: \"2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw"
Jul 14 18:05:21.531270 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.531250    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw\" (UID: \"2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw"
Jul 14 18:05:21.531337 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.531319    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw\" (UID: \"2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw"
Jul 14 18:05:21.542362 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.542333    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf2xp\" (UniqueName: \"kubernetes.io/projected/2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853-kube-api-access-wf2xp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw\" (UID: \"2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw"
Jul 14 18:05:21.656836 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.656744    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw"
Jul 14 18:05:21.733719 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.733688    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc"]
Jul 14 18:05:21.736790 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.736773    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc"
Jul 14 18:05:21.750443 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.750415    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc"]
Jul 14 18:05:21.811756 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.811727    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw"]
Jul 14 18:05:21.832656 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.832624    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/479e81cb-aee8-48bd-bb9b-4004e9f997f2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc\" (UID: \"479e81cb-aee8-48bd-bb9b-4004e9f997f2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc"
Jul 14 18:05:21.832791 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.832665    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/479e81cb-aee8-48bd-bb9b-4004e9f997f2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc\" (UID: \"479e81cb-aee8-48bd-bb9b-4004e9f997f2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc"
Jul 14 18:05:21.832872 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.832847    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj6nr\" (UniqueName: \"kubernetes.io/projected/479e81cb-aee8-48bd-bb9b-4004e9f997f2-kube-api-access-zj6nr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc\" (UID: \"479e81cb-aee8-48bd-bb9b-4004e9f997f2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc"
Jul 14 18:05:21.933993 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.933944    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj6nr\" (UniqueName: \"kubernetes.io/projected/479e81cb-aee8-48bd-bb9b-4004e9f997f2-kube-api-access-zj6nr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc\" (UID: \"479e81cb-aee8-48bd-bb9b-4004e9f997f2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc"
Jul 14 18:05:21.934198 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.934033    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/479e81cb-aee8-48bd-bb9b-4004e9f997f2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc\" (UID: \"479e81cb-aee8-48bd-bb9b-4004e9f997f2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc"
Jul 14 18:05:21.934198 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.934059    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/479e81cb-aee8-48bd-bb9b-4004e9f997f2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc\" (UID: \"479e81cb-aee8-48bd-bb9b-4004e9f997f2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc"
Jul 14 18:05:21.934420 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.934395    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/479e81cb-aee8-48bd-bb9b-4004e9f997f2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc\" (UID: \"479e81cb-aee8-48bd-bb9b-4004e9f997f2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc"
Jul 14 18:05:21.934486 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.934438    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/479e81cb-aee8-48bd-bb9b-4004e9f997f2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc\" (UID: \"479e81cb-aee8-48bd-bb9b-4004e9f997f2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc"
Jul 14 18:05:21.944411 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.944378    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj6nr\" (UniqueName: \"kubernetes.io/projected/479e81cb-aee8-48bd-bb9b-4004e9f997f2-kube-api-access-zj6nr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc\" (UID: \"479e81cb-aee8-48bd-bb9b-4004e9f997f2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc"
Jul 14 18:05:21.979066 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.979033    2558 generic.go:356] "Generic (PLEG): container finished" podID="2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853" containerID="e9e8f38926dde595b1e56bd7688249f21b2554fd924f4719d7dd09357033ddcd" exitCode=0
Jul 14 18:05:21.979242 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.979118    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw" event={"ID":"2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853","Type":"ContainerDied","Data":"e9e8f38926dde595b1e56bd7688249f21b2554fd924f4719d7dd09357033ddcd"}
Jul 14 18:05:21.979242 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.979166    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw" event={"ID":"2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853","Type":"ContainerStarted","Data":"6e140c7389440bda2e34a6015b480f42de6844681e6b1a57aeee0c0518224877"}
Jul 14 18:05:21.979675 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:21.979659    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 18:05:22.049061 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.049020    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc"
Jul 14 18:05:22.139872 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.139842    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p"]
Jul 14 18:05:22.142578 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.142545    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p"
Jul 14 18:05:22.159153 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.159123    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p"]
Jul 14 18:05:22.191481 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.191456    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc"]
Jul 14 18:05:22.193898 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:05:22.193874    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod479e81cb_aee8_48bd_bb9b_4004e9f997f2.slice/crio-a444cbd43cb1cb12924fbf893c05b7cd5e67e9796b22d6a77a114eedb79431cf WatchSource:0}: Error finding container a444cbd43cb1cb12924fbf893c05b7cd5e67e9796b22d6a77a114eedb79431cf: Status 404 returned error can't find the container with id a444cbd43cb1cb12924fbf893c05b7cd5e67e9796b22d6a77a114eedb79431cf
Jul 14 18:05:22.237187 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.237156    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d85610a-010d-4e8a-90a5-7d2a0964684d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p\" (UID: \"4d85610a-010d-4e8a-90a5-7d2a0964684d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p"
Jul 14 18:05:22.237317 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.237201    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb4gc\" (UniqueName: \"kubernetes.io/projected/4d85610a-010d-4e8a-90a5-7d2a0964684d-kube-api-access-xb4gc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p\" (UID: \"4d85610a-010d-4e8a-90a5-7d2a0964684d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p"
Jul 14 18:05:22.237317 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.237271    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d85610a-010d-4e8a-90a5-7d2a0964684d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p\" (UID: \"4d85610a-010d-4e8a-90a5-7d2a0964684d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p"
Jul 14 18:05:22.338414 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.338372    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d85610a-010d-4e8a-90a5-7d2a0964684d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p\" (UID: \"4d85610a-010d-4e8a-90a5-7d2a0964684d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p"
Jul 14 18:05:22.338614 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.338423    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb4gc\" (UniqueName: \"kubernetes.io/projected/4d85610a-010d-4e8a-90a5-7d2a0964684d-kube-api-access-xb4gc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p\" (UID: \"4d85610a-010d-4e8a-90a5-7d2a0964684d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p"
Jul 14 18:05:22.338614 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.338474    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d85610a-010d-4e8a-90a5-7d2a0964684d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p\" (UID: \"4d85610a-010d-4e8a-90a5-7d2a0964684d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p"
Jul 14 18:05:22.338784 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.338765    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d85610a-010d-4e8a-90a5-7d2a0964684d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p\" (UID: \"4d85610a-010d-4e8a-90a5-7d2a0964684d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p"
Jul 14 18:05:22.338834 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.338814    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d85610a-010d-4e8a-90a5-7d2a0964684d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p\" (UID: \"4d85610a-010d-4e8a-90a5-7d2a0964684d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p"
Jul 14 18:05:22.360072 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.360039    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb4gc\" (UniqueName: \"kubernetes.io/projected/4d85610a-010d-4e8a-90a5-7d2a0964684d-kube-api-access-xb4gc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p\" (UID: \"4d85610a-010d-4e8a-90a5-7d2a0964684d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p"
Jul 14 18:05:22.453018 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.452938    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p"
Jul 14 18:05:22.600661 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.600636    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p"]
Jul 14 18:05:22.602359 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:05:22.602332    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d85610a_010d_4e8a_90a5_7d2a0964684d.slice/crio-56668caa9f067d63d673e92280bb112b52fc80817bf9b75041d11f1ea02a4cb6 WatchSource:0}: Error finding container 56668caa9f067d63d673e92280bb112b52fc80817bf9b75041d11f1ea02a4cb6: Status 404 returned error can't find the container with id 56668caa9f067d63d673e92280bb112b52fc80817bf9b75041d11f1ea02a4cb6
Jul 14 18:05:22.726260 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.726230    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r"]
Jul 14 18:05:22.729044 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.729025    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r"
Jul 14 18:05:22.740590 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.740550    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r"]
Jul 14 18:05:22.843649 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.843614    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1301102b-1a97-44e3-b52a-feba7b9453e8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r\" (UID: \"1301102b-1a97-44e3-b52a-feba7b9453e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r"
Jul 14 18:05:22.843800 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.843782    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kw2z\" (UniqueName: \"kubernetes.io/projected/1301102b-1a97-44e3-b52a-feba7b9453e8-kube-api-access-4kw2z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r\" (UID: \"1301102b-1a97-44e3-b52a-feba7b9453e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r"
Jul 14 18:05:22.843883 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.843863    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1301102b-1a97-44e3-b52a-feba7b9453e8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r\" (UID: \"1301102b-1a97-44e3-b52a-feba7b9453e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r"
Jul 14 18:05:22.944340 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.944310    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1301102b-1a97-44e3-b52a-feba7b9453e8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r\" (UID: \"1301102b-1a97-44e3-b52a-feba7b9453e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r"
Jul 14 18:05:22.944457 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.944385    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kw2z\" (UniqueName: \"kubernetes.io/projected/1301102b-1a97-44e3-b52a-feba7b9453e8-kube-api-access-4kw2z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r\" (UID: \"1301102b-1a97-44e3-b52a-feba7b9453e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r"
Jul 14 18:05:22.944457 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.944422    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1301102b-1a97-44e3-b52a-feba7b9453e8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r\" (UID: \"1301102b-1a97-44e3-b52a-feba7b9453e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r"
Jul 14 18:05:22.944748 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.944728    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1301102b-1a97-44e3-b52a-feba7b9453e8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r\" (UID: \"1301102b-1a97-44e3-b52a-feba7b9453e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r"
Jul 14 18:05:22.944809 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.944783    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1301102b-1a97-44e3-b52a-feba7b9453e8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r\" (UID: \"1301102b-1a97-44e3-b52a-feba7b9453e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r"
Jul 14 18:05:22.953385 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.953367    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kw2z\" (UniqueName: \"kubernetes.io/projected/1301102b-1a97-44e3-b52a-feba7b9453e8-kube-api-access-4kw2z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r\" (UID: \"1301102b-1a97-44e3-b52a-feba7b9453e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r"
Jul 14 18:05:22.987192 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.987161    2558 generic.go:356] "Generic (PLEG): container finished" podID="479e81cb-aee8-48bd-bb9b-4004e9f997f2" containerID="933e355a9eeec83a1178bbee6dadb48bbac367ce8599618328a1ee3f98138d2f" exitCode=0
Jul 14 18:05:22.987321 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.987219    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc" event={"ID":"479e81cb-aee8-48bd-bb9b-4004e9f997f2","Type":"ContainerDied","Data":"933e355a9eeec83a1178bbee6dadb48bbac367ce8599618328a1ee3f98138d2f"}
Jul 14 18:05:22.987321 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.987265    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc" event={"ID":"479e81cb-aee8-48bd-bb9b-4004e9f997f2","Type":"ContainerStarted","Data":"a444cbd43cb1cb12924fbf893c05b7cd5e67e9796b22d6a77a114eedb79431cf"}
Jul 14 18:05:22.988812 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.988790    2558 generic.go:356] "Generic (PLEG): container finished" podID="4d85610a-010d-4e8a-90a5-7d2a0964684d" containerID="ce961883d1c38328ff07c823769fd18fd68af293ac087ba937f02c7d777d9bce" exitCode=0
Jul 14 18:05:22.988911 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.988870    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p" event={"ID":"4d85610a-010d-4e8a-90a5-7d2a0964684d","Type":"ContainerDied","Data":"ce961883d1c38328ff07c823769fd18fd68af293ac087ba937f02c7d777d9bce"}
Jul 14 18:05:22.988962 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:22.988912    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p" event={"ID":"4d85610a-010d-4e8a-90a5-7d2a0964684d","Type":"ContainerStarted","Data":"56668caa9f067d63d673e92280bb112b52fc80817bf9b75041d11f1ea02a4cb6"}
Jul 14 18:05:23.076413 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:23.076373    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r"
Jul 14 18:05:23.216885 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:23.216848    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r"]
Jul 14 18:05:23.217693 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:05:23.217670    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1301102b_1a97_44e3_b52a_feba7b9453e8.slice/crio-4767acc2aa8a093a155ea5823eda2c349c32dc1c0b13aef7be64d17ef96cee95 WatchSource:0}: Error finding container 4767acc2aa8a093a155ea5823eda2c349c32dc1c0b13aef7be64d17ef96cee95: Status 404 returned error can't find the container with id 4767acc2aa8a093a155ea5823eda2c349c32dc1c0b13aef7be64d17ef96cee95
Jul 14 18:05:24.002615 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:24.002555    2558 generic.go:356] "Generic (PLEG): container finished" podID="4d85610a-010d-4e8a-90a5-7d2a0964684d" containerID="7b63a1c9371fe5f651d56a89b212ce8cb46fcb75e92dd4a6431b66c67b9feb02" exitCode=0
Jul 14 18:05:24.003109 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:24.002620    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p" event={"ID":"4d85610a-010d-4e8a-90a5-7d2a0964684d","Type":"ContainerDied","Data":"7b63a1c9371fe5f651d56a89b212ce8cb46fcb75e92dd4a6431b66c67b9feb02"}
Jul 14 18:05:24.004391 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:24.004275    2558 generic.go:356] "Generic (PLEG): container finished" podID="1301102b-1a97-44e3-b52a-feba7b9453e8" containerID="7dba263227322f12a146e7a672c1035ce876985ab9909e47429a957dafd38dc8" exitCode=0
Jul 14 18:05:24.004391 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:24.004361    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r" event={"ID":"1301102b-1a97-44e3-b52a-feba7b9453e8","Type":"ContainerDied","Data":"7dba263227322f12a146e7a672c1035ce876985ab9909e47429a957dafd38dc8"}
Jul 14 18:05:24.004508 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:24.004403    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r" event={"ID":"1301102b-1a97-44e3-b52a-feba7b9453e8","Type":"ContainerStarted","Data":"4767acc2aa8a093a155ea5823eda2c349c32dc1c0b13aef7be64d17ef96cee95"}
Jul 14 18:05:24.006336 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:24.006315    2558 generic.go:356] "Generic (PLEG): container finished" podID="2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853" containerID="1a75db09c7bee5eb96eb1358ddf12214debdf8fcd1d21da6f59d8e495448cd08" exitCode=0
Jul 14 18:05:24.006428 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:24.006404    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw" event={"ID":"2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853","Type":"ContainerDied","Data":"1a75db09c7bee5eb96eb1358ddf12214debdf8fcd1d21da6f59d8e495448cd08"}
Jul 14 18:05:24.008675 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:24.008650    2558 generic.go:356] "Generic (PLEG): container finished" podID="479e81cb-aee8-48bd-bb9b-4004e9f997f2" containerID="c4408b1cd1af8c0abe429b0cdb2dad32085f2e00612a817bde2fefc241335fec" exitCode=0
Jul 14 18:05:24.008766 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:24.008713    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc" event={"ID":"479e81cb-aee8-48bd-bb9b-4004e9f997f2","Type":"ContainerDied","Data":"c4408b1cd1af8c0abe429b0cdb2dad32085f2e00612a817bde2fefc241335fec"}
Jul 14 18:05:25.016275 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:25.016243    2558 generic.go:356] "Generic (PLEG): container finished" podID="479e81cb-aee8-48bd-bb9b-4004e9f997f2" containerID="ee6293d562383e25f0fd9f76ac43d28f13cafc024a8813fb043395c8152f008a" exitCode=0
Jul 14 18:05:25.016745 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:25.016331    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc" event={"ID":"479e81cb-aee8-48bd-bb9b-4004e9f997f2","Type":"ContainerDied","Data":"ee6293d562383e25f0fd9f76ac43d28f13cafc024a8813fb043395c8152f008a"}
Jul 14 18:05:25.018596 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:25.018548    2558 generic.go:356] "Generic (PLEG): container finished" podID="4d85610a-010d-4e8a-90a5-7d2a0964684d" containerID="cb29461f228b624a377a00bd554ff2c09a9eddbdc16993541118a3a6513bf116" exitCode=0
Jul 14 18:05:25.018596 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:25.018586    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p" event={"ID":"4d85610a-010d-4e8a-90a5-7d2a0964684d","Type":"ContainerDied","Data":"cb29461f228b624a377a00bd554ff2c09a9eddbdc16993541118a3a6513bf116"}
Jul 14 18:05:25.020369 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:25.020343    2558 generic.go:356] "Generic (PLEG): container finished" podID="1301102b-1a97-44e3-b52a-feba7b9453e8" containerID="046e0147cb1ea97e1091a671a0a9841c79a71dbbbe932a8376f81630f91ac731" exitCode=0
Jul 14 18:05:25.020493 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:25.020423    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r" event={"ID":"1301102b-1a97-44e3-b52a-feba7b9453e8","Type":"ContainerDied","Data":"046e0147cb1ea97e1091a671a0a9841c79a71dbbbe932a8376f81630f91ac731"}
Jul 14 18:05:25.023153 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:25.023131    2558 generic.go:356] "Generic (PLEG): container finished" podID="2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853" containerID="7bca9f4d37967a29ae3f90f1d372e99881ae69e1704a6938acb16d1888f87bc4" exitCode=0
Jul 14 18:05:25.023247 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:25.023171    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw" event={"ID":"2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853","Type":"ContainerDied","Data":"7bca9f4d37967a29ae3f90f1d372e99881ae69e1704a6938acb16d1888f87bc4"}
Jul 14 18:05:26.030267 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.030232    2558 generic.go:356] "Generic (PLEG): container finished" podID="1301102b-1a97-44e3-b52a-feba7b9453e8" containerID="2865fb5e834fc01d827e093f5b20766e2dfd862d0cf0f9afaa589c4335ad4a65" exitCode=0
Jul 14 18:05:26.030669 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.030307    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r" event={"ID":"1301102b-1a97-44e3-b52a-feba7b9453e8","Type":"ContainerDied","Data":"2865fb5e834fc01d827e093f5b20766e2dfd862d0cf0f9afaa589c4335ad4a65"}
Jul 14 18:05:26.196599 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.196574    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p"
Jul 14 18:05:26.229512 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.229486    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc"
Jul 14 18:05:26.232750 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.232731    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw"
Jul 14 18:05:26.377472 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.377432    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xb4gc\" (UniqueName: \"kubernetes.io/projected/4d85610a-010d-4e8a-90a5-7d2a0964684d-kube-api-access-xb4gc\") pod \"4d85610a-010d-4e8a-90a5-7d2a0964684d\" (UID: \"4d85610a-010d-4e8a-90a5-7d2a0964684d\") "
Jul 14 18:05:26.377472 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.377476    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zj6nr\" (UniqueName: \"kubernetes.io/projected/479e81cb-aee8-48bd-bb9b-4004e9f997f2-kube-api-access-zj6nr\") pod \"479e81cb-aee8-48bd-bb9b-4004e9f997f2\" (UID: \"479e81cb-aee8-48bd-bb9b-4004e9f997f2\") "
Jul 14 18:05:26.377737 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.377512    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853-util\") pod \"2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853\" (UID: \"2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853\") "
Jul 14 18:05:26.377737 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.377526    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d85610a-010d-4e8a-90a5-7d2a0964684d-util\") pod \"4d85610a-010d-4e8a-90a5-7d2a0964684d\" (UID: \"4d85610a-010d-4e8a-90a5-7d2a0964684d\") "
Jul 14 18:05:26.377737 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.377581    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/479e81cb-aee8-48bd-bb9b-4004e9f997f2-bundle\") pod \"479e81cb-aee8-48bd-bb9b-4004e9f997f2\" (UID: \"479e81cb-aee8-48bd-bb9b-4004e9f997f2\") "
Jul 14 18:05:26.377737 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.377623    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853-bundle\") pod \"2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853\" (UID: \"2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853\") "
Jul 14 18:05:26.377737 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.377658    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wf2xp\" (UniqueName: \"kubernetes.io/projected/2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853-kube-api-access-wf2xp\") pod \"2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853\" (UID: \"2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853\") "
Jul 14 18:05:26.377737 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.377721    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d85610a-010d-4e8a-90a5-7d2a0964684d-bundle\") pod \"4d85610a-010d-4e8a-90a5-7d2a0964684d\" (UID: \"4d85610a-010d-4e8a-90a5-7d2a0964684d\") "
Jul 14 18:05:26.378054 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.377792    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/479e81cb-aee8-48bd-bb9b-4004e9f997f2-util\") pod \"479e81cb-aee8-48bd-bb9b-4004e9f997f2\" (UID: \"479e81cb-aee8-48bd-bb9b-4004e9f997f2\") "
Jul 14 18:05:26.378486 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.378453    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/479e81cb-aee8-48bd-bb9b-4004e9f997f2-bundle" (OuterVolumeSpecName: "bundle") pod "479e81cb-aee8-48bd-bb9b-4004e9f997f2" (UID: "479e81cb-aee8-48bd-bb9b-4004e9f997f2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:05:26.378681 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.378611    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853-bundle" (OuterVolumeSpecName: "bundle") pod "2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853" (UID: "2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:05:26.379115 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.379087    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d85610a-010d-4e8a-90a5-7d2a0964684d-bundle" (OuterVolumeSpecName: "bundle") pod "4d85610a-010d-4e8a-90a5-7d2a0964684d" (UID: "4d85610a-010d-4e8a-90a5-7d2a0964684d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:05:26.380157 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.380129    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/479e81cb-aee8-48bd-bb9b-4004e9f997f2-kube-api-access-zj6nr" (OuterVolumeSpecName: "kube-api-access-zj6nr") pod "479e81cb-aee8-48bd-bb9b-4004e9f997f2" (UID: "479e81cb-aee8-48bd-bb9b-4004e9f997f2"). InnerVolumeSpecName "kube-api-access-zj6nr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:05:26.380294 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.380268    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d85610a-010d-4e8a-90a5-7d2a0964684d-kube-api-access-xb4gc" (OuterVolumeSpecName: "kube-api-access-xb4gc") pod "4d85610a-010d-4e8a-90a5-7d2a0964684d" (UID: "4d85610a-010d-4e8a-90a5-7d2a0964684d"). InnerVolumeSpecName "kube-api-access-xb4gc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:05:26.380821 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.380798    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853-kube-api-access-wf2xp" (OuterVolumeSpecName: "kube-api-access-wf2xp") pod "2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853" (UID: "2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853"). InnerVolumeSpecName "kube-api-access-wf2xp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:05:26.384004 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.383968    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d85610a-010d-4e8a-90a5-7d2a0964684d-util" (OuterVolumeSpecName: "util") pod "4d85610a-010d-4e8a-90a5-7d2a0964684d" (UID: "4d85610a-010d-4e8a-90a5-7d2a0964684d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:05:26.384612 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.384591    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/479e81cb-aee8-48bd-bb9b-4004e9f997f2-util" (OuterVolumeSpecName: "util") pod "479e81cb-aee8-48bd-bb9b-4004e9f997f2" (UID: "479e81cb-aee8-48bd-bb9b-4004e9f997f2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:05:26.385136 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.385113    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853-util" (OuterVolumeSpecName: "util") pod "2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853" (UID: "2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:05:26.478986 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.478949    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/479e81cb-aee8-48bd-bb9b-4004e9f997f2-util\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:05:26.479200 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.479014    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xb4gc\" (UniqueName: \"kubernetes.io/projected/4d85610a-010d-4e8a-90a5-7d2a0964684d-kube-api-access-xb4gc\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:05:26.479200 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.479030    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zj6nr\" (UniqueName: \"kubernetes.io/projected/479e81cb-aee8-48bd-bb9b-4004e9f997f2-kube-api-access-zj6nr\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:05:26.479200 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.479043    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853-util\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:05:26.479200 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.479054    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d85610a-010d-4e8a-90a5-7d2a0964684d-util\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:05:26.479200 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.479065    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/479e81cb-aee8-48bd-bb9b-4004e9f997f2-bundle\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:05:26.479200 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.479075    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853-bundle\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:05:26.479200 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.479086    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wf2xp\" (UniqueName: \"kubernetes.io/projected/2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853-kube-api-access-wf2xp\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:05:26.479200 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:26.479097    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d85610a-010d-4e8a-90a5-7d2a0964684d-bundle\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:05:27.037369 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:27.037339    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw"
Jul 14 18:05:27.037828 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:27.037368    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw" event={"ID":"2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853","Type":"ContainerDied","Data":"6e140c7389440bda2e34a6015b480f42de6844681e6b1a57aeee0c0518224877"}
Jul 14 18:05:27.037828 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:27.037450    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e140c7389440bda2e34a6015b480f42de6844681e6b1a57aeee0c0518224877"
Jul 14 18:05:27.039502 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:27.039482    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc"
Jul 14 18:05:27.039655 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:27.039499    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc" event={"ID":"479e81cb-aee8-48bd-bb9b-4004e9f997f2","Type":"ContainerDied","Data":"a444cbd43cb1cb12924fbf893c05b7cd5e67e9796b22d6a77a114eedb79431cf"}
Jul 14 18:05:27.039655 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:27.039589    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a444cbd43cb1cb12924fbf893c05b7cd5e67e9796b22d6a77a114eedb79431cf"
Jul 14 18:05:27.041673 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:27.041656    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p"
Jul 14 18:05:27.041833 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:27.041648    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p" event={"ID":"4d85610a-010d-4e8a-90a5-7d2a0964684d","Type":"ContainerDied","Data":"56668caa9f067d63d673e92280bb112b52fc80817bf9b75041d11f1ea02a4cb6"}
Jul 14 18:05:27.041943 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:27.041839    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56668caa9f067d63d673e92280bb112b52fc80817bf9b75041d11f1ea02a4cb6"
Jul 14 18:05:27.164710 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:27.164680    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r"
Jul 14 18:05:27.286735 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:27.286706    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kw2z\" (UniqueName: \"kubernetes.io/projected/1301102b-1a97-44e3-b52a-feba7b9453e8-kube-api-access-4kw2z\") pod \"1301102b-1a97-44e3-b52a-feba7b9453e8\" (UID: \"1301102b-1a97-44e3-b52a-feba7b9453e8\") "
Jul 14 18:05:27.286932 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:27.286762    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1301102b-1a97-44e3-b52a-feba7b9453e8-util\") pod \"1301102b-1a97-44e3-b52a-feba7b9453e8\" (UID: \"1301102b-1a97-44e3-b52a-feba7b9453e8\") "
Jul 14 18:05:27.286932 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:27.286842    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1301102b-1a97-44e3-b52a-feba7b9453e8-bundle\") pod \"1301102b-1a97-44e3-b52a-feba7b9453e8\" (UID: \"1301102b-1a97-44e3-b52a-feba7b9453e8\") "
Jul 14 18:05:27.287318 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:27.287288    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1301102b-1a97-44e3-b52a-feba7b9453e8-bundle" (OuterVolumeSpecName: "bundle") pod "1301102b-1a97-44e3-b52a-feba7b9453e8" (UID: "1301102b-1a97-44e3-b52a-feba7b9453e8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:05:27.289084 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:27.289027    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1301102b-1a97-44e3-b52a-feba7b9453e8-kube-api-access-4kw2z" (OuterVolumeSpecName: "kube-api-access-4kw2z") pod "1301102b-1a97-44e3-b52a-feba7b9453e8" (UID: "1301102b-1a97-44e3-b52a-feba7b9453e8"). InnerVolumeSpecName "kube-api-access-4kw2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:05:27.292201 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:27.292170    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1301102b-1a97-44e3-b52a-feba7b9453e8-util" (OuterVolumeSpecName: "util") pod "1301102b-1a97-44e3-b52a-feba7b9453e8" (UID: "1301102b-1a97-44e3-b52a-feba7b9453e8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:05:27.388328 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:27.388293    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1301102b-1a97-44e3-b52a-feba7b9453e8-bundle\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:05:27.388328 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:27.388324    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kw2z\" (UniqueName: \"kubernetes.io/projected/1301102b-1a97-44e3-b52a-feba7b9453e8-kube-api-access-4kw2z\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:05:27.388328 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:27.388334    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1301102b-1a97-44e3-b52a-feba7b9453e8-util\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:05:28.049089 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:28.049051    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r"
Jul 14 18:05:28.049089 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:28.049075    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r" event={"ID":"1301102b-1a97-44e3-b52a-feba7b9453e8","Type":"ContainerDied","Data":"4767acc2aa8a093a155ea5823eda2c349c32dc1c0b13aef7be64d17ef96cee95"}
Jul 14 18:05:28.049510 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:28.049126    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4767acc2aa8a093a155ea5823eda2c349c32dc1c0b13aef7be64d17ef96cee95"
Jul 14 18:05:44.856720 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.856683    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5"]
Jul 14 18:05:44.857124 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857030    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d85610a-010d-4e8a-90a5-7d2a0964684d" containerName="util"
Jul 14 18:05:44.857124 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857040    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d85610a-010d-4e8a-90a5-7d2a0964684d" containerName="util"
Jul 14 18:05:44.857124 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857053    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1301102b-1a97-44e3-b52a-feba7b9453e8" containerName="util"
Jul 14 18:05:44.857124 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857058    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1301102b-1a97-44e3-b52a-feba7b9453e8" containerName="util"
Jul 14 18:05:44.857124 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857065    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853" containerName="extract"
Jul 14 18:05:44.857124 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857071    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853" containerName="extract"
Jul 14 18:05:44.857124 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857077    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1301102b-1a97-44e3-b52a-feba7b9453e8" containerName="extract"
Jul 14 18:05:44.857124 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857081    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1301102b-1a97-44e3-b52a-feba7b9453e8" containerName="extract"
Jul 14 18:05:44.857124 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857090    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="479e81cb-aee8-48bd-bb9b-4004e9f997f2" containerName="util"
Jul 14 18:05:44.857124 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857095    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="479e81cb-aee8-48bd-bb9b-4004e9f997f2" containerName="util"
Jul 14 18:05:44.857124 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857102    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853" containerName="util"
Jul 14 18:05:44.857124 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857108    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853" containerName="util"
Jul 14 18:05:44.857124 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857116    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853" containerName="pull"
Jul 14 18:05:44.857124 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857120    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853" containerName="pull"
Jul 14 18:05:44.857124 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857126    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="479e81cb-aee8-48bd-bb9b-4004e9f997f2" containerName="pull"
Jul 14 18:05:44.857124 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857131    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="479e81cb-aee8-48bd-bb9b-4004e9f997f2" containerName="pull"
Jul 14 18:05:44.857699 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857144    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d85610a-010d-4e8a-90a5-7d2a0964684d" containerName="pull"
Jul 14 18:05:44.857699 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857150    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d85610a-010d-4e8a-90a5-7d2a0964684d" containerName="pull"
Jul 14 18:05:44.857699 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857154    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d85610a-010d-4e8a-90a5-7d2a0964684d" containerName="extract"
Jul 14 18:05:44.857699 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857159    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d85610a-010d-4e8a-90a5-7d2a0964684d" containerName="extract"
Jul 14 18:05:44.857699 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857164    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="479e81cb-aee8-48bd-bb9b-4004e9f997f2" containerName="extract"
Jul 14 18:05:44.857699 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857169    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="479e81cb-aee8-48bd-bb9b-4004e9f997f2" containerName="extract"
Jul 14 18:05:44.857699 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857175    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1301102b-1a97-44e3-b52a-feba7b9453e8" containerName="pull"
Jul 14 18:05:44.857699 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857180    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1301102b-1a97-44e3-b52a-feba7b9453e8" containerName="pull"
Jul 14 18:05:44.857699 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857234    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1301102b-1a97-44e3-b52a-feba7b9453e8" containerName="extract"
Jul 14 18:05:44.857699 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857243    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="479e81cb-aee8-48bd-bb9b-4004e9f997f2" containerName="extract"
Jul 14 18:05:44.857699 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857250    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853" containerName="extract"
Jul 14 18:05:44.857699 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.857256    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d85610a-010d-4e8a-90a5-7d2a0964684d" containerName="extract"
Jul 14 18:05:44.860268 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.860249    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5"
Jul 14 18:05:44.865151 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.865127    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 14 18:05:44.865299 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.865127    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-hlbj4\""
Jul 14 18:05:44.866093 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.866072    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 14 18:05:44.873859 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.873834    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5"]
Jul 14 18:05:44.934156 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:44.934116    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfrwf\" (UniqueName: \"kubernetes.io/projected/f7abda9e-6fd9-44ba-b2c9-347bbf26632f-kube-api-access-nfrwf\") pod \"limitador-operator-controller-manager-859d7b78bd-sfrb5\" (UID: \"f7abda9e-6fd9-44ba-b2c9-347bbf26632f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5"
Jul 14 18:05:45.034505 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:45.034468    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfrwf\" (UniqueName: \"kubernetes.io/projected/f7abda9e-6fd9-44ba-b2c9-347bbf26632f-kube-api-access-nfrwf\") pod \"limitador-operator-controller-manager-859d7b78bd-sfrb5\" (UID: \"f7abda9e-6fd9-44ba-b2c9-347bbf26632f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5"
Jul 14 18:05:45.053292 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:45.053267    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfrwf\" (UniqueName: \"kubernetes.io/projected/f7abda9e-6fd9-44ba-b2c9-347bbf26632f-kube-api-access-nfrwf\") pod \"limitador-operator-controller-manager-859d7b78bd-sfrb5\" (UID: \"f7abda9e-6fd9-44ba-b2c9-347bbf26632f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5"
Jul 14 18:05:45.171284 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:45.171188    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5"
Jul 14 18:05:45.338134 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:45.338100    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5"]
Jul 14 18:05:45.339340 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:05:45.339314    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7abda9e_6fd9_44ba_b2c9_347bbf26632f.slice/crio-b30a8d9e5740077a60cbdc9e447f73113365e654fb54be3781f7bd12bb0bafca WatchSource:0}: Error finding container b30a8d9e5740077a60cbdc9e447f73113365e654fb54be3781f7bd12bb0bafca: Status 404 returned error can't find the container with id b30a8d9e5740077a60cbdc9e447f73113365e654fb54be3781f7bd12bb0bafca
Jul 14 18:05:46.142552 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:46.142513    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5" event={"ID":"f7abda9e-6fd9-44ba-b2c9-347bbf26632f","Type":"ContainerStarted","Data":"b30a8d9e5740077a60cbdc9e447f73113365e654fb54be3781f7bd12bb0bafca"}
Jul 14 18:05:49.160307 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:49.160268    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5" event={"ID":"f7abda9e-6fd9-44ba-b2c9-347bbf26632f","Type":"ContainerStarted","Data":"25cfd18f597463c19b2441920922cc129d1d5731b3f066870346e22c8c55b52c"}
Jul 14 18:05:49.160705 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:49.160376    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5"
Jul 14 18:05:49.188232 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:05:49.188184    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5" podStartSLOduration=1.556983349 podStartE2EDuration="5.188169743s" totalImagesPullingTime="3.631186394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:05:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:05:49.185933727 +0000 UTC m=+667.291043721" watchObservedRunningTime="2026-07-14 18:05:49.188169743 +0000 UTC m=+667.293279726"
Jul 14 18:06:00.168723 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:00.168692    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5"
Jul 14 18:06:04.695542 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:04.695507    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5"]
Jul 14 18:06:04.695989 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:04.695746    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5" podUID="f7abda9e-6fd9-44ba-b2c9-347bbf26632f" containerName="manager" containerID="cri-o://25cfd18f597463c19b2441920922cc129d1d5731b3f066870346e22c8c55b52c" gracePeriod=2
Jul 14 18:06:04.725039 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:04.725009    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5"]
Jul 14 18:06:04.746106 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:06:04.746065    2558 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f7abda9e-6fd9-44ba-b2c9-347bbf26632f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-sfrb5\": pods \"limitador-operator-controller-manager-859d7b78bd-sfrb5\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5"
Jul 14 18:06:04.774290 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:04.774260    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdwvp"]
Jul 14 18:06:04.774654 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:04.774640    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7abda9e-6fd9-44ba-b2c9-347bbf26632f" containerName="manager"
Jul 14 18:06:04.774654 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:04.774655    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7abda9e-6fd9-44ba-b2c9-347bbf26632f" containerName="manager"
Jul 14 18:06:04.774741 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:04.774714    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7abda9e-6fd9-44ba-b2c9-347bbf26632f" containerName="manager"
Jul 14 18:06:04.777777 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:04.777755    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdwvp"
Jul 14 18:06:04.779239 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:04.779216    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdwvp"]
Jul 14 18:06:04.823117 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:06:04.823074    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sfrb5\" is forbidden: User \"system:node:ip-10-0-139-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-216.ec2.internal' and this object" podUID="f7abda9e-6fd9-44ba-b2c9-347bbf26632f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5"
Jul 14 18:06:04.914199 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:04.914167    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtjl9\" (UniqueName: \"kubernetes.io/projected/69131f88-2d06-4ed8-9a40-867164bd9a57-kube-api-access-xtjl9\") pod \"limitador-operator-controller-manager-859d7b78bd-gdwvp\" (UID: \"69131f88-2d06-4ed8-9a40-867164bd9a57\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdwvp"
Jul 14 18:06:04.948181 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:04.948118    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5"
Jul 14 18:06:04.955583 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:06:04.955531    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sfrb5\" is forbidden: User \"system:node:ip-10-0-139-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-216.ec2.internal' and this object" podUID="f7abda9e-6fd9-44ba-b2c9-347bbf26632f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5"
Jul 14 18:06:05.015063 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:05.015024    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfrwf\" (UniqueName: \"kubernetes.io/projected/f7abda9e-6fd9-44ba-b2c9-347bbf26632f-kube-api-access-nfrwf\") pod \"f7abda9e-6fd9-44ba-b2c9-347bbf26632f\" (UID: \"f7abda9e-6fd9-44ba-b2c9-347bbf26632f\") "
Jul 14 18:06:05.015257 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:05.015208    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtjl9\" (UniqueName: \"kubernetes.io/projected/69131f88-2d06-4ed8-9a40-867164bd9a57-kube-api-access-xtjl9\") pod \"limitador-operator-controller-manager-859d7b78bd-gdwvp\" (UID: \"69131f88-2d06-4ed8-9a40-867164bd9a57\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdwvp"
Jul 14 18:06:05.017301 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:05.017280    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7abda9e-6fd9-44ba-b2c9-347bbf26632f-kube-api-access-nfrwf" (OuterVolumeSpecName: "kube-api-access-nfrwf") pod "f7abda9e-6fd9-44ba-b2c9-347bbf26632f" (UID: "f7abda9e-6fd9-44ba-b2c9-347bbf26632f"). InnerVolumeSpecName "kube-api-access-nfrwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:06:05.032354 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:05.032333    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtjl9\" (UniqueName: \"kubernetes.io/projected/69131f88-2d06-4ed8-9a40-867164bd9a57-kube-api-access-xtjl9\") pod \"limitador-operator-controller-manager-859d7b78bd-gdwvp\" (UID: \"69131f88-2d06-4ed8-9a40-867164bd9a57\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdwvp"
Jul 14 18:06:05.088539 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:05.088514    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdwvp"
Jul 14 18:06:05.115720 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:05.115693    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfrwf\" (UniqueName: \"kubernetes.io/projected/f7abda9e-6fd9-44ba-b2c9-347bbf26632f-kube-api-access-nfrwf\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:06:05.234627 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:05.234601    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdwvp"]
Jul 14 18:06:05.236608 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:06:05.236582    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69131f88_2d06_4ed8_9a40_867164bd9a57.slice/crio-48637540599dd0f5bd7d5d33c7cd57f11b522f717c17b235c04fbb2b9035f328 WatchSource:0}: Error finding container 48637540599dd0f5bd7d5d33c7cd57f11b522f717c17b235c04fbb2b9035f328: Status 404 returned error can't find the container with id 48637540599dd0f5bd7d5d33c7cd57f11b522f717c17b235c04fbb2b9035f328
Jul 14 18:06:05.242326 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:05.242301    2558 generic.go:356] "Generic (PLEG): container finished" podID="f7abda9e-6fd9-44ba-b2c9-347bbf26632f" containerID="25cfd18f597463c19b2441920922cc129d1d5731b3f066870346e22c8c55b52c" exitCode=0
Jul 14 18:06:05.242428 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:05.242336    2558 scope.go:117] "RemoveContainer" containerID="25cfd18f597463c19b2441920922cc129d1d5731b3f066870346e22c8c55b52c"
Jul 14 18:06:05.242428 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:05.242307    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5"
Jul 14 18:06:05.246907 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:06:05.246875    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sfrb5\" is forbidden: User \"system:node:ip-10-0-139-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-216.ec2.internal' and this object" podUID="f7abda9e-6fd9-44ba-b2c9-347bbf26632f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5"
Jul 14 18:06:05.254337 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:05.254317    2558 scope.go:117] "RemoveContainer" containerID="25cfd18f597463c19b2441920922cc129d1d5731b3f066870346e22c8c55b52c"
Jul 14 18:06:05.254446 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:06:05.254421    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sfrb5\" is forbidden: User \"system:node:ip-10-0-139-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-216.ec2.internal' and this object" podUID="f7abda9e-6fd9-44ba-b2c9-347bbf26632f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5"
Jul 14 18:06:05.254687 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:06:05.254665    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25cfd18f597463c19b2441920922cc129d1d5731b3f066870346e22c8c55b52c\": container with ID starting with 25cfd18f597463c19b2441920922cc129d1d5731b3f066870346e22c8c55b52c not found: ID does not exist" containerID="25cfd18f597463c19b2441920922cc129d1d5731b3f066870346e22c8c55b52c"
Jul 14 18:06:05.254764 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:05.254700    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25cfd18f597463c19b2441920922cc129d1d5731b3f066870346e22c8c55b52c"} err="failed to get container status \"25cfd18f597463c19b2441920922cc129d1d5731b3f066870346e22c8c55b52c\": rpc error: code = NotFound desc = could not find container \"25cfd18f597463c19b2441920922cc129d1d5731b3f066870346e22c8c55b52c\": container with ID starting with 25cfd18f597463c19b2441920922cc129d1d5731b3f066870346e22c8c55b52c not found: ID does not exist"
Jul 14 18:06:06.250668 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:06.250632    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdwvp" event={"ID":"69131f88-2d06-4ed8-9a40-867164bd9a57","Type":"ContainerStarted","Data":"494a252f524cfa0be964ed26b55d638dc00c34654cbfed830714480ed245db32"}
Jul 14 18:06:06.251070 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:06.250685    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdwvp" event={"ID":"69131f88-2d06-4ed8-9a40-867164bd9a57","Type":"ContainerStarted","Data":"48637540599dd0f5bd7d5d33c7cd57f11b522f717c17b235c04fbb2b9035f328"}
Jul 14 18:06:06.251070 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:06.250813    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdwvp"
Jul 14 18:06:06.254931 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:06:06.254902    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sfrb5\" is forbidden: User \"system:node:ip-10-0-139-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-216.ec2.internal' and this object" podUID="f7abda9e-6fd9-44ba-b2c9-347bbf26632f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sfrb5"
Jul 14 18:06:06.294687 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:06.294614    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdwvp" podStartSLOduration=2.294597832 podStartE2EDuration="2.294597832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:06:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:06:06.291862014 +0000 UTC m=+684.396971998" watchObservedRunningTime="2026-07-14 18:06:06.294597832 +0000 UTC m=+684.399707816"
Jul 14 18:06:06.441627 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:06.441587    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7abda9e-6fd9-44ba-b2c9-347bbf26632f" path="/var/lib/kubelet/pods/f7abda9e-6fd9-44ba-b2c9-347bbf26632f/volumes"
Jul 14 18:06:17.257802 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:17.257772    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdwvp"
Jul 14 18:06:46.303412 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:46.303366    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:06:46.309668 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:46.309642    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"
Jul 14 18:06:46.312373 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:46.312351    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 14 18:06:46.312524 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:46.312455    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mh459\""
Jul 14 18:06:46.314864 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:46.314838    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:06:46.360362 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:46.360331    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:06:46.382986 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:46.382957    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqjmg\" (UniqueName: \"kubernetes.io/projected/7ea38038-8f96-4f0c-b9e7-dfedd01925ce-kube-api-access-bqjmg\") pod \"limitador-limitador-54d6d988d5-wkv2p\" (UID: \"7ea38038-8f96-4f0c-b9e7-dfedd01925ce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"
Jul 14 18:06:46.383176 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:46.383096    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7ea38038-8f96-4f0c-b9e7-dfedd01925ce-config-file\") pod \"limitador-limitador-54d6d988d5-wkv2p\" (UID: \"7ea38038-8f96-4f0c-b9e7-dfedd01925ce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"
Jul 14 18:06:46.484376 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:46.484335    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqjmg\" (UniqueName: \"kubernetes.io/projected/7ea38038-8f96-4f0c-b9e7-dfedd01925ce-kube-api-access-bqjmg\") pod \"limitador-limitador-54d6d988d5-wkv2p\" (UID: \"7ea38038-8f96-4f0c-b9e7-dfedd01925ce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"
Jul 14 18:06:46.484621 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:46.484460    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7ea38038-8f96-4f0c-b9e7-dfedd01925ce-config-file\") pod \"limitador-limitador-54d6d988d5-wkv2p\" (UID: \"7ea38038-8f96-4f0c-b9e7-dfedd01925ce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"
Jul 14 18:06:46.485094 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:46.485074    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7ea38038-8f96-4f0c-b9e7-dfedd01925ce-config-file\") pod \"limitador-limitador-54d6d988d5-wkv2p\" (UID: \"7ea38038-8f96-4f0c-b9e7-dfedd01925ce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"
Jul 14 18:06:46.498270 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:46.498241    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqjmg\" (UniqueName: \"kubernetes.io/projected/7ea38038-8f96-4f0c-b9e7-dfedd01925ce-kube-api-access-bqjmg\") pod \"limitador-limitador-54d6d988d5-wkv2p\" (UID: \"7ea38038-8f96-4f0c-b9e7-dfedd01925ce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"
Jul 14 18:06:46.621691 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:46.621656    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"
Jul 14 18:06:46.769297 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:46.769274    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:06:46.771171 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:06:46.771138    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ea38038_8f96_4f0c_b9e7_dfedd01925ce.slice/crio-9b8995a4acea55f9ce6918fbfa8de63c5d680b798d204c300c9d2c864935a25e WatchSource:0}: Error finding container 9b8995a4acea55f9ce6918fbfa8de63c5d680b798d204c300c9d2c864935a25e: Status 404 returned error can't find the container with id 9b8995a4acea55f9ce6918fbfa8de63c5d680b798d204c300c9d2c864935a25e
Jul 14 18:06:47.472976 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:47.472901    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wkv2p" event={"ID":"7ea38038-8f96-4f0c-b9e7-dfedd01925ce","Type":"ContainerStarted","Data":"9b8995a4acea55f9ce6918fbfa8de63c5d680b798d204c300c9d2c864935a25e"}
Jul 14 18:06:49.486702 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:49.486665    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wkv2p" event={"ID":"7ea38038-8f96-4f0c-b9e7-dfedd01925ce","Type":"ContainerStarted","Data":"ddcf398505c1c7d06588dfcf0c71e77fa4e73c08efc88a93405c0d977c84d82b"}
Jul 14 18:06:49.487132 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:49.486809    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"
Jul 14 18:06:49.510214 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:06:49.510155    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-wkv2p" podStartSLOduration=0.913722788 podStartE2EDuration="3.510137712s" totalImagesPullingTime="2.596414924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:06:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:06:49.507898746 +0000 UTC m=+727.613008732" watchObservedRunningTime="2026-07-14 18:06:49.510137712 +0000 UTC m=+727.615247695"
Jul 14 18:07:00.493341 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:07:00.493311    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"
Jul 14 18:07:58.065243 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:07:58.065209    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:08:26.835925 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:08:26.835832    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:08:34.233019 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:08:34.232982    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:08:38.141866 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:08:38.141820    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:08:52.634475 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:08:52.634435    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:09:00.456184 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:09:00.456142    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:09:09.325640 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:09:09.325603    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:09:42.357278 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:09:42.357249    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 18:09:42.359005 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:09:42.358981    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 18:10:56.441002 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:10:56.440970    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:11:09.420478 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:11:09.420377    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:11:18.331991 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:11:18.331954    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:11:27.128810 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:11:27.128772    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:11:37.632405 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:11:37.632369    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:12:07.588962 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:12:07.588918    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:12:19.623904 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:12:19.623872    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:12:43.253830 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:12:43.253785    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:12:52.249500 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:12:52.249461    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:13:01.129397 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:13:01.129358    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:13:10.340027 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:13:10.339987    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:13:19.264850 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:13:19.264815    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:13:31.227052 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:13:31.227009    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:13:41.830482 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:13:41.830437    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:13:53.227526 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:13:53.227488    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:14:04.827242 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:14:04.827156    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:14:14.120721 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:14:14.120688    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:14:37.444411 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:14:37.444366    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:14:42.391948 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:14:42.391916    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 18:14:42.394601 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:14:42.394578    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 18:14:46.421730 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:14:46.421688    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:15:00.180664 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:15:00.180628    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734215-rpb7j"]
Jul 14 18:15:00.184190 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:15:00.184172    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734215-rpb7j"
Jul 14 18:15:00.188817 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:15:00.188793    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pp62l\""
Jul 14 18:15:00.193711 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:15:00.193693    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734215-rpb7j"
Jul 14 18:15:00.211673 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:15:00.211626    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734215-rpb7j"]
Jul 14 18:15:00.340418 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:15:00.340379    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734215-rpb7j"]
Jul 14 18:15:00.341799 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:15:00.341764    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29148738_4e63_4858_8fd8_bd9dc2b42236.slice/crio-a6c4cb0b551f7b19158da88a465505dbeedf8be185cf0fadb16e27b678576ed5 WatchSource:0}: Error finding container a6c4cb0b551f7b19158da88a465505dbeedf8be185cf0fadb16e27b678576ed5: Status 404 returned error can't find the container with id a6c4cb0b551f7b19158da88a465505dbeedf8be185cf0fadb16e27b678576ed5
Jul 14 18:15:00.343647 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:15:00.343631    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 18:15:01.110323 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:15:01.110283    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734215-rpb7j" event={"ID":"29148738-4e63-4858-8fd8-bd9dc2b42236","Type":"ContainerStarted","Data":"a6c4cb0b551f7b19158da88a465505dbeedf8be185cf0fadb16e27b678576ed5"}
Jul 14 18:15:03.124274 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:15:03.124234    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734215-rpb7j" event={"ID":"29148738-4e63-4858-8fd8-bd9dc2b42236","Type":"ContainerStarted","Data":"addc63a6b82aa1c2ae82768ca7b47d270c8eb712ebca4181c55a15a5e02d1084"}
Jul 14 18:15:03.144900 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:15:03.144840    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734215-rpb7j" podStartSLOduration=0.827569327 podStartE2EDuration="3.144822822s" totalImagesPullingTime="2.317253495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:15:03.143517813 +0000 UTC m=+1221.248627998" watchObservedRunningTime="2026-07-14 18:15:03.144822822 +0000 UTC m=+1221.249932850"
Jul 14 18:15:04.130964 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:15:04.130923    2558 generic.go:356] "Generic (PLEG): container finished" podID="29148738-4e63-4858-8fd8-bd9dc2b42236" containerID="addc63a6b82aa1c2ae82768ca7b47d270c8eb712ebca4181c55a15a5e02d1084" exitCode=0
Jul 14 18:15:04.131371 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:15:04.131010    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734215-rpb7j" event={"ID":"29148738-4e63-4858-8fd8-bd9dc2b42236","Type":"ContainerDied","Data":"addc63a6b82aa1c2ae82768ca7b47d270c8eb712ebca4181c55a15a5e02d1084"}
Jul 14 18:15:05.273871 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:15:05.273848    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734215-rpb7j"
Jul 14 18:15:06.142874 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:15:06.142845    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734215-rpb7j"
Jul 14 18:15:06.142874 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:15:06.142865    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734215-rpb7j" event={"ID":"29148738-4e63-4858-8fd8-bd9dc2b42236","Type":"ContainerDied","Data":"a6c4cb0b551f7b19158da88a465505dbeedf8be185cf0fadb16e27b678576ed5"}
Jul 14 18:15:06.143107 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:15:06.142909    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a6c4cb0b551f7b19158da88a465505dbeedf8be185cf0fadb16e27b678576ed5"
Jul 14 18:15:12.730763 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:15:12.730727    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:15:25.657275 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:15:25.657235    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:15:40.832147 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:15:40.832110    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:15:50.143036 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:15:50.142997    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:15:59.626547 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:15:59.626510    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:16:09.231470 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:16:09.231426    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:16:17.493784 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:16:17.493744    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:18:09.624099 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:18:09.624054    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:18:20.824574 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:18:20.824528    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:18:32.819388 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:18:32.819309    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:18:43.928550 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:18:43.928510    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:18:55.918199 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:18:55.918160    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:19:05.611319 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:19:05.611282    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:19:14.409029 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:19:14.408989    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:19:25.923552 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:19:25.923512    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:19:36.522405 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:19:36.522364    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:19:42.430122 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:19:42.430090    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 18:19:42.431775 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:19:42.431751    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 18:19:46.009080 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:19:46.009037    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:19:57.037391 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:19:57.037352    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:20:21.826954 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:20:21.826911    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:20:29.443795 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:20:29.443754    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:20:39.029420 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:20:39.029383    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:20:49.918520 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:20:49.918472    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:21:03.440336 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:21:03.440293    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:21:11.455137 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:21:11.455100    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:21:20.527525 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:21:20.527485    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:21:29.723180 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:21:29.723145    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:21:37.826087 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:21:37.825998    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:21:54.514044 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:21:54.514007    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:22:00.921633 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:22:00.921596    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:22:10.613525 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:22:10.613478    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:22:20.214639 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:22:20.214606    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:22:30.006784 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:22:30.006752    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:22:40.010638 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:22:40.010589    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:22:53.818240 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:22:53.818199    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:23:01.520987 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:23:01.520951    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:23:13.412033 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:23:13.411939    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:23:25.813336 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:23:25.813300    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:23:40.333594 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:23:40.333543    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:23:50.933134 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:23:50.933096    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:24:05.432132 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:05.432095    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:24:12.261341 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.261302    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"]
Jul 14 18:24:12.261793 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.261704    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29148738-4e63-4858-8fd8-bd9dc2b42236" containerName="cleanup"
Jul 14 18:24:12.261793 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.261717    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="29148738-4e63-4858-8fd8-bd9dc2b42236" containerName="cleanup"
Jul 14 18:24:12.261793 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.261791    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="29148738-4e63-4858-8fd8-bd9dc2b42236" containerName="cleanup"
Jul 14 18:24:12.264417 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.264400    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.280971 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.280942    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3ccf089e-openshift-default-dockercfg-lxmwx\""
Jul 14 18:24:12.324549 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.324519    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"]
Jul 14 18:24:12.339503 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.339468    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-workload-socket\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.339694 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.339528    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-data\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.339694 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.339597    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7af8352d-85e4-40f2-8c15-9e29a22044ea-istiod-ca-cert\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.339771 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.339713    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-podinfo\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.339771 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.339756    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jkpx\" (UniqueName: \"kubernetes.io/projected/7af8352d-85e4-40f2-8c15-9e29a22044ea-kube-api-access-6jkpx\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.339877 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.339824    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-workload-certs\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.339877 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.339865    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-credential-socket\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.339978 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.339905    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-token\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.339978 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.339972    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-envoy\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.441030 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.440992    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-workload-socket\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.441030 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.441028    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-data\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.441280 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.441047    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7af8352d-85e4-40f2-8c15-9e29a22044ea-istiod-ca-cert\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.441280 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.441083    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-podinfo\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.441280 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.441100    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jkpx\" (UniqueName: \"kubernetes.io/projected/7af8352d-85e4-40f2-8c15-9e29a22044ea-kube-api-access-6jkpx\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.441280 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.441136    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-workload-certs\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.441280 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.441164    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-credential-socket\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.441596 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.441393    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-data\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.441596 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.441442    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-token\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.441596 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.441468    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-workload-socket\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.441596 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.441516    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-workload-certs\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.441596 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.441473    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-envoy\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.441861 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.441815    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7af8352d-85e4-40f2-8c15-9e29a22044ea-istiod-ca-cert\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.442283 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.442259    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-credential-socket\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.443712 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.443689    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-envoy\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.443913 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.443896    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-podinfo\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.464140 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.464070    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jkpx\" (UniqueName: \"kubernetes.io/projected/7af8352d-85e4-40f2-8c15-9e29a22044ea-kube-api-access-6jkpx\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.464140 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.464131    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-token\") pod \"e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") " pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.574291 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.574250    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:12.733110 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.733076    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"]
Jul 14 18:24:12.733363 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:24:12.733342    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af8352d_85e4_40f2_8c15_9e29a22044ea.slice/crio-1819d4e84933b88cc9a3a27ea3d5b007b009e3b8d2098d1e821d6382996fe719 WatchSource:0}: Error finding container 1819d4e84933b88cc9a3a27ea3d5b007b009e3b8d2098d1e821d6382996fe719: Status 404 returned error can't find the container with id 1819d4e84933b88cc9a3a27ea3d5b007b009e3b8d2098d1e821d6382996fe719
Jul 14 18:24:12.735482 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.735451    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:24:12.735575 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.735512    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:24:12.735575 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:12.735541    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:24:13.080032 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:13.079940    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22" event={"ID":"7af8352d-85e4-40f2-8c15-9e29a22044ea","Type":"ContainerStarted","Data":"83ac92bd853739e0c4068b2e278c3b1744008a072878d6026ae2036f9d1a228f"}
Jul 14 18:24:13.080032 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:13.079992    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22" event={"ID":"7af8352d-85e4-40f2-8c15-9e29a22044ea","Type":"ContainerStarted","Data":"1819d4e84933b88cc9a3a27ea3d5b007b009e3b8d2098d1e821d6382996fe719"}
Jul 14 18:24:13.574658 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:13.574616    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:13.579359 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:13.579335    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:13.622028 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:13.621972    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22" podStartSLOduration=1.621957232 podStartE2EDuration="1.621957232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:24:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:24:13.116066678 +0000 UTC m=+1771.221176663" watchObservedRunningTime="2026-07-14 18:24:13.621957232 +0000 UTC m=+1771.727067216"
Jul 14 18:24:13.648326 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:13.648295    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q"]
Jul 14 18:24:13.651833 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:13.651804    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q"
Jul 14 18:24:13.658341 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:13.658320    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 18:24:13.658782 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:13.658761    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-3ccf089e-serving-cert\""
Jul 14 18:24:13.658946 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:13.658928    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 14 18:24:13.659035 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:13.659011    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dzj5k\""
Jul 14 18:24:13.668555 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:13.668531    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q"]
Jul 14 18:24:13.754670 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:13.754635    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb2927c-0b56-40db-beb3-dbb2de4a32e4-openshift-service-ca\") pod \"maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q\" (UID: \"abb2927c-0b56-40db-beb3-dbb2de4a32e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q"
Jul 14 18:24:13.754866 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:13.754687    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abb2927c-0b56-40db-beb3-dbb2de4a32e4-maas-api-tls\") pod \"maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q\" (UID: \"abb2927c-0b56-40db-beb3-dbb2de4a32e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q"
Jul 14 18:24:13.754866 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:13.754710    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wckk\" (UniqueName: \"kubernetes.io/projected/abb2927c-0b56-40db-beb3-dbb2de4a32e4-kube-api-access-4wckk\") pod \"maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q\" (UID: \"abb2927c-0b56-40db-beb3-dbb2de4a32e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q"
Jul 14 18:24:13.855968 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:13.855931    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abb2927c-0b56-40db-beb3-dbb2de4a32e4-maas-api-tls\") pod \"maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q\" (UID: \"abb2927c-0b56-40db-beb3-dbb2de4a32e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q"
Jul 14 18:24:13.856187 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:13.855985    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wckk\" (UniqueName: \"kubernetes.io/projected/abb2927c-0b56-40db-beb3-dbb2de4a32e4-kube-api-access-4wckk\") pod \"maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q\" (UID: \"abb2927c-0b56-40db-beb3-dbb2de4a32e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q"
Jul 14 18:24:13.856187 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:13.856122    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb2927c-0b56-40db-beb3-dbb2de4a32e4-openshift-service-ca\") pod \"maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q\" (UID: \"abb2927c-0b56-40db-beb3-dbb2de4a32e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q"
Jul 14 18:24:13.856991 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:13.856963    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb2927c-0b56-40db-beb3-dbb2de4a32e4-openshift-service-ca\") pod \"maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q\" (UID: \"abb2927c-0b56-40db-beb3-dbb2de4a32e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q"
Jul 14 18:24:13.859718 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:13.859690    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abb2927c-0b56-40db-beb3-dbb2de4a32e4-maas-api-tls\") pod \"maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q\" (UID: \"abb2927c-0b56-40db-beb3-dbb2de4a32e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q"
Jul 14 18:24:13.872337 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:13.872305    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wckk\" (UniqueName: \"kubernetes.io/projected/abb2927c-0b56-40db-beb3-dbb2de4a32e4-kube-api-access-4wckk\") pod \"maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q\" (UID: \"abb2927c-0b56-40db-beb3-dbb2de4a32e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q"
Jul 14 18:24:13.965492 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:13.965455    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q"
Jul 14 18:24:14.087128 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:14.087086    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:14.088464 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:14.088436    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:14.147500 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:14.147477    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q"]
Jul 14 18:24:14.149444 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:24:14.149414    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb2927c_0b56_40db_beb3_dbb2de4a32e4.slice/crio-f114aa55b8a26a289f0eef0d3fc36031dfea79555c7bb302eb44c19ec4765e71 WatchSource:0}: Error finding container f114aa55b8a26a289f0eef0d3fc36031dfea79555c7bb302eb44c19ec4765e71: Status 404 returned error can't find the container with id f114aa55b8a26a289f0eef0d3fc36031dfea79555c7bb302eb44c19ec4765e71
Jul 14 18:24:14.151190 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:14.151157    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 18:24:15.093246 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:15.093213    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q" event={"ID":"abb2927c-0b56-40db-beb3-dbb2de4a32e4","Type":"ContainerStarted","Data":"f114aa55b8a26a289f0eef0d3fc36031dfea79555c7bb302eb44c19ec4765e71"}
Jul 14 18:24:18.112504 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:18.112464    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q" event={"ID":"abb2927c-0b56-40db-beb3-dbb2de4a32e4","Type":"ContainerStarted","Data":"ddef92a085dbbd536be22526b95088b4287b327e3fdc51fd5cb772b00e68acc0"}
Jul 14 18:24:18.112911 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:18.112530    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q"
Jul 14 18:24:18.144604 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:18.144523    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q" podStartSLOduration=1.7635931089999999 podStartE2EDuration="5.144506477s" totalImagesPullingTime="3.380913368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:24:18.143623069 +0000 UTC m=+1776.248733050" watchObservedRunningTime="2026-07-14 18:24:18.144506477 +0000 UTC m=+1776.249616438"
Jul 14 18:24:21.437727 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:21.437683    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:24:24.126541 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:24.126510    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q"
Jul 14 18:24:29.304784 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:29.304439    2558 patch_prober.go:28] interesting pod/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": read tcp 10.134.0.2:36730->10.134.0.45:15021: read: connection reset by peer" start-of-body=
Jul 14 18:24:29.304784 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:29.304513    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22" podUID="7af8352d-85e4-40f2-8c15-9e29a22044ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": read tcp 10.134.0.2:36730->10.134.0.45:15021: read: connection reset by peer"
Jul 14 18:24:30.181548 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:30.181505    2558 generic.go:356] "Generic (PLEG): container finished" podID="7af8352d-85e4-40f2-8c15-9e29a22044ea" containerID="83ac92bd853739e0c4068b2e278c3b1744008a072878d6026ae2036f9d1a228f" exitCode=0
Jul 14 18:24:30.181733 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:30.181595    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22" event={"ID":"7af8352d-85e4-40f2-8c15-9e29a22044ea","Type":"ContainerDied","Data":"83ac92bd853739e0c4068b2e278c3b1744008a072878d6026ae2036f9d1a228f"}
Jul 14 18:24:30.182076 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:30.182062    2558 scope.go:117] "RemoveContainer" containerID="83ac92bd853739e0c4068b2e278c3b1744008a072878d6026ae2036f9d1a228f"
Jul 14 18:24:30.183106 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:30.183077    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:24:30.183167 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:30.183152    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:24:30.183203 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:30.183192    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:24:31.189275 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:31.189237    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22" event={"ID":"7af8352d-85e4-40f2-8c15-9e29a22044ea","Type":"ContainerStarted","Data":"bdc64f43bbc4855abdbf362adfb7e5a7ad7420ccf3dd2cc013785f4b549272eb"}
Jul 14 18:24:31.575331 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:31.575233    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:31.575518 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:31.575484    2558 patch_prober.go:28] interesting pod/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 14 18:24:31.575631 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:31.575541    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22" podUID="7af8352d-85e4-40f2-8c15-9e29a22044ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 14 18:24:32.575388 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:32.575345    2558 patch_prober.go:28] interesting pod/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 14 18:24:32.575830 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:32.575403    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22" podUID="7af8352d-85e4-40f2-8c15-9e29a22044ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 14 18:24:33.575360 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:33.575314    2558 patch_prober.go:28] interesting pod/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 14 18:24:33.575537 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:33.575390    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22" podUID="7af8352d-85e4-40f2-8c15-9e29a22044ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 14 18:24:34.574753 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:34.574710    2558 patch_prober.go:28] interesting pod/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 14 18:24:34.574965 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:34.574777    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22" podUID="7af8352d-85e4-40f2-8c15-9e29a22044ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 14 18:24:35.578204 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:35.578170    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:35.578725 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:35.578436    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:35.579200 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:35.579184    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:24:42.467163 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:42.467128    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 18:24:42.469800 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:24:42.469775    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 18:25:19.393971 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:19.393934    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q"]
Jul 14 18:25:19.394893 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:19.394207    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q" podUID="abb2927c-0b56-40db-beb3-dbb2de4a32e4" containerName="maas-api" containerID="cri-o://ddef92a085dbbd536be22526b95088b4287b327e3fdc51fd5cb772b00e68acc0" gracePeriod=30
Jul 14 18:25:19.649872 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:19.649811    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q"
Jul 14 18:25:19.754299 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:19.754259    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wckk\" (UniqueName: \"kubernetes.io/projected/abb2927c-0b56-40db-beb3-dbb2de4a32e4-kube-api-access-4wckk\") pod \"abb2927c-0b56-40db-beb3-dbb2de4a32e4\" (UID: \"abb2927c-0b56-40db-beb3-dbb2de4a32e4\") "
Jul 14 18:25:19.754483 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:19.754318    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb2927c-0b56-40db-beb3-dbb2de4a32e4-openshift-service-ca\") pod \"abb2927c-0b56-40db-beb3-dbb2de4a32e4\" (UID: \"abb2927c-0b56-40db-beb3-dbb2de4a32e4\") "
Jul 14 18:25:19.754483 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:19.754402    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abb2927c-0b56-40db-beb3-dbb2de4a32e4-maas-api-tls\") pod \"abb2927c-0b56-40db-beb3-dbb2de4a32e4\" (UID: \"abb2927c-0b56-40db-beb3-dbb2de4a32e4\") "
Jul 14 18:25:19.754822 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:19.754799    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abb2927c-0b56-40db-beb3-dbb2de4a32e4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "abb2927c-0b56-40db-beb3-dbb2de4a32e4" (UID: "abb2927c-0b56-40db-beb3-dbb2de4a32e4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:25:19.756807 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:19.756783    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abb2927c-0b56-40db-beb3-dbb2de4a32e4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "abb2927c-0b56-40db-beb3-dbb2de4a32e4" (UID: "abb2927c-0b56-40db-beb3-dbb2de4a32e4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 18:25:19.756807 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:19.756787    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abb2927c-0b56-40db-beb3-dbb2de4a32e4-kube-api-access-4wckk" (OuterVolumeSpecName: "kube-api-access-4wckk") pod "abb2927c-0b56-40db-beb3-dbb2de4a32e4" (UID: "abb2927c-0b56-40db-beb3-dbb2de4a32e4"). InnerVolumeSpecName "kube-api-access-4wckk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:25:19.855227 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:19.855183    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wckk\" (UniqueName: \"kubernetes.io/projected/abb2927c-0b56-40db-beb3-dbb2de4a32e4-kube-api-access-4wckk\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:25:19.855227 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:19.855218    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb2927c-0b56-40db-beb3-dbb2de4a32e4-openshift-service-ca\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:25:19.855227 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:19.855228    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abb2927c-0b56-40db-beb3-dbb2de4a32e4-maas-api-tls\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:25:20.463754 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:20.463722    2558 generic.go:356] "Generic (PLEG): container finished" podID="abb2927c-0b56-40db-beb3-dbb2de4a32e4" containerID="ddef92a085dbbd536be22526b95088b4287b327e3fdc51fd5cb772b00e68acc0" exitCode=0
Jul 14 18:25:20.464146 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:20.463771    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q"
Jul 14 18:25:20.464146 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:20.463799    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q" event={"ID":"abb2927c-0b56-40db-beb3-dbb2de4a32e4","Type":"ContainerDied","Data":"ddef92a085dbbd536be22526b95088b4287b327e3fdc51fd5cb772b00e68acc0"}
Jul 14 18:25:20.464146 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:20.463855    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q" event={"ID":"abb2927c-0b56-40db-beb3-dbb2de4a32e4","Type":"ContainerDied","Data":"f114aa55b8a26a289f0eef0d3fc36031dfea79555c7bb302eb44c19ec4765e71"}
Jul 14 18:25:20.464146 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:20.463877    2558 scope.go:117] "RemoveContainer" containerID="ddef92a085dbbd536be22526b95088b4287b327e3fdc51fd5cb772b00e68acc0"
Jul 14 18:25:20.473293 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:20.473277    2558 scope.go:117] "RemoveContainer" containerID="ddef92a085dbbd536be22526b95088b4287b327e3fdc51fd5cb772b00e68acc0"
Jul 14 18:25:20.473570 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:25:20.473540    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddef92a085dbbd536be22526b95088b4287b327e3fdc51fd5cb772b00e68acc0\": container with ID starting with ddef92a085dbbd536be22526b95088b4287b327e3fdc51fd5cb772b00e68acc0 not found: ID does not exist" containerID="ddef92a085dbbd536be22526b95088b4287b327e3fdc51fd5cb772b00e68acc0"
Jul 14 18:25:20.473634 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:20.473587    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddef92a085dbbd536be22526b95088b4287b327e3fdc51fd5cb772b00e68acc0"} err="failed to get container status \"ddef92a085dbbd536be22526b95088b4287b327e3fdc51fd5cb772b00e68acc0\": rpc error: code = NotFound desc = could not find container \"ddef92a085dbbd536be22526b95088b4287b327e3fdc51fd5cb772b00e68acc0\": container with ID starting with ddef92a085dbbd536be22526b95088b4287b327e3fdc51fd5cb772b00e68acc0 not found: ID does not exist"
Jul 14 18:25:20.483930 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:20.483908    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q"]
Jul 14 18:25:20.489311 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:20.489287    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ccf089e-5757b5b694-6ls9q"]
Jul 14 18:25:22.113165 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:22.113129    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:25:22.441235 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:22.441155    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abb2927c-0b56-40db-beb3-dbb2de4a32e4" path="/var/lib/kubelet/pods/abb2927c-0b56-40db-beb3-dbb2de4a32e4/volumes"
Jul 14 18:25:33.821421 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:33.821382    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"]
Jul 14 18:25:33.822009 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:33.821632    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22" podUID="7af8352d-85e4-40f2-8c15-9e29a22044ea" containerName="istio-proxy" containerID="cri-o://bdc64f43bbc4855abdbf362adfb7e5a7ad7420ccf3dd2cc013785f4b549272eb" gracePeriod=30
Jul 14 18:25:34.404227 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.403961    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"]
Jul 14 18:25:34.404388 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.404371    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb2927c-0b56-40db-beb3-dbb2de4a32e4" containerName="maas-api"
Jul 14 18:25:34.404440 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.404390    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb2927c-0b56-40db-beb3-dbb2de4a32e4" containerName="maas-api"
Jul 14 18:25:34.404489 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.404479    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="abb2927c-0b56-40db-beb3-dbb2de4a32e4" containerName="maas-api"
Jul 14 18:25:34.407515 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.407493    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.416820 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.416798    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-d0b3d618-gw-openshift-default-dockercfg-xkp9p\""
Jul 14 18:25:34.441286 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.441264    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"]
Jul 14 18:25:34.490930 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.490891    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-workload-socket\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.491125 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.490938    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-credential-socket\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.491125 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.490981    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-envoy\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.491125 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.491035    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-podinfo\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.491125 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.491083    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istiod-ca-cert\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.491125 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.491119    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-data\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.491372 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.491142    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-workload-certs\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.491372 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.491164    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-token\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.491372 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.491208    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv7gl\" (UniqueName: \"kubernetes.io/projected/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-kube-api-access-bv7gl\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.592294 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.592252    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istiod-ca-cert\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.592462 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.592303    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-data\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.592462 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.592331    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-workload-certs\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.592462 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.592355    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-token\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.592462 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.592380    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv7gl\" (UniqueName: \"kubernetes.io/projected/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-kube-api-access-bv7gl\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.592814 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.592510    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-workload-socket\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.592814 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.592548    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-credential-socket\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.592814 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.592604    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-envoy\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.592814 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.592634    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-podinfo\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.592814 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.592772    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-workload-certs\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.593077 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.592817    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-data\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.593140 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.593118    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-credential-socket\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.593233 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.593212    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-workload-socket\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.593291 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.593240    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istiod-ca-cert\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.595267 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.595232    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-envoy\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.595347 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.595332    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-podinfo\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.603040 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.603014    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv7gl\" (UniqueName: \"kubernetes.io/projected/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-kube-api-access-bv7gl\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.604111 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.604093    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-token\") pod \"e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") " pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.718779 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.718685    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:34.865276 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.865248    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"]
Jul 14 18:25:34.866533 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:25:34.866508    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7cb43a2_c13b_4035_9ee4_96c3e477cc45.slice/crio-02a697e83558aacece80efa719dff65902473c9eda99cb385e538954ea2f6558 WatchSource:0}: Error finding container 02a697e83558aacece80efa719dff65902473c9eda99cb385e538954ea2f6558: Status 404 returned error can't find the container with id 02a697e83558aacece80efa719dff65902473c9eda99cb385e538954ea2f6558
Jul 14 18:25:34.868670 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.868638    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:25:34.868750 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.868698    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:25:34.868750 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:34.868728    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:25:35.551132 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:35.551086    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv" event={"ID":"b7cb43a2-c13b-4035-9ee4-96c3e477cc45","Type":"ContainerStarted","Data":"6bcb29519821da40cdfffa81393b807fb3de7b5833b8ff445cd045505008351f"}
Jul 14 18:25:35.551318 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:35.551152    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv" event={"ID":"b7cb43a2-c13b-4035-9ee4-96c3e477cc45","Type":"ContainerStarted","Data":"02a697e83558aacece80efa719dff65902473c9eda99cb385e538954ea2f6558"}
Jul 14 18:25:35.577698 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:35.577646    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv" podStartSLOduration=1.577628053 podStartE2EDuration="1.577628053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:25:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:25:35.576410794 +0000 UTC m=+1853.681520780" watchObservedRunningTime="2026-07-14 18:25:35.577628053 +0000 UTC m=+1853.682738036"
Jul 14 18:25:35.580834 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:35.580805    2558 patch_prober.go:28] interesting pod/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 18:25:35.580969 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:35.580863    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22" podUID="7af8352d-85e4-40f2-8c15-9e29a22044ea" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 18:25:35.719629 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:35.719552    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:35.725236 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:35.725209    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:36.557462 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:36.557419    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:36.558552 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:36.558525    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:39.077468 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.077441    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:25:39.235939 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.235899    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-podinfo\") pod \"7af8352d-85e4-40f2-8c15-9e29a22044ea\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") "
Jul 14 18:25:39.235939 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.235942    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-credential-socket\") pod \"7af8352d-85e4-40f2-8c15-9e29a22044ea\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") "
Jul 14 18:25:39.236184 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.235966    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-workload-certs\") pod \"7af8352d-85e4-40f2-8c15-9e29a22044ea\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") "
Jul 14 18:25:39.236184 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.236005    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-envoy\") pod \"7af8352d-85e4-40f2-8c15-9e29a22044ea\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") "
Jul 14 18:25:39.236184 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.236085    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-workload-socket\") pod \"7af8352d-85e4-40f2-8c15-9e29a22044ea\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") "
Jul 14 18:25:39.236184 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.236110    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-token\") pod \"7af8352d-85e4-40f2-8c15-9e29a22044ea\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") "
Jul 14 18:25:39.236184 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.236140    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-data\") pod \"7af8352d-85e4-40f2-8c15-9e29a22044ea\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") "
Jul 14 18:25:39.236184 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.236182    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jkpx\" (UniqueName: \"kubernetes.io/projected/7af8352d-85e4-40f2-8c15-9e29a22044ea-kube-api-access-6jkpx\") pod \"7af8352d-85e4-40f2-8c15-9e29a22044ea\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") "
Jul 14 18:25:39.236481 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.236210    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7af8352d-85e4-40f2-8c15-9e29a22044ea-istiod-ca-cert\") pod \"7af8352d-85e4-40f2-8c15-9e29a22044ea\" (UID: \"7af8352d-85e4-40f2-8c15-9e29a22044ea\") "
Jul 14 18:25:39.236481 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.236269    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7af8352d-85e4-40f2-8c15-9e29a22044ea" (UID: "7af8352d-85e4-40f2-8c15-9e29a22044ea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:25:39.236481 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.236384    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7af8352d-85e4-40f2-8c15-9e29a22044ea" (UID: "7af8352d-85e4-40f2-8c15-9e29a22044ea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:25:39.236481 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.236434    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7af8352d-85e4-40f2-8c15-9e29a22044ea" (UID: "7af8352d-85e4-40f2-8c15-9e29a22044ea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:25:39.236744 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.236549    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-workload-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:25:39.236744 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.236600    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-credential-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:25:39.236744 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.236614    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-workload-certs\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:25:39.236880 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.236749    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7af8352d-85e4-40f2-8c15-9e29a22044ea-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7af8352d-85e4-40f2-8c15-9e29a22044ea" (UID: "7af8352d-85e4-40f2-8c15-9e29a22044ea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:25:39.237293 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.237266    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-data" (OuterVolumeSpecName: "istio-data") pod "7af8352d-85e4-40f2-8c15-9e29a22044ea" (UID: "7af8352d-85e4-40f2-8c15-9e29a22044ea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:25:39.238671 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.238552    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7af8352d-85e4-40f2-8c15-9e29a22044ea" (UID: "7af8352d-85e4-40f2-8c15-9e29a22044ea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 18:25:39.238671 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.238641    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7af8352d-85e4-40f2-8c15-9e29a22044ea" (UID: "7af8352d-85e4-40f2-8c15-9e29a22044ea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:25:39.239058 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.239040    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7af8352d-85e4-40f2-8c15-9e29a22044ea-kube-api-access-6jkpx" (OuterVolumeSpecName: "kube-api-access-6jkpx") pod "7af8352d-85e4-40f2-8c15-9e29a22044ea" (UID: "7af8352d-85e4-40f2-8c15-9e29a22044ea"). InnerVolumeSpecName "kube-api-access-6jkpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:25:39.239113 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.239054    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-token" (OuterVolumeSpecName: "istio-token") pod "7af8352d-85e4-40f2-8c15-9e29a22044ea" (UID: "7af8352d-85e4-40f2-8c15-9e29a22044ea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:25:39.337074 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.337036    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-token\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:25:39.337074 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.337067    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-data\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:25:39.337074 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.337076    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jkpx\" (UniqueName: \"kubernetes.io/projected/7af8352d-85e4-40f2-8c15-9e29a22044ea-kube-api-access-6jkpx\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:25:39.337074 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.337086    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7af8352d-85e4-40f2-8c15-9e29a22044ea-istiod-ca-cert\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:25:39.337342 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.337096    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-podinfo\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:25:39.337342 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.337104    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7af8352d-85e4-40f2-8c15-9e29a22044ea-istio-envoy\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:25:39.575150 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.575063    2558 generic.go:356] "Generic (PLEG): container finished" podID="7af8352d-85e4-40f2-8c15-9e29a22044ea" containerID="bdc64f43bbc4855abdbf362adfb7e5a7ad7420ccf3dd2cc013785f4b549272eb" exitCode=0
Jul 14 18:25:39.575150 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.575113    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"
Jul 14 18:25:39.575348 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.575150    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22" event={"ID":"7af8352d-85e4-40f2-8c15-9e29a22044ea","Type":"ContainerDied","Data":"bdc64f43bbc4855abdbf362adfb7e5a7ad7420ccf3dd2cc013785f4b549272eb"}
Jul 14 18:25:39.575348 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.575207    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22" event={"ID":"7af8352d-85e4-40f2-8c15-9e29a22044ea","Type":"ContainerDied","Data":"1819d4e84933b88cc9a3a27ea3d5b007b009e3b8d2098d1e821d6382996fe719"}
Jul 14 18:25:39.575348 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.575230    2558 scope.go:117] "RemoveContainer" containerID="bdc64f43bbc4855abdbf362adfb7e5a7ad7420ccf3dd2cc013785f4b549272eb"
Jul 14 18:25:39.585130 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.585107    2558 scope.go:117] "RemoveContainer" containerID="83ac92bd853739e0c4068b2e278c3b1744008a072878d6026ae2036f9d1a228f"
Jul 14 18:25:39.593741 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.593721    2558 scope.go:117] "RemoveContainer" containerID="bdc64f43bbc4855abdbf362adfb7e5a7ad7420ccf3dd2cc013785f4b549272eb"
Jul 14 18:25:39.594042 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:25:39.594022    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdc64f43bbc4855abdbf362adfb7e5a7ad7420ccf3dd2cc013785f4b549272eb\": container with ID starting with bdc64f43bbc4855abdbf362adfb7e5a7ad7420ccf3dd2cc013785f4b549272eb not found: ID does not exist" containerID="bdc64f43bbc4855abdbf362adfb7e5a7ad7420ccf3dd2cc013785f4b549272eb"
Jul 14 18:25:39.594113 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.594051    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdc64f43bbc4855abdbf362adfb7e5a7ad7420ccf3dd2cc013785f4b549272eb"} err="failed to get container status \"bdc64f43bbc4855abdbf362adfb7e5a7ad7420ccf3dd2cc013785f4b549272eb\": rpc error: code = NotFound desc = could not find container \"bdc64f43bbc4855abdbf362adfb7e5a7ad7420ccf3dd2cc013785f4b549272eb\": container with ID starting with bdc64f43bbc4855abdbf362adfb7e5a7ad7420ccf3dd2cc013785f4b549272eb not found: ID does not exist"
Jul 14 18:25:39.594113 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.594070    2558 scope.go:117] "RemoveContainer" containerID="83ac92bd853739e0c4068b2e278c3b1744008a072878d6026ae2036f9d1a228f"
Jul 14 18:25:39.594331 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:25:39.594313    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83ac92bd853739e0c4068b2e278c3b1744008a072878d6026ae2036f9d1a228f\": container with ID starting with 83ac92bd853739e0c4068b2e278c3b1744008a072878d6026ae2036f9d1a228f not found: ID does not exist" containerID="83ac92bd853739e0c4068b2e278c3b1744008a072878d6026ae2036f9d1a228f"
Jul 14 18:25:39.594409 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.594339    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83ac92bd853739e0c4068b2e278c3b1744008a072878d6026ae2036f9d1a228f"} err="failed to get container status \"83ac92bd853739e0c4068b2e278c3b1744008a072878d6026ae2036f9d1a228f\": rpc error: code = NotFound desc = could not find container \"83ac92bd853739e0c4068b2e278c3b1744008a072878d6026ae2036f9d1a228f\": container with ID starting with 83ac92bd853739e0c4068b2e278c3b1744008a072878d6026ae2036f9d1a228f not found: ID does not exist"
Jul 14 18:25:39.598406 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.598378    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"]
Jul 14 18:25:39.602574 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:39.602540    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3ccf089e-openshift-default-889dd6997-7nv22"]
Jul 14 18:25:40.220332 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:40.220284    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j"]
Jul 14 18:25:40.220772 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:40.220702    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7af8352d-85e4-40f2-8c15-9e29a22044ea" containerName="istio-proxy"
Jul 14 18:25:40.220772 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:40.220713    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7af8352d-85e4-40f2-8c15-9e29a22044ea" containerName="istio-proxy"
Jul 14 18:25:40.220772 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:40.220722    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7af8352d-85e4-40f2-8c15-9e29a22044ea" containerName="istio-proxy"
Jul 14 18:25:40.220772 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:40.220728    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7af8352d-85e4-40f2-8c15-9e29a22044ea" containerName="istio-proxy"
Jul 14 18:25:40.220940 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:40.220787    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7af8352d-85e4-40f2-8c15-9e29a22044ea" containerName="istio-proxy"
Jul 14 18:25:40.220940 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:40.220796    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7af8352d-85e4-40f2-8c15-9e29a22044ea" containerName="istio-proxy"
Jul 14 18:25:40.223924 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:40.223906    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j"
Jul 14 18:25:40.226640 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:40.226620    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 18:25:40.226640 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:40.226629    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pp62l\""
Jul 14 18:25:40.232778 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:40.232755    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j"]
Jul 14 18:25:40.346280 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:40.346233    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bfd0faf-4fa7-44f8-afc4-eee22fdf3703-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j\" (UID: \"8bfd0faf-4fa7-44f8-afc4-eee22fdf3703\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j"
Jul 14 18:25:40.442645 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:40.442603    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7af8352d-85e4-40f2-8c15-9e29a22044ea" path="/var/lib/kubelet/pods/7af8352d-85e4-40f2-8c15-9e29a22044ea/volumes"
Jul 14 18:25:40.446881 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:40.446849    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bfd0faf-4fa7-44f8-afc4-eee22fdf3703-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j\" (UID: \"8bfd0faf-4fa7-44f8-afc4-eee22fdf3703\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j"
Jul 14 18:25:40.447654 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:40.447630    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bfd0faf-4fa7-44f8-afc4-eee22fdf3703-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j\" (UID: \"8bfd0faf-4fa7-44f8-afc4-eee22fdf3703\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j"
Jul 14 18:25:40.535915 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:40.535818    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j"
Jul 14 18:25:40.685609 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:40.683480    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j"]
Jul 14 18:25:40.687603 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:25:40.687576    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bfd0faf_4fa7_44f8_afc4_eee22fdf3703.slice/crio-9e35b83c376d106d962536d2bfe436b24caf3ab460c14a85c1d9a0e428019c44 WatchSource:0}: Error finding container 9e35b83c376d106d962536d2bfe436b24caf3ab460c14a85c1d9a0e428019c44: Status 404 returned error can't find the container with id 9e35b83c376d106d962536d2bfe436b24caf3ab460c14a85c1d9a0e428019c44
Jul 14 18:25:41.589673 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:41.589643    2558 generic.go:356] "Generic (PLEG): container finished" podID="8bfd0faf-4fa7-44f8-afc4-eee22fdf3703" containerID="f17e77dbc16511eb2103313aa640690e95b28b2a79bc3178ef17d52e7bf805ab" exitCode=7
Jul 14 18:25:41.590053 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:41.589733    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j" event={"ID":"8bfd0faf-4fa7-44f8-afc4-eee22fdf3703","Type":"ContainerDied","Data":"f17e77dbc16511eb2103313aa640690e95b28b2a79bc3178ef17d52e7bf805ab"}
Jul 14 18:25:41.590053 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:41.589806    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j" event={"ID":"8bfd0faf-4fa7-44f8-afc4-eee22fdf3703","Type":"ContainerStarted","Data":"9e35b83c376d106d962536d2bfe436b24caf3ab460c14a85c1d9a0e428019c44"}
Jul 14 18:25:41.590053 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:41.589932    2558 scope.go:117] "RemoveContainer" containerID="f17e77dbc16511eb2103313aa640690e95b28b2a79bc3178ef17d52e7bf805ab"
Jul 14 18:25:42.597511 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:42.597476    2558 generic.go:356] "Generic (PLEG): container finished" podID="8bfd0faf-4fa7-44f8-afc4-eee22fdf3703" containerID="d64fd43be57531007d551a2d96a9ee3e4caea290795e9809bd127986c375382b" exitCode=7
Jul 14 18:25:42.597919 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:42.597534    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j" event={"ID":"8bfd0faf-4fa7-44f8-afc4-eee22fdf3703","Type":"ContainerDied","Data":"d64fd43be57531007d551a2d96a9ee3e4caea290795e9809bd127986c375382b"}
Jul 14 18:25:42.597919 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:42.597606    2558 scope.go:117] "RemoveContainer" containerID="f17e77dbc16511eb2103313aa640690e95b28b2a79bc3178ef17d52e7bf805ab"
Jul 14 18:25:42.597919 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:42.597806    2558 scope.go:117] "RemoveContainer" containerID="d64fd43be57531007d551a2d96a9ee3e4caea290795e9809bd127986c375382b"
Jul 14 18:25:42.598087 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:25:42.598066    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j_odh-ai-gateway-infra(8bfd0faf-4fa7-44f8-afc4-eee22fdf3703)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j" podUID="8bfd0faf-4fa7-44f8-afc4-eee22fdf3703"
Jul 14 18:25:42.614246 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:42.614221    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:25:43.611152 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:43.611110    2558 scope.go:117] "RemoveContainer" containerID="d64fd43be57531007d551a2d96a9ee3e4caea290795e9809bd127986c375382b"
Jul 14 18:25:43.611680 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:25:43.611365    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j_odh-ai-gateway-infra(8bfd0faf-4fa7-44f8-afc4-eee22fdf3703)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j" podUID="8bfd0faf-4fa7-44f8-afc4-eee22fdf3703"
Jul 14 18:25:50.656746 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:50.656713    2558 generic.go:356] "Generic (PLEG): container finished" podID="b7cb43a2-c13b-4035-9ee4-96c3e477cc45" containerID="6bcb29519821da40cdfffa81393b807fb3de7b5833b8ff445cd045505008351f" exitCode=0
Jul 14 18:25:50.657250 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:50.656786    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv" event={"ID":"b7cb43a2-c13b-4035-9ee4-96c3e477cc45","Type":"ContainerDied","Data":"6bcb29519821da40cdfffa81393b807fb3de7b5833b8ff445cd045505008351f"}
Jul 14 18:25:50.657321 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:50.657289    2558 scope.go:117] "RemoveContainer" containerID="6bcb29519821da40cdfffa81393b807fb3de7b5833b8ff445cd045505008351f"
Jul 14 18:25:50.658314 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:50.658287    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:25:50.658374 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:50.658355    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:25:50.658413 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:50.658388    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:25:51.557907 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:51.557871    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:51.663898 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:51.663868    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv" event={"ID":"b7cb43a2-c13b-4035-9ee4-96c3e477cc45","Type":"ContainerStarted","Data":"dabdc507496106ed77343522298e81713f724663d78b27b9032d45ae61eaba22"}
Jul 14 18:25:51.719459 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:51.719416    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:51.722056 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:51.721716    2558 patch_prober.go:28] interesting pod/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 14 18:25:51.722056 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:51.721776    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv" podUID="b7cb43a2-c13b-4035-9ee4-96c3e477cc45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 14 18:25:52.719466 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:52.719428    2558 patch_prober.go:28] interesting pod/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 14 18:25:52.720318 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:52.720285    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv" podUID="b7cb43a2-c13b-4035-9ee4-96c3e477cc45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 14 18:25:53.719326 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:53.719273    2558 patch_prober.go:28] interesting pod/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 14 18:25:53.719552 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:53.719350    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv" podUID="b7cb43a2-c13b-4035-9ee4-96c3e477cc45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 14 18:25:54.720004 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:54.719965    2558 patch_prober.go:28] interesting pod/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 14 18:25:54.720625 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:54.720588    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv" podUID="b7cb43a2-c13b-4035-9ee4-96c3e477cc45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 14 18:25:55.723930 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:55.723897    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:55.724306 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:55.724200    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:55.724939 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:55.724918    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:25:57.435339 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:57.435304    2558 scope.go:117] "RemoveContainer" containerID="d64fd43be57531007d551a2d96a9ee3e4caea290795e9809bd127986c375382b"
Jul 14 18:25:57.701624 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:57.701500    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j" event={"ID":"8bfd0faf-4fa7-44f8-afc4-eee22fdf3703","Type":"ContainerStarted","Data":"81b8098c2c5ed16a12d2837a5f4400b5d9941914dc48574ddc05369d5fc38dbc"}
Jul 14 18:25:57.720963 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:57.720902    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j" podStartSLOduration=17.720882728 podStartE2EDuration="17.720882728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:25:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:25:57.719837239 +0000 UTC m=+1875.824947224" watchObservedRunningTime="2026-07-14 18:25:57.720882728 +0000 UTC m=+1875.825992711"
Jul 14 18:25:58.709437 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:58.709403    2558 generic.go:356] "Generic (PLEG): container finished" podID="8bfd0faf-4fa7-44f8-afc4-eee22fdf3703" containerID="81b8098c2c5ed16a12d2837a5f4400b5d9941914dc48574ddc05369d5fc38dbc" exitCode=0
Jul 14 18:25:58.709936 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:58.709486    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j" event={"ID":"8bfd0faf-4fa7-44f8-afc4-eee22fdf3703","Type":"ContainerDied","Data":"81b8098c2c5ed16a12d2837a5f4400b5d9941914dc48574ddc05369d5fc38dbc"}
Jul 14 18:25:58.709936 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:58.709594    2558 scope.go:117] "RemoveContainer" containerID="d64fd43be57531007d551a2d96a9ee3e4caea290795e9809bd127986c375382b"
Jul 14 18:25:58.734149 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:58.734115    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j"]
Jul 14 18:25:59.862402 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:59.862370    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j"
Jul 14 18:25:59.917463 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:59.917432    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bfd0faf-4fa7-44f8-afc4-eee22fdf3703-maas-api-service-ca\") pod \"8bfd0faf-4fa7-44f8-afc4-eee22fdf3703\" (UID: \"8bfd0faf-4fa7-44f8-afc4-eee22fdf3703\") "
Jul 14 18:25:59.917859 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:25:59.917832    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bfd0faf-4fa7-44f8-afc4-eee22fdf3703-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8bfd0faf-4fa7-44f8-afc4-eee22fdf3703" (UID: "8bfd0faf-4fa7-44f8-afc4-eee22fdf3703"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:26:00.019122 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:00.019029    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bfd0faf-4fa7-44f8-afc4-eee22fdf3703-maas-api-service-ca\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:26:00.723953 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:00.723866    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j"
Jul 14 18:26:00.723953 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:00.723885    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j" event={"ID":"8bfd0faf-4fa7-44f8-afc4-eee22fdf3703","Type":"ContainerDied","Data":"9e35b83c376d106d962536d2bfe436b24caf3ab460c14a85c1d9a0e428019c44"}
Jul 14 18:26:00.723953 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:00.723930    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e35b83c376d106d962536d2bfe436b24caf3ab460c14a85c1d9a0e428019c44"
Jul 14 18:26:00.759244 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:00.759209    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j"]
Jul 14 18:26:00.764877 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:00.764848    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-9x42j"]
Jul 14 18:26:02.442407 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:02.442368    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bfd0faf-4fa7-44f8-afc4-eee22fdf3703" path="/var/lib/kubelet/pods/8bfd0faf-4fa7-44f8-afc4-eee22fdf3703/volumes"
Jul 14 18:26:40.276795 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:40.276753    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-zfs8g"]
Jul 14 18:26:40.277233 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:40.277179    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bfd0faf-4fa7-44f8-afc4-eee22fdf3703" containerName="revoke-keys"
Jul 14 18:26:40.277233 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:40.277195    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bfd0faf-4fa7-44f8-afc4-eee22fdf3703" containerName="revoke-keys"
Jul 14 18:26:40.277233 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:40.277202    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bfd0faf-4fa7-44f8-afc4-eee22fdf3703" containerName="revoke-keys"
Jul 14 18:26:40.277233 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:40.277207    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bfd0faf-4fa7-44f8-afc4-eee22fdf3703" containerName="revoke-keys"
Jul 14 18:26:40.277233 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:40.277217    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bfd0faf-4fa7-44f8-afc4-eee22fdf3703" containerName="revoke-keys"
Jul 14 18:26:40.277233 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:40.277224    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bfd0faf-4fa7-44f8-afc4-eee22fdf3703" containerName="revoke-keys"
Jul 14 18:26:40.277422 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:40.277280    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bfd0faf-4fa7-44f8-afc4-eee22fdf3703" containerName="revoke-keys"
Jul 14 18:26:40.277422 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:40.277292    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bfd0faf-4fa7-44f8-afc4-eee22fdf3703" containerName="revoke-keys"
Jul 14 18:26:40.280367 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:40.280351    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-zfs8g"
Jul 14 18:26:40.283020 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:40.282986    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 18:26:40.283168 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:40.283046    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pp62l\""
Jul 14 18:26:40.288712 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:40.288686    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-zfs8g"]
Jul 14 18:26:40.291115 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:40.291088    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/199a97fb-2073-417e-87ba-43692437824d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d0b3d618-zfs8g\" (UID: \"199a97fb-2073-417e-87ba-43692437824d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-zfs8g"
Jul 14 18:26:40.391929 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:40.391897    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/199a97fb-2073-417e-87ba-43692437824d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d0b3d618-zfs8g\" (UID: \"199a97fb-2073-417e-87ba-43692437824d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-zfs8g"
Jul 14 18:26:40.392120 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:40.391935    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"]
Jul 14 18:26:40.392178 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:40.392143    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv" podUID="b7cb43a2-c13b-4035-9ee4-96c3e477cc45" containerName="istio-proxy" containerID="cri-o://dabdc507496106ed77343522298e81713f724663d78b27b9032d45ae61eaba22" gracePeriod=30
Jul 14 18:26:40.393033 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:40.392698    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/199a97fb-2073-417e-87ba-43692437824d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d0b3d618-zfs8g\" (UID: \"199a97fb-2073-417e-87ba-43692437824d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-zfs8g"
Jul 14 18:26:40.592010 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:40.591979    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-zfs8g"
Jul 14 18:26:40.726436 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:40.726390    2558 patch_prober.go:28] interesting pod/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 18:26:40.726642 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:40.726472    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv" podUID="b7cb43a2-c13b-4035-9ee4-96c3e477cc45" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 18:26:40.745953 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:40.745921    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-zfs8g"]
Jul 14 18:26:40.747995 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:26:40.747962    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod199a97fb_2073_417e_87ba_43692437824d.slice/crio-bf8dd846af8ba4296b957d47d271d003e2be72c4bc58cb27194517b87e947f14 WatchSource:0}: Error finding container bf8dd846af8ba4296b957d47d271d003e2be72c4bc58cb27194517b87e947f14: Status 404 returned error can't find the container with id bf8dd846af8ba4296b957d47d271d003e2be72c4bc58cb27194517b87e947f14
Jul 14 18:26:40.947552 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:40.947514    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-zfs8g" event={"ID":"199a97fb-2073-417e-87ba-43692437824d","Type":"ContainerStarted","Data":"bf8dd846af8ba4296b957d47d271d003e2be72c4bc58cb27194517b87e947f14"}
Jul 14 18:26:41.955514 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:41.955479    2558 generic.go:356] "Generic (PLEG): container finished" podID="199a97fb-2073-417e-87ba-43692437824d" containerID="61eefed40eee1c8557a0dd89d49433d41180cbf78a3fe50e39cabe1ea95d71b1" exitCode=0
Jul 14 18:26:41.955915 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:41.955540    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-zfs8g" event={"ID":"199a97fb-2073-417e-87ba-43692437824d","Type":"ContainerDied","Data":"61eefed40eee1c8557a0dd89d49433d41180cbf78a3fe50e39cabe1ea95d71b1"}
Jul 14 18:26:43.098849 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:43.098820    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-zfs8g"
Jul 14 18:26:43.116411 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:43.116378    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/199a97fb-2073-417e-87ba-43692437824d-maas-api-service-ca\") pod \"199a97fb-2073-417e-87ba-43692437824d\" (UID: \"199a97fb-2073-417e-87ba-43692437824d\") "
Jul 14 18:26:43.116798 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:43.116776    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/199a97fb-2073-417e-87ba-43692437824d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "199a97fb-2073-417e-87ba-43692437824d" (UID: "199a97fb-2073-417e-87ba-43692437824d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:26:43.217725 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:43.217628    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/199a97fb-2073-417e-87ba-43692437824d-maas-api-service-ca\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:26:43.228639 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:43.228600    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:26:43.968431 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:43.968395    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-zfs8g" event={"ID":"199a97fb-2073-417e-87ba-43692437824d","Type":"ContainerDied","Data":"bf8dd846af8ba4296b957d47d271d003e2be72c4bc58cb27194517b87e947f14"}
Jul 14 18:26:43.968632 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:43.968455    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf8dd846af8ba4296b957d47d271d003e2be72c4bc58cb27194517b87e947f14"
Jul 14 18:26:43.968632 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:43.968403    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d0b3d618-zfs8g"
Jul 14 18:26:45.651631 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.651542    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:26:45.742958 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.742923    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-token\") pod \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") "
Jul 14 18:26:45.743154 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.743002    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-data\") pod \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") "
Jul 14 18:26:45.743292 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.743166    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bv7gl\" (UniqueName: \"kubernetes.io/projected/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-kube-api-access-bv7gl\") pod \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") "
Jul 14 18:26:45.743292 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.743287    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-envoy\") pod \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") "
Jul 14 18:26:45.743409 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.743316    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-credential-socket\") pod \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") "
Jul 14 18:26:45.743409 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.743358    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-workload-socket\") pod \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") "
Jul 14 18:26:45.743409 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.743386    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istiod-ca-cert\") pod \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") "
Jul 14 18:26:45.743553 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.743410    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-workload-certs\") pod \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") "
Jul 14 18:26:45.743553 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.743449    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-podinfo\") pod \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\" (UID: \"b7cb43a2-c13b-4035-9ee4-96c3e477cc45\") "
Jul 14 18:26:45.743679 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.743586    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b7cb43a2-c13b-4035-9ee4-96c3e477cc45" (UID: "b7cb43a2-c13b-4035-9ee4-96c3e477cc45"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:26:45.743749 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.743727    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b7cb43a2-c13b-4035-9ee4-96c3e477cc45" (UID: "b7cb43a2-c13b-4035-9ee4-96c3e477cc45"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:26:45.743809 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.743794    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-credential-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:26:45.743866 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.743816    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-workload-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:26:45.743964 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.743941    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b7cb43a2-c13b-4035-9ee4-96c3e477cc45" (UID: "b7cb43a2-c13b-4035-9ee4-96c3e477cc45"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:26:45.744153 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.744033    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b7cb43a2-c13b-4035-9ee4-96c3e477cc45" (UID: "b7cb43a2-c13b-4035-9ee4-96c3e477cc45"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:26:45.744153 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.744064    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-data" (OuterVolumeSpecName: "istio-data") pod "b7cb43a2-c13b-4035-9ee4-96c3e477cc45" (UID: "b7cb43a2-c13b-4035-9ee4-96c3e477cc45"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:26:45.745670 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.745363    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-token" (OuterVolumeSpecName: "istio-token") pod "b7cb43a2-c13b-4035-9ee4-96c3e477cc45" (UID: "b7cb43a2-c13b-4035-9ee4-96c3e477cc45"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:26:45.746141 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.746110    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b7cb43a2-c13b-4035-9ee4-96c3e477cc45" (UID: "b7cb43a2-c13b-4035-9ee4-96c3e477cc45"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:26:45.746231 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.746165    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-kube-api-access-bv7gl" (OuterVolumeSpecName: "kube-api-access-bv7gl") pod "b7cb43a2-c13b-4035-9ee4-96c3e477cc45" (UID: "b7cb43a2-c13b-4035-9ee4-96c3e477cc45"). InnerVolumeSpecName "kube-api-access-bv7gl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:26:45.746231 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.746212    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b7cb43a2-c13b-4035-9ee4-96c3e477cc45" (UID: "b7cb43a2-c13b-4035-9ee4-96c3e477cc45"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 18:26:45.844623 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.844585    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-envoy\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:26:45.844623 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.844620    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istiod-ca-cert\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:26:45.844623 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.844630    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-workload-certs\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:26:45.844860 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.844637    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-podinfo\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:26:45.844860 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.844647    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-token\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:26:45.844860 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.844655    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-istio-data\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:26:45.844860 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.844663    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bv7gl\" (UniqueName: \"kubernetes.io/projected/b7cb43a2-c13b-4035-9ee4-96c3e477cc45-kube-api-access-bv7gl\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:26:45.981492 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.981404    2558 generic.go:356] "Generic (PLEG): container finished" podID="b7cb43a2-c13b-4035-9ee4-96c3e477cc45" containerID="dabdc507496106ed77343522298e81713f724663d78b27b9032d45ae61eaba22" exitCode=0
Jul 14 18:26:45.981492 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.981462    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"
Jul 14 18:26:45.981492 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.981466    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv" event={"ID":"b7cb43a2-c13b-4035-9ee4-96c3e477cc45","Type":"ContainerDied","Data":"dabdc507496106ed77343522298e81713f724663d78b27b9032d45ae61eaba22"}
Jul 14 18:26:45.981778 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.981583    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv" event={"ID":"b7cb43a2-c13b-4035-9ee4-96c3e477cc45","Type":"ContainerDied","Data":"02a697e83558aacece80efa719dff65902473c9eda99cb385e538954ea2f6558"}
Jul 14 18:26:45.981778 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.981616    2558 scope.go:117] "RemoveContainer" containerID="dabdc507496106ed77343522298e81713f724663d78b27b9032d45ae61eaba22"
Jul 14 18:26:45.991820 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:45.991799    2558 scope.go:117] "RemoveContainer" containerID="6bcb29519821da40cdfffa81393b807fb3de7b5833b8ff445cd045505008351f"
Jul 14 18:26:46.003070 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:46.003047    2558 scope.go:117] "RemoveContainer" containerID="dabdc507496106ed77343522298e81713f724663d78b27b9032d45ae61eaba22"
Jul 14 18:26:46.003595 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:26:46.003537    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dabdc507496106ed77343522298e81713f724663d78b27b9032d45ae61eaba22\": container with ID starting with dabdc507496106ed77343522298e81713f724663d78b27b9032d45ae61eaba22 not found: ID does not exist" containerID="dabdc507496106ed77343522298e81713f724663d78b27b9032d45ae61eaba22"
Jul 14 18:26:46.003796 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:46.003593    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dabdc507496106ed77343522298e81713f724663d78b27b9032d45ae61eaba22"} err="failed to get container status \"dabdc507496106ed77343522298e81713f724663d78b27b9032d45ae61eaba22\": rpc error: code = NotFound desc = could not find container \"dabdc507496106ed77343522298e81713f724663d78b27b9032d45ae61eaba22\": container with ID starting with dabdc507496106ed77343522298e81713f724663d78b27b9032d45ae61eaba22 not found: ID does not exist"
Jul 14 18:26:46.003796 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:46.003615    2558 scope.go:117] "RemoveContainer" containerID="6bcb29519821da40cdfffa81393b807fb3de7b5833b8ff445cd045505008351f"
Jul 14 18:26:46.004146 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:26:46.004112    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bcb29519821da40cdfffa81393b807fb3de7b5833b8ff445cd045505008351f\": container with ID starting with 6bcb29519821da40cdfffa81393b807fb3de7b5833b8ff445cd045505008351f not found: ID does not exist" containerID="6bcb29519821da40cdfffa81393b807fb3de7b5833b8ff445cd045505008351f"
Jul 14 18:26:46.004241 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:46.004156    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bcb29519821da40cdfffa81393b807fb3de7b5833b8ff445cd045505008351f"} err="failed to get container status \"6bcb29519821da40cdfffa81393b807fb3de7b5833b8ff445cd045505008351f\": rpc error: code = NotFound desc = could not find container \"6bcb29519821da40cdfffa81393b807fb3de7b5833b8ff445cd045505008351f\": container with ID starting with 6bcb29519821da40cdfffa81393b807fb3de7b5833b8ff445cd045505008351f not found: ID does not exist"
Jul 14 18:26:46.006640 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:46.006619    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"]
Jul 14 18:26:46.010707 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:46.010682    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-d0b3d618-gw-openshift-default-5444d5ccdc-vf2nv"]
Jul 14 18:26:46.441121 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:46.441090    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7cb43a2-c13b-4035-9ee4-96c3e477cc45" path="/var/lib/kubelet/pods/b7cb43a2-c13b-4035-9ee4-96c3e477cc45/volumes"
Jul 14 18:26:48.999736 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:48.999692    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6679f7747c-kzqct"]
Jul 14 18:26:49.000114 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.000100    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7cb43a2-c13b-4035-9ee4-96c3e477cc45" containerName="istio-proxy"
Jul 14 18:26:49.000114 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.000114    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7cb43a2-c13b-4035-9ee4-96c3e477cc45" containerName="istio-proxy"
Jul 14 18:26:49.000184 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.000124    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="199a97fb-2073-417e-87ba-43692437824d" containerName="revoke-keys"
Jul 14 18:26:49.000184 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.000130    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="199a97fb-2073-417e-87ba-43692437824d" containerName="revoke-keys"
Jul 14 18:26:49.000252 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.000208    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="199a97fb-2073-417e-87ba-43692437824d" containerName="revoke-keys"
Jul 14 18:26:49.000252 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.000219    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bfd0faf-4fa7-44f8-afc4-eee22fdf3703" containerName="revoke-keys"
Jul 14 18:26:49.000252 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.000226    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7cb43a2-c13b-4035-9ee4-96c3e477cc45" containerName="istio-proxy"
Jul 14 18:26:49.004726 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.004706    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:49.023440 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.023409    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6679f7747c-kzqct"]
Jul 14 18:26:49.072814 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.072778    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e03d454b-3f0a-4679-a6dd-39a90852e537-console-oauth-config\") pod \"console-6679f7747c-kzqct\" (UID: \"e03d454b-3f0a-4679-a6dd-39a90852e537\") " pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:49.072814 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.072815    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzkfx\" (UniqueName: \"kubernetes.io/projected/e03d454b-3f0a-4679-a6dd-39a90852e537-kube-api-access-vzkfx\") pod \"console-6679f7747c-kzqct\" (UID: \"e03d454b-3f0a-4679-a6dd-39a90852e537\") " pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:49.073047 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.072895    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e03d454b-3f0a-4679-a6dd-39a90852e537-console-serving-cert\") pod \"console-6679f7747c-kzqct\" (UID: \"e03d454b-3f0a-4679-a6dd-39a90852e537\") " pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:49.073047 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.072914    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e03d454b-3f0a-4679-a6dd-39a90852e537-oauth-serving-cert\") pod \"console-6679f7747c-kzqct\" (UID: \"e03d454b-3f0a-4679-a6dd-39a90852e537\") " pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:49.073047 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.072941    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e03d454b-3f0a-4679-a6dd-39a90852e537-console-config\") pod \"console-6679f7747c-kzqct\" (UID: \"e03d454b-3f0a-4679-a6dd-39a90852e537\") " pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:49.073047 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.072971    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e03d454b-3f0a-4679-a6dd-39a90852e537-service-ca\") pod \"console-6679f7747c-kzqct\" (UID: \"e03d454b-3f0a-4679-a6dd-39a90852e537\") " pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:49.073047 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.073002    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e03d454b-3f0a-4679-a6dd-39a90852e537-trusted-ca-bundle\") pod \"console-6679f7747c-kzqct\" (UID: \"e03d454b-3f0a-4679-a6dd-39a90852e537\") " pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:49.173966 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.173922    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e03d454b-3f0a-4679-a6dd-39a90852e537-service-ca\") pod \"console-6679f7747c-kzqct\" (UID: \"e03d454b-3f0a-4679-a6dd-39a90852e537\") " pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:49.173966 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.173972    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e03d454b-3f0a-4679-a6dd-39a90852e537-trusted-ca-bundle\") pod \"console-6679f7747c-kzqct\" (UID: \"e03d454b-3f0a-4679-a6dd-39a90852e537\") " pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:49.174246 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.174013    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e03d454b-3f0a-4679-a6dd-39a90852e537-console-oauth-config\") pod \"console-6679f7747c-kzqct\" (UID: \"e03d454b-3f0a-4679-a6dd-39a90852e537\") " pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:49.174246 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.174031    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzkfx\" (UniqueName: \"kubernetes.io/projected/e03d454b-3f0a-4679-a6dd-39a90852e537-kube-api-access-vzkfx\") pod \"console-6679f7747c-kzqct\" (UID: \"e03d454b-3f0a-4679-a6dd-39a90852e537\") " pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:49.174246 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.174079    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e03d454b-3f0a-4679-a6dd-39a90852e537-console-serving-cert\") pod \"console-6679f7747c-kzqct\" (UID: \"e03d454b-3f0a-4679-a6dd-39a90852e537\") " pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:49.174246 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.174105    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e03d454b-3f0a-4679-a6dd-39a90852e537-oauth-serving-cert\") pod \"console-6679f7747c-kzqct\" (UID: \"e03d454b-3f0a-4679-a6dd-39a90852e537\") " pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:49.174246 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.174133    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e03d454b-3f0a-4679-a6dd-39a90852e537-console-config\") pod \"console-6679f7747c-kzqct\" (UID: \"e03d454b-3f0a-4679-a6dd-39a90852e537\") " pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:49.174925 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.174885    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e03d454b-3f0a-4679-a6dd-39a90852e537-console-config\") pod \"console-6679f7747c-kzqct\" (UID: \"e03d454b-3f0a-4679-a6dd-39a90852e537\") " pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:49.175030 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.174921    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e03d454b-3f0a-4679-a6dd-39a90852e537-service-ca\") pod \"console-6679f7747c-kzqct\" (UID: \"e03d454b-3f0a-4679-a6dd-39a90852e537\") " pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:49.175030 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.174933    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e03d454b-3f0a-4679-a6dd-39a90852e537-oauth-serving-cert\") pod \"console-6679f7747c-kzqct\" (UID: \"e03d454b-3f0a-4679-a6dd-39a90852e537\") " pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:49.175339 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.175315    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e03d454b-3f0a-4679-a6dd-39a90852e537-trusted-ca-bundle\") pod \"console-6679f7747c-kzqct\" (UID: \"e03d454b-3f0a-4679-a6dd-39a90852e537\") " pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:49.176832 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.176808    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e03d454b-3f0a-4679-a6dd-39a90852e537-console-serving-cert\") pod \"console-6679f7747c-kzqct\" (UID: \"e03d454b-3f0a-4679-a6dd-39a90852e537\") " pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:49.176937 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.176856    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e03d454b-3f0a-4679-a6dd-39a90852e537-console-oauth-config\") pod \"console-6679f7747c-kzqct\" (UID: \"e03d454b-3f0a-4679-a6dd-39a90852e537\") " pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:49.190217 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.190188    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzkfx\" (UniqueName: \"kubernetes.io/projected/e03d454b-3f0a-4679-a6dd-39a90852e537-kube-api-access-vzkfx\") pod \"console-6679f7747c-kzqct\" (UID: \"e03d454b-3f0a-4679-a6dd-39a90852e537\") " pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:49.314246 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.314143    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:49.464414 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:49.464382    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6679f7747c-kzqct"]
Jul 14 18:26:49.465763 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:26:49.465739    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode03d454b_3f0a_4679_a6dd_39a90852e537.slice/crio-f90d440aaad763d77bc71ee37d47cb509cc4893e8d40b67dd11252b4004efaee WatchSource:0}: Error finding container f90d440aaad763d77bc71ee37d47cb509cc4893e8d40b67dd11252b4004efaee: Status 404 returned error can't find the container with id f90d440aaad763d77bc71ee37d47cb509cc4893e8d40b67dd11252b4004efaee
Jul 14 18:26:50.014026 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:50.013987    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6679f7747c-kzqct" event={"ID":"e03d454b-3f0a-4679-a6dd-39a90852e537","Type":"ContainerStarted","Data":"3849138a5828b99e133cd245bb97d39d8ce151152cf5a315d9827a7d4f953bff"}
Jul 14 18:26:50.014541 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:50.014065    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6679f7747c-kzqct" event={"ID":"e03d454b-3f0a-4679-a6dd-39a90852e537","Type":"ContainerStarted","Data":"f90d440aaad763d77bc71ee37d47cb509cc4893e8d40b67dd11252b4004efaee"}
Jul 14 18:26:50.034461 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:50.034403    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6679f7747c-kzqct" podStartSLOduration=2.034384872 podStartE2EDuration="2.034384872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:26:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:26:50.03344395 +0000 UTC m=+1928.138553932" watchObservedRunningTime="2026-07-14 18:26:50.034384872 +0000 UTC m=+1928.139494855"
Jul 14 18:26:52.983745 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:52.983702    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"]
Jul 14 18:26:52.984215 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:52.984199    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7cb43a2-c13b-4035-9ee4-96c3e477cc45" containerName="istio-proxy"
Jul 14 18:26:52.984268 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:52.984218    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7cb43a2-c13b-4035-9ee4-96c3e477cc45" containerName="istio-proxy"
Jul 14 18:26:52.984304 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:52.984284    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7cb43a2-c13b-4035-9ee4-96c3e477cc45" containerName="istio-proxy"
Jul 14 18:26:52.988065 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:52.988040    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:52.990671 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:52.990643    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-296e74aa-openshift-default-dockercfg-n46z7\""
Jul 14 18:26:53.003938 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.003896    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"]
Jul 14 18:26:53.110943 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.110899    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-workload-socket\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.110943 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.110945    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbdg4\" (UniqueName: \"kubernetes.io/projected/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-kube-api-access-vbdg4\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.111178 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.110980    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-workload-certs\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.111178 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.111052    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-credential-socket\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.111178 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.111121    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-podinfo\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.111302 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.111177    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istiod-ca-cert\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.111302 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.111209    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-data\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.111302 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.111242    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-token\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.111302 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.111260    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-envoy\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.212852 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.212803    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istiod-ca-cert\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.212852 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.212859    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-data\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.213095 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.212896    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-token\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.213095 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.212913    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-envoy\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.213095 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.212962    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-workload-socket\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.213095 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.212990    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbdg4\" (UniqueName: \"kubernetes.io/projected/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-kube-api-access-vbdg4\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.213095 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.213023    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-workload-certs\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.213095 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.213056    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-credential-socket\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.213377 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.213119    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-podinfo\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.213377 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.213296    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-data\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.213479 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.213395    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-workload-socket\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.213586 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.213538    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-workload-certs\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.213638 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.213542    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-credential-socket\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.213708 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.213687    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istiod-ca-cert\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.215535 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.215511    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-envoy\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.215887 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.215867    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-podinfo\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.221510 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.221486    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbdg4\" (UniqueName: \"kubernetes.io/projected/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-kube-api-access-vbdg4\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.221737 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.221714    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-token\") pod \"e2e-ait-296e74aa-openshift-default-9b7976457-6njvt\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") " pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.300536 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.300447    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:53.444879 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.444849    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"]
Jul 14 18:26:53.446986 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:26:53.446962    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd45d5ed5_e3e9_4c75_9d83_0c83116639ed.slice/crio-4df494418eb3ce25fd102b777bef9c88b855662f013fb23a62ddc44def105f47 WatchSource:0}: Error finding container 4df494418eb3ce25fd102b777bef9c88b855662f013fb23a62ddc44def105f47: Status 404 returned error can't find the container with id 4df494418eb3ce25fd102b777bef9c88b855662f013fb23a62ddc44def105f47
Jul 14 18:26:53.449119 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.449085    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:26:53.449199 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.449147    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:26:53.449199 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:53.449178    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:26:54.039737 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:54.039698    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt" event={"ID":"d45d5ed5-e3e9-4c75-9d83-0c83116639ed","Type":"ContainerStarted","Data":"2769c4a8f02c82ab4475b9fedf7bb7c0620cdf2cd92e8f85c4dfb6e62307a323"}
Jul 14 18:26:54.040119 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:54.039781    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt" event={"ID":"d45d5ed5-e3e9-4c75-9d83-0c83116639ed","Type":"ContainerStarted","Data":"4df494418eb3ce25fd102b777bef9c88b855662f013fb23a62ddc44def105f47"}
Jul 14 18:26:54.063517 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:54.063469    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt" podStartSLOduration=2.063453153 podStartE2EDuration="2.063453153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:26:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:26:54.062005466 +0000 UTC m=+1932.167115451" watchObservedRunningTime="2026-07-14 18:26:54.063453153 +0000 UTC m=+1932.168563137"
Jul 14 18:26:54.300874 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:54.300766    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:54.302467 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:54.302433    2558 patch_prober.go:28] interesting pod/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 14 18:26:54.302629 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:54.302499    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt" podUID="d45d5ed5-e3e9-4c75-9d83-0c83116639ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 14 18:26:55.305307 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:55.305263    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:56.051653 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:56.051613    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:56.052670 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:56.052646    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:26:56.705683 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:56.705637    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:26:59.314654 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:59.314611    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:59.315295 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:59.315274    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:26:59.326102 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:26:59.326067    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:27:00.079707 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:00.079676    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6679f7747c-kzqct"
Jul 14 18:27:00.142419 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:00.142372    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67c966d67-wgckh"]
Jul 14 18:27:05.105854 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:05.105815    2558 generic.go:356] "Generic (PLEG): container finished" podID="d45d5ed5-e3e9-4c75-9d83-0c83116639ed" containerID="2769c4a8f02c82ab4475b9fedf7bb7c0620cdf2cd92e8f85c4dfb6e62307a323" exitCode=0
Jul 14 18:27:05.106398 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:05.105895    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt" event={"ID":"d45d5ed5-e3e9-4c75-9d83-0c83116639ed","Type":"ContainerDied","Data":"2769c4a8f02c82ab4475b9fedf7bb7c0620cdf2cd92e8f85c4dfb6e62307a323"}
Jul 14 18:27:05.106467 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:05.106449    2558 scope.go:117] "RemoveContainer" containerID="2769c4a8f02c82ab4475b9fedf7bb7c0620cdf2cd92e8f85c4dfb6e62307a323"
Jul 14 18:27:05.107611 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:05.107545    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:27:05.107751 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:05.107662    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:27:05.107751 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:05.107713    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:27:06.117579 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:06.117505    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt" event={"ID":"d45d5ed5-e3e9-4c75-9d83-0c83116639ed","Type":"ContainerStarted","Data":"12d180b5e71295db56a27a6d9dd2c9cf99a4c3793adb1b3e375be7dc20a3b962"}
Jul 14 18:27:06.301073 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:06.301033    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:27:06.302372 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:06.302338    2558 patch_prober.go:28] interesting pod/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 14 18:27:06.302514 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:06.302403    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt" podUID="d45d5ed5-e3e9-4c75-9d83-0c83116639ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 14 18:27:07.301863 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:07.301813    2558 patch_prober.go:28] interesting pod/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 14 18:27:07.302422 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:07.301916    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt" podUID="d45d5ed5-e3e9-4c75-9d83-0c83116639ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 14 18:27:08.301046 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:08.300998    2558 patch_prober.go:28] interesting pod/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 14 18:27:08.301263 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:08.301068    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt" podUID="d45d5ed5-e3e9-4c75-9d83-0c83116639ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 14 18:27:09.301626 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:09.301582    2558 patch_prober.go:28] interesting pod/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 14 18:27:09.302156 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:09.301651    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt" podUID="d45d5ed5-e3e9-4c75-9d83-0c83116639ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 14 18:27:10.305622 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:10.305587    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:27:10.306139 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:10.305961    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:27:10.306925 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:10.306905    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:27:12.717070 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:12.717031    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:27:25.164069 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.164017    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67c966d67-wgckh" podUID="e430bd4f-2534-4678-8b24-f7dd4047e2d0" containerName="console" containerID="cri-o://2c5bb1260b6c70b7409399ea2b1953ebabde15508d93bbefd5c9aa88b4759599" gracePeriod=15
Jul 14 18:27:25.336053 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.336023    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"]
Jul 14 18:27:25.336258 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.336231    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt" podUID="d45d5ed5-e3e9-4c75-9d83-0c83116639ed" containerName="istio-proxy" containerID="cri-o://12d180b5e71295db56a27a6d9dd2c9cf99a4c3793adb1b3e375be7dc20a3b962" gracePeriod=30
Jul 14 18:27:25.443839 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.443803    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:27:25.510740 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.510701    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-oauth-serving-cert\") pod \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") "
Jul 14 18:27:25.510942 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.510757    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-service-ca\") pod \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") "
Jul 14 18:27:25.510942 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.510789    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-console-config\") pod \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") "
Jul 14 18:27:25.510942 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.510820    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfpdg\" (UniqueName: \"kubernetes.io/projected/e430bd4f-2534-4678-8b24-f7dd4047e2d0-kube-api-access-nfpdg\") pod \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") "
Jul 14 18:27:25.510942 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.510859    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e430bd4f-2534-4678-8b24-f7dd4047e2d0-console-serving-cert\") pod \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") "
Jul 14 18:27:25.511157 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.510971    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-trusted-ca-bundle\") pod \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") "
Jul 14 18:27:25.511157 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.511020    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e430bd4f-2534-4678-8b24-f7dd4047e2d0-console-oauth-config\") pod \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\" (UID: \"e430bd4f-2534-4678-8b24-f7dd4047e2d0\") "
Jul 14 18:27:25.511299 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.511172    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e430bd4f-2534-4678-8b24-f7dd4047e2d0" (UID: "e430bd4f-2534-4678-8b24-f7dd4047e2d0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:27:25.511299 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.511285    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-console-config" (OuterVolumeSpecName: "console-config") pod "e430bd4f-2534-4678-8b24-f7dd4047e2d0" (UID: "e430bd4f-2534-4678-8b24-f7dd4047e2d0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:27:25.511412 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.511298    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-service-ca" (OuterVolumeSpecName: "service-ca") pod "e430bd4f-2534-4678-8b24-f7dd4047e2d0" (UID: "e430bd4f-2534-4678-8b24-f7dd4047e2d0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:27:25.511412 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.511364    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e430bd4f-2534-4678-8b24-f7dd4047e2d0" (UID: "e430bd4f-2534-4678-8b24-f7dd4047e2d0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:27:25.513182 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.513154    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e430bd4f-2534-4678-8b24-f7dd4047e2d0-kube-api-access-nfpdg" (OuterVolumeSpecName: "kube-api-access-nfpdg") pod "e430bd4f-2534-4678-8b24-f7dd4047e2d0" (UID: "e430bd4f-2534-4678-8b24-f7dd4047e2d0"). InnerVolumeSpecName "kube-api-access-nfpdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:27:25.513302 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.513198    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e430bd4f-2534-4678-8b24-f7dd4047e2d0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e430bd4f-2534-4678-8b24-f7dd4047e2d0" (UID: "e430bd4f-2534-4678-8b24-f7dd4047e2d0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 18:27:25.513359 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.513345    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e430bd4f-2534-4678-8b24-f7dd4047e2d0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e430bd4f-2534-4678-8b24-f7dd4047e2d0" (UID: "e430bd4f-2534-4678-8b24-f7dd4047e2d0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 18:27:25.612749 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.612702    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-console-config\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:27:25.612749 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.612738    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfpdg\" (UniqueName: \"kubernetes.io/projected/e430bd4f-2534-4678-8b24-f7dd4047e2d0-kube-api-access-nfpdg\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:27:25.612749 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.612748    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e430bd4f-2534-4678-8b24-f7dd4047e2d0-console-serving-cert\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:27:25.612749 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.612758    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-trusted-ca-bundle\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:27:25.613028 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.612768    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e430bd4f-2534-4678-8b24-f7dd4047e2d0-console-oauth-config\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:27:25.613028 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.612776    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-oauth-serving-cert\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:27:25.613028 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.612786    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e430bd4f-2534-4678-8b24-f7dd4047e2d0-service-ca\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:27:25.640476 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.640426    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"]
Jul 14 18:27:25.641268 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.641236    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e430bd4f-2534-4678-8b24-f7dd4047e2d0" containerName="console"
Jul 14 18:27:25.641268 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.641266    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e430bd4f-2534-4678-8b24-f7dd4047e2d0" containerName="console"
Jul 14 18:27:25.641469 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.641375    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e430bd4f-2534-4678-8b24-f7dd4047e2d0" containerName="console"
Jul 14 18:27:25.645217 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.645198    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.647806 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.647785    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-97e17a87-openshift-default-dockercfg-m2p8q\""
Jul 14 18:27:25.656521 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.656485    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"]
Jul 14 18:27:25.713210 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.713114    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/435b8991-5dd1-446f-ad7e-34dde4453f39-istiod-ca-cert\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.713210 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.713160    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mg4r\" (UniqueName: \"kubernetes.io/projected/435b8991-5dd1-446f-ad7e-34dde4453f39-kube-api-access-9mg4r\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.713210 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.713184    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-envoy\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.713460 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.713277    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-credential-socket\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.713460 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.713333    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-workload-socket\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.713460 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.713351    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-data\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.713460 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.713372    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-podinfo\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.713460 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.713430    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-workload-certs\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.713460 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.713458    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-token\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.814682 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.814629    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-credential-socket\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.814889 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.814696    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-workload-socket\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.814889 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.814828    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-data\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.814889 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.814884    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-podinfo\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.815078 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.814939    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-workload-certs\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.815078 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.814971    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-token\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.815078 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.815002    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/435b8991-5dd1-446f-ad7e-34dde4453f39-istiod-ca-cert\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.815078 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.815051    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mg4r\" (UniqueName: \"kubernetes.io/projected/435b8991-5dd1-446f-ad7e-34dde4453f39-kube-api-access-9mg4r\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.815274 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.815079    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-envoy\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.815274 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.815091    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-workload-socket\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.815274 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.815166    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-credential-socket\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.815274 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.815191    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-data\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.815458 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.815436    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-workload-certs\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.815921 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.815898    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/435b8991-5dd1-446f-ad7e-34dde4453f39-istiod-ca-cert\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.817584 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.817548    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-envoy\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.817672 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.817644    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-podinfo\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.826528 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.826501    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-token\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.826688 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.826632    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mg4r\" (UniqueName: \"kubernetes.io/projected/435b8991-5dd1-446f-ad7e-34dde4453f39-kube-api-access-9mg4r\") pod \"e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") " pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:25.959242 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:25.959195    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:26.108914 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:26.108882    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"]
Jul 14 18:27:26.110396 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:27:26.110369    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod435b8991_5dd1_446f_ad7e_34dde4453f39.slice/crio-535a0e10d8e3ef3e95fc84fd334a42444cf284939a56a44ac9141f7bf7468465 WatchSource:0}: Error finding container 535a0e10d8e3ef3e95fc84fd334a42444cf284939a56a44ac9141f7bf7468465: Status 404 returned error can't find the container with id 535a0e10d8e3ef3e95fc84fd334a42444cf284939a56a44ac9141f7bf7468465
Jul 14 18:27:26.112573 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:26.112533    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:27:26.112644 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:26.112615    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:27:26.112686 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:26.112663    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:27:26.237311 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:26.237215    2558 generic.go:356] "Generic (PLEG): container finished" podID="e430bd4f-2534-4678-8b24-f7dd4047e2d0" containerID="2c5bb1260b6c70b7409399ea2b1953ebabde15508d93bbefd5c9aa88b4759599" exitCode=0
Jul 14 18:27:26.237311 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:26.237272    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67c966d67-wgckh"
Jul 14 18:27:26.237311 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:26.237272    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67c966d67-wgckh" event={"ID":"e430bd4f-2534-4678-8b24-f7dd4047e2d0","Type":"ContainerDied","Data":"2c5bb1260b6c70b7409399ea2b1953ebabde15508d93bbefd5c9aa88b4759599"}
Jul 14 18:27:26.237949 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:26.237358    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67c966d67-wgckh" event={"ID":"e430bd4f-2534-4678-8b24-f7dd4047e2d0","Type":"ContainerDied","Data":"007a6c380cb7cfb4c7261ee3e146618f38dc12183a61563088e222590a49d598"}
Jul 14 18:27:26.237949 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:26.237398    2558 scope.go:117] "RemoveContainer" containerID="2c5bb1260b6c70b7409399ea2b1953ebabde15508d93bbefd5c9aa88b4759599"
Jul 14 18:27:26.239764 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:26.239734    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j" event={"ID":"435b8991-5dd1-446f-ad7e-34dde4453f39","Type":"ContainerStarted","Data":"254d9607f2d713b3dcb7cb7c52ecc86ee6f06bad2d7a1227078a58f55cb37e6d"}
Jul 14 18:27:26.239898 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:26.239798    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j" event={"ID":"435b8991-5dd1-446f-ad7e-34dde4453f39","Type":"ContainerStarted","Data":"535a0e10d8e3ef3e95fc84fd334a42444cf284939a56a44ac9141f7bf7468465"}
Jul 14 18:27:26.249028 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:26.249006    2558 scope.go:117] "RemoveContainer" containerID="2c5bb1260b6c70b7409399ea2b1953ebabde15508d93bbefd5c9aa88b4759599"
Jul 14 18:27:26.249355 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:27:26.249330    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c5bb1260b6c70b7409399ea2b1953ebabde15508d93bbefd5c9aa88b4759599\": container with ID starting with 2c5bb1260b6c70b7409399ea2b1953ebabde15508d93bbefd5c9aa88b4759599 not found: ID does not exist" containerID="2c5bb1260b6c70b7409399ea2b1953ebabde15508d93bbefd5c9aa88b4759599"
Jul 14 18:27:26.249416 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:26.249370    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c5bb1260b6c70b7409399ea2b1953ebabde15508d93bbefd5c9aa88b4759599"} err="failed to get container status \"2c5bb1260b6c70b7409399ea2b1953ebabde15508d93bbefd5c9aa88b4759599\": rpc error: code = NotFound desc = could not find container \"2c5bb1260b6c70b7409399ea2b1953ebabde15508d93bbefd5c9aa88b4759599\": container with ID starting with 2c5bb1260b6c70b7409399ea2b1953ebabde15508d93bbefd5c9aa88b4759599 not found: ID does not exist"
Jul 14 18:27:26.265335 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:26.265273    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j" podStartSLOduration=1.265247906 podStartE2EDuration="1.265247906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:27:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:27:26.261996992 +0000 UTC m=+1964.367106976" watchObservedRunningTime="2026-07-14 18:27:26.265247906 +0000 UTC m=+1964.370357894"
Jul 14 18:27:26.276754 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:26.276708    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67c966d67-wgckh"]
Jul 14 18:27:26.280885 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:26.280852    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67c966d67-wgckh"]
Jul 14 18:27:26.445589 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:26.442749    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e430bd4f-2534-4678-8b24-f7dd4047e2d0" path="/var/lib/kubelet/pods/e430bd4f-2534-4678-8b24-f7dd4047e2d0/volumes"
Jul 14 18:27:26.959466 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:26.959425    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:27.964601 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:27.964549    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:28.252902 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:28.252809    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:28.253811 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:28.253789    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:30.599843 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.599766    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:27:30.659103 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.659072    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-credential-socket\") pod \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") "
Jul 14 18:27:30.659343 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.659113    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-workload-certs\") pod \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") "
Jul 14 18:27:30.659343 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.659156    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-podinfo\") pod \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") "
Jul 14 18:27:30.659343 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.659193    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-workload-socket\") pod \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") "
Jul 14 18:27:30.659343 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.659217    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-envoy\") pod \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") "
Jul 14 18:27:30.659343 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.659240    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-token\") pod \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") "
Jul 14 18:27:30.659343 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.659279    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-data\") pod \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") "
Jul 14 18:27:30.659343 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.659296    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istiod-ca-cert\") pod \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") "
Jul 14 18:27:30.659343 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.659333    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbdg4\" (UniqueName: \"kubernetes.io/projected/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-kube-api-access-vbdg4\") pod \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\" (UID: \"d45d5ed5-e3e9-4c75-9d83-0c83116639ed\") "
Jul 14 18:27:30.659814 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.659460    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d45d5ed5-e3e9-4c75-9d83-0c83116639ed" (UID: "d45d5ed5-e3e9-4c75-9d83-0c83116639ed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:27:30.659814 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.659504    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d45d5ed5-e3e9-4c75-9d83-0c83116639ed" (UID: "d45d5ed5-e3e9-4c75-9d83-0c83116639ed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:27:30.659814 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.659751    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-credential-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:27:30.659814 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.659773    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-workload-certs\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:27:30.660008 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.659859    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d45d5ed5-e3e9-4c75-9d83-0c83116639ed" (UID: "d45d5ed5-e3e9-4c75-9d83-0c83116639ed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:27:30.660076 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.660049    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d45d5ed5-e3e9-4c75-9d83-0c83116639ed" (UID: "d45d5ed5-e3e9-4c75-9d83-0c83116639ed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:27:30.660810 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.660780    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-data" (OuterVolumeSpecName: "istio-data") pod "d45d5ed5-e3e9-4c75-9d83-0c83116639ed" (UID: "d45d5ed5-e3e9-4c75-9d83-0c83116639ed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:27:30.662301 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.662273    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d45d5ed5-e3e9-4c75-9d83-0c83116639ed" (UID: "d45d5ed5-e3e9-4c75-9d83-0c83116639ed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:27:30.662434 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.662276    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-token" (OuterVolumeSpecName: "istio-token") pod "d45d5ed5-e3e9-4c75-9d83-0c83116639ed" (UID: "d45d5ed5-e3e9-4c75-9d83-0c83116639ed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:27:30.662434 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.662276    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-kube-api-access-vbdg4" (OuterVolumeSpecName: "kube-api-access-vbdg4") pod "d45d5ed5-e3e9-4c75-9d83-0c83116639ed" (UID: "d45d5ed5-e3e9-4c75-9d83-0c83116639ed"). InnerVolumeSpecName "kube-api-access-vbdg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:27:30.662672 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.662494    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d45d5ed5-e3e9-4c75-9d83-0c83116639ed" (UID: "d45d5ed5-e3e9-4c75-9d83-0c83116639ed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 18:27:30.761044 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.761009    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-podinfo\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:27:30.761044 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.761038    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-workload-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:27:30.761044 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.761050    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-envoy\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:27:30.761044 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.761057    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-token\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:27:30.761324 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.761065    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istio-data\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:27:30.761324 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.761073    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-istiod-ca-cert\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:27:30.761324 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:30.761083    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbdg4\" (UniqueName: \"kubernetes.io/projected/d45d5ed5-e3e9-4c75-9d83-0c83116639ed-kube-api-access-vbdg4\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:27:31.191501 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.191456    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6"]
Jul 14 18:27:31.191890 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.191875    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d45d5ed5-e3e9-4c75-9d83-0c83116639ed" containerName="istio-proxy"
Jul 14 18:27:31.191945 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.191892    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d45d5ed5-e3e9-4c75-9d83-0c83116639ed" containerName="istio-proxy"
Jul 14 18:27:31.191994 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.191964    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d45d5ed5-e3e9-4c75-9d83-0c83116639ed" containerName="istio-proxy"
Jul 14 18:27:31.195768 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.195743    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6"
Jul 14 18:27:31.199044 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.198991    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pp62l\""
Jul 14 18:27:31.199350 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.199333    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 18:27:31.206119 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.206093    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6"]
Jul 14 18:27:31.266068 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.266038    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/892e2335-7eb5-4b54-980d-ecd97801b65f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6\" (UID: \"892e2335-7eb5-4b54-980d-ecd97801b65f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6"
Jul 14 18:27:31.271427 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.271400    2558 generic.go:356] "Generic (PLEG): container finished" podID="d45d5ed5-e3e9-4c75-9d83-0c83116639ed" containerID="12d180b5e71295db56a27a6d9dd2c9cf99a4c3793adb1b3e375be7dc20a3b962" exitCode=0
Jul 14 18:27:31.271626 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.271452    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"
Jul 14 18:27:31.271626 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.271452    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt" event={"ID":"d45d5ed5-e3e9-4c75-9d83-0c83116639ed","Type":"ContainerDied","Data":"12d180b5e71295db56a27a6d9dd2c9cf99a4c3793adb1b3e375be7dc20a3b962"}
Jul 14 18:27:31.271626 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.271616    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt" event={"ID":"d45d5ed5-e3e9-4c75-9d83-0c83116639ed","Type":"ContainerDied","Data":"4df494418eb3ce25fd102b777bef9c88b855662f013fb23a62ddc44def105f47"}
Jul 14 18:27:31.271816 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.271656    2558 scope.go:117] "RemoveContainer" containerID="12d180b5e71295db56a27a6d9dd2c9cf99a4c3793adb1b3e375be7dc20a3b962"
Jul 14 18:27:31.282079 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.282057    2558 scope.go:117] "RemoveContainer" containerID="2769c4a8f02c82ab4475b9fedf7bb7c0620cdf2cd92e8f85c4dfb6e62307a323"
Jul 14 18:27:31.291927 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.291907    2558 scope.go:117] "RemoveContainer" containerID="12d180b5e71295db56a27a6d9dd2c9cf99a4c3793adb1b3e375be7dc20a3b962"
Jul 14 18:27:31.292212 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:27:31.292193    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12d180b5e71295db56a27a6d9dd2c9cf99a4c3793adb1b3e375be7dc20a3b962\": container with ID starting with 12d180b5e71295db56a27a6d9dd2c9cf99a4c3793adb1b3e375be7dc20a3b962 not found: ID does not exist" containerID="12d180b5e71295db56a27a6d9dd2c9cf99a4c3793adb1b3e375be7dc20a3b962"
Jul 14 18:27:31.292259 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.292224    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12d180b5e71295db56a27a6d9dd2c9cf99a4c3793adb1b3e375be7dc20a3b962"} err="failed to get container status \"12d180b5e71295db56a27a6d9dd2c9cf99a4c3793adb1b3e375be7dc20a3b962\": rpc error: code = NotFound desc = could not find container \"12d180b5e71295db56a27a6d9dd2c9cf99a4c3793adb1b3e375be7dc20a3b962\": container with ID starting with 12d180b5e71295db56a27a6d9dd2c9cf99a4c3793adb1b3e375be7dc20a3b962 not found: ID does not exist"
Jul 14 18:27:31.292259 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.292242    2558 scope.go:117] "RemoveContainer" containerID="2769c4a8f02c82ab4475b9fedf7bb7c0620cdf2cd92e8f85c4dfb6e62307a323"
Jul 14 18:27:31.292534 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:27:31.292514    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2769c4a8f02c82ab4475b9fedf7bb7c0620cdf2cd92e8f85c4dfb6e62307a323\": container with ID starting with 2769c4a8f02c82ab4475b9fedf7bb7c0620cdf2cd92e8f85c4dfb6e62307a323 not found: ID does not exist" containerID="2769c4a8f02c82ab4475b9fedf7bb7c0620cdf2cd92e8f85c4dfb6e62307a323"
Jul 14 18:27:31.292595 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.292543    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2769c4a8f02c82ab4475b9fedf7bb7c0620cdf2cd92e8f85c4dfb6e62307a323"} err="failed to get container status \"2769c4a8f02c82ab4475b9fedf7bb7c0620cdf2cd92e8f85c4dfb6e62307a323\": rpc error: code = NotFound desc = could not find container \"2769c4a8f02c82ab4475b9fedf7bb7c0620cdf2cd92e8f85c4dfb6e62307a323\": container with ID starting with 2769c4a8f02c82ab4475b9fedf7bb7c0620cdf2cd92e8f85c4dfb6e62307a323 not found: ID does not exist"
Jul 14 18:27:31.300453 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.300418    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"]
Jul 14 18:27:31.304870 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.304841    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-296e74aa-openshift-default-9b7976457-6njvt"]
Jul 14 18:27:31.367196 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.367162    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/892e2335-7eb5-4b54-980d-ecd97801b65f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6\" (UID: \"892e2335-7eb5-4b54-980d-ecd97801b65f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6"
Jul 14 18:27:31.367825 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.367804    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/892e2335-7eb5-4b54-980d-ecd97801b65f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6\" (UID: \"892e2335-7eb5-4b54-980d-ecd97801b65f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6"
Jul 14 18:27:31.508896 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.508784    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6"
Jul 14 18:27:31.661483 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:31.661442    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6"]
Jul 14 18:27:31.665955 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:27:31.665925    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod892e2335_7eb5_4b54_980d_ecd97801b65f.slice/crio-6ca3bd445b47b3b72a509803cf26e6ab6bdf7380535ea19bd27c32c0291881b6 WatchSource:0}: Error finding container 6ca3bd445b47b3b72a509803cf26e6ab6bdf7380535ea19bd27c32c0291881b6: Status 404 returned error can't find the container with id 6ca3bd445b47b3b72a509803cf26e6ab6bdf7380535ea19bd27c32c0291881b6
Jul 14 18:27:32.281943 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:32.281835    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6" event={"ID":"892e2335-7eb5-4b54-980d-ecd97801b65f","Type":"ContainerStarted","Data":"e7583be59589154639e21198f967805aa4477a1c7c62eace551bda8c6084d96c"}
Jul 14 18:27:32.281943 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:32.281906    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6" event={"ID":"892e2335-7eb5-4b54-980d-ecd97801b65f","Type":"ContainerStarted","Data":"6ca3bd445b47b3b72a509803cf26e6ab6bdf7380535ea19bd27c32c0291881b6"}
Jul 14 18:27:32.301548 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:32.301476    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6" podStartSLOduration=1.301460026 podStartE2EDuration="1.301460026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:27:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:27:32.300296146 +0000 UTC m=+1970.405406131" watchObservedRunningTime="2026-07-14 18:27:32.301460026 +0000 UTC m=+1970.406570011"
Jul 14 18:27:32.440677 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:32.440645    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d45d5ed5-e3e9-4c75-9d83-0c83116639ed" path="/var/lib/kubelet/pods/d45d5ed5-e3e9-4c75-9d83-0c83116639ed/volumes"
Jul 14 18:27:33.290433 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:33.290348    2558 generic.go:356] "Generic (PLEG): container finished" podID="892e2335-7eb5-4b54-980d-ecd97801b65f" containerID="e7583be59589154639e21198f967805aa4477a1c7c62eace551bda8c6084d96c" exitCode=7
Jul 14 18:27:33.290816 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:33.290438    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6" event={"ID":"892e2335-7eb5-4b54-980d-ecd97801b65f","Type":"ContainerDied","Data":"e7583be59589154639e21198f967805aa4477a1c7c62eace551bda8c6084d96c"}
Jul 14 18:27:33.290816 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:33.290647    2558 scope.go:117] "RemoveContainer" containerID="e7583be59589154639e21198f967805aa4477a1c7c62eace551bda8c6084d96c"
Jul 14 18:27:34.297948 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:34.297852    2558 generic.go:356] "Generic (PLEG): container finished" podID="892e2335-7eb5-4b54-980d-ecd97801b65f" containerID="2558bb5aa9d26798064c265a8c0de17c56aadac4295c6ea7b974a73a4c9e2fe9" exitCode=7
Jul 14 18:27:34.298321 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:34.297941    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6" event={"ID":"892e2335-7eb5-4b54-980d-ecd97801b65f","Type":"ContainerDied","Data":"2558bb5aa9d26798064c265a8c0de17c56aadac4295c6ea7b974a73a4c9e2fe9"}
Jul 14 18:27:34.298321 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:34.297996    2558 scope.go:117] "RemoveContainer" containerID="e7583be59589154639e21198f967805aa4477a1c7c62eace551bda8c6084d96c"
Jul 14 18:27:34.298321 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:34.298210    2558 scope.go:117] "RemoveContainer" containerID="2558bb5aa9d26798064c265a8c0de17c56aadac4295c6ea7b974a73a4c9e2fe9"
Jul 14 18:27:34.298437 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:27:34.298424    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6_odh-ai-gateway-infra(892e2335-7eb5-4b54-980d-ecd97801b65f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6" podUID="892e2335-7eb5-4b54-980d-ecd97801b65f"
Jul 14 18:27:34.906780 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:34.906740    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:27:35.308509 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:35.308485    2558 scope.go:117] "RemoveContainer" containerID="2558bb5aa9d26798064c265a8c0de17c56aadac4295c6ea7b974a73a4c9e2fe9"
Jul 14 18:27:35.308972 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:27:35.308707    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6_odh-ai-gateway-infra(892e2335-7eb5-4b54-980d-ecd97801b65f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6" podUID="892e2335-7eb5-4b54-980d-ecd97801b65f"
Jul 14 18:27:43.254603 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:43.254546    2558 patch_prober.go:28] interesting pod/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 14 18:27:43.255014 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:43.254620    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j" podUID="435b8991-5dd1-446f-ad7e-34dde4453f39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 14 18:27:43.362541 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:43.362505    2558 generic.go:356] "Generic (PLEG): container finished" podID="435b8991-5dd1-446f-ad7e-34dde4453f39" containerID="254d9607f2d713b3dcb7cb7c52ecc86ee6f06bad2d7a1227078a58f55cb37e6d" exitCode=0
Jul 14 18:27:43.362541 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:43.362545    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j" event={"ID":"435b8991-5dd1-446f-ad7e-34dde4453f39","Type":"ContainerDied","Data":"254d9607f2d713b3dcb7cb7c52ecc86ee6f06bad2d7a1227078a58f55cb37e6d"}
Jul 14 18:27:43.362942 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:43.362926    2558 scope.go:117] "RemoveContainer" containerID="254d9607f2d713b3dcb7cb7c52ecc86ee6f06bad2d7a1227078a58f55cb37e6d"
Jul 14 18:27:43.363931 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:43.363889    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:27:43.364050 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:43.363963    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:27:43.364050 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:43.364005    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:27:44.369997 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:44.369961    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j" event={"ID":"435b8991-5dd1-446f-ad7e-34dde4453f39","Type":"ContainerStarted","Data":"390dbe1af3dadb293f991ca3b799f57e4d50347c0c0730208ac91e586513ccce"}
Jul 14 18:27:44.960070 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:44.960029    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:44.960277 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:44.960255    2558 patch_prober.go:28] interesting pod/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 14 18:27:44.960340 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:44.960320    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j" podUID="435b8991-5dd1-446f-ad7e-34dde4453f39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 14 18:27:45.960010 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:45.959973    2558 patch_prober.go:28] interesting pod/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 14 18:27:45.960402 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:45.960035    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j" podUID="435b8991-5dd1-446f-ad7e-34dde4453f39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 14 18:27:46.960054 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:46.960021    2558 patch_prober.go:28] interesting pod/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 14 18:27:46.960411 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:46.960086    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j" podUID="435b8991-5dd1-446f-ad7e-34dde4453f39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 14 18:27:47.434878 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:47.434840    2558 scope.go:117] "RemoveContainer" containerID="2558bb5aa9d26798064c265a8c0de17c56aadac4295c6ea7b974a73a4c9e2fe9"
Jul 14 18:27:47.959632 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:47.959595    2558 patch_prober.go:28] interesting pod/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 14 18:27:47.959834 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:47.959657    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j" podUID="435b8991-5dd1-446f-ad7e-34dde4453f39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 14 18:27:48.394378 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:48.394342    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6" event={"ID":"892e2335-7eb5-4b54-980d-ecd97801b65f","Type":"ContainerStarted","Data":"f8faaaca8bb42f5a60a40af48a5e10e3b87817729d48b1e7d73a0364d4adf3c3"}
Jul 14 18:27:48.964483 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:48.964452    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:48.964778 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:48.964755    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:48.965519 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:48.965498    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:27:49.402616 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:49.402579    2558 generic.go:356] "Generic (PLEG): container finished" podID="892e2335-7eb5-4b54-980d-ecd97801b65f" containerID="f8faaaca8bb42f5a60a40af48a5e10e3b87817729d48b1e7d73a0364d4adf3c3" exitCode=0
Jul 14 18:27:49.403091 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:49.402632    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6" event={"ID":"892e2335-7eb5-4b54-980d-ecd97801b65f","Type":"ContainerDied","Data":"f8faaaca8bb42f5a60a40af48a5e10e3b87817729d48b1e7d73a0364d4adf3c3"}
Jul 14 18:27:49.403091 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:49.402719    2558 scope.go:117] "RemoveContainer" containerID="2558bb5aa9d26798064c265a8c0de17c56aadac4295c6ea7b974a73a4c9e2fe9"
Jul 14 18:27:49.432164 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:49.432127    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6"]
Jul 14 18:27:50.554698 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:50.554674    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6"
Jul 14 18:27:50.653236 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:50.653206    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/892e2335-7eb5-4b54-980d-ecd97801b65f-maas-api-service-ca\") pod \"892e2335-7eb5-4b54-980d-ecd97801b65f\" (UID: \"892e2335-7eb5-4b54-980d-ecd97801b65f\") "
Jul 14 18:27:50.653614 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:50.653591    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/892e2335-7eb5-4b54-980d-ecd97801b65f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "892e2335-7eb5-4b54-980d-ecd97801b65f" (UID: "892e2335-7eb5-4b54-980d-ecd97801b65f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:27:50.753924 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:50.753830    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/892e2335-7eb5-4b54-980d-ecd97801b65f-maas-api-service-ca\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:27:51.418607 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:51.418545    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6" event={"ID":"892e2335-7eb5-4b54-980d-ecd97801b65f","Type":"ContainerDied","Data":"6ca3bd445b47b3b72a509803cf26e6ab6bdf7380535ea19bd27c32c0291881b6"}
Jul 14 18:27:51.418788 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:51.418631    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ca3bd445b47b3b72a509803cf26e6ab6bdf7380535ea19bd27c32c0291881b6"
Jul 14 18:27:51.418788 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:51.418577    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6"
Jul 14 18:27:51.460920 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:51.460886    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6"]
Jul 14 18:27:51.463123 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:51.463101    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-bh4d6"]
Jul 14 18:27:52.440673 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:27:52.440638    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="892e2335-7eb5-4b54-980d-ecd97801b65f" path="/var/lib/kubelet/pods/892e2335-7eb5-4b54-980d-ecd97801b65f/volumes"
Jul 14 18:28:31.244800 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:31.244754    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-nxkr7"]
Jul 14 18:28:31.245236 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:31.245192    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="892e2335-7eb5-4b54-980d-ecd97801b65f" containerName="revoke-keys"
Jul 14 18:28:31.245236 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:31.245204    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="892e2335-7eb5-4b54-980d-ecd97801b65f" containerName="revoke-keys"
Jul 14 18:28:31.245236 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:31.245223    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="892e2335-7eb5-4b54-980d-ecd97801b65f" containerName="revoke-keys"
Jul 14 18:28:31.245236 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:31.245228    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="892e2335-7eb5-4b54-980d-ecd97801b65f" containerName="revoke-keys"
Jul 14 18:28:31.245370 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:31.245243    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d45d5ed5-e3e9-4c75-9d83-0c83116639ed" containerName="istio-proxy"
Jul 14 18:28:31.245370 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:31.245249    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d45d5ed5-e3e9-4c75-9d83-0c83116639ed" containerName="istio-proxy"
Jul 14 18:28:31.245370 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:31.245260    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="892e2335-7eb5-4b54-980d-ecd97801b65f" containerName="revoke-keys"
Jul 14 18:28:31.245370 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:31.245268    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="892e2335-7eb5-4b54-980d-ecd97801b65f" containerName="revoke-keys"
Jul 14 18:28:31.245370 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:31.245323    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="892e2335-7eb5-4b54-980d-ecd97801b65f" containerName="revoke-keys"
Jul 14 18:28:31.245370 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:31.245334    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d45d5ed5-e3e9-4c75-9d83-0c83116639ed" containerName="istio-proxy"
Jul 14 18:28:31.245370 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:31.245348    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="892e2335-7eb5-4b54-980d-ecd97801b65f" containerName="revoke-keys"
Jul 14 18:28:31.247729 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:31.247711    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-nxkr7"
Jul 14 18:28:31.250715 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:31.250694    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pp62l\""
Jul 14 18:28:31.250850 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:31.250735    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 18:28:31.257536 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:31.257507    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-nxkr7"]
Jul 14 18:28:31.323547 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:31.323512    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3247dec9-03cc-40b9-aa97-6c1ee0e082ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97e17a87-nxkr7\" (UID: \"3247dec9-03cc-40b9-aa97-6c1ee0e082ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-nxkr7"
Jul 14 18:28:31.424368 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:31.424324    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3247dec9-03cc-40b9-aa97-6c1ee0e082ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97e17a87-nxkr7\" (UID: \"3247dec9-03cc-40b9-aa97-6c1ee0e082ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-nxkr7"
Jul 14 18:28:31.425007 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:31.424988    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3247dec9-03cc-40b9-aa97-6c1ee0e082ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97e17a87-nxkr7\" (UID: \"3247dec9-03cc-40b9-aa97-6c1ee0e082ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-nxkr7"
Jul 14 18:28:31.559260 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:31.559155    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-nxkr7"
Jul 14 18:28:31.702332 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:31.702300    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-nxkr7"]
Jul 14 18:28:31.703601 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:28:31.703550    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3247dec9_03cc_40b9_aa97_6c1ee0e082ea.slice/crio-a5a30b34317418d5e368681eda7273b8fd6d57e4ccef2df8f36f84c467abf56f WatchSource:0}: Error finding container a5a30b34317418d5e368681eda7273b8fd6d57e4ccef2df8f36f84c467abf56f: Status 404 returned error can't find the container with id a5a30b34317418d5e368681eda7273b8fd6d57e4ccef2df8f36f84c467abf56f
Jul 14 18:28:32.653261 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:32.653225    2558 generic.go:356] "Generic (PLEG): container finished" podID="3247dec9-03cc-40b9-aa97-6c1ee0e082ea" containerID="80b9bd07576870c31728bb1068b307ead58478ba7ab1361319a807ef35153b27" exitCode=0
Jul 14 18:28:32.653658 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:32.653308    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-nxkr7" event={"ID":"3247dec9-03cc-40b9-aa97-6c1ee0e082ea","Type":"ContainerDied","Data":"80b9bd07576870c31728bb1068b307ead58478ba7ab1361319a807ef35153b27"}
Jul 14 18:28:32.653658 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:32.653360    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-nxkr7" event={"ID":"3247dec9-03cc-40b9-aa97-6c1ee0e082ea","Type":"ContainerStarted","Data":"a5a30b34317418d5e368681eda7273b8fd6d57e4ccef2df8f36f84c467abf56f"}
Jul 14 18:28:33.801320 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:33.801298    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-nxkr7"
Jul 14 18:28:33.847098 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:33.847064    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3247dec9-03cc-40b9-aa97-6c1ee0e082ea-maas-api-service-ca\") pod \"3247dec9-03cc-40b9-aa97-6c1ee0e082ea\" (UID: \"3247dec9-03cc-40b9-aa97-6c1ee0e082ea\") "
Jul 14 18:28:33.847441 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:33.847419    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3247dec9-03cc-40b9-aa97-6c1ee0e082ea-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3247dec9-03cc-40b9-aa97-6c1ee0e082ea" (UID: "3247dec9-03cc-40b9-aa97-6c1ee0e082ea"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:28:33.947859 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:33.947761    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3247dec9-03cc-40b9-aa97-6c1ee0e082ea-maas-api-service-ca\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:28:34.667621 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:34.667589    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-nxkr7"
Jul 14 18:28:34.667811 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:34.667585    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97e17a87-nxkr7" event={"ID":"3247dec9-03cc-40b9-aa97-6c1ee0e082ea","Type":"ContainerDied","Data":"a5a30b34317418d5e368681eda7273b8fd6d57e4ccef2df8f36f84c467abf56f"}
Jul 14 18:28:34.667811 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:34.667729    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5a30b34317418d5e368681eda7273b8fd6d57e4ccef2df8f36f84c467abf56f"
Jul 14 18:28:44.711278 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:44.711241    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:28:56.527062 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:56.527017    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"]
Jul 14 18:28:56.527680 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:28:56.527291    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j" podUID="435b8991-5dd1-446f-ad7e-34dde4453f39" containerName="istio-proxy" containerID="cri-o://390dbe1af3dadb293f991ca3b799f57e4d50347c0c0730208ac91e586513ccce" gracePeriod=30
Jul 14 18:29:01.784918 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.784880    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:29:01.829552 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.829453    2558 generic.go:356] "Generic (PLEG): container finished" podID="435b8991-5dd1-446f-ad7e-34dde4453f39" containerID="390dbe1af3dadb293f991ca3b799f57e4d50347c0c0730208ac91e586513ccce" exitCode=0
Jul 14 18:29:01.829552 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.829536    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"
Jul 14 18:29:01.829809 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.829533    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j" event={"ID":"435b8991-5dd1-446f-ad7e-34dde4453f39","Type":"ContainerDied","Data":"390dbe1af3dadb293f991ca3b799f57e4d50347c0c0730208ac91e586513ccce"}
Jul 14 18:29:01.829809 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.829691    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j" event={"ID":"435b8991-5dd1-446f-ad7e-34dde4453f39","Type":"ContainerDied","Data":"535a0e10d8e3ef3e95fc84fd334a42444cf284939a56a44ac9141f7bf7468465"}
Jul 14 18:29:01.829809 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.829716    2558 scope.go:117] "RemoveContainer" containerID="390dbe1af3dadb293f991ca3b799f57e4d50347c0c0730208ac91e586513ccce"
Jul 14 18:29:01.840911 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.840889    2558 scope.go:117] "RemoveContainer" containerID="254d9607f2d713b3dcb7cb7c52ecc86ee6f06bad2d7a1227078a58f55cb37e6d"
Jul 14 18:29:01.854061 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.854029    2558 scope.go:117] "RemoveContainer" containerID="390dbe1af3dadb293f991ca3b799f57e4d50347c0c0730208ac91e586513ccce"
Jul 14 18:29:01.854465 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:29:01.854438    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"390dbe1af3dadb293f991ca3b799f57e4d50347c0c0730208ac91e586513ccce\": container with ID starting with 390dbe1af3dadb293f991ca3b799f57e4d50347c0c0730208ac91e586513ccce not found: ID does not exist" containerID="390dbe1af3dadb293f991ca3b799f57e4d50347c0c0730208ac91e586513ccce"
Jul 14 18:29:01.854668 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.854475    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"390dbe1af3dadb293f991ca3b799f57e4d50347c0c0730208ac91e586513ccce"} err="failed to get container status \"390dbe1af3dadb293f991ca3b799f57e4d50347c0c0730208ac91e586513ccce\": rpc error: code = NotFound desc = could not find container \"390dbe1af3dadb293f991ca3b799f57e4d50347c0c0730208ac91e586513ccce\": container with ID starting with 390dbe1af3dadb293f991ca3b799f57e4d50347c0c0730208ac91e586513ccce not found: ID does not exist"
Jul 14 18:29:01.854668 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.854500    2558 scope.go:117] "RemoveContainer" containerID="254d9607f2d713b3dcb7cb7c52ecc86ee6f06bad2d7a1227078a58f55cb37e6d"
Jul 14 18:29:01.854926 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:29:01.854897    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"254d9607f2d713b3dcb7cb7c52ecc86ee6f06bad2d7a1227078a58f55cb37e6d\": container with ID starting with 254d9607f2d713b3dcb7cb7c52ecc86ee6f06bad2d7a1227078a58f55cb37e6d not found: ID does not exist" containerID="254d9607f2d713b3dcb7cb7c52ecc86ee6f06bad2d7a1227078a58f55cb37e6d"
Jul 14 18:29:01.855033 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.854935    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"254d9607f2d713b3dcb7cb7c52ecc86ee6f06bad2d7a1227078a58f55cb37e6d"} err="failed to get container status \"254d9607f2d713b3dcb7cb7c52ecc86ee6f06bad2d7a1227078a58f55cb37e6d\": rpc error: code = NotFound desc = could not find container \"254d9607f2d713b3dcb7cb7c52ecc86ee6f06bad2d7a1227078a58f55cb37e6d\": container with ID starting with 254d9607f2d713b3dcb7cb7c52ecc86ee6f06bad2d7a1227078a58f55cb37e6d not found: ID does not exist"
Jul 14 18:29:01.903263 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.903212    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mg4r\" (UniqueName: \"kubernetes.io/projected/435b8991-5dd1-446f-ad7e-34dde4453f39-kube-api-access-9mg4r\") pod \"435b8991-5dd1-446f-ad7e-34dde4453f39\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") "
Jul 14 18:29:01.903458 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.903283    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-credential-socket\") pod \"435b8991-5dd1-446f-ad7e-34dde4453f39\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") "
Jul 14 18:29:01.903458 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.903301    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-workload-socket\") pod \"435b8991-5dd1-446f-ad7e-34dde4453f39\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") "
Jul 14 18:29:01.903458 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.903322    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-podinfo\") pod \"435b8991-5dd1-446f-ad7e-34dde4453f39\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") "
Jul 14 18:29:01.903458 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.903344    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-data\") pod \"435b8991-5dd1-446f-ad7e-34dde4453f39\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") "
Jul 14 18:29:01.903458 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.903364    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-workload-certs\") pod \"435b8991-5dd1-446f-ad7e-34dde4453f39\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") "
Jul 14 18:29:01.903458 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.903392    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-envoy\") pod \"435b8991-5dd1-446f-ad7e-34dde4453f39\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") "
Jul 14 18:29:01.903458 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.903422    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/435b8991-5dd1-446f-ad7e-34dde4453f39-istiod-ca-cert\") pod \"435b8991-5dd1-446f-ad7e-34dde4453f39\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") "
Jul 14 18:29:01.903458 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.903458    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-token\") pod \"435b8991-5dd1-446f-ad7e-34dde4453f39\" (UID: \"435b8991-5dd1-446f-ad7e-34dde4453f39\") "
Jul 14 18:29:01.903899 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.903664    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "435b8991-5dd1-446f-ad7e-34dde4453f39" (UID: "435b8991-5dd1-446f-ad7e-34dde4453f39"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:29:01.903899 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.903811    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "435b8991-5dd1-446f-ad7e-34dde4453f39" (UID: "435b8991-5dd1-446f-ad7e-34dde4453f39"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:29:01.903899 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.903821    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "435b8991-5dd1-446f-ad7e-34dde4453f39" (UID: "435b8991-5dd1-446f-ad7e-34dde4453f39"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:29:01.903899 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.903869    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-workload-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:29:01.904135 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.904109    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/435b8991-5dd1-446f-ad7e-34dde4453f39-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "435b8991-5dd1-446f-ad7e-34dde4453f39" (UID: "435b8991-5dd1-446f-ad7e-34dde4453f39"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:29:01.904453 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.904409    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-data" (OuterVolumeSpecName: "istio-data") pod "435b8991-5dd1-446f-ad7e-34dde4453f39" (UID: "435b8991-5dd1-446f-ad7e-34dde4453f39"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:29:01.905931 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.905905    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-token" (OuterVolumeSpecName: "istio-token") pod "435b8991-5dd1-446f-ad7e-34dde4453f39" (UID: "435b8991-5dd1-446f-ad7e-34dde4453f39"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:29:01.906026 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.905976    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "435b8991-5dd1-446f-ad7e-34dde4453f39" (UID: "435b8991-5dd1-446f-ad7e-34dde4453f39"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:29:01.906227 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.906211    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "435b8991-5dd1-446f-ad7e-34dde4453f39" (UID: "435b8991-5dd1-446f-ad7e-34dde4453f39"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 18:29:01.906271 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:01.906226    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/435b8991-5dd1-446f-ad7e-34dde4453f39-kube-api-access-9mg4r" (OuterVolumeSpecName: "kube-api-access-9mg4r") pod "435b8991-5dd1-446f-ad7e-34dde4453f39" (UID: "435b8991-5dd1-446f-ad7e-34dde4453f39"). InnerVolumeSpecName "kube-api-access-9mg4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:29:02.004796 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:02.004744    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-token\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:29:02.004796 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:02.004785    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mg4r\" (UniqueName: \"kubernetes.io/projected/435b8991-5dd1-446f-ad7e-34dde4453f39-kube-api-access-9mg4r\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:29:02.004796 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:02.004797    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-credential-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:29:02.004796 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:02.004806    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-podinfo\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:29:02.005086 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:02.004817    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-data\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:29:02.005086 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:02.004850    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-workload-certs\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:29:02.005086 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:02.004861    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/435b8991-5dd1-446f-ad7e-34dde4453f39-istio-envoy\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:29:02.005086 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:02.004869    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/435b8991-5dd1-446f-ad7e-34dde4453f39-istiod-ca-cert\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:29:02.155823 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:02.155787    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"]
Jul 14 18:29:02.164251 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:02.164223    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-97e17a87-openshift-default-7b968c6575-mmg8j"]
Jul 14 18:29:02.441297 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:02.441212    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="435b8991-5dd1-446f-ad7e-34dde4453f39" path="/var/lib/kubelet/pods/435b8991-5dd1-446f-ad7e-34dde4453f39/volumes"
Jul 14 18:29:42.507053 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:42.507020    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 18:29:42.510317 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:29:42.510291    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 18:30:00.147397 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:00.147355    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734230-s7jf7"]
Jul 14 18:30:00.147916 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:00.147786    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="435b8991-5dd1-446f-ad7e-34dde4453f39" containerName="istio-proxy"
Jul 14 18:30:00.147916 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:00.147801    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="435b8991-5dd1-446f-ad7e-34dde4453f39" containerName="istio-proxy"
Jul 14 18:30:00.147916 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:00.147811    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3247dec9-03cc-40b9-aa97-6c1ee0e082ea" containerName="revoke-keys"
Jul 14 18:30:00.147916 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:00.147816    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3247dec9-03cc-40b9-aa97-6c1ee0e082ea" containerName="revoke-keys"
Jul 14 18:30:00.147916 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:00.147822    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="435b8991-5dd1-446f-ad7e-34dde4453f39" containerName="istio-proxy"
Jul 14 18:30:00.147916 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:00.147828    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="435b8991-5dd1-446f-ad7e-34dde4453f39" containerName="istio-proxy"
Jul 14 18:30:00.147916 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:00.147888    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="435b8991-5dd1-446f-ad7e-34dde4453f39" containerName="istio-proxy"
Jul 14 18:30:00.147916 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:00.147895    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3247dec9-03cc-40b9-aa97-6c1ee0e082ea" containerName="revoke-keys"
Jul 14 18:30:00.147916 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:00.147903    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="435b8991-5dd1-446f-ad7e-34dde4453f39" containerName="istio-proxy"
Jul 14 18:30:00.147916 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:00.147910    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="892e2335-7eb5-4b54-980d-ecd97801b65f" containerName="revoke-keys"
Jul 14 18:30:00.151132 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:00.151105    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734230-s7jf7"
Jul 14 18:30:00.153841 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:00.153820    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pp62l\""
Jul 14 18:30:00.160214 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:00.160194    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734230-s7jf7"]
Jul 14 18:30:00.162817 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:00.162799    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734230-s7jf7"
Jul 14 18:30:00.303999 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:00.303967    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734230-s7jf7"]
Jul 14 18:30:00.305635 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:30:00.305602    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af4cd92_c3ac_4cc1_9368_afd70d0b98df.slice/crio-8b51c2ca6374966ea03aa21307fca065f2c3d2cbcbbc825576d58b33e314e04c WatchSource:0}: Error finding container 8b51c2ca6374966ea03aa21307fca065f2c3d2cbcbbc825576d58b33e314e04c: Status 404 returned error can't find the container with id 8b51c2ca6374966ea03aa21307fca065f2c3d2cbcbbc825576d58b33e314e04c
Jul 14 18:30:01.161646 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:01.161610    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734230-s7jf7" event={"ID":"7af4cd92-c3ac-4cc1-9368-afd70d0b98df","Type":"ContainerStarted","Data":"970d755664ab9f5e57582dabc5e7576e6ba76052ec41098735d8b5b2204ef998"}
Jul 14 18:30:01.162059 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:01.161676    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734230-s7jf7" event={"ID":"7af4cd92-c3ac-4cc1-9368-afd70d0b98df","Type":"ContainerStarted","Data":"8b51c2ca6374966ea03aa21307fca065f2c3d2cbcbbc825576d58b33e314e04c"}
Jul 14 18:30:01.179391 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:01.179340    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734230-s7jf7" podStartSLOduration=1.179325088 podStartE2EDuration="1.179325088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:30:01.177607208 +0000 UTC m=+2119.282717189" watchObservedRunningTime="2026-07-14 18:30:01.179325088 +0000 UTC m=+2119.284435071"
Jul 14 18:30:02.168456 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:02.168420    2558 generic.go:356] "Generic (PLEG): container finished" podID="7af4cd92-c3ac-4cc1-9368-afd70d0b98df" containerID="970d755664ab9f5e57582dabc5e7576e6ba76052ec41098735d8b5b2204ef998" exitCode=0
Jul 14 18:30:02.168918 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:02.168520    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734230-s7jf7" event={"ID":"7af4cd92-c3ac-4cc1-9368-afd70d0b98df","Type":"ContainerDied","Data":"970d755664ab9f5e57582dabc5e7576e6ba76052ec41098735d8b5b2204ef998"}
Jul 14 18:30:03.315053 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:03.315028    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734230-s7jf7"
Jul 14 18:30:04.182427 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:04.182386    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734230-s7jf7"
Jul 14 18:30:04.182427 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:04.182409    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734230-s7jf7" event={"ID":"7af4cd92-c3ac-4cc1-9368-afd70d0b98df","Type":"ContainerDied","Data":"8b51c2ca6374966ea03aa21307fca065f2c3d2cbcbbc825576d58b33e314e04c"}
Jul 14 18:30:04.182684 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:04.182490    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b51c2ca6374966ea03aa21307fca065f2c3d2cbcbbc825576d58b33e314e04c"
Jul 14 18:30:20.308057 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:20.308021    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:30:27.624805 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:27.624767    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:30:34.717073 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:34.716981    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:30:34.999407 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:34.999324    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"]
Jul 14 18:30:34.999940 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:34.999910    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7af4cd92-c3ac-4cc1-9368-afd70d0b98df" containerName="cleanup"
Jul 14 18:30:34.999940 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:34.999940    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7af4cd92-c3ac-4cc1-9368-afd70d0b98df" containerName="cleanup"
Jul 14 18:30:35.000123 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.000061    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7af4cd92-c3ac-4cc1-9368-afd70d0b98df" containerName="cleanup"
Jul 14 18:30:35.003860 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.003829    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.006362 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.006341    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-c1e47003-openshift-default-dockercfg-nq7dc\""
Jul 14 18:30:35.015931 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.015899    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"]
Jul 14 18:30:35.077113 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.077057    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-credential-socket\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.077311 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.077127    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-envoy\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.077311 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.077223    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-token\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.077311 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.077270    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld2tn\" (UniqueName: \"kubernetes.io/projected/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-kube-api-access-ld2tn\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.077499 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.077366    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-podinfo\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.077499 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.077399    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istiod-ca-cert\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.077499 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.077459    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-workload-socket\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.077701 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.077513    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-workload-certs\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.077701 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.077541    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-data\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.178317 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.178271    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-podinfo\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.178317 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.178317    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istiod-ca-cert\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.178612 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.178355    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-workload-socket\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.178612 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.178385    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-workload-certs\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.178612 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.178411    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-data\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.178612 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.178441    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-credential-socket\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.178612 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.178474    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-envoy\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.178612 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.178525    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-token\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.178612 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.178596    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld2tn\" (UniqueName: \"kubernetes.io/projected/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-kube-api-access-ld2tn\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.178998 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.178965    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-workload-certs\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.179068 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.179052    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-workload-socket\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.179146 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.179119    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istiod-ca-cert\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.179208 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.179159    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-credential-socket\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.179266 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.179208    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-data\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.180912 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.180886    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-envoy\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.181179 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.181162    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-podinfo\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.188292 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.188271    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-token\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.188504 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.188485    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld2tn\" (UniqueName: \"kubernetes.io/projected/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-kube-api-access-ld2tn\") pod \"e2e-mt-c1e47003-openshift-default-98f974795-c6lr6\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") " pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.314754 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.314656    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:35.474134 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.474102    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"]
Jul 14 18:30:35.475997 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:30:35.475967    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58f9cf81_59ca_4849_8f0e_a9ff89ebda76.slice/crio-f86a30850d6b8b98d2defe7cb0de4fb4d5b7b414b66267ec9d0513ec7996922e WatchSource:0}: Error finding container f86a30850d6b8b98d2defe7cb0de4fb4d5b7b414b66267ec9d0513ec7996922e: Status 404 returned error can't find the container with id f86a30850d6b8b98d2defe7cb0de4fb4d5b7b414b66267ec9d0513ec7996922e
Jul 14 18:30:35.478243 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.478204    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:30:35.478328 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.478275    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:30:35.478328 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:35.478304    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:30:36.366545 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:36.366506    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6" event={"ID":"58f9cf81-59ca-4849-8f0e-a9ff89ebda76","Type":"ContainerStarted","Data":"2fc8e37332d407fc2d169ad381cdb567482b887494fb5f5063ee8e10939316bf"}
Jul 14 18:30:36.366937 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:36.366572    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6" event={"ID":"58f9cf81-59ca-4849-8f0e-a9ff89ebda76","Type":"ContainerStarted","Data":"f86a30850d6b8b98d2defe7cb0de4fb4d5b7b414b66267ec9d0513ec7996922e"}
Jul 14 18:30:36.395717 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:36.395661    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6" podStartSLOduration=2.395643792 podStartE2EDuration="2.395643792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:30:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:30:36.39288216 +0000 UTC m=+2154.497992141" watchObservedRunningTime="2026-07-14 18:30:36.395643792 +0000 UTC m=+2154.500753776"
Jul 14 18:30:37.315510 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:37.315465    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:37.320587 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:37.320545    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:37.372353 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:37.372323    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:37.373250 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:37.373230    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:44.512659 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:44.512625    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:30:50.457480 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:50.457435    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c1e47003-rkch6"]
Jul 14 18:30:50.461340 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:50.461317    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c1e47003-rkch6"
Jul 14 18:30:50.464732 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:50.464702    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pp62l\""
Jul 14 18:30:50.464880 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:50.464703    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 18:30:50.474613 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:50.474545    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c1e47003-rkch6"]
Jul 14 18:30:50.639978 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:50.639941    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c13277ae-2a42-4b76-a212-d70b784614e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c1e47003-rkch6\" (UID: \"c13277ae-2a42-4b76-a212-d70b784614e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c1e47003-rkch6"
Jul 14 18:30:50.741346 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:50.741240    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c13277ae-2a42-4b76-a212-d70b784614e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c1e47003-rkch6\" (UID: \"c13277ae-2a42-4b76-a212-d70b784614e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c1e47003-rkch6"
Jul 14 18:30:50.741989 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:50.741962    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c13277ae-2a42-4b76-a212-d70b784614e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c1e47003-rkch6\" (UID: \"c13277ae-2a42-4b76-a212-d70b784614e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c1e47003-rkch6"
Jul 14 18:30:50.773342 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:50.773304    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c1e47003-rkch6"
Jul 14 18:30:50.933904 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:50.933870    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c1e47003-rkch6"]
Jul 14 18:30:50.935731 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:30:50.935700    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc13277ae_2a42_4b76_a212_d70b784614e5.slice/crio-ee1a6a40cc855b78cc1e2c7e444d2212c1396d0fd776ca2a79bf30145e499160 WatchSource:0}: Error finding container ee1a6a40cc855b78cc1e2c7e444d2212c1396d0fd776ca2a79bf30145e499160: Status 404 returned error can't find the container with id ee1a6a40cc855b78cc1e2c7e444d2212c1396d0fd776ca2a79bf30145e499160
Jul 14 18:30:51.457592 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:51.457463    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c1e47003-rkch6" event={"ID":"c13277ae-2a42-4b76-a212-d70b784614e5","Type":"ContainerStarted","Data":"36a2efa729a66f389ca5f42c98709c0251310bcf338a984bddfafc7563b6e28e"}
Jul 14 18:30:51.457592 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:51.457522    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c1e47003-rkch6" event={"ID":"c13277ae-2a42-4b76-a212-d70b784614e5","Type":"ContainerStarted","Data":"ee1a6a40cc855b78cc1e2c7e444d2212c1396d0fd776ca2a79bf30145e499160"}
Jul 14 18:30:51.475749 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:51.475702    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c1e47003-rkch6" podStartSLOduration=1.475685478 podStartE2EDuration="1.475685478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:30:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:30:51.474423323 +0000 UTC m=+2169.579533306" watchObservedRunningTime="2026-07-14 18:30:51.475685478 +0000 UTC m=+2169.580795491"
Jul 14 18:30:52.465549 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:52.465514    2558 generic.go:356] "Generic (PLEG): container finished" podID="c13277ae-2a42-4b76-a212-d70b784614e5" containerID="36a2efa729a66f389ca5f42c98709c0251310bcf338a984bddfafc7563b6e28e" exitCode=0
Jul 14 18:30:52.467882 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:52.465604    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c1e47003-rkch6" event={"ID":"c13277ae-2a42-4b76-a212-d70b784614e5","Type":"ContainerDied","Data":"36a2efa729a66f389ca5f42c98709c0251310bcf338a984bddfafc7563b6e28e"}
Jul 14 18:30:52.511175 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:52.511138    2558 patch_prober.go:28] interesting pod/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": read tcp 10.134.0.2:45382->10.134.0.56:15021: read: connection reset by peer" start-of-body=
Jul 14 18:30:52.511323 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:52.511212    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6" podUID="58f9cf81-59ca-4849-8f0e-a9ff89ebda76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": read tcp 10.134.0.2:45382->10.134.0.56:15021: read: connection reset by peer"
Jul 14 18:30:53.472525 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:53.472491    2558 generic.go:356] "Generic (PLEG): container finished" podID="58f9cf81-59ca-4849-8f0e-a9ff89ebda76" containerID="2fc8e37332d407fc2d169ad381cdb567482b887494fb5f5063ee8e10939316bf" exitCode=0
Jul 14 18:30:53.473006 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:53.472580    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6" event={"ID":"58f9cf81-59ca-4849-8f0e-a9ff89ebda76","Type":"ContainerDied","Data":"2fc8e37332d407fc2d169ad381cdb567482b887494fb5f5063ee8e10939316bf"}
Jul 14 18:30:53.473473 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:53.473202    2558 scope.go:117] "RemoveContainer" containerID="2fc8e37332d407fc2d169ad381cdb567482b887494fb5f5063ee8e10939316bf"
Jul 14 18:30:53.474314 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:53.474277    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:30:53.474425 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:53.474365    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:30:53.474425 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:53.474415    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:30:53.639426 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:53.639401    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c1e47003-rkch6"
Jul 14 18:30:53.767596 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:53.767473    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c13277ae-2a42-4b76-a212-d70b784614e5-maas-api-service-ca\") pod \"c13277ae-2a42-4b76-a212-d70b784614e5\" (UID: \"c13277ae-2a42-4b76-a212-d70b784614e5\") "
Jul 14 18:30:53.767867 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:53.767844    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c13277ae-2a42-4b76-a212-d70b784614e5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c13277ae-2a42-4b76-a212-d70b784614e5" (UID: "c13277ae-2a42-4b76-a212-d70b784614e5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:30:53.868969 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:53.868936    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c13277ae-2a42-4b76-a212-d70b784614e5-maas-api-service-ca\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:30:54.479659 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:54.479617    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6" event={"ID":"58f9cf81-59ca-4849-8f0e-a9ff89ebda76","Type":"ContainerStarted","Data":"a205b425ddb6fb3e69f2e5ebb1984f5670d7198ab1aa7a51f7574a0a7fa1f09e"}
Jul 14 18:30:54.480976 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:54.480958    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c1e47003-rkch6"
Jul 14 18:30:54.481091 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:54.480954    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c1e47003-rkch6" event={"ID":"c13277ae-2a42-4b76-a212-d70b784614e5","Type":"ContainerDied","Data":"ee1a6a40cc855b78cc1e2c7e444d2212c1396d0fd776ca2a79bf30145e499160"}
Jul 14 18:30:54.481091 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:54.481089    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee1a6a40cc855b78cc1e2c7e444d2212c1396d0fd776ca2a79bf30145e499160"
Jul 14 18:30:55.315497 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:55.315456    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:55.315959 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:55.315870    2558 patch_prober.go:28] interesting pod/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 14 18:30:55.316119 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:55.316095    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6" podUID="58f9cf81-59ca-4849-8f0e-a9ff89ebda76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 14 18:30:56.315683 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:56.315635    2558 patch_prober.go:28] interesting pod/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 14 18:30:56.316208 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:56.315708    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6" podUID="58f9cf81-59ca-4849-8f0e-a9ff89ebda76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 14 18:30:57.315834 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:57.315792    2558 patch_prober.go:28] interesting pod/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 14 18:30:57.316431 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:57.316398    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6" podUID="58f9cf81-59ca-4849-8f0e-a9ff89ebda76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 14 18:30:58.315775 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:58.315734    2558 patch_prober.go:28] interesting pod/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 14 18:30:58.316071 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:58.316042    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6" podUID="58f9cf81-59ca-4849-8f0e-a9ff89ebda76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 14 18:30:59.318584 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:59.318538    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:59.318995 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:59.318943    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:30:59.319779 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:30:59.319762    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:31:03.420415 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:03.420376    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:31:16.252627 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:16.252591    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"]
Jul 14 18:31:16.253185 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:16.252815    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6" podUID="58f9cf81-59ca-4849-8f0e-a9ff89ebda76" containerName="istio-proxy" containerID="cri-o://a205b425ddb6fb3e69f2e5ebb1984f5670d7198ab1aa7a51f7574a0a7fa1f09e" gracePeriod=30
Jul 14 18:31:21.517096 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.517065    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:31:21.614184 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.614146    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-credential-socket\") pod \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") "
Jul 14 18:31:21.614390 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.614200    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istiod-ca-cert\") pod \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") "
Jul 14 18:31:21.614390 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.614222    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-token\") pod \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") "
Jul 14 18:31:21.614390 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.614242    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-envoy\") pod \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") "
Jul 14 18:31:21.614390 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.614269    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-data\") pod \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") "
Jul 14 18:31:21.614390 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.614312    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-workload-socket\") pod \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") "
Jul 14 18:31:21.614726 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.614446    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-podinfo\") pod \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") "
Jul 14 18:31:21.614726 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.614485    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "58f9cf81-59ca-4849-8f0e-a9ff89ebda76" (UID: "58f9cf81-59ca-4849-8f0e-a9ff89ebda76"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:31:21.614726 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.614542    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ld2tn\" (UniqueName: \"kubernetes.io/projected/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-kube-api-access-ld2tn\") pod \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") "
Jul 14 18:31:21.614726 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.614606    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-workload-certs\") pod \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\" (UID: \"58f9cf81-59ca-4849-8f0e-a9ff89ebda76\") "
Jul 14 18:31:21.614926 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.614769    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "58f9cf81-59ca-4849-8f0e-a9ff89ebda76" (UID: "58f9cf81-59ca-4849-8f0e-a9ff89ebda76"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:31:21.615020 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.614921    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-credential-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:31:21.615081 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.615048    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istiod-ca-cert\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:31:21.615081 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.614998    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "58f9cf81-59ca-4849-8f0e-a9ff89ebda76" (UID: "58f9cf81-59ca-4849-8f0e-a9ff89ebda76"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:31:21.615081 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.615015    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "58f9cf81-59ca-4849-8f0e-a9ff89ebda76" (UID: "58f9cf81-59ca-4849-8f0e-a9ff89ebda76"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:31:21.615615 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.615592    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-data" (OuterVolumeSpecName: "istio-data") pod "58f9cf81-59ca-4849-8f0e-a9ff89ebda76" (UID: "58f9cf81-59ca-4849-8f0e-a9ff89ebda76"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:31:21.616900 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.616869    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "58f9cf81-59ca-4849-8f0e-a9ff89ebda76" (UID: "58f9cf81-59ca-4849-8f0e-a9ff89ebda76"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 18:31:21.616900 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.616891    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-kube-api-access-ld2tn" (OuterVolumeSpecName: "kube-api-access-ld2tn") pod "58f9cf81-59ca-4849-8f0e-a9ff89ebda76" (UID: "58f9cf81-59ca-4849-8f0e-a9ff89ebda76"). InnerVolumeSpecName "kube-api-access-ld2tn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:31:21.617291 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.617272    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "58f9cf81-59ca-4849-8f0e-a9ff89ebda76" (UID: "58f9cf81-59ca-4849-8f0e-a9ff89ebda76"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:31:21.617356 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.617284    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-token" (OuterVolumeSpecName: "istio-token") pod "58f9cf81-59ca-4849-8f0e-a9ff89ebda76" (UID: "58f9cf81-59ca-4849-8f0e-a9ff89ebda76"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:31:21.652531 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.652494    2558 generic.go:356] "Generic (PLEG): container finished" podID="58f9cf81-59ca-4849-8f0e-a9ff89ebda76" containerID="a205b425ddb6fb3e69f2e5ebb1984f5670d7198ab1aa7a51f7574a0a7fa1f09e" exitCode=0
Jul 14 18:31:21.652727 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.652550    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"
Jul 14 18:31:21.652727 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.652598    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6" event={"ID":"58f9cf81-59ca-4849-8f0e-a9ff89ebda76","Type":"ContainerDied","Data":"a205b425ddb6fb3e69f2e5ebb1984f5670d7198ab1aa7a51f7574a0a7fa1f09e"}
Jul 14 18:31:21.652727 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.652673    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6" event={"ID":"58f9cf81-59ca-4849-8f0e-a9ff89ebda76","Type":"ContainerDied","Data":"f86a30850d6b8b98d2defe7cb0de4fb4d5b7b414b66267ec9d0513ec7996922e"}
Jul 14 18:31:21.652727 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.652704    2558 scope.go:117] "RemoveContainer" containerID="a205b425ddb6fb3e69f2e5ebb1984f5670d7198ab1aa7a51f7574a0a7fa1f09e"
Jul 14 18:31:21.663792 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.663773    2558 scope.go:117] "RemoveContainer" containerID="2fc8e37332d407fc2d169ad381cdb567482b887494fb5f5063ee8e10939316bf"
Jul 14 18:31:21.672524 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.672503    2558 scope.go:117] "RemoveContainer" containerID="a205b425ddb6fb3e69f2e5ebb1984f5670d7198ab1aa7a51f7574a0a7fa1f09e"
Jul 14 18:31:21.672842 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:31:21.672816    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a205b425ddb6fb3e69f2e5ebb1984f5670d7198ab1aa7a51f7574a0a7fa1f09e\": container with ID starting with a205b425ddb6fb3e69f2e5ebb1984f5670d7198ab1aa7a51f7574a0a7fa1f09e not found: ID does not exist" containerID="a205b425ddb6fb3e69f2e5ebb1984f5670d7198ab1aa7a51f7574a0a7fa1f09e"
Jul 14 18:31:21.672909 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.672856    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a205b425ddb6fb3e69f2e5ebb1984f5670d7198ab1aa7a51f7574a0a7fa1f09e"} err="failed to get container status \"a205b425ddb6fb3e69f2e5ebb1984f5670d7198ab1aa7a51f7574a0a7fa1f09e\": rpc error: code = NotFound desc = could not find container \"a205b425ddb6fb3e69f2e5ebb1984f5670d7198ab1aa7a51f7574a0a7fa1f09e\": container with ID starting with a205b425ddb6fb3e69f2e5ebb1984f5670d7198ab1aa7a51f7574a0a7fa1f09e not found: ID does not exist"
Jul 14 18:31:21.672909 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.672882    2558 scope.go:117] "RemoveContainer" containerID="2fc8e37332d407fc2d169ad381cdb567482b887494fb5f5063ee8e10939316bf"
Jul 14 18:31:21.673156 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:31:21.673139    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fc8e37332d407fc2d169ad381cdb567482b887494fb5f5063ee8e10939316bf\": container with ID starting with 2fc8e37332d407fc2d169ad381cdb567482b887494fb5f5063ee8e10939316bf not found: ID does not exist" containerID="2fc8e37332d407fc2d169ad381cdb567482b887494fb5f5063ee8e10939316bf"
Jul 14 18:31:21.673199 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.673162    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fc8e37332d407fc2d169ad381cdb567482b887494fb5f5063ee8e10939316bf"} err="failed to get container status \"2fc8e37332d407fc2d169ad381cdb567482b887494fb5f5063ee8e10939316bf\": rpc error: code = NotFound desc = could not find container \"2fc8e37332d407fc2d169ad381cdb567482b887494fb5f5063ee8e10939316bf\": container with ID starting with 2fc8e37332d407fc2d169ad381cdb567482b887494fb5f5063ee8e10939316bf not found: ID does not exist"
Jul 14 18:31:21.680788 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.680749    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"]
Jul 14 18:31:21.684497 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.684476    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-c1e47003-openshift-default-98f974795-c6lr6"]
Jul 14 18:31:21.716102 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.716069    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-data\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:31:21.716102 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.716101    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-workload-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:31:21.716102 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.716110    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-podinfo\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:31:21.716311 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.716119    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ld2tn\" (UniqueName: \"kubernetes.io/projected/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-kube-api-access-ld2tn\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:31:21.716311 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.716130    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-workload-certs\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:31:21.716311 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.716138    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-token\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:31:21.716311 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:21.716145    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58f9cf81-59ca-4849-8f0e-a9ff89ebda76-istio-envoy\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:31:22.440866 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:22.440786    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58f9cf81-59ca-4849-8f0e-a9ff89ebda76" path="/var/lib/kubelet/pods/58f9cf81-59ca-4849-8f0e-a9ff89ebda76/volumes"
Jul 14 18:31:37.408965 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.408927    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"]
Jul 14 18:31:37.409595 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.409497    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c13277ae-2a42-4b76-a212-d70b784614e5" containerName="revoke-keys"
Jul 14 18:31:37.409595 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.409520    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c13277ae-2a42-4b76-a212-d70b784614e5" containerName="revoke-keys"
Jul 14 18:31:37.409595 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.409533    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58f9cf81-59ca-4849-8f0e-a9ff89ebda76" containerName="istio-proxy"
Jul 14 18:31:37.409595 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.409542    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="58f9cf81-59ca-4849-8f0e-a9ff89ebda76" containerName="istio-proxy"
Jul 14 18:31:37.409595 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.409582    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58f9cf81-59ca-4849-8f0e-a9ff89ebda76" containerName="istio-proxy"
Jul 14 18:31:37.409595 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.409591    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="58f9cf81-59ca-4849-8f0e-a9ff89ebda76" containerName="istio-proxy"
Jul 14 18:31:37.409917 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.409704    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c13277ae-2a42-4b76-a212-d70b784614e5" containerName="revoke-keys"
Jul 14 18:31:37.409917 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.409719    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="58f9cf81-59ca-4849-8f0e-a9ff89ebda76" containerName="istio-proxy"
Jul 14 18:31:37.414841 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.414817    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.418742 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.418713    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-31aded09-openshift-default-dockercfg-qr5g2\""
Jul 14 18:31:37.435970 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.435943    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"]
Jul 14 18:31:37.561532 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.561494    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-credential-socket\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.561532 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.561532    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istiod-ca-cert\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.561809 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.561587    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-workload-socket\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.561809 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.561655    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-token\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.561809 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.561680    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-data\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.561809 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.561715    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-workload-certs\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.561809 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.561730    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-envoy\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.562017 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.561838    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-podinfo\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.562017 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.561857    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zwv7\" (UniqueName: \"kubernetes.io/projected/540ae6a6-ca60-4ed1-b00b-021e21e33cef-kube-api-access-9zwv7\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.662867 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.662768    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-credential-socket\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.662867 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.662812    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istiod-ca-cert\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.662867 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.662835    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-workload-socket\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.663149 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.662873    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-token\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.663149 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.662891    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-data\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.663149 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.662918    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-workload-certs\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.663149 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.662934    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-envoy\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.663149 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.662957    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-podinfo\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.663149 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.662972    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zwv7\" (UniqueName: \"kubernetes.io/projected/540ae6a6-ca60-4ed1-b00b-021e21e33cef-kube-api-access-9zwv7\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.663438 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.663269    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-credential-socket\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.663438 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.663321    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-data\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.663438 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.663405    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-workload-certs\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.663597 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.663549    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-workload-socket\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.663687 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.663667    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istiod-ca-cert\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.665518 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.665496    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-envoy\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.665686 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.665668    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-podinfo\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.677532 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.677498    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zwv7\" (UniqueName: \"kubernetes.io/projected/540ae6a6-ca60-4ed1-b00b-021e21e33cef-kube-api-access-9zwv7\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.679878 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.679856    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-token\") pod \"e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") " pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.725058 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.725021    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:37.889780 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.889745    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"]
Jul 14 18:31:37.892001 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:31:37.891976    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod540ae6a6_ca60_4ed1_b00b_021e21e33cef.slice/crio-3cfb3a2400999e05a91d560115198dd1de523923a4e686113449713b4f84e082 WatchSource:0}: Error finding container 3cfb3a2400999e05a91d560115198dd1de523923a4e686113449713b4f84e082: Status 404 returned error can't find the container with id 3cfb3a2400999e05a91d560115198dd1de523923a4e686113449713b4f84e082
Jul 14 18:31:37.894116 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.894079    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:31:37.894212 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.894148    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:31:37.894212 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:37.894176    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:31:38.752092 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:38.752055    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk" event={"ID":"540ae6a6-ca60-4ed1-b00b-021e21e33cef","Type":"ContainerStarted","Data":"4c5b6b8f430b8428c57af4a3852989a9d2e082ff5933c82c35b06f895c651b05"}
Jul 14 18:31:38.752496 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:38.752114    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk" event={"ID":"540ae6a6-ca60-4ed1-b00b-021e21e33cef","Type":"ContainerStarted","Data":"3cfb3a2400999e05a91d560115198dd1de523923a4e686113449713b4f84e082"}
Jul 14 18:31:38.778814 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:38.778759    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk" podStartSLOduration=1.778743032 podStartE2EDuration="1.778743032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:31:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:31:38.776114436 +0000 UTC m=+2216.881224421" watchObservedRunningTime="2026-07-14 18:31:38.778743032 +0000 UTC m=+2216.883853016"
Jul 14 18:31:39.726029 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:39.725987    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:39.730997 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:39.730968    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:39.759899 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:39.759856    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:39.760774 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:39.760754    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:46.720619 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:46.720581    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:31:54.762050 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:54.761962    2558 patch_prober.go:28] interesting pod/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 14 18:31:54.762050 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:54.762033    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk" podUID="540ae6a6-ca60-4ed1-b00b-021e21e33cef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 14 18:31:54.865902 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:54.865871    2558 generic.go:356] "Generic (PLEG): container finished" podID="540ae6a6-ca60-4ed1-b00b-021e21e33cef" containerID="4c5b6b8f430b8428c57af4a3852989a9d2e082ff5933c82c35b06f895c651b05" exitCode=0
Jul 14 18:31:54.866096 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:54.865948    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk" event={"ID":"540ae6a6-ca60-4ed1-b00b-021e21e33cef","Type":"ContainerDied","Data":"4c5b6b8f430b8428c57af4a3852989a9d2e082ff5933c82c35b06f895c651b05"}
Jul 14 18:31:54.866376 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:54.866362    2558 scope.go:117] "RemoveContainer" containerID="4c5b6b8f430b8428c57af4a3852989a9d2e082ff5933c82c35b06f895c651b05"
Jul 14 18:31:54.867443 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:54.867417    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:31:54.867502 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:54.867486    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:31:54.867540 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:54.867517    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:31:55.874432 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:55.874390    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk" event={"ID":"540ae6a6-ca60-4ed1-b00b-021e21e33cef","Type":"ContainerStarted","Data":"94c74544b56f7a457013313edf135058166c942273441e6bf7ada86195e7f432"}
Jul 14 18:31:56.725272 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:56.725228    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:31:56.725522 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:56.725500    2558 patch_prober.go:28] interesting pod/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 14 18:31:56.725648 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:56.725553    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk" podUID="540ae6a6-ca60-4ed1-b00b-021e21e33cef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 14 18:31:57.226318 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:57.226269    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:31:57.726389 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:57.726355    2558 patch_prober.go:28] interesting pod/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 14 18:31:57.726610 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:57.726411    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk" podUID="540ae6a6-ca60-4ed1-b00b-021e21e33cef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 14 18:31:58.726041 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:58.725995    2558 patch_prober.go:28] interesting pod/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 14 18:31:58.726611 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:58.726070    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk" podUID="540ae6a6-ca60-4ed1-b00b-021e21e33cef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 14 18:31:59.726171 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:59.726137    2558 patch_prober.go:28] interesting pod/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 14 18:31:59.726582 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:31:59.726194    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk" podUID="540ae6a6-ca60-4ed1-b00b-021e21e33cef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 14 18:32:00.729921 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:00.729890    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:32:00.730363 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:00.730226    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:32:00.730985 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:00.730968    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:32:22.836758 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:22.836718    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:32:29.254853 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:29.254813    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31aded09-sxrws"]
Jul 14 18:32:29.255327 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:29.255260    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="58f9cf81-59ca-4849-8f0e-a9ff89ebda76" containerName="istio-proxy"
Jul 14 18:32:29.257499 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:29.257478    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31aded09-sxrws"
Jul 14 18:32:29.261137 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:29.261116    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pp62l\""
Jul 14 18:32:29.261260 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:29.261124    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 18:32:29.274275 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:29.274247    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31aded09-sxrws"]
Jul 14 18:32:29.438588 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:29.438521    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb40f63d-f704-4059-a993-02336448b8a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-31aded09-sxrws\" (UID: \"bb40f63d-f704-4059-a993-02336448b8a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31aded09-sxrws"
Jul 14 18:32:29.540011 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:29.539913    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb40f63d-f704-4059-a993-02336448b8a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-31aded09-sxrws\" (UID: \"bb40f63d-f704-4059-a993-02336448b8a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31aded09-sxrws"
Jul 14 18:32:29.540632 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:29.540611    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb40f63d-f704-4059-a993-02336448b8a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-31aded09-sxrws\" (UID: \"bb40f63d-f704-4059-a993-02336448b8a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31aded09-sxrws"
Jul 14 18:32:29.568386 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:29.568353    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31aded09-sxrws"
Jul 14 18:32:29.727032 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:29.726997    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31aded09-sxrws"]
Jul 14 18:32:29.728475 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:32:29.728432    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb40f63d_f704_4059_a993_02336448b8a0.slice/crio-9afc0eff41517813a4d38469dcd03fe9208069a3eb41cc48f4e45313923cffa5 WatchSource:0}: Error finding container 9afc0eff41517813a4d38469dcd03fe9208069a3eb41cc48f4e45313923cffa5: Status 404 returned error can't find the container with id 9afc0eff41517813a4d38469dcd03fe9208069a3eb41cc48f4e45313923cffa5
Jul 14 18:32:30.080023 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:30.079926    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31aded09-sxrws" event={"ID":"bb40f63d-f704-4059-a993-02336448b8a0","Type":"ContainerStarted","Data":"8420ccf8f34d0113aeccd7115b55917d83fc2f74633e72096ed22a467dc65088"}
Jul 14 18:32:30.080023 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:30.079993    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31aded09-sxrws" event={"ID":"bb40f63d-f704-4059-a993-02336448b8a0","Type":"ContainerStarted","Data":"9afc0eff41517813a4d38469dcd03fe9208069a3eb41cc48f4e45313923cffa5"}
Jul 14 18:32:30.119921 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:30.119862    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31aded09-sxrws" podStartSLOduration=1.119843093 podStartE2EDuration="1.119843093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:32:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:32:30.116888153 +0000 UTC m=+2268.221998161" watchObservedRunningTime="2026-07-14 18:32:30.119843093 +0000 UTC m=+2268.224953079"
Jul 14 18:32:31.086849 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:31.086813    2558 generic.go:356] "Generic (PLEG): container finished" podID="bb40f63d-f704-4059-a993-02336448b8a0" containerID="8420ccf8f34d0113aeccd7115b55917d83fc2f74633e72096ed22a467dc65088" exitCode=0
Jul 14 18:32:31.086849 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:31.086852    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31aded09-sxrws" event={"ID":"bb40f63d-f704-4059-a993-02336448b8a0","Type":"ContainerDied","Data":"8420ccf8f34d0113aeccd7115b55917d83fc2f74633e72096ed22a467dc65088"}
Jul 14 18:32:32.225364 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:32.225337    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31aded09-sxrws"
Jul 14 18:32:32.368352 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:32.368262    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb40f63d-f704-4059-a993-02336448b8a0-maas-api-service-ca\") pod \"bb40f63d-f704-4059-a993-02336448b8a0\" (UID: \"bb40f63d-f704-4059-a993-02336448b8a0\") "
Jul 14 18:32:32.368725 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:32.368702    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb40f63d-f704-4059-a993-02336448b8a0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bb40f63d-f704-4059-a993-02336448b8a0" (UID: "bb40f63d-f704-4059-a993-02336448b8a0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:32:32.469942 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:32.469905    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb40f63d-f704-4059-a993-02336448b8a0-maas-api-service-ca\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:32:33.099382 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:33.099345    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31aded09-sxrws"
Jul 14 18:32:33.099582 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:33.099377    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31aded09-sxrws" event={"ID":"bb40f63d-f704-4059-a993-02336448b8a0","Type":"ContainerDied","Data":"9afc0eff41517813a4d38469dcd03fe9208069a3eb41cc48f4e45313923cffa5"}
Jul 14 18:32:33.099582 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:33.099429    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9afc0eff41517813a4d38469dcd03fe9208069a3eb41cc48f4e45313923cffa5"
Jul 14 18:32:42.589121 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:42.589088    2558 scope.go:117] "RemoveContainer" containerID="81b8098c2c5ed16a12d2837a5f4400b5d9941914dc48574ddc05369d5fc38dbc"
Jul 14 18:32:43.245526 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:32:43.245491    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:33:46.705996 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:46.705950    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"]
Jul 14 18:33:46.706522 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:46.706168    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk" podUID="540ae6a6-ca60-4ed1-b00b-021e21e33cef" containerName="istio-proxy" containerID="cri-o://94c74544b56f7a457013313edf135058166c942273441e6bf7ada86195e7f432" gracePeriod=30
Jul 14 18:33:50.444237 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:50.444200    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:33:51.968822 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:51.968751    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:33:52.057151 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.057103    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zwv7\" (UniqueName: \"kubernetes.io/projected/540ae6a6-ca60-4ed1-b00b-021e21e33cef-kube-api-access-9zwv7\") pod \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") "
Jul 14 18:33:52.057151 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.057140    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-credential-socket\") pod \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") "
Jul 14 18:33:52.057151 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.057157    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-envoy\") pod \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") "
Jul 14 18:33:52.057436 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.057223    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-workload-certs\") pod \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") "
Jul 14 18:33:52.057436 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.057273    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-data\") pod \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") "
Jul 14 18:33:52.057436 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.057304    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-podinfo\") pod \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") "
Jul 14 18:33:52.057436 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.057329    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-token\") pod \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") "
Jul 14 18:33:52.057436 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.057362    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istiod-ca-cert\") pod \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") "
Jul 14 18:33:52.057436 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.057388    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-workload-socket\") pod \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\" (UID: \"540ae6a6-ca60-4ed1-b00b-021e21e33cef\") "
Jul 14 18:33:52.057887 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.057456    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "540ae6a6-ca60-4ed1-b00b-021e21e33cef" (UID: "540ae6a6-ca60-4ed1-b00b-021e21e33cef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:33:52.057887 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.057676    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "540ae6a6-ca60-4ed1-b00b-021e21e33cef" (UID: "540ae6a6-ca60-4ed1-b00b-021e21e33cef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:33:52.057887 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.057721    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-credential-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:33:52.057887 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.057717    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "540ae6a6-ca60-4ed1-b00b-021e21e33cef" (UID: "540ae6a6-ca60-4ed1-b00b-021e21e33cef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:33:52.058091 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.057965    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "540ae6a6-ca60-4ed1-b00b-021e21e33cef" (UID: "540ae6a6-ca60-4ed1-b00b-021e21e33cef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:33:52.058426 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.058385    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-data" (OuterVolumeSpecName: "istio-data") pod "540ae6a6-ca60-4ed1-b00b-021e21e33cef" (UID: "540ae6a6-ca60-4ed1-b00b-021e21e33cef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:33:52.059574 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.059540    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "540ae6a6-ca60-4ed1-b00b-021e21e33cef" (UID: "540ae6a6-ca60-4ed1-b00b-021e21e33cef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:33:52.060011 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.059979    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-token" (OuterVolumeSpecName: "istio-token") pod "540ae6a6-ca60-4ed1-b00b-021e21e33cef" (UID: "540ae6a6-ca60-4ed1-b00b-021e21e33cef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:33:52.060108 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.060037    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/540ae6a6-ca60-4ed1-b00b-021e21e33cef-kube-api-access-9zwv7" (OuterVolumeSpecName: "kube-api-access-9zwv7") pod "540ae6a6-ca60-4ed1-b00b-021e21e33cef" (UID: "540ae6a6-ca60-4ed1-b00b-021e21e33cef"). InnerVolumeSpecName "kube-api-access-9zwv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:33:52.060309 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.060290    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "540ae6a6-ca60-4ed1-b00b-021e21e33cef" (UID: "540ae6a6-ca60-4ed1-b00b-021e21e33cef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 18:33:52.158886 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.158847    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zwv7\" (UniqueName: \"kubernetes.io/projected/540ae6a6-ca60-4ed1-b00b-021e21e33cef-kube-api-access-9zwv7\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:33:52.158886 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.158883    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-envoy\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:33:52.159090 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.158896    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-workload-certs\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:33:52.159090 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.158908    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-data\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:33:52.159090 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.158917    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-podinfo\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:33:52.159090 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.158924    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istio-token\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:33:52.159090 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.158932    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/540ae6a6-ca60-4ed1-b00b-021e21e33cef-istiod-ca-cert\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:33:52.159090 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.158939    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/540ae6a6-ca60-4ed1-b00b-021e21e33cef-workload-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:33:52.550517 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.550479    2558 generic.go:356] "Generic (PLEG): container finished" podID="540ae6a6-ca60-4ed1-b00b-021e21e33cef" containerID="94c74544b56f7a457013313edf135058166c942273441e6bf7ada86195e7f432" exitCode=0
Jul 14 18:33:52.550699 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.550532    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"
Jul 14 18:33:52.550699 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.550581    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk" event={"ID":"540ae6a6-ca60-4ed1-b00b-021e21e33cef","Type":"ContainerDied","Data":"94c74544b56f7a457013313edf135058166c942273441e6bf7ada86195e7f432"}
Jul 14 18:33:52.550699 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.550641    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk" event={"ID":"540ae6a6-ca60-4ed1-b00b-021e21e33cef","Type":"ContainerDied","Data":"3cfb3a2400999e05a91d560115198dd1de523923a4e686113449713b4f84e082"}
Jul 14 18:33:52.550699 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.550666    2558 scope.go:117] "RemoveContainer" containerID="94c74544b56f7a457013313edf135058166c942273441e6bf7ada86195e7f432"
Jul 14 18:33:52.560425 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.560402    2558 scope.go:117] "RemoveContainer" containerID="4c5b6b8f430b8428c57af4a3852989a9d2e082ff5933c82c35b06f895c651b05"
Jul 14 18:33:52.569410 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.569388    2558 scope.go:117] "RemoveContainer" containerID="94c74544b56f7a457013313edf135058166c942273441e6bf7ada86195e7f432"
Jul 14 18:33:52.569737 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:33:52.569709    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94c74544b56f7a457013313edf135058166c942273441e6bf7ada86195e7f432\": container with ID starting with 94c74544b56f7a457013313edf135058166c942273441e6bf7ada86195e7f432 not found: ID does not exist" containerID="94c74544b56f7a457013313edf135058166c942273441e6bf7ada86195e7f432"
Jul 14 18:33:52.569814 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.569740    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94c74544b56f7a457013313edf135058166c942273441e6bf7ada86195e7f432"} err="failed to get container status \"94c74544b56f7a457013313edf135058166c942273441e6bf7ada86195e7f432\": rpc error: code = NotFound desc = could not find container \"94c74544b56f7a457013313edf135058166c942273441e6bf7ada86195e7f432\": container with ID starting with 94c74544b56f7a457013313edf135058166c942273441e6bf7ada86195e7f432 not found: ID does not exist"
Jul 14 18:33:52.569814 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.569761    2558 scope.go:117] "RemoveContainer" containerID="4c5b6b8f430b8428c57af4a3852989a9d2e082ff5933c82c35b06f895c651b05"
Jul 14 18:33:52.570007 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:33:52.569988    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c5b6b8f430b8428c57af4a3852989a9d2e082ff5933c82c35b06f895c651b05\": container with ID starting with 4c5b6b8f430b8428c57af4a3852989a9d2e082ff5933c82c35b06f895c651b05 not found: ID does not exist" containerID="4c5b6b8f430b8428c57af4a3852989a9d2e082ff5933c82c35b06f895c651b05"
Jul 14 18:33:52.570061 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.570013    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c5b6b8f430b8428c57af4a3852989a9d2e082ff5933c82c35b06f895c651b05"} err="failed to get container status \"4c5b6b8f430b8428c57af4a3852989a9d2e082ff5933c82c35b06f895c651b05\": rpc error: code = NotFound desc = could not find container \"4c5b6b8f430b8428c57af4a3852989a9d2e082ff5933c82c35b06f895c651b05\": container with ID starting with 4c5b6b8f430b8428c57af4a3852989a9d2e082ff5933c82c35b06f895c651b05 not found: ID does not exist"
Jul 14 18:33:52.574515 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.574492    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"]
Jul 14 18:33:52.576930 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:52.576907    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-31aded09-openshift-default-75b756cd59-4g5qk"]
Jul 14 18:33:54.441274 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:33:54.441235    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="540ae6a6-ca60-4ed1-b00b-021e21e33cef" path="/var/lib/kubelet/pods/540ae6a6-ca60-4ed1-b00b-021e21e33cef/volumes"
Jul 14 18:34:02.113911 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:02.113868    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:34:42.544068 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:42.544038    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 18:34:42.549315 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:42.549292    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 18:34:42.620171 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:42.620134    2558 scope.go:117] "RemoveContainer" containerID="f8faaaca8bb42f5a60a40af48a5e10e3b87817729d48b1e7d73a0364d4adf3c3"
Jul 14 18:34:44.459367 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.459326    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"]
Jul 14 18:34:44.459790 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.459749    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="540ae6a6-ca60-4ed1-b00b-021e21e33cef" containerName="istio-proxy"
Jul 14 18:34:44.459790 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.459763    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="540ae6a6-ca60-4ed1-b00b-021e21e33cef" containerName="istio-proxy"
Jul 14 18:34:44.459790 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.459779    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="540ae6a6-ca60-4ed1-b00b-021e21e33cef" containerName="istio-proxy"
Jul 14 18:34:44.459790 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.459785    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="540ae6a6-ca60-4ed1-b00b-021e21e33cef" containerName="istio-proxy"
Jul 14 18:34:44.459922 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.459796    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb40f63d-f704-4059-a993-02336448b8a0" containerName="revoke-keys"
Jul 14 18:34:44.459922 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.459801    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb40f63d-f704-4059-a993-02336448b8a0" containerName="revoke-keys"
Jul 14 18:34:44.459922 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.459858    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb40f63d-f704-4059-a993-02336448b8a0" containerName="revoke-keys"
Jul 14 18:34:44.459922 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.459867    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="540ae6a6-ca60-4ed1-b00b-021e21e33cef" containerName="istio-proxy"
Jul 14 18:34:44.459922 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.459873    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="540ae6a6-ca60-4ed1-b00b-021e21e33cef" containerName="istio-proxy"
Jul 14 18:34:44.464339 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.464313    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.467361 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.467337    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-4785d6-openshift-default-dockercfg-zc5cj\""
Jul 14 18:34:44.479246 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.479215    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"]
Jul 14 18:34:44.628017 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.627971    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-credential-socket\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.628210 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.628048    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-workload-socket\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.628210 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.628102    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-istio-data\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.628210 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.628177    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glhlg\" (UniqueName: \"kubernetes.io/projected/485f758c-fc0e-44cd-8230-3445f0732b56-kube-api-access-glhlg\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.628371 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.628207    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/485f758c-fc0e-44cd-8230-3445f0732b56-istio-podinfo\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.628371 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.628239    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-istio-envoy\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.628371 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.628330    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-workload-certs\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.628522 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.628401    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485f758c-fc0e-44cd-8230-3445f0732b56-istio-token\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.628522 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.628427    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/485f758c-fc0e-44cd-8230-3445f0732b56-istiod-ca-cert\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.729911 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.729802    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glhlg\" (UniqueName: \"kubernetes.io/projected/485f758c-fc0e-44cd-8230-3445f0732b56-kube-api-access-glhlg\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.729911 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.729850    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/485f758c-fc0e-44cd-8230-3445f0732b56-istio-podinfo\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.730161 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.729918    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-istio-envoy\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.730161 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.729953    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-workload-certs\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.730161 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.729986    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485f758c-fc0e-44cd-8230-3445f0732b56-istio-token\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.730298 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.730145    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/485f758c-fc0e-44cd-8230-3445f0732b56-istiod-ca-cert\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.730298 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.730232    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-credential-socket\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.730298 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.730292    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-workload-socket\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.730446 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.730323    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-istio-data\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.730497 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.730484    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-workload-certs\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.730645 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.730619    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-credential-socket\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.730943 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.730701    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-istio-data\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.730943 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.730721    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-workload-socket\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.730943 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.730890    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/485f758c-fc0e-44cd-8230-3445f0732b56-istiod-ca-cert\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.732517 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.732495    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-istio-envoy\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.732679 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.732661    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/485f758c-fc0e-44cd-8230-3445f0732b56-istio-podinfo\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.740770 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.740746    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485f758c-fc0e-44cd-8230-3445f0732b56-istio-token\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.740972 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.740947    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glhlg\" (UniqueName: \"kubernetes.io/projected/485f758c-fc0e-44cd-8230-3445f0732b56-kube-api-access-glhlg\") pod \"e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") " pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.774768 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.774736    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:44.928208 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.928178    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"]
Jul 14 18:34:44.929109 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:34:44.929083    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod485f758c_fc0e_44cd_8230_3445f0732b56.slice/crio-f53cc898a641b2dfb3094a1cb454e592f664a5e97298176904599a87b5de979f WatchSource:0}: Error finding container f53cc898a641b2dfb3094a1cb454e592f664a5e97298176904599a87b5de979f: Status 404 returned error can't find the container with id f53cc898a641b2dfb3094a1cb454e592f664a5e97298176904599a87b5de979f
Jul 14 18:34:44.931197 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.931165    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:34:44.931268 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.931237    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:34:44.931312 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:44.931267    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:34:45.865458 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:45.865417    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7" event={"ID":"485f758c-fc0e-44cd-8230-3445f0732b56","Type":"ContainerStarted","Data":"792fd8a2ce6668ca6c6a4675550a9dfc4e9f405a4e8da5a8825cfa8327720891"}
Jul 14 18:34:45.865872 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:45.865479    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7" event={"ID":"485f758c-fc0e-44cd-8230-3445f0732b56","Type":"ContainerStarted","Data":"f53cc898a641b2dfb3094a1cb454e592f664a5e97298176904599a87b5de979f"}
Jul 14 18:34:45.893671 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:45.893617    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7" podStartSLOduration=1.893596981 podStartE2EDuration="1.893596981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:34:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:34:45.892633322 +0000 UTC m=+2403.997743305" watchObservedRunningTime="2026-07-14 18:34:45.893596981 +0000 UTC m=+2403.998706965"
Jul 14 18:34:46.775529 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:46.775489    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:46.780403 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:46.780375    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:46.871460 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:46.871430    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:46.872519 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:46.872500    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:34:53.284617 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.284536    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"]
Jul 14 18:34:53.288055 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.288034    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.291335 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.291314    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-55e12d-openshift-default-dockercfg-84gkf\""
Jul 14 18:34:53.303103 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.303079    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-podinfo\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.303217 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.303117    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65bwz\" (UniqueName: \"kubernetes.io/projected/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-kube-api-access-65bwz\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.303217 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.303146    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-credential-socket\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.303217 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.303190    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-workload-certs\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.303344 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.303221    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-data\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.303344 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.303245    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istiod-ca-cert\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.303344 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.303286    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-envoy\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.303344 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.303311    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-token\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.303344 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.303328    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-workload-socket\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.317382 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.317352    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"]
Jul 14 18:34:53.404368 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.404324    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-workload-socket\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.404549 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.404418    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-podinfo\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.404549 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.404459    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65bwz\" (UniqueName: \"kubernetes.io/projected/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-kube-api-access-65bwz\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.404549 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.404497    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-credential-socket\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.404549 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.404540    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-workload-certs\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.404840 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.404606    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-data\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.404840 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.404646    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istiod-ca-cert\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.404840 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.404716    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-envoy\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.404840 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.404742    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-token\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.404840 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.404816    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-workload-socket\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.405108 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.404892    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-credential-socket\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.405170 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.405141    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-data\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.405443 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.405406    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-workload-certs\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.405698 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.405666    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istiod-ca-cert\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.407235 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.407213    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-podinfo\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.407343 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.407332    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-envoy\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.416914 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.416886    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65bwz\" (UniqueName: \"kubernetes.io/projected/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-kube-api-access-65bwz\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.417068 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.416920    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-token\") pod \"e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") " pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.598923 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.598889    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:53.761613 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.758445    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"]
Jul 14 18:34:53.763253 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.763213    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:34:53.763357 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.763286    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:34:53.763357 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.763315    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:34:53.921229 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.921107    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms" event={"ID":"075ed4c5-0bc7-4c3c-befd-54227b7cc21a","Type":"ContainerStarted","Data":"009cda4e55206070c259a0b97012555347a403d4c07f7b4c5f79c99162ec89fe"}
Jul 14 18:34:53.921229 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.921188    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms" event={"ID":"075ed4c5-0bc7-4c3c-befd-54227b7cc21a","Type":"ContainerStarted","Data":"87a4350fa39f87999f8fd9bff542c24af2256b59abfb030028f0305ded6f050b"}
Jul 14 18:34:53.958366 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:53.958302    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms" podStartSLOduration=0.958280355 podStartE2EDuration="958.280355ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:34:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:34:53.956937678 +0000 UTC m=+2412.062047663" watchObservedRunningTime="2026-07-14 18:34:53.958280355 +0000 UTC m=+2412.063390344"
Jul 14 18:34:54.228005 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:54.227914    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:34:54.600122 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:54.600078    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:54.605861 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:54.605825    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:54.927420 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:54.927329    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:34:54.928238 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:34:54.928220    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:35:02.912960 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:02.912816    2558 patch_prober.go:28] interesting pod/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 14 18:35:02.913445 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:02.912965    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7" podUID="485f758c-fc0e-44cd-8230-3445f0732b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 14 18:35:04.990728 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:04.990682    2558 generic.go:356] "Generic (PLEG): container finished" podID="485f758c-fc0e-44cd-8230-3445f0732b56" containerID="792fd8a2ce6668ca6c6a4675550a9dfc4e9f405a4e8da5a8825cfa8327720891" exitCode=0
Jul 14 18:35:04.991166 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:04.990757    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7" event={"ID":"485f758c-fc0e-44cd-8230-3445f0732b56","Type":"ContainerDied","Data":"792fd8a2ce6668ca6c6a4675550a9dfc4e9f405a4e8da5a8825cfa8327720891"}
Jul 14 18:35:04.991302 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:04.991284    2558 scope.go:117] "RemoveContainer" containerID="792fd8a2ce6668ca6c6a4675550a9dfc4e9f405a4e8da5a8825cfa8327720891"
Jul 14 18:35:04.992398 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:04.992362    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:35:04.992488 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:04.992461    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:35:04.992658 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:04.992519    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:35:05.815192 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:05.815139    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:35:05.999006 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:05.998970    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7" event={"ID":"485f758c-fc0e-44cd-8230-3445f0732b56","Type":"ContainerStarted","Data":"8ebf25320b3807d715b79f5cdae5f0919bdbcd4c9505f65326671bcda2caf3fc"}
Jul 14 18:35:06.775523 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:06.775484    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:35:06.775762 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:06.775732    2558 patch_prober.go:28] interesting pod/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 14 18:35:06.775847 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:06.775786    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7" podUID="485f758c-fc0e-44cd-8230-3445f0732b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 14 18:35:07.775914 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:07.775879    2558 patch_prober.go:28] interesting pod/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 14 18:35:07.776332 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:07.775938    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7" podUID="485f758c-fc0e-44cd-8230-3445f0732b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 14 18:35:08.018990 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:08.018878    2558 generic.go:356] "Generic (PLEG): container finished" podID="075ed4c5-0bc7-4c3c-befd-54227b7cc21a" containerID="009cda4e55206070c259a0b97012555347a403d4c07f7b4c5f79c99162ec89fe" exitCode=0
Jul 14 18:35:08.019179 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:08.019075    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms" event={"ID":"075ed4c5-0bc7-4c3c-befd-54227b7cc21a","Type":"ContainerDied","Data":"009cda4e55206070c259a0b97012555347a403d4c07f7b4c5f79c99162ec89fe"}
Jul 14 18:35:08.019633 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:08.019606    2558 scope.go:117] "RemoveContainer" containerID="009cda4e55206070c259a0b97012555347a403d4c07f7b4c5f79c99162ec89fe"
Jul 14 18:35:08.020987 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:08.020940    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:35:08.021083 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:08.021050    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:35:08.021146 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:08.021099    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:35:08.775610 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:08.775532    2558 patch_prober.go:28] interesting pod/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 14 18:35:08.775790 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:08.775633    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7" podUID="485f758c-fc0e-44cd-8230-3445f0732b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 14 18:35:09.031896 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:09.031795    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms" event={"ID":"075ed4c5-0bc7-4c3c-befd-54227b7cc21a","Type":"ContainerStarted","Data":"7e273c697c0f4c7a48a15ab98cac3da8dbb7ad6174af094e98eaf24d535c3b27"}
Jul 14 18:35:09.599890 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:09.599845    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:35:09.601046 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:09.601009    2558 patch_prober.go:28] interesting pod/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 14 18:35:09.601189 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:09.601079    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms" podUID="075ed4c5-0bc7-4c3c-befd-54227b7cc21a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 14 18:35:09.776124 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:09.776093    2558 patch_prober.go:28] interesting pod/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 14 18:35:09.776371 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:09.776349    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7" podUID="485f758c-fc0e-44cd-8230-3445f0732b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 14 18:35:09.928068 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:09.927958    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:35:10.599548 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:10.599506    2558 patch_prober.go:28] interesting pod/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 14 18:35:10.600092 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:10.599589    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms" podUID="075ed4c5-0bc7-4c3c-befd-54227b7cc21a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 14 18:35:10.778494 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:10.778459    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:35:10.778762 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:10.778741    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:35:10.779631 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:10.779614    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:35:11.599944 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:11.599898    2558 patch_prober.go:28] interesting pod/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 14 18:35:11.600451 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:11.599972    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms" podUID="075ed4c5-0bc7-4c3c-befd-54227b7cc21a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 14 18:35:12.600250 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:12.600206    2558 patch_prober.go:28] interesting pod/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 14 18:35:12.601283 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:12.600883    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms" podUID="075ed4c5-0bc7-4c3c-befd-54227b7cc21a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 14 18:35:13.603974 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:13.603942    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:35:13.605027 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:13.605005    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:35:31.621249 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:31.621208    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:35:46.123072 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:35:46.123035    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:36:01.018311 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:01.018276    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:36:15.617743 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:15.617709    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:36:26.653374 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:26.653339    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:36:37.187251 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:37.187167    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"]
Jul 14 18:36:37.187733 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:37.187404    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7" podUID="485f758c-fc0e-44cd-8230-3445f0732b56" containerName="istio-proxy" containerID="cri-o://8ebf25320b3807d715b79f5cdae5f0919bdbcd4c9505f65326671bcda2caf3fc" gracePeriod=30
Jul 14 18:36:40.781778 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:40.781736    2558 patch_prober.go:28] interesting pod/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 18:36:40.782158 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:40.781807    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7" podUID="485f758c-fc0e-44cd-8230-3445f0732b56" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 18:36:42.447148 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.447081    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:36:42.516515 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.516477    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-istio-envoy\") pod \"485f758c-fc0e-44cd-8230-3445f0732b56\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") "
Jul 14 18:36:42.516732 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.516555    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-credential-socket\") pod \"485f758c-fc0e-44cd-8230-3445f0732b56\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") "
Jul 14 18:36:42.516732 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.516627    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/485f758c-fc0e-44cd-8230-3445f0732b56-istio-podinfo\") pod \"485f758c-fc0e-44cd-8230-3445f0732b56\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") "
Jul 14 18:36:42.516732 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.516644    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-workload-socket\") pod \"485f758c-fc0e-44cd-8230-3445f0732b56\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") "
Jul 14 18:36:42.516732 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.516663    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485f758c-fc0e-44cd-8230-3445f0732b56-istio-token\") pod \"485f758c-fc0e-44cd-8230-3445f0732b56\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") "
Jul 14 18:36:42.516732 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.516690    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-istio-data\") pod \"485f758c-fc0e-44cd-8230-3445f0732b56\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") "
Jul 14 18:36:42.517008 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.516817    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/485f758c-fc0e-44cd-8230-3445f0732b56-istiod-ca-cert\") pod \"485f758c-fc0e-44cd-8230-3445f0732b56\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") "
Jul 14 18:36:42.517008 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.516852    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "485f758c-fc0e-44cd-8230-3445f0732b56" (UID: "485f758c-fc0e-44cd-8230-3445f0732b56"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:36:42.517008 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.516860    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glhlg\" (UniqueName: \"kubernetes.io/projected/485f758c-fc0e-44cd-8230-3445f0732b56-kube-api-access-glhlg\") pod \"485f758c-fc0e-44cd-8230-3445f0732b56\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") "
Jul 14 18:36:42.517008 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.516953    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-workload-certs\") pod \"485f758c-fc0e-44cd-8230-3445f0732b56\" (UID: \"485f758c-fc0e-44cd-8230-3445f0732b56\") "
Jul 14 18:36:42.517249 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.517222    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/485f758c-fc0e-44cd-8230-3445f0732b56-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "485f758c-fc0e-44cd-8230-3445f0732b56" (UID: "485f758c-fc0e-44cd-8230-3445f0732b56"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:36:42.517341 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.517303    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "485f758c-fc0e-44cd-8230-3445f0732b56" (UID: "485f758c-fc0e-44cd-8230-3445f0732b56"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:36:42.517591 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.517499    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-credential-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:36:42.517591 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.517520    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-workload-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:36:42.517591 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.517534    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/485f758c-fc0e-44cd-8230-3445f0732b56-istiod-ca-cert\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:36:42.517806 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.517782    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "485f758c-fc0e-44cd-8230-3445f0732b56" (UID: "485f758c-fc0e-44cd-8230-3445f0732b56"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:36:42.517875 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.517822    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-istio-data" (OuterVolumeSpecName: "istio-data") pod "485f758c-fc0e-44cd-8230-3445f0732b56" (UID: "485f758c-fc0e-44cd-8230-3445f0732b56"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:36:42.518988 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.518963    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "485f758c-fc0e-44cd-8230-3445f0732b56" (UID: "485f758c-fc0e-44cd-8230-3445f0732b56"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:36:42.519107 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.519055    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/485f758c-fc0e-44cd-8230-3445f0732b56-istio-token" (OuterVolumeSpecName: "istio-token") pod "485f758c-fc0e-44cd-8230-3445f0732b56" (UID: "485f758c-fc0e-44cd-8230-3445f0732b56"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:36:42.519151 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.519100    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/485f758c-fc0e-44cd-8230-3445f0732b56-kube-api-access-glhlg" (OuterVolumeSpecName: "kube-api-access-glhlg") pod "485f758c-fc0e-44cd-8230-3445f0732b56" (UID: "485f758c-fc0e-44cd-8230-3445f0732b56"). InnerVolumeSpecName "kube-api-access-glhlg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:36:42.519151 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.519120    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/485f758c-fc0e-44cd-8230-3445f0732b56-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "485f758c-fc0e-44cd-8230-3445f0732b56" (UID: "485f758c-fc0e-44cd-8230-3445f0732b56"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 18:36:42.574764 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.574723    2558 generic.go:356] "Generic (PLEG): container finished" podID="485f758c-fc0e-44cd-8230-3445f0732b56" containerID="8ebf25320b3807d715b79f5cdae5f0919bdbcd4c9505f65326671bcda2caf3fc" exitCode=0
Jul 14 18:36:42.574956 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.574775    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"
Jul 14 18:36:42.574956 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.574812    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7" event={"ID":"485f758c-fc0e-44cd-8230-3445f0732b56","Type":"ContainerDied","Data":"8ebf25320b3807d715b79f5cdae5f0919bdbcd4c9505f65326671bcda2caf3fc"}
Jul 14 18:36:42.574956 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.574878    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7" event={"ID":"485f758c-fc0e-44cd-8230-3445f0732b56","Type":"ContainerDied","Data":"f53cc898a641b2dfb3094a1cb454e592f664a5e97298176904599a87b5de979f"}
Jul 14 18:36:42.574956 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.574911    2558 scope.go:117] "RemoveContainer" containerID="8ebf25320b3807d715b79f5cdae5f0919bdbcd4c9505f65326671bcda2caf3fc"
Jul 14 18:36:42.584533 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.584515    2558 scope.go:117] "RemoveContainer" containerID="792fd8a2ce6668ca6c6a4675550a9dfc4e9f405a4e8da5a8825cfa8327720891"
Jul 14 18:36:42.595484 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.595461    2558 scope.go:117] "RemoveContainer" containerID="8ebf25320b3807d715b79f5cdae5f0919bdbcd4c9505f65326671bcda2caf3fc"
Jul 14 18:36:42.595914 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:36:42.595890    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ebf25320b3807d715b79f5cdae5f0919bdbcd4c9505f65326671bcda2caf3fc\": container with ID starting with 8ebf25320b3807d715b79f5cdae5f0919bdbcd4c9505f65326671bcda2caf3fc not found: ID does not exist" containerID="8ebf25320b3807d715b79f5cdae5f0919bdbcd4c9505f65326671bcda2caf3fc"
Jul 14 18:36:42.596011 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.595929    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ebf25320b3807d715b79f5cdae5f0919bdbcd4c9505f65326671bcda2caf3fc"} err="failed to get container status \"8ebf25320b3807d715b79f5cdae5f0919bdbcd4c9505f65326671bcda2caf3fc\": rpc error: code = NotFound desc = could not find container \"8ebf25320b3807d715b79f5cdae5f0919bdbcd4c9505f65326671bcda2caf3fc\": container with ID starting with 8ebf25320b3807d715b79f5cdae5f0919bdbcd4c9505f65326671bcda2caf3fc not found: ID does not exist"
Jul 14 18:36:42.596011 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.595956    2558 scope.go:117] "RemoveContainer" containerID="792fd8a2ce6668ca6c6a4675550a9dfc4e9f405a4e8da5a8825cfa8327720891"
Jul 14 18:36:42.596250 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:36:42.596232    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"792fd8a2ce6668ca6c6a4675550a9dfc4e9f405a4e8da5a8825cfa8327720891\": container with ID starting with 792fd8a2ce6668ca6c6a4675550a9dfc4e9f405a4e8da5a8825cfa8327720891 not found: ID does not exist" containerID="792fd8a2ce6668ca6c6a4675550a9dfc4e9f405a4e8da5a8825cfa8327720891"
Jul 14 18:36:42.596290 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.596257    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"792fd8a2ce6668ca6c6a4675550a9dfc4e9f405a4e8da5a8825cfa8327720891"} err="failed to get container status \"792fd8a2ce6668ca6c6a4675550a9dfc4e9f405a4e8da5a8825cfa8327720891\": rpc error: code = NotFound desc = could not find container \"792fd8a2ce6668ca6c6a4675550a9dfc4e9f405a4e8da5a8825cfa8327720891\": container with ID starting with 792fd8a2ce6668ca6c6a4675550a9dfc4e9f405a4e8da5a8825cfa8327720891 not found: ID does not exist"
Jul 14 18:36:42.606019 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.605978    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"]
Jul 14 18:36:42.608641 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.608614    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-4785d6-openshift-default-d4885dc8f-5nmb7"]
Jul 14 18:36:42.618842 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.618818    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/485f758c-fc0e-44cd-8230-3445f0732b56-istio-podinfo\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:36:42.618842 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.618842    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485f758c-fc0e-44cd-8230-3445f0732b56-istio-token\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:36:42.618998 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.618856    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-istio-data\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:36:42.618998 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.618868    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glhlg\" (UniqueName: \"kubernetes.io/projected/485f758c-fc0e-44cd-8230-3445f0732b56-kube-api-access-glhlg\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:36:42.618998 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.618881    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-workload-certs\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:36:42.618998 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:42.618892    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/485f758c-fc0e-44cd-8230-3445f0732b56-istio-envoy\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:36:44.440668 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:44.440633    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="485f758c-fc0e-44cd-8230-3445f0732b56" path="/var/lib/kubelet/pods/485f758c-fc0e-44cd-8230-3445f0732b56/volumes"
Jul 14 18:36:51.113041 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:36:51.113004    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:37:03.439102 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:03.439062    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"]
Jul 14 18:37:03.439638 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:03.439427    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms" podUID="075ed4c5-0bc7-4c3c-befd-54227b7cc21a" containerName="istio-proxy" containerID="cri-o://7e273c697c0f4c7a48a15ab98cac3da8dbb7ad6174af094e98eaf24d535c3b27" gracePeriod=30
Jul 14 18:37:04.479039 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.478996    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"]
Jul 14 18:37:04.479428 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.479386    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="485f758c-fc0e-44cd-8230-3445f0732b56" containerName="istio-proxy"
Jul 14 18:37:04.479428 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.479397    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="485f758c-fc0e-44cd-8230-3445f0732b56" containerName="istio-proxy"
Jul 14 18:37:04.479428 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.479414    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="485f758c-fc0e-44cd-8230-3445f0732b56" containerName="istio-proxy"
Jul 14 18:37:04.479428 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.479420    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="485f758c-fc0e-44cd-8230-3445f0732b56" containerName="istio-proxy"
Jul 14 18:37:04.479584 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.479476    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="485f758c-fc0e-44cd-8230-3445f0732b56" containerName="istio-proxy"
Jul 14 18:37:04.479584 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.479485    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="485f758c-fc0e-44cd-8230-3445f0732b56" containerName="istio-proxy"
Jul 14 18:37:04.481655 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.481636    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.484989 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.484951    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-e0452a-openshift-default-dockercfg-jqkl8\""
Jul 14 18:37:04.495046 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.495015    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"]
Jul 14 18:37:04.632102 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.632059    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-envoy\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.632302 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.632119    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-workload-socket\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.632302 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.632165    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-workload-certs\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.632302 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.632201    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-data\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.632302 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.632229    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-podinfo\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.632302 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.632250    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-token\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.632503 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.632321    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv8gs\" (UniqueName: \"kubernetes.io/projected/b64248bc-2a3d-4eeb-942f-28b08bbc45db-kube-api-access-mv8gs\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.632503 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.632368    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istiod-ca-cert\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.632503 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.632396    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-credential-socket\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.733850 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.733757    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv8gs\" (UniqueName: \"kubernetes.io/projected/b64248bc-2a3d-4eeb-942f-28b08bbc45db-kube-api-access-mv8gs\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.733850 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.733816    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istiod-ca-cert\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.733850 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.733846    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-credential-socket\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.734136 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.733873    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-envoy\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.734136 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.733914    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-workload-socket\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.734136 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.733931    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-workload-certs\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.734136 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.733949    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-data\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.734136 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.733983    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-podinfo\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.734136 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.734011    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-token\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.734452 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.734329    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-credential-socket\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.734452 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.734414    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-workload-certs\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.734538 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.734485    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-workload-socket\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.734622 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.734599    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-data\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.734747 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.734725    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istiod-ca-cert\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.736493 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.736471    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-envoy\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.736732 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.736713    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-podinfo\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.743158 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.743130    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-token\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.743266 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.743175    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv8gs\" (UniqueName: \"kubernetes.io/projected/b64248bc-2a3d-4eeb-942f-28b08bbc45db-kube-api-access-mv8gs\") pod \"e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") " pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.792502 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.792458    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:04.940118 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.940088    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"]
Jul 14 18:37:04.941793 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:37:04.941770    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb64248bc_2a3d_4eeb_942f_28b08bbc45db.slice/crio-3888b9b267853bacd4a59f8e1582ce7e3668d8db57ad5558faff53f109ecd4eb WatchSource:0}: Error finding container 3888b9b267853bacd4a59f8e1582ce7e3668d8db57ad5558faff53f109ecd4eb: Status 404 returned error can't find the container with id 3888b9b267853bacd4a59f8e1582ce7e3668d8db57ad5558faff53f109ecd4eb
Jul 14 18:37:04.943934 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.943900    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:37:04.944014 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.943967    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:37:04.944014 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:04.943997    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:37:05.705166 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:05.705131    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz" event={"ID":"b64248bc-2a3d-4eeb-942f-28b08bbc45db","Type":"ContainerStarted","Data":"b6bcbc39e329393e9ec5ecf3f45273b2fcf945c8f679f7cafab31e0e1a603849"}
Jul 14 18:37:05.705642 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:05.705190    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz" event={"ID":"b64248bc-2a3d-4eeb-942f-28b08bbc45db","Type":"ContainerStarted","Data":"3888b9b267853bacd4a59f8e1582ce7e3668d8db57ad5558faff53f109ecd4eb"}
Jul 14 18:37:05.736181 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:05.736130    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz" podStartSLOduration=1.736116236 podStartE2EDuration="1.736116236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:37:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:37:05.733683415 +0000 UTC m=+2543.838793400" watchObservedRunningTime="2026-07-14 18:37:05.736116236 +0000 UTC m=+2543.841226219"
Jul 14 18:37:05.793226 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:05.793194    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:06.797910 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:06.797880    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:07.716738 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:07.716707    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:07.717614 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:07.717590    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:08.710717 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.710646    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:37:08.724637 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.724598    2558 generic.go:356] "Generic (PLEG): container finished" podID="075ed4c5-0bc7-4c3c-befd-54227b7cc21a" containerID="7e273c697c0f4c7a48a15ab98cac3da8dbb7ad6174af094e98eaf24d535c3b27" exitCode=0
Jul 14 18:37:08.724820 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.724648    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"
Jul 14 18:37:08.724820 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.724684    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms" event={"ID":"075ed4c5-0bc7-4c3c-befd-54227b7cc21a","Type":"ContainerDied","Data":"7e273c697c0f4c7a48a15ab98cac3da8dbb7ad6174af094e98eaf24d535c3b27"}
Jul 14 18:37:08.724820 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.724735    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms" event={"ID":"075ed4c5-0bc7-4c3c-befd-54227b7cc21a","Type":"ContainerDied","Data":"87a4350fa39f87999f8fd9bff542c24af2256b59abfb030028f0305ded6f050b"}
Jul 14 18:37:08.724820 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.724758    2558 scope.go:117] "RemoveContainer" containerID="7e273c697c0f4c7a48a15ab98cac3da8dbb7ad6174af094e98eaf24d535c3b27"
Jul 14 18:37:08.734225 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.734206    2558 scope.go:117] "RemoveContainer" containerID="009cda4e55206070c259a0b97012555347a403d4c07f7b4c5f79c99162ec89fe"
Jul 14 18:37:08.751321 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.751288    2558 scope.go:117] "RemoveContainer" containerID="7e273c697c0f4c7a48a15ab98cac3da8dbb7ad6174af094e98eaf24d535c3b27"
Jul 14 18:37:08.751727 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:37:08.751696    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e273c697c0f4c7a48a15ab98cac3da8dbb7ad6174af094e98eaf24d535c3b27\": container with ID starting with 7e273c697c0f4c7a48a15ab98cac3da8dbb7ad6174af094e98eaf24d535c3b27 not found: ID does not exist" containerID="7e273c697c0f4c7a48a15ab98cac3da8dbb7ad6174af094e98eaf24d535c3b27"
Jul 14 18:37:08.751825 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.751737    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e273c697c0f4c7a48a15ab98cac3da8dbb7ad6174af094e98eaf24d535c3b27"} err="failed to get container status \"7e273c697c0f4c7a48a15ab98cac3da8dbb7ad6174af094e98eaf24d535c3b27\": rpc error: code = NotFound desc = could not find container \"7e273c697c0f4c7a48a15ab98cac3da8dbb7ad6174af094e98eaf24d535c3b27\": container with ID starting with 7e273c697c0f4c7a48a15ab98cac3da8dbb7ad6174af094e98eaf24d535c3b27 not found: ID does not exist"
Jul 14 18:37:08.751825 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.751756    2558 scope.go:117] "RemoveContainer" containerID="009cda4e55206070c259a0b97012555347a403d4c07f7b4c5f79c99162ec89fe"
Jul 14 18:37:08.752044 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:37:08.752024    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"009cda4e55206070c259a0b97012555347a403d4c07f7b4c5f79c99162ec89fe\": container with ID starting with 009cda4e55206070c259a0b97012555347a403d4c07f7b4c5f79c99162ec89fe not found: ID does not exist" containerID="009cda4e55206070c259a0b97012555347a403d4c07f7b4c5f79c99162ec89fe"
Jul 14 18:37:08.752086 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.752053    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"009cda4e55206070c259a0b97012555347a403d4c07f7b4c5f79c99162ec89fe"} err="failed to get container status \"009cda4e55206070c259a0b97012555347a403d4c07f7b4c5f79c99162ec89fe\": rpc error: code = NotFound desc = could not find container \"009cda4e55206070c259a0b97012555347a403d4c07f7b4c5f79c99162ec89fe\": container with ID starting with 009cda4e55206070c259a0b97012555347a403d4c07f7b4c5f79c99162ec89fe not found: ID does not exist"
Jul 14 18:37:08.773063 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.773025    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-envoy\") pod \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") "
Jul 14 18:37:08.773369 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.773329    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-token\") pod \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") "
Jul 14 18:37:08.776074 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.776039    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "075ed4c5-0bc7-4c3c-befd-54227b7cc21a" (UID: "075ed4c5-0bc7-4c3c-befd-54227b7cc21a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:37:08.776917 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.776890    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-token" (OuterVolumeSpecName: "istio-token") pod "075ed4c5-0bc7-4c3c-befd-54227b7cc21a" (UID: "075ed4c5-0bc7-4c3c-befd-54227b7cc21a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:37:08.874307 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.874268    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-credential-socket\") pod \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") "
Jul 14 18:37:08.874307 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.874305    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-data\") pod \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") "
Jul 14 18:37:08.874603 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.874331    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istiod-ca-cert\") pod \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") "
Jul 14 18:37:08.874603 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.874363    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-podinfo\") pod \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") "
Jul 14 18:37:08.874603 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.874390    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65bwz\" (UniqueName: \"kubernetes.io/projected/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-kube-api-access-65bwz\") pod \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") "
Jul 14 18:37:08.874603 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.874422    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-workload-certs\") pod \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") "
Jul 14 18:37:08.874603 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.874493    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-workload-socket\") pod \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\" (UID: \"075ed4c5-0bc7-4c3c-befd-54227b7cc21a\") "
Jul 14 18:37:08.874872 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.874618    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "075ed4c5-0bc7-4c3c-befd-54227b7cc21a" (UID: "075ed4c5-0bc7-4c3c-befd-54227b7cc21a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:37:08.874872 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.874743    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "075ed4c5-0bc7-4c3c-befd-54227b7cc21a" (UID: "075ed4c5-0bc7-4c3c-befd-54227b7cc21a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:37:08.874872 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.874802    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "075ed4c5-0bc7-4c3c-befd-54227b7cc21a" (UID: "075ed4c5-0bc7-4c3c-befd-54227b7cc21a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:37:08.874872 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.874834    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "075ed4c5-0bc7-4c3c-befd-54227b7cc21a" (UID: "075ed4c5-0bc7-4c3c-befd-54227b7cc21a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:37:08.874872 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.874858    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-envoy\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:37:08.874872 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.874877    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-token\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:37:08.875126 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.874889    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-credential-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:37:08.875126 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.874900    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istiod-ca-cert\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:37:08.875126 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.875091    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-data" (OuterVolumeSpecName: "istio-data") pod "075ed4c5-0bc7-4c3c-befd-54227b7cc21a" (UID: "075ed4c5-0bc7-4c3c-befd-54227b7cc21a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:37:08.876822 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.876799    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-kube-api-access-65bwz" (OuterVolumeSpecName: "kube-api-access-65bwz") pod "075ed4c5-0bc7-4c3c-befd-54227b7cc21a" (UID: "075ed4c5-0bc7-4c3c-befd-54227b7cc21a"). InnerVolumeSpecName "kube-api-access-65bwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:37:08.876822 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.876808    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "075ed4c5-0bc7-4c3c-befd-54227b7cc21a" (UID: "075ed4c5-0bc7-4c3c-befd-54227b7cc21a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 18:37:08.976021 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.975919    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-data\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:37:08.976021 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.975951    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-istio-podinfo\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:37:08.976021 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.975963    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65bwz\" (UniqueName: \"kubernetes.io/projected/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-kube-api-access-65bwz\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:37:08.976021 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.975972    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-workload-certs\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:37:08.976021 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:08.975981    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/075ed4c5-0bc7-4c3c-befd-54227b7cc21a-workload-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:37:09.051637 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:09.051540    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"]
Jul 14 18:37:09.055197 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:09.055161    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-55e12d-openshift-default-6db66b7d6c-pwnms"]
Jul 14 18:37:10.441166 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:10.441122    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="075ed4c5-0bc7-4c3c-befd-54227b7cc21a" path="/var/lib/kubelet/pods/075ed4c5-0bc7-4c3c-befd-54227b7cc21a/volumes"
Jul 14 18:37:12.114886 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:12.114852    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:37:13.224588 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.222778    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"]
Jul 14 18:37:13.224588 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.223345    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="075ed4c5-0bc7-4c3c-befd-54227b7cc21a" containerName="istio-proxy"
Jul 14 18:37:13.224588 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.223362    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="075ed4c5-0bc7-4c3c-befd-54227b7cc21a" containerName="istio-proxy"
Jul 14 18:37:13.224588 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.223389    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="075ed4c5-0bc7-4c3c-befd-54227b7cc21a" containerName="istio-proxy"
Jul 14 18:37:13.224588 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.223398    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="075ed4c5-0bc7-4c3c-befd-54227b7cc21a" containerName="istio-proxy"
Jul 14 18:37:13.224588 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.223506    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="075ed4c5-0bc7-4c3c-befd-54227b7cc21a" containerName="istio-proxy"
Jul 14 18:37:13.224588 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.223519    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="075ed4c5-0bc7-4c3c-befd-54227b7cc21a" containerName="istio-proxy"
Jul 14 18:37:13.227504 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.227363    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.230440 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.230408    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-b418a4-openshift-default-dockercfg-dfxcb\""
Jul 14 18:37:13.251047 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.248475    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"]
Jul 14 18:37:13.319587 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.319093    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-envoy\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.319587 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.319171    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-data\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.319587 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.319213    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-podinfo\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.319587 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.319243    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/804f2d30-f232-43bb-bd7f-f07eace30ce6-istiod-ca-cert\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.319587 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.319270    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-token\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.319587 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.319298    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-workload-socket\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.319587 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.319322    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bh6m\" (UniqueName: \"kubernetes.io/projected/804f2d30-f232-43bb-bd7f-f07eace30ce6-kube-api-access-6bh6m\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.319587 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.319351    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-workload-certs\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.319587 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.319416    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-credential-socket\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.420678 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.420616    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-envoy\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.421067 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.421041    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-data\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.421251 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.421224    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-podinfo\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.421377 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.421362    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/804f2d30-f232-43bb-bd7f-f07eace30ce6-istiod-ca-cert\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.421514 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.421500    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-token\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.421692 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.421677    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-workload-socket\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.421823 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.421809    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bh6m\" (UniqueName: \"kubernetes.io/projected/804f2d30-f232-43bb-bd7f-f07eace30ce6-kube-api-access-6bh6m\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.421954 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.421940    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-workload-certs\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.422145 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.422130    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-credential-socket\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.422343 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.422312    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/804f2d30-f232-43bb-bd7f-f07eace30ce6-istiod-ca-cert\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.422444 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.421693    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-data\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.423779 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.423431    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-workload-certs\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.423779 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.423666    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-workload-socket\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.423779 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.423711    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-credential-socket\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.426880 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.426843    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-envoy\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.427940 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.427794    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-podinfo\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.431445 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.431421    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-token\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.431842 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.431819    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bh6m\" (UniqueName: \"kubernetes.io/projected/804f2d30-f232-43bb-bd7f-f07eace30ce6-kube-api-access-6bh6m\") pod \"e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") " pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.539331 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.539227    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:13.729332 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:37:13.729295    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod804f2d30_f232_43bb_bd7f_f07eace30ce6.slice/crio-7b086fa94eddf110b56c014e00769a59b331c30ba57dd210ebe17fd964607c63 WatchSource:0}: Error finding container 7b086fa94eddf110b56c014e00769a59b331c30ba57dd210ebe17fd964607c63: Status 404 returned error can't find the container with id 7b086fa94eddf110b56c014e00769a59b331c30ba57dd210ebe17fd964607c63
Jul 14 18:37:13.729480 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.729394    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"]
Jul 14 18:37:13.731673 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.731624    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:37:13.731795 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.731716    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:37:13.731795 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.731758    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:37:13.758124 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:13.758092    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s" event={"ID":"804f2d30-f232-43bb-bd7f-f07eace30ce6","Type":"ContainerStarted","Data":"7b086fa94eddf110b56c014e00769a59b331c30ba57dd210ebe17fd964607c63"}
Jul 14 18:37:14.765233 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:14.765197    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s" event={"ID":"804f2d30-f232-43bb-bd7f-f07eace30ce6","Type":"ContainerStarted","Data":"3155e56b36d64b4b504a4bbc748ff974a70ee58fec378924dd8832ea38c9a757"}
Jul 14 18:37:14.791580 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:14.791514    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s" podStartSLOduration=1.791495955 podStartE2EDuration="1.791495955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:37:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:37:14.788921706 +0000 UTC m=+2552.894031716" watchObservedRunningTime="2026-07-14 18:37:14.791495955 +0000 UTC m=+2552.896606013"
Jul 14 18:37:15.539421 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:15.539383    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:15.544405 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:15.544376    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:15.771588 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:15.771522    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:15.772644 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:15.772621    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:20.803715 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:20.803680    2558 generic.go:356] "Generic (PLEG): container finished" podID="b64248bc-2a3d-4eeb-942f-28b08bbc45db" containerID="b6bcbc39e329393e9ec5ecf3f45273b2fcf945c8f679f7cafab31e0e1a603849" exitCode=0
Jul 14 18:37:20.804139 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:20.803760    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz" event={"ID":"b64248bc-2a3d-4eeb-942f-28b08bbc45db","Type":"ContainerDied","Data":"b6bcbc39e329393e9ec5ecf3f45273b2fcf945c8f679f7cafab31e0e1a603849"}
Jul 14 18:37:20.804182 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:20.804168    2558 scope.go:117] "RemoveContainer" containerID="b6bcbc39e329393e9ec5ecf3f45273b2fcf945c8f679f7cafab31e0e1a603849"
Jul 14 18:37:20.805180 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:20.805152    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:37:20.805247 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:20.805224    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:37:20.805282 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:20.805255    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:37:21.815389 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:21.815339    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz" event={"ID":"b64248bc-2a3d-4eeb-942f-28b08bbc45db","Type":"ContainerStarted","Data":"04a0f05799e6accb2448e7d63f8a34af702d5717013b6a04acf1e2b64f75ef63"}
Jul 14 18:37:22.717321 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:22.717264    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:22.792821 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:22.792784    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:22.794192 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:22.794163    2558 patch_prober.go:28] interesting pod/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 14 18:37:22.794321 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:22.794214    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz" podUID="b64248bc-2a3d-4eeb-942f-28b08bbc45db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 14 18:37:23.792786 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:23.792750    2558 patch_prober.go:28] interesting pod/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 14 18:37:23.793168 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:23.792808    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz" podUID="b64248bc-2a3d-4eeb-942f-28b08bbc45db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 14 18:37:24.215076 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:24.215012    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:37:24.793460 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:24.793418    2558 patch_prober.go:28] interesting pod/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 14 18:37:24.793904 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:24.793492    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz" podUID="b64248bc-2a3d-4eeb-942f-28b08bbc45db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 14 18:37:25.803004 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:25.802958    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:25.808034 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:25.807993    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:37:31.813769 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:31.813722    2558 patch_prober.go:28] interesting pod/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 14 18:37:31.814163 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:31.813809    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s" podUID="804f2d30-f232-43bb-bd7f-f07eace30ce6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 14 18:37:32.886020 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:32.885988    2558 generic.go:356] "Generic (PLEG): container finished" podID="804f2d30-f232-43bb-bd7f-f07eace30ce6" containerID="3155e56b36d64b4b504a4bbc748ff974a70ee58fec378924dd8832ea38c9a757" exitCode=0
Jul 14 18:37:32.886439 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:32.886060    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s" event={"ID":"804f2d30-f232-43bb-bd7f-f07eace30ce6","Type":"ContainerDied","Data":"3155e56b36d64b4b504a4bbc748ff974a70ee58fec378924dd8832ea38c9a757"}
Jul 14 18:37:32.886487 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:32.886439    2558 scope.go:117] "RemoveContainer" containerID="3155e56b36d64b4b504a4bbc748ff974a70ee58fec378924dd8832ea38c9a757"
Jul 14 18:37:32.887524 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:32.887497    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:37:32.887616 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:32.887592    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:37:32.887669 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:32.887658    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:37:33.894468 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:33.894426    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s" event={"ID":"804f2d30-f232-43bb-bd7f-f07eace30ce6","Type":"ContainerStarted","Data":"a6b0aa2782f0cdf600aa121ad79af7f5455e5f301135ab65c9503c7199797787"}
Jul 14 18:37:34.540451 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:34.540411    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:34.540669 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:34.540647    2558 patch_prober.go:28] interesting pod/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 14 18:37:34.540749 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:34.540694    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s" podUID="804f2d30-f232-43bb-bd7f-f07eace30ce6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 14 18:37:35.539693 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:35.539657    2558 patch_prober.go:28] interesting pod/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 14 18:37:35.540089 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:35.539725    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s" podUID="804f2d30-f232-43bb-bd7f-f07eace30ce6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 14 18:37:36.539993 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:36.539946    2558 patch_prober.go:28] interesting pod/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 14 18:37:36.540403 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:36.540012    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s" podUID="804f2d30-f232-43bb-bd7f-f07eace30ce6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 14 18:37:37.540470 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:37.540427    2558 patch_prober.go:28] interesting pod/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 14 18:37:37.540897 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:37.540492    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s" podUID="804f2d30-f232-43bb-bd7f-f07eace30ce6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 14 18:37:38.544042 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:38.544007    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:38.544466 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:38.544399    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:38.545090 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:38.545066    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:37:43.318769 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:43.318733    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:37:55.175429 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:55.175394    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"]
Jul 14 18:37:55.175897 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:55.175671    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz" podUID="b64248bc-2a3d-4eeb-942f-28b08bbc45db" containerName="istio-proxy" containerID="cri-o://04a0f05799e6accb2448e7d63f8a34af702d5717013b6a04acf1e2b64f75ef63" gracePeriod=30
Jul 14 18:37:55.807044 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:55.806995    2558 patch_prober.go:28] interesting pod/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 18:37:55.807220 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:37:55.807075    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz" podUID="b64248bc-2a3d-4eeb-942f-28b08bbc45db" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 18:38:00.432957 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.432927    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:38:00.485287 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.485185    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-data\") pod \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") "
Jul 14 18:38:00.485287 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.485228    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv8gs\" (UniqueName: \"kubernetes.io/projected/b64248bc-2a3d-4eeb-942f-28b08bbc45db-kube-api-access-mv8gs\") pod \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") "
Jul 14 18:38:00.485287 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.485260    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-token\") pod \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") "
Jul 14 18:38:00.485601 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.485297    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-credential-socket\") pod \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") "
Jul 14 18:38:00.485601 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.485326    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istiod-ca-cert\") pod \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") "
Jul 14 18:38:00.485601 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.485362    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-podinfo\") pod \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") "
Jul 14 18:38:00.485601 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.485393    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-workload-socket\") pod \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") "
Jul 14 18:38:00.485601 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.485420    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-envoy\") pod \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") "
Jul 14 18:38:00.485601 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.485492    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-workload-certs\") pod \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\" (UID: \"b64248bc-2a3d-4eeb-942f-28b08bbc45db\") "
Jul 14 18:38:00.485917 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.485652    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b64248bc-2a3d-4eeb-942f-28b08bbc45db" (UID: "b64248bc-2a3d-4eeb-942f-28b08bbc45db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:38:00.485917 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.485878    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-credential-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:38:00.485917 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.485883    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b64248bc-2a3d-4eeb-942f-28b08bbc45db" (UID: "b64248bc-2a3d-4eeb-942f-28b08bbc45db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:38:00.486052 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.485988    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b64248bc-2a3d-4eeb-942f-28b08bbc45db" (UID: "b64248bc-2a3d-4eeb-942f-28b08bbc45db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:38:00.486052 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.486024    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b64248bc-2a3d-4eeb-942f-28b08bbc45db" (UID: "b64248bc-2a3d-4eeb-942f-28b08bbc45db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:38:00.486164 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.486101    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-data" (OuterVolumeSpecName: "istio-data") pod "b64248bc-2a3d-4eeb-942f-28b08bbc45db" (UID: "b64248bc-2a3d-4eeb-942f-28b08bbc45db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:38:00.487685 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.487656    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b64248bc-2a3d-4eeb-942f-28b08bbc45db-kube-api-access-mv8gs" (OuterVolumeSpecName: "kube-api-access-mv8gs") pod "b64248bc-2a3d-4eeb-942f-28b08bbc45db" (UID: "b64248bc-2a3d-4eeb-942f-28b08bbc45db"). InnerVolumeSpecName "kube-api-access-mv8gs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:38:00.487806 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.487750    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b64248bc-2a3d-4eeb-942f-28b08bbc45db" (UID: "b64248bc-2a3d-4eeb-942f-28b08bbc45db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 18:38:00.487984 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.487970    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b64248bc-2a3d-4eeb-942f-28b08bbc45db" (UID: "b64248bc-2a3d-4eeb-942f-28b08bbc45db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:38:00.488143 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.488129    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-token" (OuterVolumeSpecName: "istio-token") pod "b64248bc-2a3d-4eeb-942f-28b08bbc45db" (UID: "b64248bc-2a3d-4eeb-942f-28b08bbc45db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:38:00.586593 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.586525    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istiod-ca-cert\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:38:00.586593 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.586590    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-podinfo\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:38:00.586593 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.586600    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-workload-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:38:00.586847 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.586610    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-envoy\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:38:00.586847 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.586619    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-workload-certs\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:38:00.586847 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.586627    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-data\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:38:00.586847 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.586635    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv8gs\" (UniqueName: \"kubernetes.io/projected/b64248bc-2a3d-4eeb-942f-28b08bbc45db-kube-api-access-mv8gs\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:38:00.586847 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:00.586644    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b64248bc-2a3d-4eeb-942f-28b08bbc45db-istio-token\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:38:01.059855 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:01.059822    2558 generic.go:356] "Generic (PLEG): container finished" podID="b64248bc-2a3d-4eeb-942f-28b08bbc45db" containerID="04a0f05799e6accb2448e7d63f8a34af702d5717013b6a04acf1e2b64f75ef63" exitCode=0
Jul 14 18:38:01.060089 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:01.059882    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"
Jul 14 18:38:01.060089 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:01.059905    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz" event={"ID":"b64248bc-2a3d-4eeb-942f-28b08bbc45db","Type":"ContainerDied","Data":"04a0f05799e6accb2448e7d63f8a34af702d5717013b6a04acf1e2b64f75ef63"}
Jul 14 18:38:01.060089 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:01.059967    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz" event={"ID":"b64248bc-2a3d-4eeb-942f-28b08bbc45db","Type":"ContainerDied","Data":"3888b9b267853bacd4a59f8e1582ce7e3668d8db57ad5558faff53f109ecd4eb"}
Jul 14 18:38:01.060089 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:01.059996    2558 scope.go:117] "RemoveContainer" containerID="04a0f05799e6accb2448e7d63f8a34af702d5717013b6a04acf1e2b64f75ef63"
Jul 14 18:38:01.070160 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:01.070137    2558 scope.go:117] "RemoveContainer" containerID="b6bcbc39e329393e9ec5ecf3f45273b2fcf945c8f679f7cafab31e0e1a603849"
Jul 14 18:38:01.079551 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:01.079528    2558 scope.go:117] "RemoveContainer" containerID="04a0f05799e6accb2448e7d63f8a34af702d5717013b6a04acf1e2b64f75ef63"
Jul 14 18:38:01.079882 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:38:01.079864    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04a0f05799e6accb2448e7d63f8a34af702d5717013b6a04acf1e2b64f75ef63\": container with ID starting with 04a0f05799e6accb2448e7d63f8a34af702d5717013b6a04acf1e2b64f75ef63 not found: ID does not exist" containerID="04a0f05799e6accb2448e7d63f8a34af702d5717013b6a04acf1e2b64f75ef63"
Jul 14 18:38:01.079931 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:01.079893    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04a0f05799e6accb2448e7d63f8a34af702d5717013b6a04acf1e2b64f75ef63"} err="failed to get container status \"04a0f05799e6accb2448e7d63f8a34af702d5717013b6a04acf1e2b64f75ef63\": rpc error: code = NotFound desc = could not find container \"04a0f05799e6accb2448e7d63f8a34af702d5717013b6a04acf1e2b64f75ef63\": container with ID starting with 04a0f05799e6accb2448e7d63f8a34af702d5717013b6a04acf1e2b64f75ef63 not found: ID does not exist"
Jul 14 18:38:01.079931 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:01.079912    2558 scope.go:117] "RemoveContainer" containerID="b6bcbc39e329393e9ec5ecf3f45273b2fcf945c8f679f7cafab31e0e1a603849"
Jul 14 18:38:01.080160 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:38:01.080141    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6bcbc39e329393e9ec5ecf3f45273b2fcf945c8f679f7cafab31e0e1a603849\": container with ID starting with b6bcbc39e329393e9ec5ecf3f45273b2fcf945c8f679f7cafab31e0e1a603849 not found: ID does not exist" containerID="b6bcbc39e329393e9ec5ecf3f45273b2fcf945c8f679f7cafab31e0e1a603849"
Jul 14 18:38:01.080209 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:01.080168    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6bcbc39e329393e9ec5ecf3f45273b2fcf945c8f679f7cafab31e0e1a603849"} err="failed to get container status \"b6bcbc39e329393e9ec5ecf3f45273b2fcf945c8f679f7cafab31e0e1a603849\": rpc error: code = NotFound desc = could not find container \"b6bcbc39e329393e9ec5ecf3f45273b2fcf945c8f679f7cafab31e0e1a603849\": container with ID starting with b6bcbc39e329393e9ec5ecf3f45273b2fcf945c8f679f7cafab31e0e1a603849 not found: ID does not exist"
Jul 14 18:38:01.085335 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:01.085301    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"]
Jul 14 18:38:01.090922 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:01.090895    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-e0452a-openshift-default-7cbd8954b9-qslmz"]
Jul 14 18:38:02.441032 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:02.440998    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b64248bc-2a3d-4eeb-942f-28b08bbc45db" path="/var/lib/kubelet/pods/b64248bc-2a3d-4eeb-942f-28b08bbc45db/volumes"
Jul 14 18:38:08.996141 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:08.996091    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:38:21.326073 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:21.326038    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"]
Jul 14 18:38:21.326629 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:21.326247    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s" podUID="804f2d30-f232-43bb-bd7f-f07eace30ce6" containerName="istio-proxy" containerID="cri-o://a6b0aa2782f0cdf600aa121ad79af7f5455e5f301135ab65c9503c7199797787" gracePeriod=30
Jul 14 18:38:22.241208 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.241132    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"]
Jul 14 18:38:22.241589 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.241546    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b64248bc-2a3d-4eeb-942f-28b08bbc45db" containerName="istio-proxy"
Jul 14 18:38:22.241589 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.241583    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b64248bc-2a3d-4eeb-942f-28b08bbc45db" containerName="istio-proxy"
Jul 14 18:38:22.241690 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.241593    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b64248bc-2a3d-4eeb-942f-28b08bbc45db" containerName="istio-proxy"
Jul 14 18:38:22.241690 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.241599    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b64248bc-2a3d-4eeb-942f-28b08bbc45db" containerName="istio-proxy"
Jul 14 18:38:22.241690 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.241678    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b64248bc-2a3d-4eeb-942f-28b08bbc45db" containerName="istio-proxy"
Jul 14 18:38:22.241690 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.241687    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b64248bc-2a3d-4eeb-942f-28b08bbc45db" containerName="istio-proxy"
Jul 14 18:38:22.243798 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.243782    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.246764 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.246741    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-7e7ccb-openshift-default-dockercfg-4chw8\""
Jul 14 18:38:22.262438 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.262396    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"]
Jul 14 18:38:22.383183 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.383131    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d341ab49-2213-468a-993c-1e9cf75358f9-istio-token\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.383183 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.383185    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-credential-socket\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.383766 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.383206    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gcnn\" (UniqueName: \"kubernetes.io/projected/d341ab49-2213-468a-993c-1e9cf75358f9-kube-api-access-8gcnn\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.383766 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.383231    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-workload-certs\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.383766 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.383250    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-workload-socket\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.383766 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.383270    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d341ab49-2213-468a-993c-1e9cf75358f9-istio-podinfo\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.383766 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.383423    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d341ab49-2213-468a-993c-1e9cf75358f9-istiod-ca-cert\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.383766 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.383469    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-istio-envoy\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.383766 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.383521    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-istio-data\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.485127 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.485023    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d341ab49-2213-468a-993c-1e9cf75358f9-istiod-ca-cert\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.485127 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.485070    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-istio-envoy\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.485127 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.485107    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-istio-data\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.485413 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.485177    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d341ab49-2213-468a-993c-1e9cf75358f9-istio-token\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.485413 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.485213    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-credential-socket\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.485413 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.485241    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gcnn\" (UniqueName: \"kubernetes.io/projected/d341ab49-2213-468a-993c-1e9cf75358f9-kube-api-access-8gcnn\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.485413 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.485298    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-workload-certs\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.485413 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.485345    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-workload-socket\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.485413 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.485378    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d341ab49-2213-468a-993c-1e9cf75358f9-istio-podinfo\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.485760 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.485667    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-istio-data\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.485951 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.485930    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-credential-socket\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.486035 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.485960    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d341ab49-2213-468a-993c-1e9cf75358f9-istiod-ca-cert\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.486221 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.486195    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-workload-certs\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.486524 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.486499    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-workload-socket\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.487779 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.487752    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-istio-envoy\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.488093 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.488073    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d341ab49-2213-468a-993c-1e9cf75358f9-istio-podinfo\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.495575 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.495519    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d341ab49-2213-468a-993c-1e9cf75358f9-istio-token\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.495575 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.495552    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gcnn\" (UniqueName: \"kubernetes.io/projected/d341ab49-2213-468a-993c-1e9cf75358f9-kube-api-access-8gcnn\") pod \"e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") " pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.555808 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.555760    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:22.709317 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.709280    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"]
Jul 14 18:38:22.711476 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:38:22.711444    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd341ab49_2213_468a_993c_1e9cf75358f9.slice/crio-aee57a5a910de8fa5cbb59af27fc44e23760201dba0f8d0e754dea63beacacaf WatchSource:0}: Error finding container aee57a5a910de8fa5cbb59af27fc44e23760201dba0f8d0e754dea63beacacaf: Status 404 returned error can't find the container with id aee57a5a910de8fa5cbb59af27fc44e23760201dba0f8d0e754dea63beacacaf
Jul 14 18:38:22.713726 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.713691    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:38:22.713817 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.713760    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:38:22.713817 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:22.713790    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:38:23.189746 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:23.189706    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc" event={"ID":"d341ab49-2213-468a-993c-1e9cf75358f9","Type":"ContainerStarted","Data":"867894a62110aee95125c5482f53a0eb0d6f67fcb4c1f53025f45ea982df9fc8"}
Jul 14 18:38:23.189947 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:23.189762    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc" event={"ID":"d341ab49-2213-468a-993c-1e9cf75358f9","Type":"ContainerStarted","Data":"aee57a5a910de8fa5cbb59af27fc44e23760201dba0f8d0e754dea63beacacaf"}
Jul 14 18:38:23.215648 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:23.215590    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc" podStartSLOduration=1.21555006 podStartE2EDuration="1.21555006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:38:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:38:23.214166408 +0000 UTC m=+2621.319276393" watchObservedRunningTime="2026-07-14 18:38:23.21555006 +0000 UTC m=+2621.320660044"
Jul 14 18:38:23.547376 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:23.547281    2558 patch_prober.go:28] interesting pod/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 18:38:23.547376 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:23.547346    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s" podUID="804f2d30-f232-43bb-bd7f-f07eace30ce6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 18:38:23.556520 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:23.556482    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:23.561763 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:23.561733    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:24.196013 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:24.195980    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:24.197071 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:24.197054    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:26.580807 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.580779    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:38:26.724858 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.724815    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bh6m\" (UniqueName: \"kubernetes.io/projected/804f2d30-f232-43bb-bd7f-f07eace30ce6-kube-api-access-6bh6m\") pod \"804f2d30-f232-43bb-bd7f-f07eace30ce6\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") "
Jul 14 18:38:26.725075 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.724877    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/804f2d30-f232-43bb-bd7f-f07eace30ce6-istiod-ca-cert\") pod \"804f2d30-f232-43bb-bd7f-f07eace30ce6\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") "
Jul 14 18:38:26.725075 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.724902    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-token\") pod \"804f2d30-f232-43bb-bd7f-f07eace30ce6\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") "
Jul 14 18:38:26.725075 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.724926    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-credential-socket\") pod \"804f2d30-f232-43bb-bd7f-f07eace30ce6\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") "
Jul 14 18:38:26.725245 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.725145    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-envoy\") pod \"804f2d30-f232-43bb-bd7f-f07eace30ce6\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") "
Jul 14 18:38:26.725245 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.725172    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "804f2d30-f232-43bb-bd7f-f07eace30ce6" (UID: "804f2d30-f232-43bb-bd7f-f07eace30ce6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:38:26.725245 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.725196    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-workload-socket\") pod \"804f2d30-f232-43bb-bd7f-f07eace30ce6\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") "
Jul 14 18:38:26.725409 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.725258    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-workload-certs\") pod \"804f2d30-f232-43bb-bd7f-f07eace30ce6\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") "
Jul 14 18:38:26.725409 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.725318    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-podinfo\") pod \"804f2d30-f232-43bb-bd7f-f07eace30ce6\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") "
Jul 14 18:38:26.725409 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.725345    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-data\") pod \"804f2d30-f232-43bb-bd7f-f07eace30ce6\" (UID: \"804f2d30-f232-43bb-bd7f-f07eace30ce6\") "
Jul 14 18:38:26.725409 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.725391    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "804f2d30-f232-43bb-bd7f-f07eace30ce6" (UID: "804f2d30-f232-43bb-bd7f-f07eace30ce6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:38:26.725668 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.725419    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/804f2d30-f232-43bb-bd7f-f07eace30ce6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "804f2d30-f232-43bb-bd7f-f07eace30ce6" (UID: "804f2d30-f232-43bb-bd7f-f07eace30ce6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:38:26.725668 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.725494    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "804f2d30-f232-43bb-bd7f-f07eace30ce6" (UID: "804f2d30-f232-43bb-bd7f-f07eace30ce6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:38:26.725906 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.725719    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/804f2d30-f232-43bb-bd7f-f07eace30ce6-istiod-ca-cert\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:38:26.725906 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.725741    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-credential-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:38:26.725906 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.725861    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-workload-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:38:26.726074 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.725936    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-workload-certs\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:38:26.726723 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.726694    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-data" (OuterVolumeSpecName: "istio-data") pod "804f2d30-f232-43bb-bd7f-f07eace30ce6" (UID: "804f2d30-f232-43bb-bd7f-f07eace30ce6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:38:26.727349 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.727318    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-token" (OuterVolumeSpecName: "istio-token") pod "804f2d30-f232-43bb-bd7f-f07eace30ce6" (UID: "804f2d30-f232-43bb-bd7f-f07eace30ce6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:38:26.727349 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.727331    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "804f2d30-f232-43bb-bd7f-f07eace30ce6" (UID: "804f2d30-f232-43bb-bd7f-f07eace30ce6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:38:26.727468 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.727405    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/804f2d30-f232-43bb-bd7f-f07eace30ce6-kube-api-access-6bh6m" (OuterVolumeSpecName: "kube-api-access-6bh6m") pod "804f2d30-f232-43bb-bd7f-f07eace30ce6" (UID: "804f2d30-f232-43bb-bd7f-f07eace30ce6"). InnerVolumeSpecName "kube-api-access-6bh6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:38:26.727721 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.727706    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "804f2d30-f232-43bb-bd7f-f07eace30ce6" (UID: "804f2d30-f232-43bb-bd7f-f07eace30ce6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 18:38:26.826977 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.826936    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-podinfo\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:38:26.826977 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.826970    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-data\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:38:26.826977 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.826980    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bh6m\" (UniqueName: \"kubernetes.io/projected/804f2d30-f232-43bb-bd7f-f07eace30ce6-kube-api-access-6bh6m\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:38:26.826977 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.826990    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-token\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:38:26.827251 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:26.826998    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/804f2d30-f232-43bb-bd7f-f07eace30ce6-istio-envoy\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:38:27.216876 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:27.216834    2558 generic.go:356] "Generic (PLEG): container finished" podID="804f2d30-f232-43bb-bd7f-f07eace30ce6" containerID="a6b0aa2782f0cdf600aa121ad79af7f5455e5f301135ab65c9503c7199797787" exitCode=0
Jul 14 18:38:27.217063 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:27.216890    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"
Jul 14 18:38:27.217063 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:27.216921    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s" event={"ID":"804f2d30-f232-43bb-bd7f-f07eace30ce6","Type":"ContainerDied","Data":"a6b0aa2782f0cdf600aa121ad79af7f5455e5f301135ab65c9503c7199797787"}
Jul 14 18:38:27.217063 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:27.216995    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s" event={"ID":"804f2d30-f232-43bb-bd7f-f07eace30ce6","Type":"ContainerDied","Data":"7b086fa94eddf110b56c014e00769a59b331c30ba57dd210ebe17fd964607c63"}
Jul 14 18:38:27.217063 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:27.217027    2558 scope.go:117] "RemoveContainer" containerID="a6b0aa2782f0cdf600aa121ad79af7f5455e5f301135ab65c9503c7199797787"
Jul 14 18:38:27.227438 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:27.227417    2558 scope.go:117] "RemoveContainer" containerID="3155e56b36d64b4b504a4bbc748ff974a70ee58fec378924dd8832ea38c9a757"
Jul 14 18:38:27.237056 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:27.237034    2558 scope.go:117] "RemoveContainer" containerID="a6b0aa2782f0cdf600aa121ad79af7f5455e5f301135ab65c9503c7199797787"
Jul 14 18:38:27.237360 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:38:27.237338    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6b0aa2782f0cdf600aa121ad79af7f5455e5f301135ab65c9503c7199797787\": container with ID starting with a6b0aa2782f0cdf600aa121ad79af7f5455e5f301135ab65c9503c7199797787 not found: ID does not exist" containerID="a6b0aa2782f0cdf600aa121ad79af7f5455e5f301135ab65c9503c7199797787"
Jul 14 18:38:27.237442 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:27.237376    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6b0aa2782f0cdf600aa121ad79af7f5455e5f301135ab65c9503c7199797787"} err="failed to get container status \"a6b0aa2782f0cdf600aa121ad79af7f5455e5f301135ab65c9503c7199797787\": rpc error: code = NotFound desc = could not find container \"a6b0aa2782f0cdf600aa121ad79af7f5455e5f301135ab65c9503c7199797787\": container with ID starting with a6b0aa2782f0cdf600aa121ad79af7f5455e5f301135ab65c9503c7199797787 not found: ID does not exist"
Jul 14 18:38:27.237442 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:27.237402    2558 scope.go:117] "RemoveContainer" containerID="3155e56b36d64b4b504a4bbc748ff974a70ee58fec378924dd8832ea38c9a757"
Jul 14 18:38:27.237714 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:38:27.237695    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3155e56b36d64b4b504a4bbc748ff974a70ee58fec378924dd8832ea38c9a757\": container with ID starting with 3155e56b36d64b4b504a4bbc748ff974a70ee58fec378924dd8832ea38c9a757 not found: ID does not exist" containerID="3155e56b36d64b4b504a4bbc748ff974a70ee58fec378924dd8832ea38c9a757"
Jul 14 18:38:27.237781 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:27.237720    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3155e56b36d64b4b504a4bbc748ff974a70ee58fec378924dd8832ea38c9a757"} err="failed to get container status \"3155e56b36d64b4b504a4bbc748ff974a70ee58fec378924dd8832ea38c9a757\": rpc error: code = NotFound desc = could not find container \"3155e56b36d64b4b504a4bbc748ff974a70ee58fec378924dd8832ea38c9a757\": container with ID starting with 3155e56b36d64b4b504a4bbc748ff974a70ee58fec378924dd8832ea38c9a757 not found: ID does not exist"
Jul 14 18:38:27.253917 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:27.253885    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"]
Jul 14 18:38:27.256533 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:27.256494    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-b418a4-openshift-default-8d4ddb477-g6b2s"]
Jul 14 18:38:28.441523 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:28.441484    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="804f2d30-f232-43bb-bd7f-f07eace30ce6" path="/var/lib/kubelet/pods/804f2d30-f232-43bb-bd7f-f07eace30ce6/volumes"
Jul 14 18:38:29.323288 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:29.323253    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:38:30.316730 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.316673    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"]
Jul 14 18:38:30.317875 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.317847    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="804f2d30-f232-43bb-bd7f-f07eace30ce6" containerName="istio-proxy"
Jul 14 18:38:30.318041 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.318029    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="804f2d30-f232-43bb-bd7f-f07eace30ce6" containerName="istio-proxy"
Jul 14 18:38:30.318262 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.318249    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="804f2d30-f232-43bb-bd7f-f07eace30ce6" containerName="istio-proxy"
Jul 14 18:38:30.318360 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.318349    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="804f2d30-f232-43bb-bd7f-f07eace30ce6" containerName="istio-proxy"
Jul 14 18:38:30.330403 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.329846    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.334532 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.333525    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-b860a5-openshift-default-dockercfg-l4z2g\""
Jul 14 18:38:30.334532 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.334408    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"]
Jul 14 18:38:30.458974 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.458933    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-token\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.458974 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.458978    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-workload-certs\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.459212 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.459108    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfe1304f-5a11-4294-8016-627f6987d2b9-istiod-ca-cert\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.459212 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.459150    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lwqm\" (UniqueName: \"kubernetes.io/projected/cfe1304f-5a11-4294-8016-627f6987d2b9-kube-api-access-5lwqm\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.459284 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.459210    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-podinfo\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.459284 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.459250    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-workload-socket\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.459284 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.459265    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-envoy\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.459284 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.459282    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-credential-socket\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.459449 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.459299    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-data\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.559847 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.559804    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-podinfo\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.559847 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.559857    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-workload-socket\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.560106 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.559907    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-envoy\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.560106 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.559925    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-credential-socket\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.560106 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.559944    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-data\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.560106 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.559985    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-token\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.560106 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.560015    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-workload-certs\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.560106 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.560106    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfe1304f-5a11-4294-8016-627f6987d2b9-istiod-ca-cert\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.560384 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.560147    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lwqm\" (UniqueName: \"kubernetes.io/projected/cfe1304f-5a11-4294-8016-627f6987d2b9-kube-api-access-5lwqm\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.560444 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.560411    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-data\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.560652 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.560626    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-credential-socket\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.560827 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.560652    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-workload-socket\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.560827 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.560672    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-workload-certs\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.561440 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.561417    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfe1304f-5a11-4294-8016-627f6987d2b9-istiod-ca-cert\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.562620 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.562600    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-envoy\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.562733 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.562716    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-podinfo\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.573291 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.573207    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lwqm\" (UniqueName: \"kubernetes.io/projected/cfe1304f-5a11-4294-8016-627f6987d2b9-kube-api-access-5lwqm\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.574194 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.574167    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-token\") pod \"e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") " pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.643370 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.643334    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:30.827815 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.827774    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"]
Jul 14 18:38:30.828902 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:38:30.828869    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe1304f_5a11_4294_8016_627f6987d2b9.slice/crio-25e366df54a8c74fd79c856775102d285d32ff1690ebe11ef1ff2aa36e90a218 WatchSource:0}: Error finding container 25e366df54a8c74fd79c856775102d285d32ff1690ebe11ef1ff2aa36e90a218: Status 404 returned error can't find the container with id 25e366df54a8c74fd79c856775102d285d32ff1690ebe11ef1ff2aa36e90a218
Jul 14 18:38:30.831071 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.831037    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:38:30.831139 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.831112    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:38:30.831180 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:30.831139    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:38:31.246478 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:31.246438    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg" event={"ID":"cfe1304f-5a11-4294-8016-627f6987d2b9","Type":"ContainerStarted","Data":"21a13c09840c07996fe981a2b1ca57394e147e5d42c023d8743cd0521a92d564"}
Jul 14 18:38:31.246685 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:31.246522    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg" event={"ID":"cfe1304f-5a11-4294-8016-627f6987d2b9","Type":"ContainerStarted","Data":"25e366df54a8c74fd79c856775102d285d32ff1690ebe11ef1ff2aa36e90a218"}
Jul 14 18:38:31.270718 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:31.270664    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg" podStartSLOduration=1.270647516 podStartE2EDuration="1.270647516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:38:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:38:31.267759369 +0000 UTC m=+2629.372869352" watchObservedRunningTime="2026-07-14 18:38:31.270647516 +0000 UTC m=+2629.375757570"
Jul 14 18:38:31.643998 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:31.643955    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:31.649264 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:31.649233    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:32.252990 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:32.252956    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:32.253977 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:32.253956    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:38.291918 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:38.291885    2558 generic.go:356] "Generic (PLEG): container finished" podID="d341ab49-2213-468a-993c-1e9cf75358f9" containerID="867894a62110aee95125c5482f53a0eb0d6f67fcb4c1f53025f45ea982df9fc8" exitCode=0
Jul 14 18:38:38.292365 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:38.291965    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc" event={"ID":"d341ab49-2213-468a-993c-1e9cf75358f9","Type":"ContainerDied","Data":"867894a62110aee95125c5482f53a0eb0d6f67fcb4c1f53025f45ea982df9fc8"}
Jul 14 18:38:38.292424 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:38.292408    2558 scope.go:117] "RemoveContainer" containerID="867894a62110aee95125c5482f53a0eb0d6f67fcb4c1f53025f45ea982df9fc8"
Jul 14 18:38:38.293497 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:38.293466    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:38:38.293633 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:38.293616    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:38:38.293680 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:38.293656    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:38:39.195968 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:39.195925    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:39.300242 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:39.300190    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc" event={"ID":"d341ab49-2213-468a-993c-1e9cf75358f9","Type":"ContainerStarted","Data":"25180299a1a38c652102a383ca35fcc6b3a75307409b600688f64de08089e09c"}
Jul 14 18:38:39.556695 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:39.556594    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:39.557897 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:39.557872    2558 patch_prober.go:28] interesting pod/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 14 18:38:39.557982 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:39.557937    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc" podUID="d341ab49-2213-468a-993c-1e9cf75358f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 14 18:38:40.556346 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:40.556307    2558 patch_prober.go:28] interesting pod/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 14 18:38:40.556752 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:40.556366    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc" podUID="d341ab49-2213-468a-993c-1e9cf75358f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 14 18:38:40.619686 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:40.619643    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:38:41.556299 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:41.556259    2558 patch_prober.go:28] interesting pod/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 14 18:38:41.556491 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:41.556321    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc" podUID="d341ab49-2213-468a-993c-1e9cf75358f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 14 18:38:42.556418 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:42.556374    2558 patch_prober.go:28] interesting pod/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 14 18:38:42.556620 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:42.556435    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc" podUID="d341ab49-2213-468a-993c-1e9cf75358f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 14 18:38:43.560974 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:43.560943    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:43.561392 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:43.561345    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:43.562009 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:43.561989    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:38:48.294824 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:48.294784    2558 patch_prober.go:28] interesting pod/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 14 18:38:48.295257 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:48.294895    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg" podUID="cfe1304f-5a11-4294-8016-627f6987d2b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 14 18:38:49.380714 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:49.380676    2558 generic.go:356] "Generic (PLEG): container finished" podID="cfe1304f-5a11-4294-8016-627f6987d2b9" containerID="21a13c09840c07996fe981a2b1ca57394e147e5d42c023d8743cd0521a92d564" exitCode=0
Jul 14 18:38:49.381244 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:49.380756    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg" event={"ID":"cfe1304f-5a11-4294-8016-627f6987d2b9","Type":"ContainerDied","Data":"21a13c09840c07996fe981a2b1ca57394e147e5d42c023d8743cd0521a92d564"}
Jul 14 18:38:49.381320 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:49.381302    2558 scope.go:117] "RemoveContainer" containerID="21a13c09840c07996fe981a2b1ca57394e147e5d42c023d8743cd0521a92d564"
Jul 14 18:38:49.382447 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:49.382418    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:38:49.382508 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:49.382487    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:38:49.382549 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:49.382520    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 18:38:50.389192 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:50.389162    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg" event={"ID":"cfe1304f-5a11-4294-8016-627f6987d2b9","Type":"ContainerStarted","Data":"47025c884d42ec35085f259a14a023ce1b0eb76cddff912e60a18944dbba352d"}
Jul 14 18:38:50.643839 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:50.643753    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:50.644008 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:50.643968    2558 patch_prober.go:28] interesting pod/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 14 18:38:50.644071 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:50.644027    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg" podUID="cfe1304f-5a11-4294-8016-627f6987d2b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 14 18:38:51.644087 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:51.644050    2558 patch_prober.go:28] interesting pod/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 14 18:38:51.644494 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:51.644110    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg" podUID="cfe1304f-5a11-4294-8016-627f6987d2b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 14 18:38:52.644656 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:52.644617    2558 patch_prober.go:28] interesting pod/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 14 18:38:52.645140 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:52.644679    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg" podUID="cfe1304f-5a11-4294-8016-627f6987d2b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 14 18:38:53.116545 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:53.116497    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:38:53.644229 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:53.644187    2558 patch_prober.go:28] interesting pod/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 14 18:38:53.644430 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:53.644258    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg" podUID="cfe1304f-5a11-4294-8016-627f6987d2b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 14 18:38:54.647974 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:54.647939    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:54.648418 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:54.648399    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:38:54.649171 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:38:54.649151    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:39:11.527592 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:39:11.527532    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:39:24.516302 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:39:24.516264    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:39:42.581052 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:39:42.581020    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 18:39:42.587169 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:39:42.587148    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 18:39:43.378846 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:39:43.378803    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:39:59.421068 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:39:59.421027    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:40:15.637115 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:40:15.637073    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:40:31.119572 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:40:31.119533    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:40:51.019496 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:40:51.019459    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:41:07.324879 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:07.324787    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:41:07.972677 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:07.972639    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"]
Jul 14 18:41:07.973044 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:07.973030    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="804f2d30-f232-43bb-bd7f-f07eace30ce6" containerName="istio-proxy"
Jul 14 18:41:07.973103 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:07.973046    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="804f2d30-f232-43bb-bd7f-f07eace30ce6" containerName="istio-proxy"
Jul 14 18:41:07.975322 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:07.975304    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:07.981805 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:07.978144    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7e7ccb\"/\"default-dockercfg-2kjkj\""
Jul 14 18:41:07.981805 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:07.979311    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7e7ccb\"/\"sub-test-model-7e7ccb-kserve-self-signed-certs\""
Jul 14 18:41:07.981805 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:07.979433    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7e7ccb\"/\"openshift-service-ca.crt\""
Jul 14 18:41:07.981805 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:07.979498    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7e7ccb\"/\"kube-root-ca.crt\""
Jul 14 18:41:07.988195 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:07.988168    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"]
Jul 14 18:41:08.113070 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:08.113024    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-home\") pod \"sub-test-model-7e7ccb-kserve-79574d768f-4cn69\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") " pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:08.113255 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:08.113094    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-tmp-dir\") pod \"sub-test-model-7e7ccb-kserve-79574d768f-4cn69\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") " pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:08.113255 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:08.113147    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-dshm\") pod \"sub-test-model-7e7ccb-kserve-79574d768f-4cn69\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") " pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:08.113255 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:08.113173    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42phk\" (UniqueName: \"kubernetes.io/projected/406f0425-2aa6-4fb1-9b4d-283c914367d7-kube-api-access-42phk\") pod \"sub-test-model-7e7ccb-kserve-79574d768f-4cn69\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") " pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:08.113362 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:08.113284    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-model-cache\") pod \"sub-test-model-7e7ccb-kserve-79574d768f-4cn69\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") " pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:08.113362 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:08.113319    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/406f0425-2aa6-4fb1-9b4d-283c914367d7-tls-certs\") pod \"sub-test-model-7e7ccb-kserve-79574d768f-4cn69\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") " pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:08.214640 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:08.214598    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-dshm\") pod \"sub-test-model-7e7ccb-kserve-79574d768f-4cn69\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") " pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:08.214640 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:08.214643    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42phk\" (UniqueName: \"kubernetes.io/projected/406f0425-2aa6-4fb1-9b4d-283c914367d7-kube-api-access-42phk\") pod \"sub-test-model-7e7ccb-kserve-79574d768f-4cn69\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") " pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:08.214884 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:08.214698    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-model-cache\") pod \"sub-test-model-7e7ccb-kserve-79574d768f-4cn69\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") " pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:08.214884 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:08.214713    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/406f0425-2aa6-4fb1-9b4d-283c914367d7-tls-certs\") pod \"sub-test-model-7e7ccb-kserve-79574d768f-4cn69\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") " pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:08.214884 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:08.214750    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-home\") pod \"sub-test-model-7e7ccb-kserve-79574d768f-4cn69\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") " pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:08.214884 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:08.214784    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-tmp-dir\") pod \"sub-test-model-7e7ccb-kserve-79574d768f-4cn69\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") " pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:08.215179 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:08.215156    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-model-cache\") pod \"sub-test-model-7e7ccb-kserve-79574d768f-4cn69\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") " pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:08.215259 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:08.215192    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-home\") pod \"sub-test-model-7e7ccb-kserve-79574d768f-4cn69\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") " pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:08.215300 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:08.215261    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-tmp-dir\") pod \"sub-test-model-7e7ccb-kserve-79574d768f-4cn69\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") " pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:08.217122 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:08.217102    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-dshm\") pod \"sub-test-model-7e7ccb-kserve-79574d768f-4cn69\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") " pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:08.217305 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:08.217287    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/406f0425-2aa6-4fb1-9b4d-283c914367d7-tls-certs\") pod \"sub-test-model-7e7ccb-kserve-79574d768f-4cn69\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") " pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:08.229032 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:08.228951    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42phk\" (UniqueName: \"kubernetes.io/projected/406f0425-2aa6-4fb1-9b4d-283c914367d7-kube-api-access-42phk\") pod \"sub-test-model-7e7ccb-kserve-79574d768f-4cn69\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") " pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:08.289341 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:08.289296    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:08.442647 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:41:08.442618    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod406f0425_2aa6_4fb1_9b4d_283c914367d7.slice/crio-6ebe264e1e3cd16a33886dab004f0e040f88232f819d372df65e2e16d91895c5 WatchSource:0}: Error finding container 6ebe264e1e3cd16a33886dab004f0e040f88232f819d372df65e2e16d91895c5: Status 404 returned error can't find the container with id 6ebe264e1e3cd16a33886dab004f0e040f88232f819d372df65e2e16d91895c5
Jul 14 18:41:08.443657 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:08.443629    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"]
Jul 14 18:41:08.444483 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:08.444468    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 18:41:09.204442 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:09.204398    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69" event={"ID":"406f0425-2aa6-4fb1-9b4d-283c914367d7","Type":"ContainerStarted","Data":"6ebe264e1e3cd16a33886dab004f0e040f88232f819d372df65e2e16d91895c5"}
Jul 14 18:41:10.212801 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:10.212757    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69" event={"ID":"406f0425-2aa6-4fb1-9b4d-283c914367d7","Type":"ContainerStarted","Data":"44cfb7be8a29375553a666f5e19557e61e767201cb25e9e7e1b413c000f4f326"}
Jul 14 18:41:10.235133 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:10.235075    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69" podStartSLOduration=2.229318857 podStartE2EDuration="3.235057461s" totalImagesPullingTime="1.005738604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:41:10.232236334 +0000 UTC m=+2788.337346331" watchObservedRunningTime="2026-07-14 18:41:10.235057461 +0000 UTC m=+2788.340167446"
Jul 14 18:41:18.289474 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:18.289427    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:18.289931 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:18.289497    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:18.302255 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:18.302223    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:19.281284 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:19.281255    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:41:22.427346 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:22.427310    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:41:37.426339 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:37.426297    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:41:55.116486 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:41:55.116437    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:42:14.421478 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:14.421436    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:42:20.811901 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:20.811865    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"]
Jul 14 18:42:32.042053 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:32.042009    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:42:35.832607 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:35.832454    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69" podUID="406f0425-2aa6-4fb1-9b4d-283c914367d7" containerName="main" containerID="cri-o://44cfb7be8a29375553a666f5e19557e61e767201cb25e9e7e1b413c000f4f326" gracePeriod=45
Jul 14 18:42:36.088603 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.088583    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:42:36.225019 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.224970    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-tmp-dir\") pod \"406f0425-2aa6-4fb1-9b4d-283c914367d7\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") "
Jul 14 18:42:36.225019 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.225021    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/406f0425-2aa6-4fb1-9b4d-283c914367d7-tls-certs\") pod \"406f0425-2aa6-4fb1-9b4d-283c914367d7\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") "
Jul 14 18:42:36.225283 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.225050    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42phk\" (UniqueName: \"kubernetes.io/projected/406f0425-2aa6-4fb1-9b4d-283c914367d7-kube-api-access-42phk\") pod \"406f0425-2aa6-4fb1-9b4d-283c914367d7\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") "
Jul 14 18:42:36.225283 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.225070    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-home\") pod \"406f0425-2aa6-4fb1-9b4d-283c914367d7\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") "
Jul 14 18:42:36.225283 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.225116    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-model-cache\") pod \"406f0425-2aa6-4fb1-9b4d-283c914367d7\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") "
Jul 14 18:42:36.225283 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.225141    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-dshm\") pod \"406f0425-2aa6-4fb1-9b4d-283c914367d7\" (UID: \"406f0425-2aa6-4fb1-9b4d-283c914367d7\") "
Jul 14 18:42:36.225507 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.225302    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "406f0425-2aa6-4fb1-9b4d-283c914367d7" (UID: "406f0425-2aa6-4fb1-9b4d-283c914367d7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:42:36.225507 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.225433    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-home" (OuterVolumeSpecName: "home") pod "406f0425-2aa6-4fb1-9b4d-283c914367d7" (UID: "406f0425-2aa6-4fb1-9b4d-283c914367d7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:42:36.225507 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.225451    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-model-cache" (OuterVolumeSpecName: "model-cache") pod "406f0425-2aa6-4fb1-9b4d-283c914367d7" (UID: "406f0425-2aa6-4fb1-9b4d-283c914367d7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:42:36.225696 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.225629    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-model-cache\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:42:36.225696 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.225647    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-tmp-dir\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:42:36.225696 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.225661    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-home\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:42:36.227521 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.227499    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-dshm" (OuterVolumeSpecName: "dshm") pod "406f0425-2aa6-4fb1-9b4d-283c914367d7" (UID: "406f0425-2aa6-4fb1-9b4d-283c914367d7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:42:36.227835 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.227819    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/406f0425-2aa6-4fb1-9b4d-283c914367d7-kube-api-access-42phk" (OuterVolumeSpecName: "kube-api-access-42phk") pod "406f0425-2aa6-4fb1-9b4d-283c914367d7" (UID: "406f0425-2aa6-4fb1-9b4d-283c914367d7"). InnerVolumeSpecName "kube-api-access-42phk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:42:36.227835 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.227823    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/406f0425-2aa6-4fb1-9b4d-283c914367d7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "406f0425-2aa6-4fb1-9b4d-283c914367d7" (UID: "406f0425-2aa6-4fb1-9b4d-283c914367d7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 18:42:36.326404 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.326353    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/406f0425-2aa6-4fb1-9b4d-283c914367d7-dshm\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:42:36.326404 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.326396    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/406f0425-2aa6-4fb1-9b4d-283c914367d7-tls-certs\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:42:36.326404 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.326410    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42phk\" (UniqueName: \"kubernetes.io/projected/406f0425-2aa6-4fb1-9b4d-283c914367d7-kube-api-access-42phk\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:42:36.389131 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.389046    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"]
Jul 14 18:42:36.389445 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.389433    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="406f0425-2aa6-4fb1-9b4d-283c914367d7" containerName="main"
Jul 14 18:42:36.389487 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.389447    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="406f0425-2aa6-4fb1-9b4d-283c914367d7" containerName="main"
Jul 14 18:42:36.389527 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.389506    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="406f0425-2aa6-4fb1-9b4d-283c914367d7" containerName="main"
Jul 14 18:42:36.392634 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.392617    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:42:36.396488 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.396461    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7e7ccb\"/\"rate-test-model-7e7ccb-kserve-self-signed-certs\""
Jul 14 18:42:36.404729 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.404707    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"]
Jul 14 18:42:36.528969 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.528917    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-tls-certs\") pod \"rate-test-model-7e7ccb-kserve-69b5566ddc-298f2\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") " pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:42:36.528969 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.528969    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-dshm\") pod \"rate-test-model-7e7ccb-kserve-69b5566ddc-298f2\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") " pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:42:36.529195 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.529035    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-model-cache\") pod \"rate-test-model-7e7ccb-kserve-69b5566ddc-298f2\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") " pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:42:36.529195 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.529066    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57s7j\" (UniqueName: \"kubernetes.io/projected/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-kube-api-access-57s7j\") pod \"rate-test-model-7e7ccb-kserve-69b5566ddc-298f2\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") " pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:42:36.529195 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.529109    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-tmp-dir\") pod \"rate-test-model-7e7ccb-kserve-69b5566ddc-298f2\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") " pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:42:36.529195 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.529147    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-home\") pod \"rate-test-model-7e7ccb-kserve-69b5566ddc-298f2\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") " pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:42:36.629806 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.629768    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-tls-certs\") pod \"rate-test-model-7e7ccb-kserve-69b5566ddc-298f2\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") " pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:42:36.629991 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.629817    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-dshm\") pod \"rate-test-model-7e7ccb-kserve-69b5566ddc-298f2\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") " pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:42:36.629991 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.629881    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-model-cache\") pod \"rate-test-model-7e7ccb-kserve-69b5566ddc-298f2\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") " pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:42:36.629991 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.629926    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57s7j\" (UniqueName: \"kubernetes.io/projected/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-kube-api-access-57s7j\") pod \"rate-test-model-7e7ccb-kserve-69b5566ddc-298f2\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") " pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:42:36.630160 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.630061    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-tmp-dir\") pod \"rate-test-model-7e7ccb-kserve-69b5566ddc-298f2\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") " pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:42:36.630160 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.630119    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-home\") pod \"rate-test-model-7e7ccb-kserve-69b5566ddc-298f2\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") " pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:42:36.630319 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.630301    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-model-cache\") pod \"rate-test-model-7e7ccb-kserve-69b5566ddc-298f2\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") " pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:42:36.630407 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.630389    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-tmp-dir\") pod \"rate-test-model-7e7ccb-kserve-69b5566ddc-298f2\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") " pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:42:36.630474 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.630461    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-home\") pod \"rate-test-model-7e7ccb-kserve-69b5566ddc-298f2\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") " pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:42:36.632200 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.632177    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-dshm\") pod \"rate-test-model-7e7ccb-kserve-69b5566ddc-298f2\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") " pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:42:36.632460 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.632443    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-tls-certs\") pod \"rate-test-model-7e7ccb-kserve-69b5566ddc-298f2\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") " pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:42:36.638462 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.638441    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57s7j\" (UniqueName: \"kubernetes.io/projected/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-kube-api-access-57s7j\") pod \"rate-test-model-7e7ccb-kserve-69b5566ddc-298f2\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") " pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:42:36.703428 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.703344    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:42:36.718772 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.718738    2558 generic.go:356] "Generic (PLEG): container finished" podID="406f0425-2aa6-4fb1-9b4d-283c914367d7" containerID="44cfb7be8a29375553a666f5e19557e61e767201cb25e9e7e1b413c000f4f326" exitCode=0
Jul 14 18:42:36.718908 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.718789    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"
Jul 14 18:42:36.718908 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.718848    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69" event={"ID":"406f0425-2aa6-4fb1-9b4d-283c914367d7","Type":"ContainerDied","Data":"44cfb7be8a29375553a666f5e19557e61e767201cb25e9e7e1b413c000f4f326"}
Jul 14 18:42:36.718908 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.718897    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69" event={"ID":"406f0425-2aa6-4fb1-9b4d-283c914367d7","Type":"ContainerDied","Data":"6ebe264e1e3cd16a33886dab004f0e040f88232f819d372df65e2e16d91895c5"}
Jul 14 18:42:36.719050 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.718920    2558 scope.go:117] "RemoveContainer" containerID="44cfb7be8a29375553a666f5e19557e61e767201cb25e9e7e1b413c000f4f326"
Jul 14 18:42:36.729953 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.729929    2558 scope.go:117] "RemoveContainer" containerID="44cfb7be8a29375553a666f5e19557e61e767201cb25e9e7e1b413c000f4f326"
Jul 14 18:42:36.730278 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:42:36.730262    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44cfb7be8a29375553a666f5e19557e61e767201cb25e9e7e1b413c000f4f326\": container with ID starting with 44cfb7be8a29375553a666f5e19557e61e767201cb25e9e7e1b413c000f4f326 not found: ID does not exist" containerID="44cfb7be8a29375553a666f5e19557e61e767201cb25e9e7e1b413c000f4f326"
Jul 14 18:42:36.730339 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.730286    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44cfb7be8a29375553a666f5e19557e61e767201cb25e9e7e1b413c000f4f326"} err="failed to get container status \"44cfb7be8a29375553a666f5e19557e61e767201cb25e9e7e1b413c000f4f326\": rpc error: code = NotFound desc = could not find container \"44cfb7be8a29375553a666f5e19557e61e767201cb25e9e7e1b413c000f4f326\": container with ID starting with 44cfb7be8a29375553a666f5e19557e61e767201cb25e9e7e1b413c000f4f326 not found: ID does not exist"
Jul 14 18:42:36.743716 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.743684    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"]
Jul 14 18:42:36.760778 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.760744    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7e7ccb/sub-test-model-7e7ccb-kserve-79574d768f-4cn69"]
Jul 14 18:42:36.876507 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:36.876480    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"]
Jul 14 18:42:36.878149 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:42:36.878120    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ee4b41c_7788_4593_8bbf_bb6e7bfec2c8.slice/crio-398edb20a666167a20292dffcf1e0e6c4d5627222ab645a00b861340d944fc06 WatchSource:0}: Error finding container 398edb20a666167a20292dffcf1e0e6c4d5627222ab645a00b861340d944fc06: Status 404 returned error can't find the container with id 398edb20a666167a20292dffcf1e0e6c4d5627222ab645a00b861340d944fc06
Jul 14 18:42:37.729543 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:37.729507    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2" event={"ID":"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8","Type":"ContainerStarted","Data":"fac232242f22ece79f4bd72a7556c9f0d0d3ceebdf98a9e4416c66d90c1ebd17"}
Jul 14 18:42:37.729543 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:37.729574    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2" event={"ID":"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8","Type":"ContainerStarted","Data":"398edb20a666167a20292dffcf1e0e6c4d5627222ab645a00b861340d944fc06"}
Jul 14 18:42:37.750686 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:37.750634    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2" podStartSLOduration=1.750619091 podStartE2EDuration="1.750619091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:42:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:42:37.749796427 +0000 UTC m=+2875.854906415" watchObservedRunningTime="2026-07-14 18:42:37.750619091 +0000 UTC m=+2875.855729076"
Jul 14 18:42:38.440966 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:38.440929    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="406f0425-2aa6-4fb1-9b4d-283c914367d7" path="/var/lib/kubelet/pods/406f0425-2aa6-4fb1-9b4d-283c914367d7/volumes"
Jul 14 18:42:42.824297 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:42.824261    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:42:46.703685 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:46.703633    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:42:46.704121 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:46.703705    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:42:46.716299 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:46.716264    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:42:46.793152 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:42:46.793121    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:44:03.310681 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:44:03.310595    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:44:27.018308 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:44:27.018270    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:44:41.232107 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:44:41.232063    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:44:42.618907 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:44:42.618877    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 18:44:42.626718 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:44:42.626693    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkf5f_3089991f-8aa5-4b20-b767-8b8c8ff17c05/ovn-acl-logging/0.log"
Jul 14 18:44:46.607340 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:44:46.607291    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"]
Jul 14 18:44:54.121784 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:44:54.121745    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:45:01.628226 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:01.628164    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2" podUID="8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8" containerName="main" containerID="cri-o://fac232242f22ece79f4bd72a7556c9f0d0d3ceebdf98a9e4416c66d90c1ebd17" gracePeriod=45
Jul 14 18:45:01.892156 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:01.892080    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:45:01.957879 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:01.957839    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-tls-certs\") pod \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") "
Jul 14 18:45:01.957879 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:01.957885    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-tmp-dir\") pod \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") "
Jul 14 18:45:01.958108 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:01.957909    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-home\") pod \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") "
Jul 14 18:45:01.958108 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:01.957949    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-model-cache\") pod \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") "
Jul 14 18:45:01.958108 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:01.958029    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-dshm\") pod \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") "
Jul 14 18:45:01.958108 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:01.958059    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57s7j\" (UniqueName: \"kubernetes.io/projected/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-kube-api-access-57s7j\") pod \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\" (UID: \"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8\") "
Jul 14 18:45:01.958296 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:01.958219    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-home" (OuterVolumeSpecName: "home") pod "8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8" (UID: "8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:45:01.958296 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:01.958215    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8" (UID: "8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:45:01.958421 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:01.958321    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-model-cache" (OuterVolumeSpecName: "model-cache") pod "8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8" (UID: "8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:45:01.958481 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:01.958432    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-tmp-dir\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:45:01.958481 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:01.958450    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-home\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:45:01.958481 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:01.958463    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-model-cache\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:45:01.960299 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:01.960270    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-dshm" (OuterVolumeSpecName: "dshm") pod "8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8" (UID: "8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:45:01.960451 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:01.960305    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-kube-api-access-57s7j" (OuterVolumeSpecName: "kube-api-access-57s7j") pod "8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8" (UID: "8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8"). InnerVolumeSpecName "kube-api-access-57s7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:45:01.960451 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:01.960390    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8" (UID: "8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 18:45:02.059200 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:02.059160    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-tls-certs\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:45:02.059200 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:02.059192    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-dshm\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:45:02.059200 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:02.059203    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57s7j\" (UniqueName: \"kubernetes.io/projected/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8-kube-api-access-57s7j\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:45:02.587940 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:02.587901    2558 generic.go:356] "Generic (PLEG): container finished" podID="8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8" containerID="fac232242f22ece79f4bd72a7556c9f0d0d3ceebdf98a9e4416c66d90c1ebd17" exitCode=0
Jul 14 18:45:02.588110 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:02.587960    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"
Jul 14 18:45:02.588110 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:02.587988    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2" event={"ID":"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8","Type":"ContainerDied","Data":"fac232242f22ece79f4bd72a7556c9f0d0d3ceebdf98a9e4416c66d90c1ebd17"}
Jul 14 18:45:02.588110 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:02.588034    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2" event={"ID":"8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8","Type":"ContainerDied","Data":"398edb20a666167a20292dffcf1e0e6c4d5627222ab645a00b861340d944fc06"}
Jul 14 18:45:02.588110 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:02.588053    2558 scope.go:117] "RemoveContainer" containerID="fac232242f22ece79f4bd72a7556c9f0d0d3ceebdf98a9e4416c66d90c1ebd17"
Jul 14 18:45:02.597847 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:02.597825    2558 scope.go:117] "RemoveContainer" containerID="fac232242f22ece79f4bd72a7556c9f0d0d3ceebdf98a9e4416c66d90c1ebd17"
Jul 14 18:45:02.598175 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:45:02.598153    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fac232242f22ece79f4bd72a7556c9f0d0d3ceebdf98a9e4416c66d90c1ebd17\": container with ID starting with fac232242f22ece79f4bd72a7556c9f0d0d3ceebdf98a9e4416c66d90c1ebd17 not found: ID does not exist" containerID="fac232242f22ece79f4bd72a7556c9f0d0d3ceebdf98a9e4416c66d90c1ebd17"
Jul 14 18:45:02.598254 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:02.598189    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fac232242f22ece79f4bd72a7556c9f0d0d3ceebdf98a9e4416c66d90c1ebd17"} err="failed to get container status \"fac232242f22ece79f4bd72a7556c9f0d0d3ceebdf98a9e4416c66d90c1ebd17\": rpc error: code = NotFound desc = could not find container \"fac232242f22ece79f4bd72a7556c9f0d0d3ceebdf98a9e4416c66d90c1ebd17\": container with ID starting with fac232242f22ece79f4bd72a7556c9f0d0d3ceebdf98a9e4416c66d90c1ebd17 not found: ID does not exist"
Jul 14 18:45:02.608953 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:02.608924    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"]
Jul 14 18:45:02.615449 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:02.615422    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7e7ccb/rate-test-model-7e7ccb-kserve-69b5566ddc-298f2"]
Jul 14 18:45:04.441662 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:04.441631    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8" path="/var/lib/kubelet/pods/8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8/volumes"
Jul 14 18:45:20.827493 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:20.827455    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:45:32.856810 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:32.856716    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"]
Jul 14 18:45:32.857339 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:32.856928    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc" podUID="d341ab49-2213-468a-993c-1e9cf75358f9" containerName="istio-proxy" containerID="cri-o://25180299a1a38c652102a383ca35fcc6b3a75307409b600688f64de08089e09c" gracePeriod=30
Jul 14 18:45:38.114100 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.114071    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:45:38.296316 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.296227    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-credential-socket\") pod \"d341ab49-2213-468a-993c-1e9cf75358f9\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") "
Jul 14 18:45:38.296316 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.296264    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-workload-certs\") pod \"d341ab49-2213-468a-993c-1e9cf75358f9\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") "
Jul 14 18:45:38.296316 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.296311    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gcnn\" (UniqueName: \"kubernetes.io/projected/d341ab49-2213-468a-993c-1e9cf75358f9-kube-api-access-8gcnn\") pod \"d341ab49-2213-468a-993c-1e9cf75358f9\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") "
Jul 14 18:45:38.296670 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.296335    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d341ab49-2213-468a-993c-1e9cf75358f9-istio-podinfo\") pod \"d341ab49-2213-468a-993c-1e9cf75358f9\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") "
Jul 14 18:45:38.296670 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.296382    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d341ab49-2213-468a-993c-1e9cf75358f9-istio-token\") pod \"d341ab49-2213-468a-993c-1e9cf75358f9\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") "
Jul 14 18:45:38.296670 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.296415    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-istio-envoy\") pod \"d341ab49-2213-468a-993c-1e9cf75358f9\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") "
Jul 14 18:45:38.296670 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.296461    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d341ab49-2213-468a-993c-1e9cf75358f9-istiod-ca-cert\") pod \"d341ab49-2213-468a-993c-1e9cf75358f9\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") "
Jul 14 18:45:38.296670 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.296483    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-istio-data\") pod \"d341ab49-2213-468a-993c-1e9cf75358f9\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") "
Jul 14 18:45:38.296670 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.296509    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-workload-socket\") pod \"d341ab49-2213-468a-993c-1e9cf75358f9\" (UID: \"d341ab49-2213-468a-993c-1e9cf75358f9\") "
Jul 14 18:45:38.296670 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.296595    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d341ab49-2213-468a-993c-1e9cf75358f9" (UID: "d341ab49-2213-468a-993c-1e9cf75358f9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:45:38.297033 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.296720    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d341ab49-2213-468a-993c-1e9cf75358f9" (UID: "d341ab49-2213-468a-993c-1e9cf75358f9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:45:38.297033 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.296898    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-credential-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:45:38.297033 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.296919    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-workload-certs\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:45:38.297033 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.296917    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d341ab49-2213-468a-993c-1e9cf75358f9" (UID: "d341ab49-2213-468a-993c-1e9cf75358f9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:45:38.297239 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.297134    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d341ab49-2213-468a-993c-1e9cf75358f9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d341ab49-2213-468a-993c-1e9cf75358f9" (UID: "d341ab49-2213-468a-993c-1e9cf75358f9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:45:38.297547 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.297517    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-istio-data" (OuterVolumeSpecName: "istio-data") pod "d341ab49-2213-468a-993c-1e9cf75358f9" (UID: "d341ab49-2213-468a-993c-1e9cf75358f9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:45:38.299310 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.299282    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d341ab49-2213-468a-993c-1e9cf75358f9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d341ab49-2213-468a-993c-1e9cf75358f9" (UID: "d341ab49-2213-468a-993c-1e9cf75358f9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 18:45:38.299310 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.299282    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d341ab49-2213-468a-993c-1e9cf75358f9" (UID: "d341ab49-2213-468a-993c-1e9cf75358f9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:45:38.299474 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.299396    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d341ab49-2213-468a-993c-1e9cf75358f9-istio-token" (OuterVolumeSpecName: "istio-token") pod "d341ab49-2213-468a-993c-1e9cf75358f9" (UID: "d341ab49-2213-468a-993c-1e9cf75358f9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:45:38.299474 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.299420    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d341ab49-2213-468a-993c-1e9cf75358f9-kube-api-access-8gcnn" (OuterVolumeSpecName: "kube-api-access-8gcnn") pod "d341ab49-2213-468a-993c-1e9cf75358f9" (UID: "d341ab49-2213-468a-993c-1e9cf75358f9"). InnerVolumeSpecName "kube-api-access-8gcnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:45:38.397427 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.397394    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gcnn\" (UniqueName: \"kubernetes.io/projected/d341ab49-2213-468a-993c-1e9cf75358f9-kube-api-access-8gcnn\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:45:38.397427 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.397420    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d341ab49-2213-468a-993c-1e9cf75358f9-istio-podinfo\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:45:38.397427 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.397430    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d341ab49-2213-468a-993c-1e9cf75358f9-istio-token\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:45:38.397427 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.397438    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-istio-envoy\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:45:38.397737 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.397445    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d341ab49-2213-468a-993c-1e9cf75358f9-istiod-ca-cert\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:45:38.397737 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.397453    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-istio-data\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:45:38.397737 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.397460    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d341ab49-2213-468a-993c-1e9cf75358f9-workload-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:45:38.798328 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.798293    2558 generic.go:356] "Generic (PLEG): container finished" podID="d341ab49-2213-468a-993c-1e9cf75358f9" containerID="25180299a1a38c652102a383ca35fcc6b3a75307409b600688f64de08089e09c" exitCode=0
Jul 14 18:45:38.798543 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.798346    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"
Jul 14 18:45:38.798543 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.798382    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc" event={"ID":"d341ab49-2213-468a-993c-1e9cf75358f9","Type":"ContainerDied","Data":"25180299a1a38c652102a383ca35fcc6b3a75307409b600688f64de08089e09c"}
Jul 14 18:45:38.798543 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.798442    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc" event={"ID":"d341ab49-2213-468a-993c-1e9cf75358f9","Type":"ContainerDied","Data":"aee57a5a910de8fa5cbb59af27fc44e23760201dba0f8d0e754dea63beacacaf"}
Jul 14 18:45:38.798543 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.798462    2558 scope.go:117] "RemoveContainer" containerID="25180299a1a38c652102a383ca35fcc6b3a75307409b600688f64de08089e09c"
Jul 14 18:45:38.808333 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.808314    2558 scope.go:117] "RemoveContainer" containerID="867894a62110aee95125c5482f53a0eb0d6f67fcb4c1f53025f45ea982df9fc8"
Jul 14 18:45:38.816989 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.816969    2558 scope.go:117] "RemoveContainer" containerID="25180299a1a38c652102a383ca35fcc6b3a75307409b600688f64de08089e09c"
Jul 14 18:45:38.817243 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:45:38.817222    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25180299a1a38c652102a383ca35fcc6b3a75307409b600688f64de08089e09c\": container with ID starting with 25180299a1a38c652102a383ca35fcc6b3a75307409b600688f64de08089e09c not found: ID does not exist" containerID="25180299a1a38c652102a383ca35fcc6b3a75307409b600688f64de08089e09c"
Jul 14 18:45:38.817291 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.817252    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25180299a1a38c652102a383ca35fcc6b3a75307409b600688f64de08089e09c"} err="failed to get container status \"25180299a1a38c652102a383ca35fcc6b3a75307409b600688f64de08089e09c\": rpc error: code = NotFound desc = could not find container \"25180299a1a38c652102a383ca35fcc6b3a75307409b600688f64de08089e09c\": container with ID starting with 25180299a1a38c652102a383ca35fcc6b3a75307409b600688f64de08089e09c not found: ID does not exist"
Jul 14 18:45:38.817291 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.817272    2558 scope.go:117] "RemoveContainer" containerID="867894a62110aee95125c5482f53a0eb0d6f67fcb4c1f53025f45ea982df9fc8"
Jul 14 18:45:38.817527 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:45:38.817508    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"867894a62110aee95125c5482f53a0eb0d6f67fcb4c1f53025f45ea982df9fc8\": container with ID starting with 867894a62110aee95125c5482f53a0eb0d6f67fcb4c1f53025f45ea982df9fc8 not found: ID does not exist" containerID="867894a62110aee95125c5482f53a0eb0d6f67fcb4c1f53025f45ea982df9fc8"
Jul 14 18:45:38.817639 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.817545    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"867894a62110aee95125c5482f53a0eb0d6f67fcb4c1f53025f45ea982df9fc8"} err="failed to get container status \"867894a62110aee95125c5482f53a0eb0d6f67fcb4c1f53025f45ea982df9fc8\": rpc error: code = NotFound desc = could not find container \"867894a62110aee95125c5482f53a0eb0d6f67fcb4c1f53025f45ea982df9fc8\": container with ID starting with 867894a62110aee95125c5482f53a0eb0d6f67fcb4c1f53025f45ea982df9fc8 not found: ID does not exist"
Jul 14 18:45:38.825465 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.825442    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"]
Jul 14 18:45:38.833158 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:38.833135    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-7e7ccb-openshift-default-745b69cb95-9kqmc"]
Jul 14 18:45:40.441199 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:40.441164    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d341ab49-2213-468a-993c-1e9cf75358f9" path="/var/lib/kubelet/pods/d341ab49-2213-468a-993c-1e9cf75358f9/volumes"
Jul 14 18:45:46.939600 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:46.939097    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkv2p"]
Jul 14 18:45:59.113513 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:59.113474    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"]
Jul 14 18:45:59.113987 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:45:59.113731    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg" podUID="cfe1304f-5a11-4294-8016-627f6987d2b9" containerName="istio-proxy" containerID="cri-o://47025c884d42ec35085f259a14a023ce1b0eb76cddff912e60a18944dbba352d" gracePeriod=30
Jul 14 18:46:04.375097 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.375069    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:46:04.425341 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.425257    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-data\") pod \"cfe1304f-5a11-4294-8016-627f6987d2b9\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") "
Jul 14 18:46:04.425341 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.425302    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-token\") pod \"cfe1304f-5a11-4294-8016-627f6987d2b9\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") "
Jul 14 18:46:04.425341 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.425324    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-podinfo\") pod \"cfe1304f-5a11-4294-8016-627f6987d2b9\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") "
Jul 14 18:46:04.425659 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.425344    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-credential-socket\") pod \"cfe1304f-5a11-4294-8016-627f6987d2b9\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") "
Jul 14 18:46:04.425659 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.425374    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-workload-certs\") pod \"cfe1304f-5a11-4294-8016-627f6987d2b9\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") "
Jul 14 18:46:04.425659 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.425417    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-envoy\") pod \"cfe1304f-5a11-4294-8016-627f6987d2b9\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") "
Jul 14 18:46:04.425659 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.425509    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfe1304f-5a11-4294-8016-627f6987d2b9-istiod-ca-cert\") pod \"cfe1304f-5a11-4294-8016-627f6987d2b9\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") "
Jul 14 18:46:04.425659 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.425549    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lwqm\" (UniqueName: \"kubernetes.io/projected/cfe1304f-5a11-4294-8016-627f6987d2b9-kube-api-access-5lwqm\") pod \"cfe1304f-5a11-4294-8016-627f6987d2b9\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") "
Jul 14 18:46:04.425659 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.425612    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-workload-socket\") pod \"cfe1304f-5a11-4294-8016-627f6987d2b9\" (UID: \"cfe1304f-5a11-4294-8016-627f6987d2b9\") "
Jul 14 18:46:04.426045 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.425726    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cfe1304f-5a11-4294-8016-627f6987d2b9" (UID: "cfe1304f-5a11-4294-8016-627f6987d2b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:46:04.426045 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.425937    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-credential-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:46:04.426045 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.425974    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cfe1304f-5a11-4294-8016-627f6987d2b9" (UID: "cfe1304f-5a11-4294-8016-627f6987d2b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:46:04.426778 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.426417    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cfe1304f-5a11-4294-8016-627f6987d2b9" (UID: "cfe1304f-5a11-4294-8016-627f6987d2b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:46:04.426778 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.426723    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-data" (OuterVolumeSpecName: "istio-data") pod "cfe1304f-5a11-4294-8016-627f6987d2b9" (UID: "cfe1304f-5a11-4294-8016-627f6987d2b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:46:04.426778 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.426742    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfe1304f-5a11-4294-8016-627f6987d2b9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cfe1304f-5a11-4294-8016-627f6987d2b9" (UID: "cfe1304f-5a11-4294-8016-627f6987d2b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 18:46:04.428116 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.428090    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cfe1304f-5a11-4294-8016-627f6987d2b9" (UID: "cfe1304f-5a11-4294-8016-627f6987d2b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 18:46:04.428228 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.428141    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cfe1304f-5a11-4294-8016-627f6987d2b9" (UID: "cfe1304f-5a11-4294-8016-627f6987d2b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 18:46:04.428278 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.428227    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfe1304f-5a11-4294-8016-627f6987d2b9-kube-api-access-5lwqm" (OuterVolumeSpecName: "kube-api-access-5lwqm") pod "cfe1304f-5a11-4294-8016-627f6987d2b9" (UID: "cfe1304f-5a11-4294-8016-627f6987d2b9"). InnerVolumeSpecName "kube-api-access-5lwqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:46:04.428667 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.428642    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-token" (OuterVolumeSpecName: "istio-token") pod "cfe1304f-5a11-4294-8016-627f6987d2b9" (UID: "cfe1304f-5a11-4294-8016-627f6987d2b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 18:46:04.526876 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.526836    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-workload-certs\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:46:04.526876 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.526866    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-envoy\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:46:04.526876 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.526875    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfe1304f-5a11-4294-8016-627f6987d2b9-istiod-ca-cert\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:46:04.526876 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.526883    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lwqm\" (UniqueName: \"kubernetes.io/projected/cfe1304f-5a11-4294-8016-627f6987d2b9-kube-api-access-5lwqm\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:46:04.527158 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.526891    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-workload-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:46:04.527158 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.526900    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-data\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:46:04.527158 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.526908    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-token\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:46:04.527158 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.526916    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfe1304f-5a11-4294-8016-627f6987d2b9-istio-podinfo\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\""
Jul 14 18:46:04.950231 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.950195    2558 generic.go:356] "Generic (PLEG): container finished" podID="cfe1304f-5a11-4294-8016-627f6987d2b9" containerID="47025c884d42ec35085f259a14a023ce1b0eb76cddff912e60a18944dbba352d" exitCode=0
Jul 14 18:46:04.950405 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.950252    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"
Jul 14 18:46:04.950405 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.950280    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg" event={"ID":"cfe1304f-5a11-4294-8016-627f6987d2b9","Type":"ContainerDied","Data":"47025c884d42ec35085f259a14a023ce1b0eb76cddff912e60a18944dbba352d"}
Jul 14 18:46:04.950405 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.950344    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg" event={"ID":"cfe1304f-5a11-4294-8016-627f6987d2b9","Type":"ContainerDied","Data":"25e366df54a8c74fd79c856775102d285d32ff1690ebe11ef1ff2aa36e90a218"}
Jul 14 18:46:04.950405 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.950375    2558 scope.go:117] "RemoveContainer" containerID="47025c884d42ec35085f259a14a023ce1b0eb76cddff912e60a18944dbba352d"
Jul 14 18:46:04.960286 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.960267    2558 scope.go:117] "RemoveContainer" containerID="21a13c09840c07996fe981a2b1ca57394e147e5d42c023d8743cd0521a92d564"
Jul 14 18:46:04.968922 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.968898    2558 scope.go:117] "RemoveContainer" containerID="47025c884d42ec35085f259a14a023ce1b0eb76cddff912e60a18944dbba352d"
Jul 14 18:46:04.969344 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:46:04.969317    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47025c884d42ec35085f259a14a023ce1b0eb76cddff912e60a18944dbba352d\": container with ID starting with 47025c884d42ec35085f259a14a023ce1b0eb76cddff912e60a18944dbba352d not found: ID does not exist" containerID="47025c884d42ec35085f259a14a023ce1b0eb76cddff912e60a18944dbba352d"
Jul 14 18:46:04.969482 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.969346    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47025c884d42ec35085f259a14a023ce1b0eb76cddff912e60a18944dbba352d"} err="failed to get container status \"47025c884d42ec35085f259a14a023ce1b0eb76cddff912e60a18944dbba352d\": rpc error: code = NotFound desc = could not find container \"47025c884d42ec35085f259a14a023ce1b0eb76cddff912e60a18944dbba352d\": container with ID starting with 47025c884d42ec35085f259a14a023ce1b0eb76cddff912e60a18944dbba352d not found: ID does not exist"
Jul 14 18:46:04.969482 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.969364    2558 scope.go:117] "RemoveContainer" containerID="21a13c09840c07996fe981a2b1ca57394e147e5d42c023d8743cd0521a92d564"
Jul 14 18:46:04.969676 ip-10-0-139-216 kubenswrapper[2558]: E0714 18:46:04.969652    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21a13c09840c07996fe981a2b1ca57394e147e5d42c023d8743cd0521a92d564\": container with ID starting with 21a13c09840c07996fe981a2b1ca57394e147e5d42c023d8743cd0521a92d564 not found: ID does not exist" containerID="21a13c09840c07996fe981a2b1ca57394e147e5d42c023d8743cd0521a92d564"
Jul 14 18:46:04.969742 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.969681    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21a13c09840c07996fe981a2b1ca57394e147e5d42c023d8743cd0521a92d564"} err="failed to get container status \"21a13c09840c07996fe981a2b1ca57394e147e5d42c023d8743cd0521a92d564\": rpc error: code = NotFound desc = could not find container \"21a13c09840c07996fe981a2b1ca57394e147e5d42c023d8743cd0521a92d564\": container with ID starting with 21a13c09840c07996fe981a2b1ca57394e147e5d42c023d8743cd0521a92d564 not found: ID does not exist"
Jul 14 18:46:04.972231 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.972207    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"]
Jul 14 18:46:04.976521 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:04.976499    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-b860a5-openshift-default-78bd76448c-82swg"]
Jul 14 18:46:05.069414 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:05.069388    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ljt47_6357a700-67b5-4d69-baf1-d59a52d072f7/manager/0.log"
Jul 14 18:46:05.186330 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:05.186295    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-nkvlx_3d1ff281-472d-43df-af26-0acbbda45926/manager/0.log"
Jul 14 18:46:05.425818 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:05.425791    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-dzfh2_4cc23c90-470d-4a2d-8d4f-09ae7e6b6751/server/0.log"
Jul 14 18:46:05.539746 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:05.539712    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2nbrx_7af7b6d6-0424-42fa-a852-f747cbc071dd/manager/0.log"
Jul 14 18:46:05.899575 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:05.899545    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67c464fdbc-wcgr8_08e673a6-1903-455e-ba64-436947d58a68/copy-manifests/0.log"
Jul 14 18:46:05.912711 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:05.912677    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67c464fdbc-wcgr8_08e673a6-1903-455e-ba64-436947d58a68/manager/0.log"
Jul 14 18:46:06.404236 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:06.404203    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29734215-rpb7j_29148738-4e63-4858-8fd8-bd9dc2b42236/cleanup/0.log"
Jul 14 18:46:06.441494 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:06.441460    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfe1304f-5a11-4294-8016-627f6987d2b9" path="/var/lib/kubelet/pods/cfe1304f-5a11-4294-8016-627f6987d2b9/volumes"
Jul 14 18:46:06.511773 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:06.511741    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29734230-s7jf7_7af4cd92-c3ac-4cc1-9368-afd70d0b98df/cleanup/0.log"
Jul 14 18:46:07.198096 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:07.198072    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-97e17a87-nxkr7_3247dec9-03cc-40b9-aa97-6c1ee0e082ea/revoke-keys/0.log"
Jul 14 18:46:07.546205 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:07.546122    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-d0b3d618-zfs8g_199a97fb-2073-417e-87ba-43692437824d/revoke-keys/0.log"
Jul 14 18:46:07.660053 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:07.660021    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-31aded09-sxrws_bb40f63d-f704-4059-a993-02336448b8a0/revoke-keys/0.log"
Jul 14 18:46:07.776143 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:07.776117    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-c1e47003-rkch6_c13277ae-2a42-4b76-a212-d70b784614e5/revoke-keys/0.log"
Jul 14 18:46:08.941223 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:08.941193    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r_1301102b-1a97-44e3-b52a-feba7b9453e8/util/0.log"
Jul 14 18:46:08.948723 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:08.948685    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r_1301102b-1a97-44e3-b52a-feba7b9453e8/pull/0.log"
Jul 14 18:46:08.955235 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:08.955211    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r_1301102b-1a97-44e3-b52a-feba7b9453e8/extract/0.log"
Jul 14 18:46:09.066171 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:09.066134    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc_479e81cb-aee8-48bd-bb9b-4004e9f997f2/util/0.log"
Jul 14 18:46:09.075187 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:09.075155    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc_479e81cb-aee8-48bd-bb9b-4004e9f997f2/pull/0.log"
Jul 14 18:46:09.082033 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:09.082008    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc_479e81cb-aee8-48bd-bb9b-4004e9f997f2/extract/0.log"
Jul 14 18:46:09.197246 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:09.197166    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p_4d85610a-010d-4e8a-90a5-7d2a0964684d/util/0.log"
Jul 14 18:46:09.204950 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:09.204923    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p_4d85610a-010d-4e8a-90a5-7d2a0964684d/pull/0.log"
Jul 14 18:46:09.212575 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:09.212546    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p_4d85610a-010d-4e8a-90a5-7d2a0964684d/extract/0.log"
Jul 14 18:46:09.331174 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:09.331147    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw_2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853/util/0.log"
Jul 14 18:46:09.338852 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:09.338821    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw_2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853/pull/0.log"
Jul 14 18:46:09.346597 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:09.346552    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw_2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853/extract/0.log"
Jul 14 18:46:10.207371 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:10.207337    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wkv2p_7ea38038-8f96-4f0c-b9e7-dfedd01925ce/limitador/0.log"
Jul 14 18:46:10.324474 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:10.324440    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gdwvp_69131f88-2d06-4ed8-9a40-867164bd9a57/manager/0.log"
Jul 14 18:46:10.701068 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:10.701033    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qm5zw_d38a3503-f76c-460d-8bec-0a098f690f2f/istio-proxy/0.log"
Jul 14 18:46:10.819096 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:10.819066    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-n744r_721caaf1-0bea-446f-bad6-d3b7855daab0/discovery/0.log"
Jul 14 18:46:10.938019 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:10.937989    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5979cf877b-djrtg_cc905b62-2b1d-4b83-9139-866c53a9b5a3/kube-auth-proxy/0.log"
Jul 14 18:46:16.517440 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.517401    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qkbmz/must-gather-g7hh7"]
Jul 14 18:46:16.517860 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.517810    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8" containerName="main"
Jul 14 18:46:16.517860 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.517823    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8" containerName="main"
Jul 14 18:46:16.517860 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.517841    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d341ab49-2213-468a-993c-1e9cf75358f9" containerName="istio-proxy"
Jul 14 18:46:16.517860 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.517846    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d341ab49-2213-468a-993c-1e9cf75358f9" containerName="istio-proxy"
Jul 14 18:46:16.517860 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.517854    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfe1304f-5a11-4294-8016-627f6987d2b9" containerName="istio-proxy"
Jul 14 18:46:16.517860 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.517860    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfe1304f-5a11-4294-8016-627f6987d2b9" containerName="istio-proxy"
Jul 14 18:46:16.518050 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.517870    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfe1304f-5a11-4294-8016-627f6987d2b9" containerName="istio-proxy"
Jul 14 18:46:16.518050 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.517875    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfe1304f-5a11-4294-8016-627f6987d2b9" containerName="istio-proxy"
Jul 14 18:46:16.518050 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.517883    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d341ab49-2213-468a-993c-1e9cf75358f9" containerName="istio-proxy"
Jul 14 18:46:16.518050 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.517888    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d341ab49-2213-468a-993c-1e9cf75358f9" containerName="istio-proxy"
Jul 14 18:46:16.518050 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.517941    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d341ab49-2213-468a-993c-1e9cf75358f9" containerName="istio-proxy"
Jul 14 18:46:16.518050 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.517949    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d341ab49-2213-468a-993c-1e9cf75358f9" containerName="istio-proxy"
Jul 14 18:46:16.518050 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.517955    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfe1304f-5a11-4294-8016-627f6987d2b9" containerName="istio-proxy"
Jul 14 18:46:16.518050 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.517960    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ee4b41c-7788-4593-8bbf-bb6e7bfec2c8" containerName="main"
Jul 14 18:46:16.518050 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.517965    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfe1304f-5a11-4294-8016-627f6987d2b9" containerName="istio-proxy"
Jul 14 18:46:16.522650 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.522627    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qkbmz/must-gather-g7hh7"
Jul 14 18:46:16.525781 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.525754    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qkbmz\"/\"openshift-service-ca.crt\""
Jul 14 18:46:16.525955 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.525755    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qkbmz\"/\"default-dockercfg-qfjll\""
Jul 14 18:46:16.526614 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.526596    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qkbmz\"/\"kube-root-ca.crt\""
Jul 14 18:46:16.534131 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.534107    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qkbmz/must-gather-g7hh7"]
Jul 14 18:46:16.634546 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.634505    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwmsb\" (UniqueName: \"kubernetes.io/projected/69bcf252-7d9a-4635-b53e-d3c83b7ec0da-kube-api-access-xwmsb\") pod \"must-gather-g7hh7\" (UID: \"69bcf252-7d9a-4635-b53e-d3c83b7ec0da\") " pod="openshift-must-gather-qkbmz/must-gather-g7hh7"
Jul 14 18:46:16.634546 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.634546    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/69bcf252-7d9a-4635-b53e-d3c83b7ec0da-must-gather-output\") pod \"must-gather-g7hh7\" (UID: \"69bcf252-7d9a-4635-b53e-d3c83b7ec0da\") " pod="openshift-must-gather-qkbmz/must-gather-g7hh7"
Jul 14 18:46:16.735382 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.735339    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwmsb\" (UniqueName: \"kubernetes.io/projected/69bcf252-7d9a-4635-b53e-d3c83b7ec0da-kube-api-access-xwmsb\") pod \"must-gather-g7hh7\" (UID: \"69bcf252-7d9a-4635-b53e-d3c83b7ec0da\") " pod="openshift-must-gather-qkbmz/must-gather-g7hh7"
Jul 14 18:46:16.735382 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.735384    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/69bcf252-7d9a-4635-b53e-d3c83b7ec0da-must-gather-output\") pod \"must-gather-g7hh7\" (UID: \"69bcf252-7d9a-4635-b53e-d3c83b7ec0da\") " pod="openshift-must-gather-qkbmz/must-gather-g7hh7"
Jul 14 18:46:16.735786 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.735764    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/69bcf252-7d9a-4635-b53e-d3c83b7ec0da-must-gather-output\") pod \"must-gather-g7hh7\" (UID: \"69bcf252-7d9a-4635-b53e-d3c83b7ec0da\") " pod="openshift-must-gather-qkbmz/must-gather-g7hh7"
Jul 14 18:46:16.749264 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.749238    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwmsb\" (UniqueName: \"kubernetes.io/projected/69bcf252-7d9a-4635-b53e-d3c83b7ec0da-kube-api-access-xwmsb\") pod \"must-gather-g7hh7\" (UID: \"69bcf252-7d9a-4635-b53e-d3c83b7ec0da\") " pod="openshift-must-gather-qkbmz/must-gather-g7hh7"
Jul 14 18:46:16.833177 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.833086    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qkbmz/must-gather-g7hh7"
Jul 14 18:46:16.989129 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.989097    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qkbmz/must-gather-g7hh7"]
Jul 14 18:46:16.990099 ip-10-0-139-216 kubenswrapper[2558]: W0714 18:46:16.990072    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69bcf252_7d9a_4635_b53e_d3c83b7ec0da.slice/crio-35ef9c3f2f5b4bf1dcdd4946f85a487219270260be8d39dbd0723752642137db WatchSource:0}: Error finding container 35ef9c3f2f5b4bf1dcdd4946f85a487219270260be8d39dbd0723752642137db: Status 404 returned error can't find the container with id 35ef9c3f2f5b4bf1dcdd4946f85a487219270260be8d39dbd0723752642137db
Jul 14 18:46:16.992348 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:16.992326    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 18:46:17.021002 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:17.020961    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qkbmz/must-gather-g7hh7" event={"ID":"69bcf252-7d9a-4635-b53e-d3c83b7ec0da","Type":"ContainerStarted","Data":"35ef9c3f2f5b4bf1dcdd4946f85a487219270260be8d39dbd0723752642137db"}
Jul 14 18:46:20.045174 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:20.045137    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qkbmz/must-gather-g7hh7" event={"ID":"69bcf252-7d9a-4635-b53e-d3c83b7ec0da","Type":"ContainerStarted","Data":"81e758b299b54e9a8d14f4bf598c4559771065d90ef86d42410fb7e583d6d17c"}
Jul 14 18:46:20.045757 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:20.045728    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qkbmz/must-gather-g7hh7" event={"ID":"69bcf252-7d9a-4635-b53e-d3c83b7ec0da","Type":"ContainerStarted","Data":"3663f67b94f1826f78acc786216ba47da6cf7e5f3b08c2d5227f7bf02f5e6f93"}
Jul 14 18:46:20.063954 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:20.063892    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qkbmz/must-gather-g7hh7" podStartSLOduration=1.8326350310000001 podStartE2EDuration="4.063876873s" totalImagesPullingTime="2.231241842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:46:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:46:20.063070652 +0000 UTC m=+3098.168180649" watchObservedRunningTime="2026-07-14 18:46:20.063876873 +0000 UTC m=+3098.168986834"
Jul 14 18:46:21.080960 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:21.080930    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-khkzc_383a3b60-1510-4f9a-9075-16da8bed771e/global-pull-secret-syncer/0.log"
Jul 14 18:46:21.262462 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:21.262420    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x2hq6_38b4a869-6295-4e6f-b53e-dd0ec7635b3e/konnectivity-agent/0.log"
Jul 14 18:46:21.450439 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:21.450405    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-216.ec2.internal_282757532e8cff0af802bbd37036b971/haproxy/0.log"
Jul 14 18:46:25.771890 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:25.771846    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r_1301102b-1a97-44e3-b52a-feba7b9453e8/extract/0.log"
Jul 14 18:46:25.869629 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:25.869601    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r_1301102b-1a97-44e3-b52a-feba7b9453e8/util/0.log"
Jul 14 18:46:25.939168 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:25.939136    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759td46r_1301102b-1a97-44e3-b52a-feba7b9453e8/pull/0.log"
Jul 14 18:46:26.038360 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:26.038238    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc_479e81cb-aee8-48bd-bb9b-4004e9f997f2/extract/0.log"
Jul 14 18:46:26.086688 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:26.086657    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc_479e81cb-aee8-48bd-bb9b-4004e9f997f2/util/0.log"
Jul 14 18:46:26.136581 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:26.136506    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dj7kc_479e81cb-aee8-48bd-bb9b-4004e9f997f2/pull/0.log"
Jul 14 18:46:26.192176 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:26.192147    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p_4d85610a-010d-4e8a-90a5-7d2a0964684d/extract/0.log"
Jul 14 18:46:26.252339 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:26.252308    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p_4d85610a-010d-4e8a-90a5-7d2a0964684d/util/0.log"
Jul 14 18:46:26.300181 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:26.300089    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qf6p_4d85610a-010d-4e8a-90a5-7d2a0964684d/pull/0.log"
Jul 14 18:46:26.345696 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:26.345667    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw_2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853/extract/0.log"
Jul 14 18:46:26.390301 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:26.390273    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw_2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853/util/0.log"
Jul 14 18:46:26.431203 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:26.431155    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cvvpw_2fcd7e57-bbb4-4ecf-96ff-8245eeaa8853/pull/0.log"
Jul 14 18:46:27.478492 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:27.478429    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wkv2p_7ea38038-8f96-4f0c-b9e7-dfedd01925ce/limitador/0.log"
Jul 14 18:46:27.564516 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:27.564429    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gdwvp_69131f88-2d06-4ed8-9a40-867164bd9a57/manager/0.log"
Jul 14 18:46:29.645021 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:29.644990    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-c766fdf6c-x4nk2_f62d258d-1509-4057-994c-1aac4a86be2c/metrics-server/0.log"
Jul 14 18:46:29.687156 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:29.687116    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-2wxlx_b58d02dc-8106-4059-9e14-09624f38e02d/monitoring-plugin/0.log"
Jul 14 18:46:29.727830 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:29.727791    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9gqhz_a0b5b6ad-4dae-4201-9e27-0c6ed022247b/node-exporter/0.log"
Jul 14 18:46:29.753246 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:29.753213    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9gqhz_a0b5b6ad-4dae-4201-9e27-0c6ed022247b/kube-rbac-proxy/0.log"
Jul 14 18:46:29.778084 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:29.778056    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9gqhz_a0b5b6ad-4dae-4201-9e27-0c6ed022247b/init-textfile/0.log"
Jul 14 18:46:30.435971 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:30.435940    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-sjmkv_87dd818d-53dd-4962-a61f-4b90fd4e11e7/prometheus-operator-admission-webhook/0.log"
Jul 14 18:46:30.557055 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:30.557022    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69fb87c44-2vlpk_54a469e3-9929-45b8-90e9-6facd3f90aa6/thanos-query/0.log"
Jul 14 18:46:30.583805 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:30.583730    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69fb87c44-2vlpk_54a469e3-9929-45b8-90e9-6facd3f90aa6/kube-rbac-proxy-web/0.log"
Jul 14 18:46:30.613792 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:30.613760    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69fb87c44-2vlpk_54a469e3-9929-45b8-90e9-6facd3f90aa6/kube-rbac-proxy/0.log"
Jul 14 18:46:30.641269 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:30.641230    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69fb87c44-2vlpk_54a469e3-9929-45b8-90e9-6facd3f90aa6/prom-label-proxy/0.log"
Jul 14 18:46:30.668515 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:30.668476    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69fb87c44-2vlpk_54a469e3-9929-45b8-90e9-6facd3f90aa6/kube-rbac-proxy-rules/0.log"
Jul 14 18:46:30.698202 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:30.698106    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69fb87c44-2vlpk_54a469e3-9929-45b8-90e9-6facd3f90aa6/kube-rbac-proxy-metrics/0.log"
Jul 14 18:46:31.738155 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:31.738117    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd"]
Jul 14 18:46:31.744855 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:31.744818    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd"
Jul 14 18:46:31.751428 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:31.751397    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd"]
Jul 14 18:46:31.894921 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:31.894763    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1398768f-dfde-43b5-a0d3-3fd6bac13fa2-sys\") pod \"perf-node-gather-daemonset-blhqd\" (UID: \"1398768f-dfde-43b5-a0d3-3fd6bac13fa2\") " pod="openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd"
Jul 14 18:46:31.894921 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:31.894812    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wslbv\" (UniqueName: \"kubernetes.io/projected/1398768f-dfde-43b5-a0d3-3fd6bac13fa2-kube-api-access-wslbv\") pod \"perf-node-gather-daemonset-blhqd\" (UID: \"1398768f-dfde-43b5-a0d3-3fd6bac13fa2\") " pod="openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd"
Jul 14 18:46:31.894921 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:31.894862    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1398768f-dfde-43b5-a0d3-3fd6bac13fa2-podres\") pod \"perf-node-gather-daemonset-blhqd\" (UID: \"1398768f-dfde-43b5-a0d3-3fd6bac13fa2\") " pod="openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd"
Jul 14 18:46:31.895267 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:31.895007    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1398768f-dfde-43b5-a0d3-3fd6bac13fa2-lib-modules\") pod \"perf-node-gather-daemonset-blhqd\" (UID: \"1398768f-dfde-43b5-a0d3-3fd6bac13fa2\") " pod="openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd"
Jul 14 18:46:31.895267 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:31.895047    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1398768f-dfde-43b5-a0d3-3fd6bac13fa2-proc\") pod \"perf-node-gather-daemonset-blhqd\" (UID: \"1398768f-dfde-43b5-a0d3-3fd6bac13fa2\") " pod="openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd"
Jul 14 18:46:31.996527 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:31.996427    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1398768f-dfde-43b5-a0d3-3fd6bac13fa2-podres\") pod \"perf-node-gather-daemonset-blhqd\" (UID: \"1398768f-dfde-43b5-a0d3-3fd6bac13fa2\") " pod="openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd"
Jul 14 18:46:31.996722 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:31.996540    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1398768f-dfde-43b5-a0d3-3fd6bac13fa2-lib-modules\") pod \"perf-node-gather-daemonset-blhqd\" (UID: \"1398768f-dfde-43b5-a0d3-3fd6bac13fa2\") " pod="openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd"
Jul 14 18:46:31.996722 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:31.996583    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1398768f-dfde-43b5-a0d3-3fd6bac13fa2-proc\") pod \"perf-node-gather-daemonset-blhqd\" (UID: \"1398768f-dfde-43b5-a0d3-3fd6bac13fa2\") " pod="openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd"
Jul 14 18:46:31.996722 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:31.996629    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1398768f-dfde-43b5-a0d3-3fd6bac13fa2-sys\") pod \"perf-node-gather-daemonset-blhqd\" (UID: \"1398768f-dfde-43b5-a0d3-3fd6bac13fa2\") " pod="openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd"
Jul 14 18:46:31.996722 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:31.996633    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1398768f-dfde-43b5-a0d3-3fd6bac13fa2-podres\") pod \"perf-node-gather-daemonset-blhqd\" (UID: \"1398768f-dfde-43b5-a0d3-3fd6bac13fa2\") " pod="openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd"
Jul 14 18:46:31.996722 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:31.996652    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wslbv\" (UniqueName: \"kubernetes.io/projected/1398768f-dfde-43b5-a0d3-3fd6bac13fa2-kube-api-access-wslbv\") pod \"perf-node-gather-daemonset-blhqd\" (UID: \"1398768f-dfde-43b5-a0d3-3fd6bac13fa2\") " pod="openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd"
Jul 14 18:46:31.996979 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:31.996721    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1398768f-dfde-43b5-a0d3-3fd6bac13fa2-lib-modules\") pod \"perf-node-gather-daemonset-blhqd\" (UID: \"1398768f-dfde-43b5-a0d3-3fd6bac13fa2\") " pod="openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd"
Jul 14 18:46:31.996979 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:31.996740    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1398768f-dfde-43b5-a0d3-3fd6bac13fa2-proc\") pod \"perf-node-gather-daemonset-blhqd\" (UID: \"1398768f-dfde-43b5-a0d3-3fd6bac13fa2\") " pod="openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd"
Jul 14 18:46:31.996979 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:31.996740    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1398768f-dfde-43b5-a0d3-3fd6bac13fa2-sys\") pod \"perf-node-gather-daemonset-blhqd\" (UID: \"1398768f-dfde-43b5-a0d3-3fd6bac13fa2\") " pod="openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd"
Jul 14 18:46:32.017999 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:32.017964    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wslbv\" (UniqueName: \"kubernetes.io/projected/1398768f-dfde-43b5-a0d3-3fd6bac13fa2-kube-api-access-wslbv\") pod \"perf-node-gather-daemonset-blhqd\" (UID: \"1398768f-dfde-43b5-a0d3-3fd6bac13fa2\") " pod="openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd"
Jul 14 18:46:32.061067 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:32.061029    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd"
Jul 14 18:46:32.245406 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:32.244953    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd"]
Jul 14 18:46:33.004431 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:33.004338    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6679f7747c-kzqct_e03d454b-3f0a-4679-a6dd-39a90852e537/console/0.log"
Jul 14 18:46:33.058318 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:33.058270    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-shcnm_c05507a8-89d3-40a2-900a-fe47242d023b/download-server/0.log"
Jul 14 18:46:33.158862 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:33.158824    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd" event={"ID":"1398768f-dfde-43b5-a0d3-3fd6bac13fa2","Type":"ContainerStarted","Data":"96efe50e45016ee4d7d281f10e1b679a6b02b51269d6393c28344c7c5d58f101"}
Jul 14 18:46:33.159081 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:33.159024    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd"
Jul 14 18:46:33.159081 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:33.159062    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd" event={"ID":"1398768f-dfde-43b5-a0d3-3fd6bac13fa2","Type":"ContainerStarted","Data":"8256709b5757ad0b0c99909d907963f6a127eabded5e3e75a24704435feccc88"}
Jul 14 18:46:33.187085 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:33.187020    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd" podStartSLOduration=2.187004289 podStartE2EDuration="2.187004289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:46:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:46:33.186611827 +0000 UTC m=+3111.291721811" watchObservedRunningTime="2026-07-14 18:46:33.187004289 +0000 UTC m=+3111.292114273"
Jul 14 18:46:33.745915 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:33.745881    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-vlrwr_a0358384-d357-4d5c-9ebe-e0afcee0707b/volume-data-source-validator/0.log"
Jul 14 18:46:35.028288 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:35.028257    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tfgds_89451cd2-2887-4999-962c-156d3b2a6043/dns/0.log"
Jul 14 18:46:35.068245 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:35.068211    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tfgds_89451cd2-2887-4999-962c-156d3b2a6043/kube-rbac-proxy/0.log"
Jul 14 18:46:35.258236 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:35.258201    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xdk6j_807562d8-2b97-4c0d-9752-aef06e1e80d8/dns-node-resolver/0.log"
Jul 14 18:46:36.175574 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:36.175541    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wv4j8_4c968316-3b97-4c10-84f0-0560cd4bcf20/node-ca/0.log"
Jul 14 18:46:37.215833 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:37.215801    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qm5zw_d38a3503-f76c-460d-8bec-0a098f690f2f/istio-proxy/0.log"
Jul 14 18:46:37.379752 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:37.378284    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-n744r_721caaf1-0bea-446f-bad6-d3b7855daab0/discovery/0.log"
Jul 14 18:46:37.442983 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:37.442956    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5979cf877b-djrtg_cc905b62-2b1d-4b83-9139-866c53a9b5a3/kube-auth-proxy/0.log"
Jul 14 18:46:38.717695 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:38.717658    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6gdbj_69e043c1-b897-4005-964a-b4febac67de7/serve-healthcheck-canary/0.log"
Jul 14 18:46:39.180961 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:39.180924    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qkbmz/perf-node-gather-daemonset-blhqd"
Jul 14 18:46:39.580000 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:39.579905    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vcngd_04732bec-9669-48a8-8eb9-c50fbaac502e/kube-rbac-proxy/0.log"
Jul 14 18:46:39.606858 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:39.606827    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vcngd_04732bec-9669-48a8-8eb9-c50fbaac502e/exporter/0.log"
Jul 14 18:46:39.644970 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:39.644935    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vcngd_04732bec-9669-48a8-8eb9-c50fbaac502e/extractor/0.log"
Jul 14 18:46:41.679356 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:41.679290    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qm5zw_d38a3503-f76c-460d-8bec-0a098f690f2f/istio-proxy/0.log"
Jul 14 18:46:41.828469 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:41.828437    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-n744r_721caaf1-0bea-446f-bad6-d3b7855daab0/discovery/0.log"
Jul 14 18:46:41.844284 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:41.844243    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5979cf877b-djrtg_cc905b62-2b1d-4b83-9139-866c53a9b5a3/kube-auth-proxy/0.log"
Jul 14 18:46:42.680075 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:42.679980    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ljt47_6357a700-67b5-4d69-baf1-d59a52d072f7/manager/0.log"
Jul 14 18:46:42.865738 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:42.865701    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-nkvlx_3d1ff281-472d-43df-af26-0acbbda45926/manager/0.log"
Jul 14 18:46:43.062123 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:43.062034    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-dzfh2_4cc23c90-470d-4a2d-8d4f-09ae7e6b6751/server/0.log"
Jul 14 18:46:43.151675 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:43.151638    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2nbrx_7af7b6d6-0424-42fa-a852-f747cbc071dd/manager/0.log"
Jul 14 18:46:43.314305 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:43.314209    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qm5zw_d38a3503-f76c-460d-8bec-0a098f690f2f/istio-proxy/0.log"
Jul 14 18:46:43.489555 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:43.489502    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-n744r_721caaf1-0bea-446f-bad6-d3b7855daab0/discovery/0.log"
Jul 14 18:46:43.521146 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:43.521111    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5979cf877b-djrtg_cc905b62-2b1d-4b83-9139-866c53a9b5a3/kube-auth-proxy/0.log"
Jul 14 18:46:43.552699 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:43.552669    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67c464fdbc-wcgr8_08e673a6-1903-455e-ba64-436947d58a68/manager/0.log"
Jul 14 18:46:43.598895 ip-10-0-139-216 kubenswrapper[2558]: I0714 18:46:43.598869    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67c464fdbc-wcgr8_08e673a6-1903-455e-ba64-436947d58a68/copy-manifests/0.log"