Jul 24 17:00:59.116494 ip-10-0-135-233 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 24 17:00:59.116509 ip-10-0-135-233 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 24 17:00:59.116518 ip-10-0-135-233 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 24 17:00:59.116825 ip-10-0-135-233 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 24 17:01:10.515686 ip-10-0-135-233 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 24 17:01:10.515701 ip-10-0-135-233 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 39c01fb5a7844501b84c6392ace4d1b6 --
Jul 24 17:03:02.430553 ip-10-0-135-233 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 17:03:02.858201 ip-10-0-135-233 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 17:03:02.858201 ip-10-0-135-233 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 17:03:02.858201 ip-10-0-135-233 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 17:03:02.858201 ip-10-0-135-233 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 17:03:02.858201 ip-10-0-135-233 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 17:03:02.861221 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.861097    2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 17:03:02.865943 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.865922    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:02.865943 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.865942    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:02.865943 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.865947    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:02.866059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.865951    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:02.866059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.865954    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:02.866059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.865958    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:02.866059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.865961    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:02.866059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.865964    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:02.866059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.865966    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:02.866059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.865969    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:02.866059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.865972    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:02.866059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.865975    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:02.866059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.865977    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:02.866059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.865980    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:02.866059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.865983    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:02.866059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.865985    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:02.866059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.865992    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:02.866059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.865995    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:02.866059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.865997    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:02.866059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866000    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:02.866059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866003    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:02.866059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866005    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:02.866059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866008    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:02.866545 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866010    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:02.866545 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866013    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:02.866545 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866016    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:02.866545 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866018    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:02.866545 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866021    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:02.866545 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866023    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:02.866545 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866026    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:02.866545 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866028    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:02.866545 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866030    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:02.866545 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866033    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:02.866545 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866035    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:02.866545 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866040    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:02.866545 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866042    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:02.866545 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866045    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:02.866545 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866048    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:02.866545 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866050    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:02.866545 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866053    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:02.866545 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866057    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:02.866545 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866059    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:02.866545 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866062    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:02.867059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866065    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:02.867059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866068    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:02.867059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866070    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:02.867059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866073    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:02.867059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866076    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:02.867059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866078    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:02.867059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866082    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:02.867059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866084    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:02.867059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866087    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:02.867059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866089    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:02.867059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866092    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:02.867059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866094    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:02.867059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866098    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:02.867059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866101    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:02.867059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866104    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:02.867059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866107    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:02.867059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866110    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:02.867059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866112    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:02.867059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866115    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:02.867059 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866117    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:02.867576 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866120    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:02.867576 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866123    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:02.867576 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866125    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:02.867576 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866128    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:02.867576 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866131    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:02.867576 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866134    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:02.867576 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866137    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:02.867576 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866139    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:02.867576 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866143    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:02.867576 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866146    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:02.867576 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866148    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:02.867576 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866151    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:02.867576 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866154    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:02.867576 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866156    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:02.867576 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866159    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:02.867576 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866161    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:02.867576 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866164    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:02.867576 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866166    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:02.867576 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866169    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:02.867576 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866171    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:02.868053 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866174    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:02.868053 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866178    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:02.868053 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866181    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:02.868053 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866183    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:02.868053 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866186    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:02.868053 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866188    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:02.868053 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866191    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:02.868053 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866193    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:02.868053 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866197    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:02.868053 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866202    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:02.868053 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866205    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:02.868053 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866210    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:02.868053 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866214    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:02.868053 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866218    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:02.868053 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866222    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:02.868053 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866225    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:02.868053 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866980    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:02.868053 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866987    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:02.868053 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866990    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:02.868524 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866993    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:02.868524 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866996    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:02.868524 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.866999    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:02.868524 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867002    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:02.868524 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867006    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:02.868524 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867009    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:02.868524 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867011    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:02.868524 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867014    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:02.868524 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867016    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:02.868524 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867019    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:02.868524 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867022    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:02.868524 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867026    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:02.868524 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867030    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:02.868524 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867033    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:02.868524 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867037    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:02.868524 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867040    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:02.868524 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867043    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:02.868524 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867047    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:02.868524 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867050    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:02.868524 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867053    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:02.869022 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867056    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:02.869022 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867059    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:02.869022 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867061    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:02.869022 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867064    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:02.869022 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867068    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:02.869022 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867071    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:02.869022 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867073    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:02.869022 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867076    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:02.869022 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867079    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:02.869022 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867082    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:02.869022 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867084    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:02.869022 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867087    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:02.869022 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867089    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:02.869022 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867092    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:02.869022 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867095    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:02.869022 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867098    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:02.869022 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867101    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:02.869022 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867103    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:02.869022 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867106    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:02.869525 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867108    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:02.869525 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867111    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:02.869525 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867114    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:02.869525 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867116    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:02.869525 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867118    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:02.869525 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867121    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:02.869525 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867124    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:02.869525 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867126    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:02.869525 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867129    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:02.869525 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867131    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:02.869525 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867133    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:02.869525 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867136    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:02.869525 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867141    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:02.869525 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867143    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:02.869525 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867146    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:02.869525 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867148    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:02.869525 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867151    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:02.869525 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867153    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:02.869525 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867156    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:02.870017 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867158    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:02.870017 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867161    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:02.870017 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867164    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:02.870017 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867166    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:02.870017 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867169    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:02.870017 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867171    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:02.870017 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867174    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:02.870017 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867176    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:02.870017 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867179    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:02.870017 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867181    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:02.870017 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867187    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:02.870017 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867190    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:02.870017 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867192    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:02.870017 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867196    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:02.870017 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867198    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:02.870017 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867201    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:02.870017 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867203    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:02.870017 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867207    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:02.870017 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867210    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:02.870017 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867213    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:02.870526 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867216    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:02.870526 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867219    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:02.870526 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867222    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:02.870526 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867224    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:02.870526 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867227    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:02.870526 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867247    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:02.870526 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867250    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:02.870526 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867253    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:02.870526 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867255    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:02.870526 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867258    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:02.870526 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867262    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:02.870526 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867265    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:02.870526 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867268    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:02.870526 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867271    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:02.870526 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867273    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:02.870526 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867276    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:02.870526 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867278    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:02.870526 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867281    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:02.870526 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867677    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:02.870526 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867682    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:02.871120 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867685    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:02.871120 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867687    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:02.871120 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867690    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:02.871120 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867693    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:02.871120 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867696    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:02.871120 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867699    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:02.871120 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867701    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:02.871120 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867703    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:02.871120 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867706    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:02.871120 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867708    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:02.871120 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867711    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:02.871120 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867713    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:02.871120 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867716    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:02.871120 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867720    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:02.871120 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867723    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:02.871120 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867726    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:02.871120 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867729    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:02.871120 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867732    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:02.871120 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867735    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:02.871120 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867738    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:02.871623 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867740    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:02.871623 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867743    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:02.871623 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867745    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:02.871623 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867748    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:02.871623 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867750    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:02.871623 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867754    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:02.871623 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867757    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:02.871623 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867760    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:02.871623 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867762    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:02.871623 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867765    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:02.871623 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867767    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:02.871623 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867770    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:02.871623 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867772    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:02.871623 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867775    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:02.871623 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867777    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:02.871623 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867780    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:02.871623 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867782    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:02.871623 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867784    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:02.871623 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867787    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:02.871623 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867789    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:02.872105 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867792    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:02.872105 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867795    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:02.872105 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867798    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:02.872105 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867801    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:02.872105 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867803    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:02.872105 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867806    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:02.872105 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867808    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:02.872105 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867811    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:02.872105 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867813    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:02.872105 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867816    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:02.872105 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867819    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:02.872105 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867821    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:02.872105 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867824    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:02.872105 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867826    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:02.872105 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867829    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:02.872105 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867832    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:02.872105 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867835    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:02.872105 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867837    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:02.872105 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867840    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:02.872105 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867842    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:02.872605 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867845    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:02.872605 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867847    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:02.872605 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867850    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:02.872605 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867852    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:02.872605 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867855    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:02.872605 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867859    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:02.872605 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867862    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:02.872605 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867865    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:02.872605 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867868    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:02.872605 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867871    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:02.872605 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867874    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:02.872605 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867877    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:02.872605 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867880    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:02.872605 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867883    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:02.872605 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867885    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:02.872605 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867888    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:02.872605 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867890    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:02.872605 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867893    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:02.872605 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867896    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:02.873060 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867899    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:02.873060 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867901    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:02.873060 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867904    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:02.873060 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867906    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:02.873060 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867909    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:02.873060 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867912    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:02.873060 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867914    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:02.873060 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867916    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:02.873060 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867919    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:02.873060 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867921    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:02.873060 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867924    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:02.873060 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867927    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:02.873060 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867929    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:02.873060 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867932    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:02.873060 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867934    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:02.873060 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867937    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:02.873060 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867939    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:02.873060 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.867941    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:02.873060 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868028    2572 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 17:03:02.873060 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868048    2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 17:03:02.873576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868058    2572 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 17:03:02.873576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868063    2572 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 17:03:02.873576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868074    2572 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 17:03:02.873576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868077    2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 17:03:02.873576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868082    2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 17:03:02.873576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868086    2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 17:03:02.873576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868089    2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 17:03:02.873576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868092    2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 17:03:02.873576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868095    2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 17:03:02.873576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868099    2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 17:03:02.873576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868102    2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 17:03:02.873576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868105    2572 flags.go:64] FLAG: --cgroup-root=""
Jul 24 17:03:02.873576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868108    2572 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 17:03:02.873576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868111    2572 flags.go:64] FLAG: --client-ca-file=""
Jul 24 17:03:02.873576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868114    2572 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 17:03:02.873576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868117    2572 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 17:03:02.873576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868122    2572 flags.go:64] FLAG: --cluster-domain=""
Jul 24 17:03:02.873576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868124    2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 17:03:02.873576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868127    2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 17:03:02.873576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868130    2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 17:03:02.873576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868134    2572 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 17:03:02.873576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868140    2572 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 17:03:02.873576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868143    2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868146    2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868149    2572 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868152    2572 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868155    2572 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868158    2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868161    2572 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868164    2572 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868168    2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868171    2572 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868174    2572 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868177    2572 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868180    2572 flags.go:64] FLAG: --enable-server="true"
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868184    2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868190    2572 flags.go:64] FLAG: --event-burst="100"
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868193    2572 flags.go:64] FLAG: --event-qps="50"
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868197    2572 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868200    2572 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868202    2572 flags.go:64] FLAG: --eviction-hard=""
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868206    2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868209    2572 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868212    2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868216    2572 flags.go:64] FLAG: --eviction-soft=""
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868219    2572 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868222    2572 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 17:03:02.874130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868225    2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868241    2572 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868244    2572 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868247    2572 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868250    2572 flags.go:64] FLAG: --feature-gates=""
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868254    2572 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868258    2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868262    2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868265    2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868268    2572 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868271    2572 flags.go:64] FLAG: --help="false"
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868274    2572 flags.go:64] FLAG: --hostname-override="ip-10-0-135-233.ec2.internal"
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868277    2572 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868280    2572 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868283    2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868286    2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868289    2572 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868292    2572 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868295    2572 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868297    2572 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868300    2572 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868307    2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868310    2572 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868313    2572 flags.go:64] FLAG: --kube-reserved=""
Jul 24 17:03:02.874768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868315    2572 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868318    2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868321    2572 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868324    2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868327    2572 flags.go:64] FLAG: --lock-file=""
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868331    2572 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868334    2572 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868337    2572 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868342    2572 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868345    2572 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868348    2572 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868350    2572 flags.go:64] FLAG: --logging-format="text"
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868353    2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868356    2572 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868360    2572 flags.go:64] FLAG: --manifest-url=""
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868363    2572 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868367    2572 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868370    2572 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868375    2572 flags.go:64] FLAG: --max-pods="110"
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868378    2572 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868380    2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868383    2572 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868387    2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868389    2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868392    2572 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 17:03:02.875381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868395    2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868402    2572 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868405    2572 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868408    2572 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868411    2572 flags.go:64] FLAG: --pod-cidr=""
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868414    2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868420    2572 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868423    2572 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868426    2572 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868429    2572 flags.go:64] FLAG: --port="10250"
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868432    2572 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868435    2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-070fb40a559b64142"
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868440    2572 flags.go:64] FLAG: --qos-reserved=""
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868443    2572 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868445    2572 flags.go:64] FLAG: --register-node="true"
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868448    2572 flags.go:64] FLAG: --register-with-taints=""
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868452    2572 flags.go:64] FLAG: --registry-burst="10"
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868455    2572 flags.go:64] FLAG: --registry-qps="5"
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868457    2572 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868460    2572 flags.go:64] FLAG: --reserved-memory=""
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868463    2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868466    2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868470    2572 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868474    2572 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868477    2572 flags.go:64] FLAG: --runonce="false"
Jul 24 17:03:02.875990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868479    2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868482    2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868485    2572 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868488    2572 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868491    2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868494    2572 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868497    2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868500    2572 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868503    2572 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868506    2572 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868509    2572 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868511    2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868514    2572 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868518    2572 flags.go:64] FLAG: --system-cgroups=""
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868521    2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868526    2572 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868529    2572 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868532    2572 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868537    2572 flags.go:64] FLAG: --tls-min-version=""
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868542    2572 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868544    2572 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868547    2572 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868550    2572 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868553    2572 flags.go:64] FLAG: --v="2"
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868557    2572 flags.go:64] FLAG: --version="false"
Jul 24 17:03:02.876601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868561    2572 flags.go:64] FLAG: --vmodule=""
Jul 24 17:03:02.877203 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868564    2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 17:03:02.877203 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.868567    2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 17:03:02.877203 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868711    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:02.877203 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868717    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:02.877203 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868720    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:02.877203 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868724    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:02.877203 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868727    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:02.877203 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868729    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:02.877203 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868732    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:02.877203 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868735    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:02.877203 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868737    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:02.877203 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868739    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:02.877203 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868742    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:02.877203 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868744    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:02.877203 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868747    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:02.877203 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868749    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:02.877203 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868752    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:02.877203 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868754    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:02.877203 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868757    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:02.877203 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868759    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:02.877724 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868762    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:02.877724 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868765    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:02.877724 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868768    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:02.877724 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868770    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:02.877724 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868772    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:02.877724 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868776    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:02.877724 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868779    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:02.877724 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868781    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:02.877724 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868784    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:02.877724 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868786    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:02.877724 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868789    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:02.877724 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868791    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:02.877724 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868794    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:02.877724 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868796    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:02.877724 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868799    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:02.877724 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868802    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:02.877724 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868805    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:02.877724 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868807    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:02.877724 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868810    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:02.877724 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868812    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:02.878224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868815    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:02.878224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868818    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:02.878224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868820    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:02.878224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868822    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:02.878224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868825    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:02.878224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868827    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:02.878224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868830    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:02.878224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868834    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:02.878224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868837    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:02.878224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868840    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:02.878224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868844    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:02.878224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868846    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:02.878224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868849    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:02.878224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868854    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:02.878224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868858    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:02.878224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868861    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:02.878224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868864    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:02.878224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868867    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:02.878747 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868870    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:02.878747 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868872    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:02.878747 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868874    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:02.878747 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868877    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:02.878747 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868879    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:02.878747 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868882    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:02.878747 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868884    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:02.878747 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868887    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:02.878747 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868889    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:02.878747 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868893    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:02.878747 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868895    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:02.878747 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868898    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:02.878747 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868900    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:02.878747 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868903    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:02.878747 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868905    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:02.878747 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868908    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:02.878747 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868910    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:02.878747 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868913    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:02.878747 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868915    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:02.878747 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868918    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:02.879309 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868920    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:02.879309 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868923    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:02.879309 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868925    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:02.879309 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868928    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:02.879309 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868930    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:02.879309 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868933    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:02.879309 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868935    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:02.879309 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868937    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:02.879309 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868943    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:02.879309 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868946    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:02.879309 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868949    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:02.879309 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868953    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:02.879309 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868955    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:02.879309 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868957    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:02.879309 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868960    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:02.879309 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868963    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:02.879309 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868965    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:02.879309 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868968    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:02.879309 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868970    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:02.879309 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868973    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:02.879896 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868975    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:02.879896 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868979    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:02.879896 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.868982    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:02.879896 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.869791    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 17:03:02.879896 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.877203    2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 17:03:02.879896 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.877222    2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 17:03:02.879896 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.877259    2572 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 17:03:02.879896 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.877266    2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 17:03:02.879896 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877325    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:02.879896 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877330    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:02.879896 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877334    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:02.879896 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877338    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:02.879896 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877341    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:02.879896 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877344    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:02.880442 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877347    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:02.880442 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877350    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:02.880442 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877353    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:02.880442 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877356    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:02.880442 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877358    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:02.880442 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877361    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:02.880442 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877363    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:02.880442 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877366    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:02.880442 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877368    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:02.880442 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877371    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:02.880442 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877373    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:02.880442 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877376    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:02.880442 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877378    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:02.880442 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877381    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:02.880442 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877383    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:02.880442 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877386    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:02.880442 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877388    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:02.880442 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877391    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:02.880442 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877393    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:02.880442 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877396    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:02.880957 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877398    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:02.880957 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877401    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:02.880957 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877405    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:02.880957 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877410    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:02.880957 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877413    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:02.880957 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877417    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:02.880957 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877420    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:02.880957 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877423    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:02.880957 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877426    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:02.880957 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877428    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:02.880957 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877440    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:02.880957 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877443    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:02.880957 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877446    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:02.880957 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877449    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:02.880957 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877451    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:02.880957 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877454    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:02.880957 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877456    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:02.880957 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877459    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:02.880957 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877462    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:02.881440 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877464    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:02.881440 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877467    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:02.881440 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877469    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:02.881440 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877472    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:02.881440 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877474    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:02.881440 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877477    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:02.881440 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877479    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:02.881440 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877482    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:02.881440 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877484    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:02.881440 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877487    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:02.881440 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877489    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:02.881440 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877492    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:02.881440 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877495    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:02.881440 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877497    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:02.881440 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877500    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:02.881440 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877502    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:02.881440 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877506    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:02.881440 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877510    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:02.881440 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877512    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:02.881440 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877515    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:02.881921 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877518    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:02.881921 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877522    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:02.881921 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877525    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:02.881921 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877527    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:02.881921 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877530    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:02.881921 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877533    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:02.881921 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877535    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:02.881921 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877538    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:02.881921 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877540    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:02.881921 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877542    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:02.881921 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877545    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:02.881921 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877547    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:02.881921 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877550    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:02.881921 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877552    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:02.881921 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877555    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:02.881921 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877557    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:02.881921 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877560    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:02.881921 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877562    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:02.881921 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877565    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:02.882457 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877567    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:02.882457 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877570    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:02.882457 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877572    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:02.882457 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877575    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:02.882457 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877577    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:02.882457 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877580    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:02.882457 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877583    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:02.882457 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877586    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:02.882457 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877589    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:02.882457 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877591    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:02.882457 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877594    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:02.882457 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877600    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:02.882457 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877604    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:02.882457 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877608    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:02.882457 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877611    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:02.882850 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.877616    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 17:03:02.882850 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877731    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:02.882850 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877736    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:02.882850 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877740    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:02.882850 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877743    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:02.882850 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877745    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:02.882850 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877748    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:02.882850 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877752    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:02.882850 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877754    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:02.882850 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877757    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:02.882850 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877759    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:02.882850 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877762    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:02.882850 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877764    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:02.882850 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877766    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:02.882850 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877769    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:02.883302 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877772    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:02.883302 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877774    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:02.883302 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877776    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:02.883302 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877779    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:02.883302 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877781    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:02.883302 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877784    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:02.883302 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877786    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:02.883302 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877789    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:02.883302 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877792    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:02.883302 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877795    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:02.883302 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877797    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:02.883302 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877800    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:02.883302 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877803    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:02.883302 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877805    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:02.883302 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877808    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:02.883302 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877810    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:02.883302 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877813    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:02.883302 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877815    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:02.883302 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877818    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:02.883302 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877820    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:02.883773 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877822    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:02.883773 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877825    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:02.883773 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877827    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:02.883773 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877829    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:02.883773 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877832    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:02.883773 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877834    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:02.883773 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877838    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:02.883773 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877842    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:02.883773 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877845    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:02.883773 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877848    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:02.883773 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877851    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:02.883773 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877854    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:02.883773 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877857    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:02.883773 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877860    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:02.883773 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877863    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:02.883773 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877865    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:02.883773 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877868    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:02.883773 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877871    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:02.883773 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877873    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:02.884279 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877876    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:02.884279 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877879    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:02.884279 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877881    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:02.884279 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877884    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:02.884279 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877887    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:02.884279 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877890    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:02.884279 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877892    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:02.884279 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877895    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:02.884279 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877898    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:02.884279 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877900    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:02.884279 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877903    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:02.884279 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877905    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:02.884279 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877908    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:02.884279 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877910    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:02.884279 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877913    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:02.884279 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877915    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:02.884279 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877918    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:02.884279 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877920    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:02.884279 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877922    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:02.884279 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877925    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:02.884777 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877927    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:02.884777 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877930    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:02.884777 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877932    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:02.884777 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877934    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:02.884777 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877937    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:02.884777 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877939    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:02.884777 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877942    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:02.884777 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877944    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:02.884777 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877947    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:02.884777 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877949    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:02.884777 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877952    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:02.884777 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877954    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:02.884777 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877957    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:02.884777 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877960    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:02.884777 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877963    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:02.884777 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877965    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:02.884777 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877968    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:02.884777 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877970    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:02.884777 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877973    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:02.885224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877976    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:02.885224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877978    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:02.885224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877981    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:02.885224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877983    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:02.885224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877985    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:02.885224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877988    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:02.885224 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:02.877990    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:02.885224 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.877995    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 17:03:02.885224 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.879731    2572 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 17:03:02.885224 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.882121    2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 17:03:02.885224 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.884068    2572 server.go:1019] "Starting client certificate rotation"
Jul 24 17:03:02.885224 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.884172    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 17:03:02.885224 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.884208    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 17:03:02.886525 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.886511    2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 17:03:02.887729 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.887711    2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 17:03:02.898169 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.898145    2572 log.go:25] "Validated CRI v1 runtime API"
Jul 24 17:03:02.902274 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.902252    2572 log.go:25] "Validated CRI v1 image API"
Jul 24 17:03:02.903136 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.903117    2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 17:03:02.905550 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.905528    2572 fs.go:135] Filesystem UUIDs: map[027215d6-310d-4a92-8aed-736ebdf200b4:/dev/nvme0n1p3 05512fb2-7447-47c3-aa62-e7e2ae5a2e4a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 24 17:03:02.905625 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.905548    2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 17:03:02.912784 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.912647    2572 manager.go:216] Machine: {Timestamp:2026-07-24 17:03:02.911332139 +0000 UTC m=+0.345547698 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3088889 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec276fb95c79f3778b81a8b9c10accf6 SystemUUID:ec276fb9-5c79-f377-8b81-a8b9c10accf6 BootID:39c01fb5-a784-4501-b84c-6392ace4d1b6 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:68:97:aa:58:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:68:97:aa:58:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:34:23:ac:53:05 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 17:03:02.912784 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.912770    2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 17:03:02.912907 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.912862    2572 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 17:03:02.915890 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.915869    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 17:03:02.916993 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.916813    2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 17:03:02.917140 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.917001    2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-233.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 17:03:02.918126 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.918115    2572 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 17:03:02.918159 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.918132    2572 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 17:03:02.918159 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.918140    2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 17:03:02.918906 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.918895    2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 17:03:02.919740 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.919730    2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 17:03:02.922271 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.922258    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 17:03:02.922443 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.922433    2572 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 17:03:02.922472 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.922465    2572 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 17:03:02.922506 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.922475    2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 17:03:02.922506 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.922490    2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 17:03:02.922506 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.922499    2572 kubelet.go:398] "Adding apiserver pod source"
Jul 24 17:03:02.922602 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.922508    2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 17:03:02.922873 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.922860    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 17:03:02.922922 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.922878    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 17:03:02.926435 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.926419    2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 17:03:02.928161 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.928143    2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 17:03:02.928272 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.928182    2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 17:03:02.930166 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.930152    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 17:03:02.930290 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.930173    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 17:03:02.930290 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.930181    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 17:03:02.930290 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.930189    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 17:03:02.930290 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.930201    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 17:03:02.930290 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.930210    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 17:03:02.930290 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.930223    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 17:03:02.930290 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.930246    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 17:03:02.930290 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.930257    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 17:03:02.930290 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.930265    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 17:03:02.930290 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.930277    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 17:03:02.930290 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.930286    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 17:03:02.931019 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.931008    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 17:03:02.931070 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.931021    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 17:03:02.933426 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:02.933401    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 17:03:02.933632 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.933603    2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-233.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 17:03:02.933913 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:02.933895    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 17:03:02.934562 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.934546    2572 server.go:1268] "Started kubelet"
Jul 24 17:03:02.934676 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.934621    2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 17:03:02.934736 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.934653    2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 17:03:02.934736 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.934698    2572 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 17:03:02.935436 ip-10-0-135-233 systemd[1]: Started Kubernetes Kubelet.
Jul 24 17:03:02.936274 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.936260    2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 17:03:02.937484 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.937467    2572 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 17:03:02.940192 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:02.940163    2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 17:03:02.943729 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.943710    2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 17:03:02.943729 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.943721    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 17:03:02.943883 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:02.943801    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-233.ec2.internal\" not found"
Jul 24 17:03:02.944294 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.944277    2572 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 17:03:02.944294 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.944297    2572 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 17:03:02.944445 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.944275    2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 17:03:02.944445 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.944434    2572 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 17:03:02.944445 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.944443    2572 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 17:03:02.945075 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.945058    2572 factory.go:55] Registering systemd factory
Jul 24 17:03:02.945152 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.945100    2572 factory.go:223] Registration of the systemd container factory successfully
Jul 24 17:03:02.945840 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.945818    2572 factory.go:153] Registering CRI-O factory
Jul 24 17:03:02.945840 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.945842    2572 factory.go:223] Registration of the crio container factory successfully
Jul 24 17:03:02.945986 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.945926    2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 17:03:02.945986 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.945951    2572 factory.go:103] Registering Raw factory
Jul 24 17:03:02.945986 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.945967    2572 manager.go:1196] Started watching for new ooms in manager
Jul 24 17:03:02.948161 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.946605    2572 manager.go:349] Starting recovery of all containers
Jul 24 17:03:02.949621 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:02.949586    2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 17:03:02.949715 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:02.949681    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 17:03:02.952661 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:02.949777    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-233.ec2.internal.18c548898cefc3f2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-233.ec2.internal,UID:ip-10-0-135-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-233.ec2.internal,},FirstTimestamp:2026-07-24 17:03:02.934512626 +0000 UTC m=+0.368728183,LastTimestamp:2026-07-24 17:03:02.934512626 +0000 UTC m=+0.368728183,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-233.ec2.internal,}"
Jul 24 17:03:02.958651 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.958632    2572 manager.go:354] Recovery completed
Jul 24 17:03:02.962637 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.962527    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:02.964541 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.964510    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:02.964600 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.964563    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:02.964600 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.964576    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:02.965087 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.965072    2572 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 17:03:02.965087 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.965077    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:02.965204 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.965089    2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 17:03:02.965204 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.965115    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 17:03:02.965942 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.965927    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:02.965996 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.965957    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:02.965996 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.965968    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:02.966792 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.966778    2572 policy_none.go:49] "None policy: Start"
Jul 24 17:03:02.966858 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.966797    2572 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 17:03:02.966858 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.966810    2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 17:03:02.966931 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:02.966796    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-233.ec2.internal.18c548898eb9feca  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-233.ec2.internal,UID:ip-10-0-135-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-233.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-233.ec2.internal,},FirstTimestamp:2026-07-24 17:03:02.964543178 +0000 UTC m=+0.398758742,LastTimestamp:2026-07-24 17:03:02.964543178 +0000 UTC m=+0.398758742,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-233.ec2.internal,}"
Jul 24 17:03:02.967929 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.967917    2572 policy_none.go:47] "Start"
Jul 24 17:03:02.975092 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:02.975007    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-233.ec2.internal.18c548898eba63a9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-233.ec2.internal,UID:ip-10-0-135-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-233.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-233.ec2.internal,},FirstTimestamp:2026-07-24 17:03:02.964569001 +0000 UTC m=+0.398784558,LastTimestamp:2026-07-24 17:03:02.964569001 +0000 UTC m=+0.398784558,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-233.ec2.internal,}"
Jul 24 17:03:02.977652 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:02.977590    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-233.ec2.internal.18c548898eba8d43  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-233.ec2.internal,UID:ip-10-0-135-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-233.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-233.ec2.internal,},FirstTimestamp:2026-07-24 17:03:02.964579651 +0000 UTC m=+0.398795211,LastTimestamp:2026-07-24 17:03:02.964579651 +0000 UTC m=+0.398795211,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-233.ec2.internal,}"
Jul 24 17:03:02.979780 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.979747    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7z8n4"
Jul 24 17:03:02.986190 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:02.986089    2572 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-233.ec2.internal.18c548898eb9feca\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-233.ec2.internal.18c548898eb9feca  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-233.ec2.internal,UID:ip-10-0-135-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-233.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-233.ec2.internal,},FirstTimestamp:2026-07-24 17:03:02.964543178 +0000 UTC m=+0.398758742,LastTimestamp:2026-07-24 17:03:02.965941076 +0000 UTC m=+0.400156634,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-233.ec2.internal,}"
Jul 24 17:03:02.987641 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:02.987623    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7z8n4"
Jul 24 17:03:03.005861 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.005843    2572 manager.go:337] "Starting Device Plugin manager"
Jul 24 17:03:03.005963 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:03.005877    2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 17:03:03.005963 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.005905    2572 server.go:87] "Starting device plugin registration server"
Jul 24 17:03:03.006257 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.006226    2572 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 17:03:03.006339 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.006264    2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 17:03:03.006385 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.006355    2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 17:03:03.006442 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.006428    2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 17:03:03.006496 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.006443    2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 17:03:03.007496 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:03.007479    2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 17:03:03.007574 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:03.007519    2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-233.ec2.internal\" not found"
Jul 24 17:03:03.077197 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.077155    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 17:03:03.078563 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.078548    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 17:03:03.078635 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.078601    2572 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 17:03:03.078635 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.078624    2572 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 17:03:03.078707 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:03.078668    2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 17:03:03.081426 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.081404    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:03:03.107381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.107341    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:03.108866 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.108814    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:03.108866 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.108850    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:03.108866 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.108868    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:03.109009 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.108896    2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-233.ec2.internal"
Jul 24 17:03:03.118320 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.118299    2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-233.ec2.internal"
Jul 24 17:03:03.118422 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:03.118323    2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-233.ec2.internal\": node \"ip-10-0-135-233.ec2.internal\" not found"
Jul 24 17:03:03.155837 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:03.155806    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-233.ec2.internal\" not found"
Jul 24 17:03:03.180273 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.180221    2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-233.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-233.ec2.internal"]
Jul 24 17:03:03.180388 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.180323    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:03.182036 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.182019    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:03.182113 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.182064    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:03.182113 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.182075    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:03.183560 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.183547    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:03.183678 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.183665    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-233.ec2.internal"
Jul 24 17:03:03.183725 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.183715    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:03.184767 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.184752    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:03.184826 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.184790    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:03.184826 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.184756    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:03.184826 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.184800    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:03.184917 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.184823    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:03.184917 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.184843    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:03.186849 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.186835    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-233.ec2.internal"
Jul 24 17:03:03.187457 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.187185    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:03.188794 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.188774    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:03.188909 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.188811    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:03.188909 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.188827    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:03.211839 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:03.211820    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-233.ec2.internal\" not found" node="ip-10-0-135-233.ec2.internal"
Jul 24 17:03:03.216370 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:03.216353    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-233.ec2.internal\" not found" node="ip-10-0-135-233.ec2.internal"
Jul 24 17:03:03.246512 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.246487    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/088a772ea827d74ea5135dd3264e29f0-config\") pod \"kube-apiserver-proxy-ip-10-0-135-233.ec2.internal\" (UID: \"088a772ea827d74ea5135dd3264e29f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-233.ec2.internal"
Jul 24 17:03:03.246512 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.246512    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/950aaf3b8d91a1606a6455f923c8161c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-233.ec2.internal\" (UID: \"950aaf3b8d91a1606a6455f923c8161c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-233.ec2.internal"
Jul 24 17:03:03.246645 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.246530    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/950aaf3b8d91a1606a6455f923c8161c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-233.ec2.internal\" (UID: \"950aaf3b8d91a1606a6455f923c8161c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-233.ec2.internal"
Jul 24 17:03:03.256758 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:03.256734    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-233.ec2.internal\" not found"
Jul 24 17:03:03.347662 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.347625    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/950aaf3b8d91a1606a6455f923c8161c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-233.ec2.internal\" (UID: \"950aaf3b8d91a1606a6455f923c8161c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-233.ec2.internal"
Jul 24 17:03:03.347662 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.347661    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/950aaf3b8d91a1606a6455f923c8161c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-233.ec2.internal\" (UID: \"950aaf3b8d91a1606a6455f923c8161c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-233.ec2.internal"
Jul 24 17:03:03.347855 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.347690    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/088a772ea827d74ea5135dd3264e29f0-config\") pod \"kube-apiserver-proxy-ip-10-0-135-233.ec2.internal\" (UID: \"088a772ea827d74ea5135dd3264e29f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-233.ec2.internal"
Jul 24 17:03:03.347855 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.347729    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/088a772ea827d74ea5135dd3264e29f0-config\") pod \"kube-apiserver-proxy-ip-10-0-135-233.ec2.internal\" (UID: \"088a772ea827d74ea5135dd3264e29f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-233.ec2.internal"
Jul 24 17:03:03.347855 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.347736    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/950aaf3b8d91a1606a6455f923c8161c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-233.ec2.internal\" (UID: \"950aaf3b8d91a1606a6455f923c8161c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-233.ec2.internal"
Jul 24 17:03:03.347855 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.347741    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/950aaf3b8d91a1606a6455f923c8161c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-233.ec2.internal\" (UID: \"950aaf3b8d91a1606a6455f923c8161c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-233.ec2.internal"
Jul 24 17:03:03.357761 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:03.357734    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-233.ec2.internal\" not found"
Jul 24 17:03:03.458661 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:03.458587    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-233.ec2.internal\" not found"
Jul 24 17:03:03.514802 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.514761    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-233.ec2.internal"
Jul 24 17:03:03.519920 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.519901    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-233.ec2.internal"
Jul 24 17:03:03.558958 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:03.558926    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-233.ec2.internal\" not found"
Jul 24 17:03:03.659523 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:03.659470    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-233.ec2.internal\" not found"
Jul 24 17:03:03.760028 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:03.759950    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-233.ec2.internal\" not found"
Jul 24 17:03:03.860520 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:03.860489    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-233.ec2.internal\" not found"
Jul 24 17:03:03.882660 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.882635    2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 17:03:03.882795 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.882779    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 17:03:03.961464 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:03.961427    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-233.ec2.internal\" not found"
Jul 24 17:03:03.983039 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.983008    2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:03:03.992965 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.992937    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 16:58:03 +0000 UTC" deadline="2028-04-22 16:37:01.44071564 +0000 UTC"
Jul 24 17:03:03.992965 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:03.992964    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15311h33m57.447754435s"
Jul 24 17:03:04.019283 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.019260    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:04.021003 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.020981    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:04.021114 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.021014    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:04.021114 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.021025    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:04.025012 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:04.024988    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod950aaf3b8d91a1606a6455f923c8161c.slice/crio-999af561a8d6815768f3a30f95ffee6639ec3424e13b595bc3b5df9b21bd39bd WatchSource:0}: Error finding container 999af561a8d6815768f3a30f95ffee6639ec3424e13b595bc3b5df9b21bd39bd: Status 404 returned error can't find the container with id 999af561a8d6815768f3a30f95ffee6639ec3424e13b595bc3b5df9b21bd39bd
Jul 24 17:03:04.030639 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.030622    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:03:04.036818 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:04.036800    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod088a772ea827d74ea5135dd3264e29f0.slice/crio-4f0b871bcae62177d67bc527f50a7444160e448e9dc2ba0ec0fe22d92178f003 WatchSource:0}: Error finding container 4f0b871bcae62177d67bc527f50a7444160e448e9dc2ba0ec0fe22d92178f003: Status 404 returned error can't find the container with id 4f0b871bcae62177d67bc527f50a7444160e448e9dc2ba0ec0fe22d92178f003
Jul 24 17:03:04.061786 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:04.061765    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-233.ec2.internal\" not found"
Jul 24 17:03:04.082934 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.082886    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-233.ec2.internal" event={"ID":"950aaf3b8d91a1606a6455f923c8161c","Type":"ContainerStarted","Data":"999af561a8d6815768f3a30f95ffee6639ec3424e13b595bc3b5df9b21bd39bd"}
Jul 24 17:03:04.084050 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.084030    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-233.ec2.internal" event={"ID":"088a772ea827d74ea5135dd3264e29f0","Type":"ContainerStarted","Data":"4f0b871bcae62177d67bc527f50a7444160e448e9dc2ba0ec0fe22d92178f003"}
Jul 24 17:03:04.162455 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:04.162420    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-233.ec2.internal\" not found"
Jul 24 17:03:04.219338 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.219307    2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:03:04.245215 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.245178    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-233.ec2.internal"
Jul 24 17:03:04.259090 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.259069    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 17:03:04.260226 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.260212    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-233.ec2.internal"
Jul 24 17:03:04.269576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.269512    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 17:03:04.520513 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.520280    2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:03:04.923695 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.923664    2572 apiserver.go:52] "Watching apiserver"
Jul 24 17:03:04.932997 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.932974    2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 17:03:04.933537 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.933511    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-6tjfb","openshift-ovn-kubernetes/ovnkube-node-zq9nc","kube-system/kube-apiserver-proxy-ip-10-0-135-233.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t","openshift-dns/node-resolver-c6q8k","openshift-image-registry/node-ca-cc5xn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-233.ec2.internal","openshift-multus/multus-additional-cni-plugins-llp7b","openshift-multus/network-metrics-daemon-td8qt","openshift-network-diagnostics/network-check-target-4fk6m","kube-system/global-pull-secret-syncer-2dlhn","kube-system/konnectivity-agent-lz86b","openshift-cluster-node-tuning-operator/tuned-qppkz","openshift-multus/multus-grb54"]
Jul 24 17:03:04.935559 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.935536    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:04.935663 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:04.935639    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4fk6m" podUID="ea693e0b-70ff-4a94-80a0-ce8688fb1449"
Jul 24 17:03:04.936901 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.936876    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:04.938456 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.938431    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-grb54"
Jul 24 17:03:04.942027 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.942001    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 17:03:04.942136 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.942118    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 17:03:04.942697 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.942334    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 17:03:04.942697 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.942392    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 17:03:04.942697 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.942561    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 17:03:04.942697 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.942645    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5v2gv\""
Jul 24 17:03:04.942697 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.942680    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t"
Jul 24 17:03:04.943056 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.943036    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:03:04.943276 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.943224    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5s8wd\""
Jul 24 17:03:04.944112 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.944095    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c6q8k"
Jul 24 17:03:04.944369 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.944353    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 17:03:04.944962 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.944942    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fwdmt\""
Jul 24 17:03:04.945112 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.945094    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 17:03:04.945184 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.945140    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 17:03:04.945184 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.945173    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 17:03:04.945419 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.945392    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cc5xn"
Jul 24 17:03:04.946100 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.946080    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 17:03:04.946194 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.946109    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xgzbb\""
Jul 24 17:03:04.946450 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.946432    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 17:03:04.947062 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.947043    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:04.947175 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:04.947111    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td8qt" podUID="ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b"
Jul 24 17:03:04.947730 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.947714    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 17:03:04.947809 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.947778    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 17:03:04.948003 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.947986    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-99kcv\""
Jul 24 17:03:04.948105 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.948001    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 17:03:04.948741 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.948722    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:04.950507 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.950490    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:04.950811 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.950775    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 17:03:04.951052 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.951035    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 17:03:04.951093 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.951035    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dj8jg\""
Jul 24 17:03:04.951857 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.951836    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6tjfb"
Jul 24 17:03:04.952601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.952583    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qxxlc\""
Jul 24 17:03:04.952933 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.952875    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 17:03:04.953399 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.953257    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 17:03:04.953399 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.953310    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 17:03:04.953399 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.953327    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 17:03:04.953647 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.953591    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 17:03:04.954089 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.953962    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 17:03:04.954476 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.954456    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 17:03:04.954681 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.954651    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:03:04.954844 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.954821    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:04.954947 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:04.954913    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dlhn" podUID="eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7"
Jul 24 17:03:04.955393 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.955247    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 17:03:04.955393 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.955327    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bsrkd\""
Jul 24 17:03:04.956892 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.956869    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lz86b"
Jul 24 17:03:04.957839 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.957819    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-host-run-multus-certs\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:04.957839 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.957828    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 17:03:04.957991 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.957851    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/af97397c-bef7-455d-b554-6694a6a68ae4-socket-dir\") pod \"aws-ebs-csi-driver-node-q7s2t\" (UID: \"af97397c-bef7-455d-b554-6694a6a68ae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t"
Jul 24 17:03:04.957991 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.957877    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/af97397c-bef7-455d-b554-6694a6a68ae4-sys-fs\") pod \"aws-ebs-csi-driver-node-q7s2t\" (UID: \"af97397c-bef7-455d-b554-6694a6a68ae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t"
Jul 24 17:03:04.957991 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.957912    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-etc-sysctl-conf\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:04.957991 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.957950    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-etc-systemd\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:04.957991 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.957975    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-hostroot\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:04.958242 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.957999    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/af97397c-bef7-455d-b554-6694a6a68ae4-registration-dir\") pod \"aws-ebs-csi-driver-node-q7s2t\" (UID: \"af97397c-bef7-455d-b554-6694a6a68ae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t"
Jul 24 17:03:04.958242 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958026    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c57cr\" (UniqueName: \"kubernetes.io/projected/8ff2442b-1e6e-4d7e-9e4b-289e4b74517a-kube-api-access-c57cr\") pod \"node-ca-cc5xn\" (UID: \"8ff2442b-1e6e-4d7e-9e4b-289e4b74517a\") " pod="openshift-image-registry/node-ca-cc5xn"
Jul 24 17:03:04.958242 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958061    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-etc-sysctl-d\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:04.958242 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958087    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-var-lib-kubelet\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:04.958242 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958119    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-host\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:04.958242 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958161    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-os-release\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:04.958242 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958216    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-cni-binary-copy\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:04.958242 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958242    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-multus-conf-dir\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:04.958661 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958288    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-etc-kubernetes\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:04.958661 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958333    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6b98\" (UniqueName: \"kubernetes.io/projected/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-kube-api-access-x6b98\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:04.958661 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958363    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/af97397c-bef7-455d-b554-6694a6a68ae4-etc-selinux\") pod \"aws-ebs-csi-driver-node-q7s2t\" (UID: \"af97397c-bef7-455d-b554-6694a6a68ae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t"
Jul 24 17:03:04.958661 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958419    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22q98\" (UniqueName: \"kubernetes.io/projected/af97397c-bef7-455d-b554-6694a6a68ae4-kube-api-access-22q98\") pod \"aws-ebs-csi-driver-node-q7s2t\" (UID: \"af97397c-bef7-455d-b554-6694a6a68ae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t"
Jul 24 17:03:04.958661 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958466    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db2edea8-70c4-4ab5-898c-e0db3a2dacbe-hosts-file\") pod \"node-resolver-c6q8k\" (UID: \"db2edea8-70c4-4ab5-898c-e0db3a2dacbe\") " pod="openshift-dns/node-resolver-c6q8k"
Jul 24 17:03:04.958661 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958501    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db2edea8-70c4-4ab5-898c-e0db3a2dacbe-tmp-dir\") pod \"node-resolver-c6q8k\" (UID: \"db2edea8-70c4-4ab5-898c-e0db3a2dacbe\") " pod="openshift-dns/node-resolver-c6q8k"
Jul 24 17:03:04.958661 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958526    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzfdz\" (UniqueName: \"kubernetes.io/projected/db2edea8-70c4-4ab5-898c-e0db3a2dacbe-kube-api-access-gzfdz\") pod \"node-resolver-c6q8k\" (UID: \"db2edea8-70c4-4ab5-898c-e0db3a2dacbe\") " pod="openshift-dns/node-resolver-c6q8k"
Jul 24 17:03:04.958661 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958551    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-etc-modprobe-d\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:04.958661 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958584    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-etc-sysconfig\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:04.958661 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958621    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-sys\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:04.958661 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958659    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-multus-cni-dir\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:04.959351 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958701    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-multus-socket-dir-parent\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:04.959351 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958722    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/af97397c-bef7-455d-b554-6694a6a68ae4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q7s2t\" (UID: \"af97397c-bef7-455d-b554-6694a6a68ae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t"
Jul 24 17:03:04.959351 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958749    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/af97397c-bef7-455d-b554-6694a6a68ae4-device-dir\") pod \"aws-ebs-csi-driver-node-q7s2t\" (UID: \"af97397c-bef7-455d-b554-6694a6a68ae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t"
Jul 24 17:03:04.959351 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958798    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-etc-kubernetes\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:04.959351 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958822    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-etc-tuned\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:04.959351 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958846    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-tmp\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:04.959351 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958870    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-host-var-lib-cni-multus\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:04.959351 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958902    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-host-var-lib-kubelet\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:04.959351 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958947    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g4z4\" (UniqueName: \"kubernetes.io/projected/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-kube-api-access-8g4z4\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:04.959351 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958971    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ff2442b-1e6e-4d7e-9e4b-289e4b74517a-host\") pod \"node-ca-cc5xn\" (UID: \"8ff2442b-1e6e-4d7e-9e4b-289e4b74517a\") " pod="openshift-image-registry/node-ca-cc5xn"
Jul 24 17:03:04.959351 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.958996    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-run\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:04.959351 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.959019    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-lib-modules\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:04.959351 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.959041    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-host-run-k8s-cni-cncf-io\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:04.959351 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.959066    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-multus-daemon-config\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:04.959351 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.959121    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ff2442b-1e6e-4d7e-9e4b-289e4b74517a-serviceca\") pod \"node-ca-cc5xn\" (UID: \"8ff2442b-1e6e-4d7e-9e4b-289e4b74517a\") " pod="openshift-image-registry/node-ca-cc5xn"
Jul 24 17:03:04.959351 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.959176    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p2s9\" (UniqueName: \"kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9\") pod \"network-check-target-4fk6m\" (UID: \"ea693e0b-70ff-4a94-80a0-ce8688fb1449\") " pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:04.959351 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.959216    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-system-cni-dir\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:04.960208 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.959286    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 17:03:04.960208 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.959293    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-cnibin\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:04.960208 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.959322    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-host-run-netns\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:04.960208 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.959355    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-host-var-lib-cni-bin\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:04.960208 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.959399    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 17:03:04.960208 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.959488    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p2jrb\""
Jul 24 17:03:04.960741 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.960726    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:03:04.986114 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.986093    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fn2qt"
Jul 24 17:03:04.996436 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:04.996417    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fn2qt"
Jul 24 17:03:05.045087 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.045059    2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 17:03:05.059778 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.059745    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22q98\" (UniqueName: \"kubernetes.io/projected/af97397c-bef7-455d-b554-6694a6a68ae4-kube-api-access-22q98\") pod \"aws-ebs-csi-driver-node-q7s2t\" (UID: \"af97397c-bef7-455d-b554-6694a6a68ae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t"
Jul 24 17:03:05.059920 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.059792    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzfdz\" (UniqueName: \"kubernetes.io/projected/db2edea8-70c4-4ab5-898c-e0db3a2dacbe-kube-api-access-gzfdz\") pod \"node-resolver-c6q8k\" (UID: \"db2edea8-70c4-4ab5-898c-e0db3a2dacbe\") " pod="openshift-dns/node-resolver-c6q8k"
Jul 24 17:03:05.059920 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.059819    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-etc-openvswitch\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.059920 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.059841    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-run-ovn\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.059920 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.059869    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75173365-4f71-459a-8957-a7b81a803a31-os-release\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.059920 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.059904    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret\") pod \"global-pull-secret-syncer-2dlhn\" (UID: \"eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7\") " pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:05.060154 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.059944    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-etc-modprobe-d\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.060154 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.059964    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-etc-sysconfig\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.060154 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.059982    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-multus-cni-dir\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.060154 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.059998    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-multus-socket-dir-parent\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.060154 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060015    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-etc-tuned\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.060154 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060039    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-host-var-lib-cni-multus\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.060154 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060057    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-host-var-lib-kubelet\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.060154 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060072    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g4z4\" (UniqueName: \"kubernetes.io/projected/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-kube-api-access-8g4z4\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.060154 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060105    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrhtp\" (UniqueName: \"kubernetes.io/projected/75173365-4f71-459a-8957-a7b81a803a31-kube-api-access-vrhtp\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.060154 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060122    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-run-openvswitch\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.060154 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060137    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-node-log\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.060154 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060152    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.060746 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060171    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p2s9\" (UniqueName: \"kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9\") pod \"network-check-target-4fk6m\" (UID: \"ea693e0b-70ff-4a94-80a0-ce8688fb1449\") " pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:05.060746 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060169    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-multus-socket-dir-parent\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.060746 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060188    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-system-cni-dir\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.060746 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060199    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-multus-cni-dir\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.060746 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060206    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-cnibin\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.060746 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060252    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-cnibin\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.060746 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060310    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-host-var-lib-kubelet\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.060746 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060365    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-etc-modprobe-d\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.060746 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060420    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-etc-sysconfig\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.060746 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060542    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-host-var-lib-cni-multus\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.060746 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060544    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-system-cni-dir\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.060746 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060607    2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 17:03:05.060746 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060669    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-host-var-lib-cni-bin\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.060746 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060692    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/af97397c-bef7-455d-b554-6694a6a68ae4-sys-fs\") pod \"aws-ebs-csi-driver-node-q7s2t\" (UID: \"af97397c-bef7-455d-b554-6694a6a68ae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t"
Jul 24 17:03:05.060746 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060717    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk7nd\" (UniqueName: \"kubernetes.io/projected/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-kube-api-access-vk7nd\") pod \"network-metrics-daemon-td8qt\" (UID: \"ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b\") " pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:05.060746 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060737    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-host-slash\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.061519 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060764    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-host-cni-netd\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.061519 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060785    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-etc-sysctl-conf\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.061519 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060804    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-hostroot\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.061519 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060828    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/af97397c-bef7-455d-b554-6694a6a68ae4-registration-dir\") pod \"aws-ebs-csi-driver-node-q7s2t\" (UID: \"af97397c-bef7-455d-b554-6694a6a68ae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t"
Jul 24 17:03:05.061519 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060854    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4e0b0dcc-7de7-4aec-9a86-f325770a006b-ovnkube-config\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.061519 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060872    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75173365-4f71-459a-8957-a7b81a803a31-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.061519 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060892    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-dbus\") pod \"global-pull-secret-syncer-2dlhn\" (UID: \"eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7\") " pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:05.061519 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060909    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b4e94037-5cfa-4bdf-b325-58bdaa8a6bb5-agent-certs\") pod \"konnectivity-agent-lz86b\" (UID: \"b4e94037-5cfa-4bdf-b325-58bdaa8a6bb5\") " pod="kube-system/konnectivity-agent-lz86b"
Jul 24 17:03:05.061519 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060940    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-var-lib-kubelet\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.061519 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060956    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-host\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.061519 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060975    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-systemd-units\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.061519 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.060994    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2sz7\" (UniqueName: \"kubernetes.io/projected/4e0b0dcc-7de7-4aec-9a86-f325770a006b-kube-api-access-p2sz7\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.061519 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061021    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-host-run-netns\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.061519 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061041    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e1b23a60-9f95-456c-8ed1-258d015439aa-iptables-alerter-script\") pod \"iptables-alerter-6tjfb\" (UID: \"e1b23a60-9f95-456c-8ed1-258d015439aa\") " pod="openshift-network-operator/iptables-alerter-6tjfb"
Jul 24 17:03:05.061519 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061063    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75173365-4f71-459a-8957-a7b81a803a31-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.061519 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061084    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b4e94037-5cfa-4bdf-b325-58bdaa8a6bb5-konnectivity-ca\") pod \"konnectivity-agent-lz86b\" (UID: \"b4e94037-5cfa-4bdf-b325-58bdaa8a6bb5\") " pod="kube-system/konnectivity-agent-lz86b"
Jul 24 17:03:05.062160 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061108    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-sys\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.062160 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061125    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/af97397c-bef7-455d-b554-6694a6a68ae4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q7s2t\" (UID: \"af97397c-bef7-455d-b554-6694a6a68ae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t"
Jul 24 17:03:05.062160 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061200    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-host-var-lib-cni-bin\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.062160 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061237    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-var-lib-kubelet\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.062160 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061278    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/af97397c-bef7-455d-b554-6694a6a68ae4-sys-fs\") pod \"aws-ebs-csi-driver-node-q7s2t\" (UID: \"af97397c-bef7-455d-b554-6694a6a68ae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t"
Jul 24 17:03:05.062160 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061333    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/af97397c-bef7-455d-b554-6694a6a68ae4-device-dir\") pod \"aws-ebs-csi-driver-node-q7s2t\" (UID: \"af97397c-bef7-455d-b554-6694a6a68ae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t"
Jul 24 17:03:05.062160 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061363    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-etc-sysctl-conf\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.062160 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061379    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-run-systemd\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.062160 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061389    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/af97397c-bef7-455d-b554-6694a6a68ae4-device-dir\") pod \"aws-ebs-csi-driver-node-q7s2t\" (UID: \"af97397c-bef7-455d-b554-6694a6a68ae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t"
Jul 24 17:03:05.062160 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061420    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-sys\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.062160 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061420    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-var-lib-openvswitch\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.062160 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061436    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-hostroot\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.062160 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061454    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/af97397c-bef7-455d-b554-6694a6a68ae4-registration-dir\") pod \"aws-ebs-csi-driver-node-q7s2t\" (UID: \"af97397c-bef7-455d-b554-6694a6a68ae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t"
Jul 24 17:03:05.062160 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061475    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/af97397c-bef7-455d-b554-6694a6a68ae4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q7s2t\" (UID: \"af97397c-bef7-455d-b554-6694a6a68ae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t"
Jul 24 17:03:05.062160 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061476    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-host\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.062160 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061531    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-etc-kubernetes\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.062160 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061482    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-etc-kubernetes\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.062830 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061594    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-tmp\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.062830 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061642    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ff2442b-1e6e-4d7e-9e4b-289e4b74517a-host\") pod \"node-ca-cc5xn\" (UID: \"8ff2442b-1e6e-4d7e-9e4b-289e4b74517a\") " pod="openshift-image-registry/node-ca-cc5xn"
Jul 24 17:03:05.062830 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061684    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ff2442b-1e6e-4d7e-9e4b-289e4b74517a-host\") pod \"node-ca-cc5xn\" (UID: \"8ff2442b-1e6e-4d7e-9e4b-289e4b74517a\") " pod="openshift-image-registry/node-ca-cc5xn"
Jul 24 17:03:05.062830 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061684    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ff2442b-1e6e-4d7e-9e4b-289e4b74517a-serviceca\") pod \"node-ca-cc5xn\" (UID: \"8ff2442b-1e6e-4d7e-9e4b-289e4b74517a\") " pod="openshift-image-registry/node-ca-cc5xn"
Jul 24 17:03:05.062830 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061731    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-host-cni-bin\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.062830 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061791    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e0b0dcc-7de7-4aec-9a86-f325770a006b-ovn-node-metrics-cert\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.062830 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061838    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4e0b0dcc-7de7-4aec-9a86-f325770a006b-ovnkube-script-lib\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.062830 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061884    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-run\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.062830 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061931    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-lib-modules\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.062830 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.061967    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-host-run-k8s-cni-cncf-io\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.062830 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062007    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-multus-daemon-config\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.062830 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062040    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-host-run-k8s-cni-cncf-io\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.062830 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062089    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75173365-4f71-459a-8957-a7b81a803a31-system-cni-dir\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.062830 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062086    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-lib-modules\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.062830 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062127    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75173365-4f71-459a-8957-a7b81a803a31-cnibin\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.062830 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062158    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75173365-4f71-459a-8957-a7b81a803a31-tuning-conf-dir\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.062830 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062208    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-host-run-netns\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.063684 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062233    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-host-run-multus-certs\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.063684 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062209    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ff2442b-1e6e-4d7e-9e4b-289e4b74517a-serviceca\") pod \"node-ca-cc5xn\" (UID: \"8ff2442b-1e6e-4d7e-9e4b-289e4b74517a\") " pod="openshift-image-registry/node-ca-cc5xn"
Jul 24 17:03:05.063684 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062274    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-host-run-netns\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.063684 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062322    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/af97397c-bef7-455d-b554-6694a6a68ae4-socket-dir\") pod \"aws-ebs-csi-driver-node-q7s2t\" (UID: \"af97397c-bef7-455d-b554-6694a6a68ae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t"
Jul 24 17:03:05.063684 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062336    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-host-run-multus-certs\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.063684 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062352    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs\") pod \"network-metrics-daemon-td8qt\" (UID: \"ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b\") " pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:05.063684 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062378    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4e0b0dcc-7de7-4aec-9a86-f325770a006b-env-overrides\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.063684 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062404    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75173365-4f71-459a-8957-a7b81a803a31-cni-binary-copy\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.063684 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062440    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-etc-systemd\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.063684 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062447    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/af97397c-bef7-455d-b554-6694a6a68ae4-socket-dir\") pod \"aws-ebs-csi-driver-node-q7s2t\" (UID: \"af97397c-bef7-455d-b554-6694a6a68ae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t"
Jul 24 17:03:05.063684 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062466    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c57cr\" (UniqueName: \"kubernetes.io/projected/8ff2442b-1e6e-4d7e-9e4b-289e4b74517a-kube-api-access-c57cr\") pod \"node-ca-cc5xn\" (UID: \"8ff2442b-1e6e-4d7e-9e4b-289e4b74517a\") " pod="openshift-image-registry/node-ca-cc5xn"
Jul 24 17:03:05.063684 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062499    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-host-kubelet\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.063684 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062526    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-log-socket\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.063684 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062536    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-etc-systemd\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.063684 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062551    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-host-run-ovn-kubernetes\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.063684 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062567    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-multus-daemon-config\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.063684 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062577    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1b23a60-9f95-456c-8ed1-258d015439aa-host-slash\") pod \"iptables-alerter-6tjfb\" (UID: \"e1b23a60-9f95-456c-8ed1-258d015439aa\") " pod="openshift-network-operator/iptables-alerter-6tjfb"
Jul 24 17:03:05.064620 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062612    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j9rj\" (UniqueName: \"kubernetes.io/projected/e1b23a60-9f95-456c-8ed1-258d015439aa-kube-api-access-2j9rj\") pod \"iptables-alerter-6tjfb\" (UID: \"e1b23a60-9f95-456c-8ed1-258d015439aa\") " pod="openshift-network-operator/iptables-alerter-6tjfb"
Jul 24 17:03:05.064620 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062648    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-kubelet-config\") pod \"global-pull-secret-syncer-2dlhn\" (UID: \"eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7\") " pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:05.064620 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062700    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-etc-sysctl-d\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.064620 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062758    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-run\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.064620 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062811    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-os-release\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.064620 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062842    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-cni-binary-copy\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.064620 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062938    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-os-release\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.064620 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.062961    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-etc-sysctl-d\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.064620 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.063018    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-multus-conf-dir\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.064620 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.063082    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-etc-kubernetes\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.064620 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.063114    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db2edea8-70c4-4ab5-898c-e0db3a2dacbe-hosts-file\") pod \"node-resolver-c6q8k\" (UID: \"db2edea8-70c4-4ab5-898c-e0db3a2dacbe\") " pod="openshift-dns/node-resolver-c6q8k"
Jul 24 17:03:05.064620 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.063121    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-multus-conf-dir\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.064620 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.063140    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db2edea8-70c4-4ab5-898c-e0db3a2dacbe-tmp-dir\") pod \"node-resolver-c6q8k\" (UID: \"db2edea8-70c4-4ab5-898c-e0db3a2dacbe\") " pod="openshift-dns/node-resolver-c6q8k"
Jul 24 17:03:05.064620 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.063184    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-etc-kubernetes\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.064620 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.063273    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6b98\" (UniqueName: \"kubernetes.io/projected/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-kube-api-access-x6b98\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.064620 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.063339    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db2edea8-70c4-4ab5-898c-e0db3a2dacbe-hosts-file\") pod \"node-resolver-c6q8k\" (UID: \"db2edea8-70c4-4ab5-898c-e0db3a2dacbe\") " pod="openshift-dns/node-resolver-c6q8k"
Jul 24 17:03:05.064620 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.063391    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-cni-binary-copy\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.064620 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.063398    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/af97397c-bef7-455d-b554-6694a6a68ae4-etc-selinux\") pod \"aws-ebs-csi-driver-node-q7s2t\" (UID: \"af97397c-bef7-455d-b554-6694a6a68ae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t"
Jul 24 17:03:05.065540 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.063430    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db2edea8-70c4-4ab5-898c-e0db3a2dacbe-tmp-dir\") pod \"node-resolver-c6q8k\" (UID: \"db2edea8-70c4-4ab5-898c-e0db3a2dacbe\") " pod="openshift-dns/node-resolver-c6q8k"
Jul 24 17:03:05.065540 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.063493    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/af97397c-bef7-455d-b554-6694a6a68ae4-etc-selinux\") pod \"aws-ebs-csi-driver-node-q7s2t\" (UID: \"af97397c-bef7-455d-b554-6694a6a68ae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t"
Jul 24 17:03:05.065540 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.064616    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-etc-tuned\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.065540 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.064945    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-tmp\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.073769 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.073749    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22q98\" (UniqueName: \"kubernetes.io/projected/af97397c-bef7-455d-b554-6694a6a68ae4-kube-api-access-22q98\") pod \"aws-ebs-csi-driver-node-q7s2t\" (UID: \"af97397c-bef7-455d-b554-6694a6a68ae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t"
Jul 24 17:03:05.073903 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.073779    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzfdz\" (UniqueName: \"kubernetes.io/projected/db2edea8-70c4-4ab5-898c-e0db3a2dacbe-kube-api-access-gzfdz\") pod \"node-resolver-c6q8k\" (UID: \"db2edea8-70c4-4ab5-898c-e0db3a2dacbe\") " pod="openshift-dns/node-resolver-c6q8k"
Jul 24 17:03:05.075421 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:05.075398    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:05.075535 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:05.075431    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:05.075535 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:05.075445    2572 projected.go:196] Error preparing data for projected volume kube-api-access-4p2s9 for pod openshift-network-diagnostics/network-check-target-4fk6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:05.075535 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:05.075530    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9 podName:ea693e0b-70ff-4a94-80a0-ce8688fb1449 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:05.575492819 +0000 UTC m=+3.009708422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4p2s9" (UniqueName: "kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9") pod "network-check-target-4fk6m" (UID: "ea693e0b-70ff-4a94-80a0-ce8688fb1449") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:05.078066 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.078045    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g4z4\" (UniqueName: \"kubernetes.io/projected/d49486f2-e3c5-443a-9a2f-9627ee4e0d7f-kube-api-access-8g4z4\") pod \"multus-grb54\" (UID: \"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f\") " pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.078383 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.078362    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c57cr\" (UniqueName: \"kubernetes.io/projected/8ff2442b-1e6e-4d7e-9e4b-289e4b74517a-kube-api-access-c57cr\") pod \"node-ca-cc5xn\" (UID: \"8ff2442b-1e6e-4d7e-9e4b-289e4b74517a\") " pod="openshift-image-registry/node-ca-cc5xn"
Jul 24 17:03:05.080098 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.080079    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6b98\" (UniqueName: \"kubernetes.io/projected/e110c4c6-2e6f-42f0-89cd-6bae1a2de29d-kube-api-access-x6b98\") pod \"tuned-qppkz\" (UID: \"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d\") " pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.167853 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.164152    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75173365-4f71-459a-8957-a7b81a803a31-system-cni-dir\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.167853 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.164210    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75173365-4f71-459a-8957-a7b81a803a31-cnibin\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.167853 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.164238    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75173365-4f71-459a-8957-a7b81a803a31-tuning-conf-dir\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.167853 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.164367    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75173365-4f71-459a-8957-a7b81a803a31-cnibin\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.167853 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:05.164410    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:05.167853 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.164437    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75173365-4f71-459a-8957-a7b81a803a31-system-cni-dir\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.167853 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:05.164517    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs podName:ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b nodeName:}" failed. No retries permitted until 2026-07-24 17:03:05.664496692 +0000 UTC m=+3.098712255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs") pod "network-metrics-daemon-td8qt" (UID: "ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:05.167853 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.164643    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75173365-4f71-459a-8957-a7b81a803a31-tuning-conf-dir\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.167853 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.164275    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs\") pod \"network-metrics-daemon-td8qt\" (UID: \"ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b\") " pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:05.167853 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.164795    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4e0b0dcc-7de7-4aec-9a86-f325770a006b-env-overrides\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.167853 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.164831    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75173365-4f71-459a-8957-a7b81a803a31-cni-binary-copy\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.167853 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.164867    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-host-kubelet\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.167853 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.164898    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-log-socket\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.167853 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.164955    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-host-kubelet\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.167853 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.164996    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-host-run-ovn-kubernetes\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.167853 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165028    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1b23a60-9f95-456c-8ed1-258d015439aa-host-slash\") pod \"iptables-alerter-6tjfb\" (UID: \"e1b23a60-9f95-456c-8ed1-258d015439aa\") " pod="openshift-network-operator/iptables-alerter-6tjfb"
Jul 24 17:03:05.167853 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165058    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j9rj\" (UniqueName: \"kubernetes.io/projected/e1b23a60-9f95-456c-8ed1-258d015439aa-kube-api-access-2j9rj\") pod \"iptables-alerter-6tjfb\" (UID: \"e1b23a60-9f95-456c-8ed1-258d015439aa\") " pod="openshift-network-operator/iptables-alerter-6tjfb"
Jul 24 17:03:05.168721 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165099    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-kubelet-config\") pod \"global-pull-secret-syncer-2dlhn\" (UID: \"eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7\") " pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:05.168721 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165162    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-etc-openvswitch\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.168721 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165194    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-run-ovn\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.168721 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165230    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75173365-4f71-459a-8957-a7b81a803a31-os-release\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.168721 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165259    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret\") pod \"global-pull-secret-syncer-2dlhn\" (UID: \"eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7\") " pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:05.168721 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165324    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrhtp\" (UniqueName: \"kubernetes.io/projected/75173365-4f71-459a-8957-a7b81a803a31-kube-api-access-vrhtp\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.168721 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165411    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-kubelet-config\") pod \"global-pull-secret-syncer-2dlhn\" (UID: \"eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7\") " pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:05.168721 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165465    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-run-openvswitch\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.168721 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165495    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-node-log\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.168721 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165529    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.168721 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165539    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4e0b0dcc-7de7-4aec-9a86-f325770a006b-env-overrides\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.168721 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165584    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk7nd\" (UniqueName: \"kubernetes.io/projected/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-kube-api-access-vk7nd\") pod \"network-metrics-daemon-td8qt\" (UID: \"ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b\") " pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:05.168721 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165617    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-host-slash\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.168721 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165619    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-run-ovn\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.168721 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165676    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-log-socket\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.168721 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165692    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-etc-openvswitch\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.168721 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:05.165721    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:05.168721 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165727    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-host-cni-netd\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.169439 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165740    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1b23a60-9f95-456c-8ed1-258d015439aa-host-slash\") pod \"iptables-alerter-6tjfb\" (UID: \"e1b23a60-9f95-456c-8ed1-258d015439aa\") " pod="openshift-network-operator/iptables-alerter-6tjfb"
Jul 24 17:03:05.169439 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165762    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4e0b0dcc-7de7-4aec-9a86-f325770a006b-ovnkube-config\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.169439 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:05.165795    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret podName:eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:05.665776741 +0000 UTC m=+3.099992305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret") pod "global-pull-secret-syncer-2dlhn" (UID: "eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:05.169439 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165817    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75173365-4f71-459a-8957-a7b81a803a31-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.169439 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165852    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-dbus\") pod \"global-pull-secret-syncer-2dlhn\" (UID: \"eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7\") " pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:05.169439 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165866    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-host-run-ovn-kubernetes\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.169439 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165884    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b4e94037-5cfa-4bdf-b325-58bdaa8a6bb5-agent-certs\") pod \"konnectivity-agent-lz86b\" (UID: \"b4e94037-5cfa-4bdf-b325-58bdaa8a6bb5\") " pod="kube-system/konnectivity-agent-lz86b"
Jul 24 17:03:05.169439 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165924    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-host-cni-netd\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.169439 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.165994    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75173365-4f71-459a-8957-a7b81a803a31-os-release\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.169439 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.166090    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-dbus\") pod \"global-pull-secret-syncer-2dlhn\" (UID: \"eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7\") " pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:05.169439 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.166137    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-systemd-units\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.169439 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.166175    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2sz7\" (UniqueName: \"kubernetes.io/projected/4e0b0dcc-7de7-4aec-9a86-f325770a006b-kube-api-access-p2sz7\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.169439 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.166207    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-host-run-netns\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.169439 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.166239    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e1b23a60-9f95-456c-8ed1-258d015439aa-iptables-alerter-script\") pod \"iptables-alerter-6tjfb\" (UID: \"e1b23a60-9f95-456c-8ed1-258d015439aa\") " pod="openshift-network-operator/iptables-alerter-6tjfb"
Jul 24 17:03:05.169439 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.166273    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75173365-4f71-459a-8957-a7b81a803a31-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.169439 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.166299    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b4e94037-5cfa-4bdf-b325-58bdaa8a6bb5-konnectivity-ca\") pod \"konnectivity-agent-lz86b\" (UID: \"b4e94037-5cfa-4bdf-b325-58bdaa8a6bb5\") " pod="kube-system/konnectivity-agent-lz86b"
Jul 24 17:03:05.170161 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.166364    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-run-systemd\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.170161 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.166395    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-var-lib-openvswitch\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.170161 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.166433    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-host-cni-bin\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.170161 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.166462    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e0b0dcc-7de7-4aec-9a86-f325770a006b-ovn-node-metrics-cert\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.170161 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.166502    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4e0b0dcc-7de7-4aec-9a86-f325770a006b-ovnkube-script-lib\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.170161 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.166604    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4e0b0dcc-7de7-4aec-9a86-f325770a006b-ovnkube-config\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.170161 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.166698    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-run-openvswitch\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.170161 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.166757    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-node-log\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.170161 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.166807    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.170161 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.167240    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4e0b0dcc-7de7-4aec-9a86-f325770a006b-ovnkube-script-lib\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.170161 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.167811    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-host-slash\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.170161 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.167737    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e1b23a60-9f95-456c-8ed1-258d015439aa-iptables-alerter-script\") pod \"iptables-alerter-6tjfb\" (UID: \"e1b23a60-9f95-456c-8ed1-258d015439aa\") " pod="openshift-network-operator/iptables-alerter-6tjfb"
Jul 24 17:03:05.170161 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.167886    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b4e94037-5cfa-4bdf-b325-58bdaa8a6bb5-konnectivity-ca\") pod \"konnectivity-agent-lz86b\" (UID: \"b4e94037-5cfa-4bdf-b325-58bdaa8a6bb5\") " pod="kube-system/konnectivity-agent-lz86b"
Jul 24 17:03:05.170161 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.167971    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-run-systemd\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.170161 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.168032    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-host-cni-bin\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.170161 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.168095    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-systemd-units\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.170161 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.168158    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-host-run-netns\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.170771 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.168450    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e0b0dcc-7de7-4aec-9a86-f325770a006b-var-lib-openvswitch\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.170771 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.168454    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75173365-4f71-459a-8957-a7b81a803a31-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.170771 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.168572    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75173365-4f71-459a-8957-a7b81a803a31-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.170771 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.168858    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75173365-4f71-459a-8957-a7b81a803a31-cni-binary-copy\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.170771 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.170467    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b4e94037-5cfa-4bdf-b325-58bdaa8a6bb5-agent-certs\") pod \"konnectivity-agent-lz86b\" (UID: \"b4e94037-5cfa-4bdf-b325-58bdaa8a6bb5\") " pod="kube-system/konnectivity-agent-lz86b"
Jul 24 17:03:05.170946 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.170861    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e0b0dcc-7de7-4aec-9a86-f325770a006b-ovn-node-metrics-cert\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.174550 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.174484    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrhtp\" (UniqueName: \"kubernetes.io/projected/75173365-4f71-459a-8957-a7b81a803a31-kube-api-access-vrhtp\") pod \"multus-additional-cni-plugins-llp7b\" (UID: \"75173365-4f71-459a-8957-a7b81a803a31\") " pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.174901 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.174875    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j9rj\" (UniqueName: \"kubernetes.io/projected/e1b23a60-9f95-456c-8ed1-258d015439aa-kube-api-access-2j9rj\") pod \"iptables-alerter-6tjfb\" (UID: \"e1b23a60-9f95-456c-8ed1-258d015439aa\") " pod="openshift-network-operator/iptables-alerter-6tjfb"
Jul 24 17:03:05.175343 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.175317    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk7nd\" (UniqueName: \"kubernetes.io/projected/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-kube-api-access-vk7nd\") pod \"network-metrics-daemon-td8qt\" (UID: \"ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b\") " pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:05.175971 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.175951    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2sz7\" (UniqueName: \"kubernetes.io/projected/4e0b0dcc-7de7-4aec-9a86-f325770a006b-kube-api-access-p2sz7\") pod \"ovnkube-node-zq9nc\" (UID: \"4e0b0dcc-7de7-4aec-9a86-f325770a006b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.249690 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.249647    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qppkz"
Jul 24 17:03:05.257374 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.257333    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-grb54"
Jul 24 17:03:05.267764 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.267741    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t"
Jul 24 17:03:05.271450 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.271430    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c6q8k"
Jul 24 17:03:05.278241 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.278222    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cc5xn"
Jul 24 17:03:05.285328 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.285299    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-llp7b"
Jul 24 17:03:05.292333 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.292311    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:05.301009 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.300984    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6tjfb"
Jul 24 17:03:05.308037 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.308016    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lz86b"
Jul 24 17:03:05.671988 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.671955    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p2s9\" (UniqueName: \"kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9\") pod \"network-check-target-4fk6m\" (UID: \"ea693e0b-70ff-4a94-80a0-ce8688fb1449\") " pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:05.672148 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.672008    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs\") pod \"network-metrics-daemon-td8qt\" (UID: \"ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b\") " pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:05.672148 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.672043    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret\") pod \"global-pull-secret-syncer-2dlhn\" (UID: \"eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7\") " pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:05.672148 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:05.672137    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:05.672269 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:05.672150    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:05.672269 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:05.672169    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:05.672269 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:05.672179    2572 projected.go:196] Error preparing data for projected volume kube-api-access-4p2s9 for pod openshift-network-diagnostics/network-check-target-4fk6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:05.672269 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:05.672197    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs podName:ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b nodeName:}" failed. No retries permitted until 2026-07-24 17:03:06.672181477 +0000 UTC m=+4.106397023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs") pod "network-metrics-daemon-td8qt" (UID: "ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:05.672269 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:05.672223    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9 podName:ea693e0b-70ff-4a94-80a0-ce8688fb1449 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:06.672209241 +0000 UTC m=+4.106424805 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4p2s9" (UniqueName: "kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9") pod "network-check-target-4fk6m" (UID: "ea693e0b-70ff-4a94-80a0-ce8688fb1449") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:05.672269 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:05.672137    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:05.672509 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:05.672292    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret podName:eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:06.672279385 +0000 UTC m=+4.106494950 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret") pod "global-pull-secret-syncer-2dlhn" (UID: "eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:05.999454 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.999401    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 16:58:05 +0000 UTC" deadline="2028-02-03 07:52:10.103892385 +0000 UTC"
Jul 24 17:03:05.999454 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:05.999454    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13406h49m4.104442539s"
Jul 24 17:03:06.001816 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:06.001785    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1b23a60_9f95_456c_8ed1_258d015439aa.slice/crio-e454972db63d6eb16d1033fa39465ba81bebc63d7f5748a7b67f0e6e8650d701 WatchSource:0}: Error finding container e454972db63d6eb16d1033fa39465ba81bebc63d7f5748a7b67f0e6e8650d701: Status 404 returned error can't find the container with id e454972db63d6eb16d1033fa39465ba81bebc63d7f5748a7b67f0e6e8650d701
Jul 24 17:03:06.003226 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:06.003193    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75173365_4f71_459a_8957_a7b81a803a31.slice/crio-fecc252bad505df8cf5929c760c25462caab68416f3ed4f70da36fc097c5b4d2 WatchSource:0}: Error finding container fecc252bad505df8cf5929c760c25462caab68416f3ed4f70da36fc097c5b4d2: Status 404 returned error can't find the container with id fecc252bad505df8cf5929c760c25462caab68416f3ed4f70da36fc097c5b4d2
Jul 24 17:03:06.005086 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:06.005064    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf97397c_bef7_455d_b554_6694a6a68ae4.slice/crio-de97c3b162bd775b8f644eede36e9bc5df3e47dbd3ea6bc824048a825078e92a WatchSource:0}: Error finding container de97c3b162bd775b8f644eede36e9bc5df3e47dbd3ea6bc824048a825078e92a: Status 404 returned error can't find the container with id de97c3b162bd775b8f644eede36e9bc5df3e47dbd3ea6bc824048a825078e92a
Jul 24 17:03:06.006548 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:06.006352    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd49486f2_e3c5_443a_9a2f_9627ee4e0d7f.slice/crio-f88d394573da56b338c672678db5a83c38579af5f4da9431d8f304aadb67a4e7 WatchSource:0}: Error finding container f88d394573da56b338c672678db5a83c38579af5f4da9431d8f304aadb67a4e7: Status 404 returned error can't find the container with id f88d394573da56b338c672678db5a83c38579af5f4da9431d8f304aadb67a4e7
Jul 24 17:03:06.009157 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:06.009136    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode110c4c6_2e6f_42f0_89cd_6bae1a2de29d.slice/crio-fd9c1c46b50325ef999fc6a601ea1ab290f17583ffbcabf4d4fe647fc7584942 WatchSource:0}: Error finding container fd9c1c46b50325ef999fc6a601ea1ab290f17583ffbcabf4d4fe647fc7584942: Status 404 returned error can't find the container with id fd9c1c46b50325ef999fc6a601ea1ab290f17583ffbcabf4d4fe647fc7584942
Jul 24 17:03:06.011174 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:06.011153    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e0b0dcc_7de7_4aec_9a86_f325770a006b.slice/crio-f91db17b131b4f5eae79ea6ccb1b001b4da5e26e9546e51db9258c632cdd8464 WatchSource:0}: Error finding container f91db17b131b4f5eae79ea6ccb1b001b4da5e26e9546e51db9258c632cdd8464: Status 404 returned error can't find the container with id f91db17b131b4f5eae79ea6ccb1b001b4da5e26e9546e51db9258c632cdd8464
Jul 24 17:03:06.011759 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:06.011646    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4e94037_5cfa_4bdf_b325_58bdaa8a6bb5.slice/crio-836cda4197ca60fd52bb1ba42c55da0cdbb8ea019ac02d17c989d31d5cf24ce7 WatchSource:0}: Error finding container 836cda4197ca60fd52bb1ba42c55da0cdbb8ea019ac02d17c989d31d5cf24ce7: Status 404 returned error can't find the container with id 836cda4197ca60fd52bb1ba42c55da0cdbb8ea019ac02d17c989d31d5cf24ce7
Jul 24 17:03:06.014041 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:06.012804    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ff2442b_1e6e_4d7e_9e4b_289e4b74517a.slice/crio-238dad4b2d14150935d1c8d63cbedf3c0c9c9e37d15a9e1cd950b0c49528cb95 WatchSource:0}: Error finding container 238dad4b2d14150935d1c8d63cbedf3c0c9c9e37d15a9e1cd950b0c49528cb95: Status 404 returned error can't find the container with id 238dad4b2d14150935d1c8d63cbedf3c0c9c9e37d15a9e1cd950b0c49528cb95
Jul 24 17:03:06.079581 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:06.079428    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:06.079723 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:06.079700    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td8qt" podUID="ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b"
Jul 24 17:03:06.088550 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:06.088518    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc" event={"ID":"4e0b0dcc-7de7-4aec-9a86-f325770a006b","Type":"ContainerStarted","Data":"f91db17b131b4f5eae79ea6ccb1b001b4da5e26e9546e51db9258c632cdd8464"}
Jul 24 17:03:06.089894 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:06.089868    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qppkz" event={"ID":"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d","Type":"ContainerStarted","Data":"fd9c1c46b50325ef999fc6a601ea1ab290f17583ffbcabf4d4fe647fc7584942"}
Jul 24 17:03:06.093887 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:06.093859    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-grb54" event={"ID":"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f","Type":"ContainerStarted","Data":"f88d394573da56b338c672678db5a83c38579af5f4da9431d8f304aadb67a4e7"}
Jul 24 17:03:06.097684 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:06.097662    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c6q8k" event={"ID":"db2edea8-70c4-4ab5-898c-e0db3a2dacbe","Type":"ContainerStarted","Data":"5c98fcb448c04f596cee21f4e158f0173efc51423e81713af953f999d9996862"}
Jul 24 17:03:06.103872 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:06.103839    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cc5xn" event={"ID":"8ff2442b-1e6e-4d7e-9e4b-289e4b74517a","Type":"ContainerStarted","Data":"238dad4b2d14150935d1c8d63cbedf3c0c9c9e37d15a9e1cd950b0c49528cb95"}
Jul 24 17:03:06.108211 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:06.108188    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lz86b" event={"ID":"b4e94037-5cfa-4bdf-b325-58bdaa8a6bb5","Type":"ContainerStarted","Data":"836cda4197ca60fd52bb1ba42c55da0cdbb8ea019ac02d17c989d31d5cf24ce7"}
Jul 24 17:03:06.111625 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:06.111600    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t" event={"ID":"af97397c-bef7-455d-b554-6694a6a68ae4","Type":"ContainerStarted","Data":"de97c3b162bd775b8f644eede36e9bc5df3e47dbd3ea6bc824048a825078e92a"}
Jul 24 17:03:06.112369 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:06.112300    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-233.ec2.internal" podStartSLOduration=2.112286854 podStartE2EDuration="2.112286854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:06.111955764 +0000 UTC m=+3.546171334" watchObservedRunningTime="2026-07-24 17:03:06.112286854 +0000 UTC m=+3.546502424"
Jul 24 17:03:06.112845 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:06.112814    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llp7b" event={"ID":"75173365-4f71-459a-8957-a7b81a803a31","Type":"ContainerStarted","Data":"fecc252bad505df8cf5929c760c25462caab68416f3ed4f70da36fc097c5b4d2"}
Jul 24 17:03:06.113932 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:06.113910    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6tjfb" event={"ID":"e1b23a60-9f95-456c-8ed1-258d015439aa","Type":"ContainerStarted","Data":"e454972db63d6eb16d1033fa39465ba81bebc63d7f5748a7b67f0e6e8650d701"}
Jul 24 17:03:06.679984 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:06.679941    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p2s9\" (UniqueName: \"kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9\") pod \"network-check-target-4fk6m\" (UID: \"ea693e0b-70ff-4a94-80a0-ce8688fb1449\") " pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:06.680181 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:06.680027    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs\") pod \"network-metrics-daemon-td8qt\" (UID: \"ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b\") " pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:06.680181 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:06.680072    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret\") pod \"global-pull-secret-syncer-2dlhn\" (UID: \"eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7\") " pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:06.680303 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:06.680217    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:06.680303 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:06.680308    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret podName:eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:08.680267725 +0000 UTC m=+6.114483277 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret") pod "global-pull-secret-syncer-2dlhn" (UID: "eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:06.680454 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:06.680428    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:06.680508 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:06.680480    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs podName:ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b nodeName:}" failed. No retries permitted until 2026-07-24 17:03:08.680464182 +0000 UTC m=+6.114679732 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs") pod "network-metrics-daemon-td8qt" (UID: "ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:06.680587 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:06.680560    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:06.680636 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:06.680596    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:06.680636 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:06.680609    2572 projected.go:196] Error preparing data for projected volume kube-api-access-4p2s9 for pod openshift-network-diagnostics/network-check-target-4fk6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:06.680743 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:06.680647    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9 podName:ea693e0b-70ff-4a94-80a0-ce8688fb1449 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:08.680634777 +0000 UTC m=+6.114850326 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4p2s9" (UniqueName: "kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9") pod "network-check-target-4fk6m" (UID: "ea693e0b-70ff-4a94-80a0-ce8688fb1449") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:07.000157 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:07.000021    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 16:58:05 +0000 UTC" deadline="2028-01-11 20:48:55.829511567 +0000 UTC"
Jul 24 17:03:07.000157 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:07.000102    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12867h45m48.829414038s"
Jul 24 17:03:07.082150 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:07.082118    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:07.082342 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:07.082255    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dlhn" podUID="eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7"
Jul 24 17:03:07.082434 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:07.082356    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:07.082495 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:07.082429    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4fk6m" podUID="ea693e0b-70ff-4a94-80a0-ce8688fb1449"
Jul 24 17:03:07.124218 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:07.124178    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-233.ec2.internal" event={"ID":"088a772ea827d74ea5135dd3264e29f0","Type":"ContainerStarted","Data":"21773f40ad4d2aaa2ea903fd6983ffabbb93c76790336148ef3f4fba7a8bfd37"}
Jul 24 17:03:07.146479 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:07.146403    2572 generic.go:356] "Generic (PLEG): container finished" podID="950aaf3b8d91a1606a6455f923c8161c" containerID="48ee85620ed87a4eae203e38fcb77f3589994d48dde9d29d536b694f7888f311" exitCode=0
Jul 24 17:03:07.146479 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:07.146458    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-233.ec2.internal" event={"ID":"950aaf3b8d91a1606a6455f923c8161c","Type":"ContainerDied","Data":"48ee85620ed87a4eae203e38fcb77f3589994d48dde9d29d536b694f7888f311"}
Jul 24 17:03:08.079081 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:08.079047    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:08.079545 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:08.079188    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td8qt" podUID="ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b"
Jul 24 17:03:08.168215 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:08.168151    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-233.ec2.internal" event={"ID":"950aaf3b8d91a1606a6455f923c8161c","Type":"ContainerStarted","Data":"d095498a527f55caa124655fd1af69791603684e3a0acbfb5f0700d090241cf4"}
Jul 24 17:03:08.697667 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:08.697632    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs\") pod \"network-metrics-daemon-td8qt\" (UID: \"ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b\") " pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:08.697827 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:08.697692    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret\") pod \"global-pull-secret-syncer-2dlhn\" (UID: \"eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7\") " pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:08.697827 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:08.697728    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p2s9\" (UniqueName: \"kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9\") pod \"network-check-target-4fk6m\" (UID: \"ea693e0b-70ff-4a94-80a0-ce8688fb1449\") " pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:08.697950 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:08.697870    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:08.697950 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:08.697887    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:08.697950 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:08.697900    2572 projected.go:196] Error preparing data for projected volume kube-api-access-4p2s9 for pod openshift-network-diagnostics/network-check-target-4fk6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:08.698091 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:08.697956    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9 podName:ea693e0b-70ff-4a94-80a0-ce8688fb1449 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:12.697937758 +0000 UTC m=+10.132153307 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4p2s9" (UniqueName: "kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9") pod "network-check-target-4fk6m" (UID: "ea693e0b-70ff-4a94-80a0-ce8688fb1449") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:08.698399 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:08.698378    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:08.698488 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:08.698435    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs podName:ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b nodeName:}" failed. No retries permitted until 2026-07-24 17:03:12.698418601 +0000 UTC m=+10.132634161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs") pod "network-metrics-daemon-td8qt" (UID: "ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:08.698552 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:08.698494    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:08.698552 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:08.698529    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret podName:eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:12.698517955 +0000 UTC m=+10.132733502 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret") pod "global-pull-secret-syncer-2dlhn" (UID: "eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:09.080192 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:09.080116    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:09.080644 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:09.080293    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dlhn" podUID="eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7"
Jul 24 17:03:09.080644 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:09.080345    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:09.080644 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:09.080487    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4fk6m" podUID="ea693e0b-70ff-4a94-80a0-ce8688fb1449"
Jul 24 17:03:10.079773 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:10.079738    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:10.079967 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:10.079940    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td8qt" podUID="ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b"
Jul 24 17:03:11.081402 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:11.081370    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:11.081826 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:11.081375    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:11.081826 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:11.081510    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dlhn" podUID="eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7"
Jul 24 17:03:11.081826 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:11.081561    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4fk6m" podUID="ea693e0b-70ff-4a94-80a0-ce8688fb1449"
Jul 24 17:03:12.079523 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:12.079013    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:12.079523 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:12.079151    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td8qt" podUID="ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b"
Jul 24 17:03:12.732607 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:12.732575    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs\") pod \"network-metrics-daemon-td8qt\" (UID: \"ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b\") " pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:12.733107 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:12.732626    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret\") pod \"global-pull-secret-syncer-2dlhn\" (UID: \"eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7\") " pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:12.733107 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:12.732736    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:12.733107 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:12.732777    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:12.733107 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:12.732787    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret podName:eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:20.732774547 +0000 UTC m=+18.166990092 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret") pod "global-pull-secret-syncer-2dlhn" (UID: "eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:12.733107 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:12.732869    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs podName:ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b nodeName:}" failed. No retries permitted until 2026-07-24 17:03:20.732850712 +0000 UTC m=+18.167066264 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs") pod "network-metrics-daemon-td8qt" (UID: "ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:12.733107 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:12.732897    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p2s9\" (UniqueName: \"kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9\") pod \"network-check-target-4fk6m\" (UID: \"ea693e0b-70ff-4a94-80a0-ce8688fb1449\") " pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:12.733107 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:12.733049    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:12.733107 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:12.733068    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:12.733107 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:12.733089    2572 projected.go:196] Error preparing data for projected volume kube-api-access-4p2s9 for pod openshift-network-diagnostics/network-check-target-4fk6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:12.733571 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:12.733133    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9 podName:ea693e0b-70ff-4a94-80a0-ce8688fb1449 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:20.733120891 +0000 UTC m=+18.167336452 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4p2s9" (UniqueName: "kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9") pod "network-check-target-4fk6m" (UID: "ea693e0b-70ff-4a94-80a0-ce8688fb1449") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:13.080582 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:13.080488    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:13.080727 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:13.080646    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dlhn" podUID="eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7"
Jul 24 17:03:13.081256 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:13.081221    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:13.081450 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:13.081327    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4fk6m" podUID="ea693e0b-70ff-4a94-80a0-ce8688fb1449"
Jul 24 17:03:14.079278 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:14.079248    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:14.079750 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:14.079401    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td8qt" podUID="ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b"
Jul 24 17:03:15.081422 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:15.081374    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:15.081832 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:15.081510    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dlhn" podUID="eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7"
Jul 24 17:03:15.082163 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:15.082004    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:15.082163 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:15.082122    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4fk6m" podUID="ea693e0b-70ff-4a94-80a0-ce8688fb1449"
Jul 24 17:03:16.079516 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:16.079483    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:16.079673 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:16.079589    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td8qt" podUID="ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b"
Jul 24 17:03:17.078908 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:17.078879    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:17.079322 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:17.078976    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4fk6m" podUID="ea693e0b-70ff-4a94-80a0-ce8688fb1449"
Jul 24 17:03:17.079322 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:17.079064    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:17.079322 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:17.079166    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dlhn" podUID="eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7"
Jul 24 17:03:18.079450 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:18.079410    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:18.079877 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:18.079542    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td8qt" podUID="ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b"
Jul 24 17:03:19.079613 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:19.079579    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:19.080106 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:19.079687    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dlhn" podUID="eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7"
Jul 24 17:03:19.080106 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:19.079750    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:19.080106 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:19.079830    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4fk6m" podUID="ea693e0b-70ff-4a94-80a0-ce8688fb1449"
Jul 24 17:03:20.079187 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:20.079151    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:20.079416 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:20.079292    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td8qt" podUID="ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b"
Jul 24 17:03:20.791991 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:20.791953    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs\") pod \"network-metrics-daemon-td8qt\" (UID: \"ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b\") " pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:20.792468 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:20.792002    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret\") pod \"global-pull-secret-syncer-2dlhn\" (UID: \"eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7\") " pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:20.792468 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:20.792034    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p2s9\" (UniqueName: \"kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9\") pod \"network-check-target-4fk6m\" (UID: \"ea693e0b-70ff-4a94-80a0-ce8688fb1449\") " pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:20.792468 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:20.792126    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:20.792468 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:20.792152    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:20.792468 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:20.792172    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:20.792468 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:20.792181    2572 projected.go:196] Error preparing data for projected volume kube-api-access-4p2s9 for pod openshift-network-diagnostics/network-check-target-4fk6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:20.792468 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:20.792190    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs podName:ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b nodeName:}" failed. No retries permitted until 2026-07-24 17:03:36.79217311 +0000 UTC m=+34.226388674 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs") pod "network-metrics-daemon-td8qt" (UID: "ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:20.792468 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:20.792126    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:20.792468 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:20.792226    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9 podName:ea693e0b-70ff-4a94-80a0-ce8688fb1449 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:36.79221113 +0000 UTC m=+34.226426689 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4p2s9" (UniqueName: "kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9") pod "network-check-target-4fk6m" (UID: "ea693e0b-70ff-4a94-80a0-ce8688fb1449") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:20.792468 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:20.792282    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret podName:eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:36.792268126 +0000 UTC m=+34.226483671 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret") pod "global-pull-secret-syncer-2dlhn" (UID: "eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:21.079348 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:21.079095    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:21.079348 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:21.079256    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:21.079348 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:21.079259    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dlhn" podUID="eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7"
Jul 24 17:03:21.079680 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:21.079356    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4fk6m" podUID="ea693e0b-70ff-4a94-80a0-ce8688fb1449"
Jul 24 17:03:22.079612 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:22.079559    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:22.080117 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:22.079707    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td8qt" podUID="ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b"
Jul 24 17:03:23.080295 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:23.080261    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:23.080740 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:23.080364    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dlhn" podUID="eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7"
Jul 24 17:03:23.080740 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:23.080431    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:23.080740 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:23.080555    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4fk6m" podUID="ea693e0b-70ff-4a94-80a0-ce8688fb1449"
Jul 24 17:03:24.079062 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:24.079029    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:24.079208 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:24.079155    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td8qt" podUID="ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b"
Jul 24 17:03:25.082019 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:25.081354    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:25.082019 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:25.081483    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4fk6m" podUID="ea693e0b-70ff-4a94-80a0-ce8688fb1449"
Jul 24 17:03:25.082019 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:25.081859    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:25.082019 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:25.081949    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dlhn" podUID="eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7"
Jul 24 17:03:25.205331 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:25.204778    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-grb54" event={"ID":"d49486f2-e3c5-443a-9a2f-9627ee4e0d7f","Type":"ContainerStarted","Data":"7853e9894271a62a9dfb2267c8d39cbd668946af698257629d55671a0b150bcc"}
Jul 24 17:03:25.206833 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:25.206807    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c6q8k" event={"ID":"db2edea8-70c4-4ab5-898c-e0db3a2dacbe","Type":"ContainerStarted","Data":"97d41c0341b983589538ccb311ddab19882b279979fa4d3587c1dda816c642fd"}
Jul 24 17:03:25.209045 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:25.208881    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cc5xn" event={"ID":"8ff2442b-1e6e-4d7e-9e4b-289e4b74517a","Type":"ContainerStarted","Data":"c511a566d7ab9b1a3a13c9a0f266d8bf9b75ee2d866332c8a330c9314519bfa9"}
Jul 24 17:03:25.211381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:25.211313    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lz86b" event={"ID":"b4e94037-5cfa-4bdf-b325-58bdaa8a6bb5","Type":"ContainerStarted","Data":"51a5219efc98dbd44231dbfacf384385fc28e495cbade2d0f3984e52fcb7aecb"}
Jul 24 17:03:25.213449 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:25.213424    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t" event={"ID":"af97397c-bef7-455d-b554-6694a6a68ae4","Type":"ContainerStarted","Data":"99db6acada416e6eb94ff2e205d381619a4f42ce4051b3a742a680dbd899b313"}
Jul 24 17:03:25.215182 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:25.215153    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llp7b" event={"ID":"75173365-4f71-459a-8957-a7b81a803a31","Type":"ContainerStarted","Data":"b354f1c8cf89e0e387e43a35f9986f34bd12286f01311489aa73e1b899da4177"}
Jul 24 17:03:25.219386 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:25.219326    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc" event={"ID":"4e0b0dcc-7de7-4aec-9a86-f325770a006b","Type":"ContainerStarted","Data":"756ac48a7a8168ab9d0ff18bbfe61a8d12351f6d7080fbe6a5d7ae2c5ba1c5f5"}
Jul 24 17:03:25.222264 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:25.222201    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qppkz" event={"ID":"e110c4c6-2e6f-42f0-89cd-6bae1a2de29d","Type":"ContainerStarted","Data":"1c356d50e95556d9aa3b86a31b1cf1b26f88a5264a86bbdecc9f5a90ee15de88"}
Jul 24 17:03:25.226193 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:25.226007    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-233.ec2.internal" podStartSLOduration=21.225990439 podStartE2EDuration="21.225990439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:08.184836493 +0000 UTC m=+5.619052060" watchObservedRunningTime="2026-07-24 17:03:25.225990439 +0000 UTC m=+22.660206006"
Jul 24 17:03:25.226931 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:25.226480    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-grb54" podStartSLOduration=3.201923398 podStartE2EDuration="22.226468273s" totalImagesPullingTime="19.024544875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:25.225573402 +0000 UTC m=+22.659788981" watchObservedRunningTime="2026-07-24 17:03:25.226468273 +0000 UTC m=+22.660683841"
Jul 24 17:03:25.244855 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:25.244730    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qppkz" podStartSLOduration=3.274936004 podStartE2EDuration="22.244716775s" totalImagesPullingTime="18.969780771s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:25.244612701 +0000 UTC m=+22.678828269" watchObservedRunningTime="2026-07-24 17:03:25.244716775 +0000 UTC m=+22.678932343"
Jul 24 17:03:25.350497 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:25.350311    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c6q8k" podStartSLOduration=3.381743267 podStartE2EDuration="22.350296079s" totalImagesPullingTime="18.968552812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:25.300478198 +0000 UTC m=+22.734693766" watchObservedRunningTime="2026-07-24 17:03:25.350296079 +0000 UTC m=+22.784511646"
Jul 24 17:03:25.350696 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:25.350564    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cc5xn" podStartSLOduration=3.3917091089999998 podStartE2EDuration="22.350552s" totalImagesPullingTime="18.958842891s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:25.349727016 +0000 UTC m=+22.783942593" watchObservedRunningTime="2026-07-24 17:03:25.350552 +0000 UTC m=+22.784767567"
Jul 24 17:03:25.381804 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:25.381764    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lz86b" podStartSLOduration=3.420909924 podStartE2EDuration="22.381748638s" totalImagesPullingTime="18.960838714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:03:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:25.381110945 +0000 UTC m=+22.815326512" watchObservedRunningTime="2026-07-24 17:03:25.381748638 +0000 UTC m=+22.815964201"
Jul 24 17:03:25.670296 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:25.670272    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lz86b"
Jul 24 17:03:25.671045 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:25.671026    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lz86b"
Jul 24 17:03:26.079634 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:26.079598    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:26.079800 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:26.079714    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td8qt" podUID="ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b"
Jul 24 17:03:26.225825 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:26.225788    2572 generic.go:356] "Generic (PLEG): container finished" podID="75173365-4f71-459a-8957-a7b81a803a31" containerID="b354f1c8cf89e0e387e43a35f9986f34bd12286f01311489aa73e1b899da4177" exitCode=0
Jul 24 17:03:26.226586 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:26.225877    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llp7b" event={"ID":"75173365-4f71-459a-8957-a7b81a803a31","Type":"ContainerDied","Data":"b354f1c8cf89e0e387e43a35f9986f34bd12286f01311489aa73e1b899da4177"}
Jul 24 17:03:26.228914 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:26.228889    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc" event={"ID":"4e0b0dcc-7de7-4aec-9a86-f325770a006b","Type":"ContainerStarted","Data":"cd049efa9793c15346dd1f4b2c8d0fb8b0a3fa7e25761ee31ad2f6d76bfdef4e"}
Jul 24 17:03:26.229044 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:26.228964    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc" event={"ID":"4e0b0dcc-7de7-4aec-9a86-f325770a006b","Type":"ContainerStarted","Data":"38d9424d8ad96e4eba4ff9895318027bf0eecaeb36afa5999622fdf4b56e651a"}
Jul 24 17:03:26.229044 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:26.229025    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc" event={"ID":"4e0b0dcc-7de7-4aec-9a86-f325770a006b","Type":"ContainerStarted","Data":"6d4b20a17e6cb2d5327af6cfc6b5c9cb452e259c41b32da7fd8828a31dffb5d0"}
Jul 24 17:03:26.229163 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:26.229072    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc" event={"ID":"4e0b0dcc-7de7-4aec-9a86-f325770a006b","Type":"ContainerStarted","Data":"1b4218baa11741fb6d7e1750f3b461f2857020d321de59049a0e2353d4b0dd00"}
Jul 24 17:03:26.229163 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:26.229121    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc" event={"ID":"4e0b0dcc-7de7-4aec-9a86-f325770a006b","Type":"ContainerStarted","Data":"c8502442e9f721b13510af39536533bc114e3ee0a27414b3e71ac0ccb4efcbb7"}
Jul 24 17:03:26.229489 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:26.229473    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lz86b"
Jul 24 17:03:26.229729 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:26.229715    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lz86b"
Jul 24 17:03:26.445859 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:26.445836    2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 17:03:27.017956 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:27.017805    2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T17:03:26.445853141Z","UUID":"19f19a8a-7ecd-4ebc-8848-212fb0631dad","Handler":null,"Name":"","Endpoint":""}
Jul 24 17:03:27.019583 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:27.019562    2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 17:03:27.019712 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:27.019604    2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 17:03:27.081066 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:27.081033    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:27.081255 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:27.081159    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dlhn" podUID="eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7"
Jul 24 17:03:27.081396 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:27.081372    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:27.081514 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:27.081491    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4fk6m" podUID="ea693e0b-70ff-4a94-80a0-ce8688fb1449"
Jul 24 17:03:27.233338 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:27.233254    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t" event={"ID":"af97397c-bef7-455d-b554-6694a6a68ae4","Type":"ContainerStarted","Data":"6e3e5a8ffc46f46c3acace1702480fe6e5653c62eca13c9550e63b72df519fa1"}
Jul 24 17:03:27.235315 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:27.235275    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6tjfb" event={"ID":"e1b23a60-9f95-456c-8ed1-258d015439aa","Type":"ContainerStarted","Data":"3eded09f31ab4e0c6ff79e11787cdd6d35e4069c6e2d8045a4287cf6d2a40d11"}
Jul 24 17:03:27.250176 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:27.250112    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6tjfb" podStartSLOduration=5.276911125 podStartE2EDuration="24.250095093s" totalImagesPullingTime="18.973183968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:27.249429222 +0000 UTC m=+24.683644802" watchObservedRunningTime="2026-07-24 17:03:27.250095093 +0000 UTC m=+24.684310663"
Jul 24 17:03:28.079889 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:28.079795    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:28.080132 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:28.079948    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td8qt" podUID="ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b"
Jul 24 17:03:28.240325 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:28.240275    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t" event={"ID":"af97397c-bef7-455d-b554-6694a6a68ae4","Type":"ContainerStarted","Data":"4029854e567989138473b65506c46a2d766b491979148c868f7324693c8c9c6d"}
Jul 24 17:03:28.244292 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:28.244261    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc" event={"ID":"4e0b0dcc-7de7-4aec-9a86-f325770a006b","Type":"ContainerStarted","Data":"be581fd4c1bc3c22fa21eaf030032d032e50a0a534f36c73428be5589bce7038"}
Jul 24 17:03:28.258523 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:28.258474    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7s2t" podStartSLOduration=4.096692177 podStartE2EDuration="25.258454903s" totalImagesPullingTime="21.161762726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:28.257896169 +0000 UTC m=+25.692111735" watchObservedRunningTime="2026-07-24 17:03:28.258454903 +0000 UTC m=+25.692670513"
Jul 24 17:03:29.078974 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:29.078941    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:29.079168 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:29.078941    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:29.079168 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:29.079086    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4fk6m" podUID="ea693e0b-70ff-4a94-80a0-ce8688fb1449"
Jul 24 17:03:29.079300 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:29.079168    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dlhn" podUID="eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7"
Jul 24 17:03:30.079843 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:30.079645    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:30.080278 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:30.079948    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td8qt" podUID="ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b"
Jul 24 17:03:31.079896 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:31.079653    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:31.080583 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:31.079721    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:31.080583 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:31.079947    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dlhn" podUID="eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7"
Jul 24 17:03:31.080583 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:31.079978    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4fk6m" podUID="ea693e0b-70ff-4a94-80a0-ce8688fb1449"
Jul 24 17:03:31.252647 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:31.252615    2572 generic.go:356] "Generic (PLEG): container finished" podID="75173365-4f71-459a-8957-a7b81a803a31" containerID="bd1b0deb218c281b83190978f36ff21b53fa67c7dce7a25328dda7cb22e2c0bd" exitCode=0
Jul 24 17:03:31.252811 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:31.252687    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llp7b" event={"ID":"75173365-4f71-459a-8957-a7b81a803a31","Type":"ContainerDied","Data":"bd1b0deb218c281b83190978f36ff21b53fa67c7dce7a25328dda7cb22e2c0bd"}
Jul 24 17:03:31.256499 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:31.256478    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc" event={"ID":"4e0b0dcc-7de7-4aec-9a86-f325770a006b","Type":"ContainerStarted","Data":"2594068455c6b35a43c159d88675d10954785d3f6768ddb02775870d29cbae35"}
Jul 24 17:03:31.256765 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:31.256750    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:31.272707 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:31.272682    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:31.307471 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:31.307417    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc" podStartSLOduration=9.277087294 podStartE2EDuration="28.307401602s" totalImagesPullingTime="19.030314308s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:31.307210304 +0000 UTC m=+28.741425883" watchObservedRunningTime="2026-07-24 17:03:31.307401602 +0000 UTC m=+28.741617169"
Jul 24 17:03:32.079058 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:32.079019    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:32.079315 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:32.079131    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td8qt" podUID="ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b"
Jul 24 17:03:32.259994 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:32.259957    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:32.260403 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:32.260030    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:32.275594 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:32.275564    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:03:32.498352 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:32.498319    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4fk6m"]
Jul 24 17:03:32.498551 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:32.498435    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:32.498551 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:32.498533    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4fk6m" podUID="ea693e0b-70ff-4a94-80a0-ce8688fb1449"
Jul 24 17:03:32.502739 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:32.502308    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2dlhn"]
Jul 24 17:03:32.507676 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:32.507648    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-td8qt"]
Jul 24 17:03:32.507842 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:32.507821    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:32.507934 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:32.507848    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:32.508512 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:32.508259    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dlhn" podUID="eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7"
Jul 24 17:03:32.508512 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:32.508367    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td8qt" podUID="ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b"
Jul 24 17:03:33.263651 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:33.263618    2572 generic.go:356] "Generic (PLEG): container finished" podID="75173365-4f71-459a-8957-a7b81a803a31" containerID="b67a8c01ff77b8e956873a3589c7a2f65a90d05f3cfec2415052f7764c1e8f83" exitCode=0
Jul 24 17:03:33.264119 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:33.263701    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llp7b" event={"ID":"75173365-4f71-459a-8957-a7b81a803a31","Type":"ContainerDied","Data":"b67a8c01ff77b8e956873a3589c7a2f65a90d05f3cfec2415052f7764c1e8f83"}
Jul 24 17:03:34.079506 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:34.079468    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:34.079506 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:34.079495    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:34.079695 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:34.079473    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:34.079695 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:34.079591    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td8qt" podUID="ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b"
Jul 24 17:03:34.079695 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:34.079660    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4fk6m" podUID="ea693e0b-70ff-4a94-80a0-ce8688fb1449"
Jul 24 17:03:34.079793 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:34.079711    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dlhn" podUID="eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7"
Jul 24 17:03:35.269982 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:35.269947    2572 generic.go:356] "Generic (PLEG): container finished" podID="75173365-4f71-459a-8957-a7b81a803a31" containerID="7950bc2e31497304135961db28b8d0059d9c017926570855c8fbbe435f1a5887" exitCode=0
Jul 24 17:03:35.270465 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:35.269999    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llp7b" event={"ID":"75173365-4f71-459a-8957-a7b81a803a31","Type":"ContainerDied","Data":"7950bc2e31497304135961db28b8d0059d9c017926570855c8fbbe435f1a5887"}
Jul 24 17:03:36.079411 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:36.079207    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:36.079581 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:36.079220    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:36.079581 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:36.079533    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td8qt" podUID="ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b"
Jul 24 17:03:36.079655 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:36.079585    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dlhn" podUID="eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7"
Jul 24 17:03:36.079655 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:36.079244    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:36.079740 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:36.079656    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4fk6m" podUID="ea693e0b-70ff-4a94-80a0-ce8688fb1449"
Jul 24 17:03:36.812360 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:36.812321    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs\") pod \"network-metrics-daemon-td8qt\" (UID: \"ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b\") " pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:36.812809 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:36.812381    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret\") pod \"global-pull-secret-syncer-2dlhn\" (UID: \"eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7\") " pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:36.812809 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:36.812417    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p2s9\" (UniqueName: \"kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9\") pod \"network-check-target-4fk6m\" (UID: \"ea693e0b-70ff-4a94-80a0-ce8688fb1449\") " pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:36.812809 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:36.812490    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:36.812809 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:36.812540    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:36.812809 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:36.812545    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:36.812809 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:36.812560    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs podName:ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b nodeName:}" failed. No retries permitted until 2026-07-24 17:04:08.812538655 +0000 UTC m=+66.246754216 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs") pod "network-metrics-daemon-td8qt" (UID: "ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:36.812809 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:36.812566    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:36.812809 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:36.812579    2572 projected.go:196] Error preparing data for projected volume kube-api-access-4p2s9 for pod openshift-network-diagnostics/network-check-target-4fk6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:36.812809 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:36.812591    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret podName:eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7 nodeName:}" failed. No retries permitted until 2026-07-24 17:04:08.812574618 +0000 UTC m=+66.246790165 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret") pod "global-pull-secret-syncer-2dlhn" (UID: "eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:36.812809 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:36.812622    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9 podName:ea693e0b-70ff-4a94-80a0-ce8688fb1449 nodeName:}" failed. No retries permitted until 2026-07-24 17:04:08.812607733 +0000 UTC m=+66.246823281 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4p2s9" (UniqueName: "kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9") pod "network-check-target-4fk6m" (UID: "ea693e0b-70ff-4a94-80a0-ce8688fb1449") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:37.896351 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.896323    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-233.ec2.internal" event="NodeReady"
Jul 24 17:03:37.896774 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.896471    2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 17:03:37.948159 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.948120    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78998df997-xrrv4"]
Jul 24 17:03:37.952756 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.952731    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg"]
Jul 24 17:03:37.952885 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.952869    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:37.956291 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.956273    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg"
Jul 24 17:03:37.960190 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.960170    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pst72\""
Jul 24 17:03:37.960379 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.960354    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 24 17:03:37.960487 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.960420    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 17:03:37.960578 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.960559    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 17:03:37.960683 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.960668    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-sbg9g\""
Jul 24 17:03:37.960832 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.960818    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 24 17:03:37.961031 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.961015    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 17:03:37.970849 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.970822    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-q8g77"]
Jul 24 17:03:37.973431 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.973408    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 17:03:37.975417 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.975394    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x9wf4"]
Jul 24 17:03:37.975924 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.975904    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q8g77"
Jul 24 17:03:37.978798 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.978779    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-57f2l\""
Jul 24 17:03:37.978895 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.978882    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg"]
Jul 24 17:03:37.978953 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.978915    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78998df997-xrrv4"]
Jul 24 17:03:37.979010 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.978992    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x9wf4"
Jul 24 17:03:37.979010 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.979001    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 17:03:37.979115 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.979046    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 17:03:37.980405 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.980386    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q8g77"]
Jul 24 17:03:37.981624 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.981603    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 17:03:37.981720 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.981703    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c58hb\""
Jul 24 17:03:37.981779 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.981714    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 17:03:37.982114 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.982070    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 17:03:37.991462 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:37.991404    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x9wf4"]
Jul 24 17:03:38.078920 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.078882    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:03:38.078920 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.078901    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:03:38.079150 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.078897    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:03:38.084181 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.084158    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 17:03:38.084181 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.084177    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pgbn9\""
Jul 24 17:03:38.090769 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.090753    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 17:03:38.090889 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.090858    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2xn4k\""
Jul 24 17:03:38.090948 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.090900    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 17:03:38.090948 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.090933    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 17:03:38.120999 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.120956    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls\") pod \"dns-default-q8g77\" (UID: \"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306\") " pod="openshift-dns/dns-default-q8g77"
Jul 24 17:03:38.120999 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.120997    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt9nk\" (UniqueName: \"kubernetes.io/projected/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-kube-api-access-gt9nk\") pod \"dns-default-q8g77\" (UID: \"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306\") " pod="openshift-dns/dns-default-q8g77"
Jul 24 17:03:38.121193 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.121035    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/42e2f9ae-322f-4796-8440-bf12d50a8283-ca-trust-extracted\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.121193 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.121053    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptm4m\" (UniqueName: \"kubernetes.io/projected/c0d0a73d-6ae3-4e09-8853-510f01311e43-kube-api-access-ptm4m\") pod \"ingress-canary-x9wf4\" (UID: \"c0d0a73d-6ae3-4e09-8853-510f01311e43\") " pod="openshift-ingress-canary/ingress-canary-x9wf4"
Jul 24 17:03:38.121193 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.121107    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/42e2f9ae-322f-4796-8440-bf12d50a8283-image-registry-private-configuration\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.121193 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.121150    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0d0a73d-6ae3-4e09-8853-510f01311e43-cert\") pod \"ingress-canary-x9wf4\" (UID: \"c0d0a73d-6ae3-4e09-8853-510f01311e43\") " pod="openshift-ingress-canary/ingress-canary-x9wf4"
Jul 24 17:03:38.121193 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.121177    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/42e2f9ae-322f-4796-8440-bf12d50a8283-installation-pull-secrets\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.121425 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.121205    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pft85\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-kube-api-access-pft85\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.121425 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.121247    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-config-volume\") pod \"dns-default-q8g77\" (UID: \"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306\") " pod="openshift-dns/dns-default-q8g77"
Jul 24 17:03:38.121425 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.121285    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3f3ba1e9-16df-42fc-801b-822202b455d8-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-d9jzg\" (UID: \"3f3ba1e9-16df-42fc-801b-822202b455d8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg"
Jul 24 17:03:38.121425 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.121306    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-certificates\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.121425 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.121332    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-bound-sa-token\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.121425 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.121359    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-d9jzg\" (UID: \"3f3ba1e9-16df-42fc-801b-822202b455d8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg"
Jul 24 17:03:38.121425 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.121383    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/42e2f9ae-322f-4796-8440-bf12d50a8283-trusted-ca\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.121425 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.121407    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-tmp-dir\") pod \"dns-default-q8g77\" (UID: \"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306\") " pod="openshift-dns/dns-default-q8g77"
Jul 24 17:03:38.121755 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.121446    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.187390 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.187296    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lz86b_b4e94037-5cfa-4bdf-b325-58bdaa8a6bb5/konnectivity-agent/0.log" limit=1024
Jul 24 17:03:38.222753 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.222723    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptm4m\" (UniqueName: \"kubernetes.io/projected/c0d0a73d-6ae3-4e09-8853-510f01311e43-kube-api-access-ptm4m\") pod \"ingress-canary-x9wf4\" (UID: \"c0d0a73d-6ae3-4e09-8853-510f01311e43\") " pod="openshift-ingress-canary/ingress-canary-x9wf4"
Jul 24 17:03:38.222753 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.222757    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/42e2f9ae-322f-4796-8440-bf12d50a8283-image-registry-private-configuration\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.223004 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.222787    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0d0a73d-6ae3-4e09-8853-510f01311e43-cert\") pod \"ingress-canary-x9wf4\" (UID: \"c0d0a73d-6ae3-4e09-8853-510f01311e43\") " pod="openshift-ingress-canary/ingress-canary-x9wf4"
Jul 24 17:03:38.223004 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.222813    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/42e2f9ae-322f-4796-8440-bf12d50a8283-installation-pull-secrets\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.223004 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.222836    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pft85\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-kube-api-access-pft85\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.223004 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.222861    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-config-volume\") pod \"dns-default-q8g77\" (UID: \"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306\") " pod="openshift-dns/dns-default-q8g77"
Jul 24 17:03:38.223004 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.222925    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3f3ba1e9-16df-42fc-801b-822202b455d8-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-d9jzg\" (UID: \"3f3ba1e9-16df-42fc-801b-822202b455d8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg"
Jul 24 17:03:38.223004 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.222953    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-certificates\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.223004 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.222974    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-bound-sa-token\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.223004 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.222993    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-d9jzg\" (UID: \"3f3ba1e9-16df-42fc-801b-822202b455d8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg"
Jul 24 17:03:38.223323 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.223013    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/42e2f9ae-322f-4796-8440-bf12d50a8283-trusted-ca\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.223323 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.223036    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-tmp-dir\") pod \"dns-default-q8g77\" (UID: \"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306\") " pod="openshift-dns/dns-default-q8g77"
Jul 24 17:03:38.223323 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.223061    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.223323 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.223113    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls\") pod \"dns-default-q8g77\" (UID: \"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306\") " pod="openshift-dns/dns-default-q8g77"
Jul 24 17:03:38.223323 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.223138    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt9nk\" (UniqueName: \"kubernetes.io/projected/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-kube-api-access-gt9nk\") pod \"dns-default-q8g77\" (UID: \"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306\") " pod="openshift-dns/dns-default-q8g77"
Jul 24 17:03:38.223323 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.223189    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/42e2f9ae-322f-4796-8440-bf12d50a8283-ca-trust-extracted\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.223553 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.223529    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/42e2f9ae-322f-4796-8440-bf12d50a8283-ca-trust-extracted\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.223675 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:38.223656    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:03:38.223738 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:38.223679    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78998df997-xrrv4: secret "image-registry-tls" not found
Jul 24 17:03:38.223738 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.223683    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-certificates\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.223840 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:38.223744    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls podName:42e2f9ae-322f-4796-8440-bf12d50a8283 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:38.723726836 +0000 UTC m=+36.157942401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls") pod "image-registry-78998df997-xrrv4" (UID: "42e2f9ae-322f-4796-8440-bf12d50a8283") : secret "image-registry-tls" not found
Jul 24 17:03:38.223840 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.223779    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-tmp-dir\") pod \"dns-default-q8g77\" (UID: \"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306\") " pod="openshift-dns/dns-default-q8g77"
Jul 24 17:03:38.223840 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.223808    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-config-volume\") pod \"dns-default-q8g77\" (UID: \"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306\") " pod="openshift-dns/dns-default-q8g77"
Jul 24 17:03:38.224038 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:38.224000    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 17:03:38.224109 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:38.224064    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert podName:3f3ba1e9-16df-42fc-801b-822202b455d8 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:38.724045138 +0000 UTC m=+36.158260698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-d9jzg" (UID: "3f3ba1e9-16df-42fc-801b-822202b455d8") : secret "networking-console-plugin-cert" not found
Jul 24 17:03:38.224109 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:38.224093    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:03:38.224225 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:38.224135    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls podName:63e25ce3-9fe4-4a91-a85c-2cf9bce6c306 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:38.724121261 +0000 UTC m=+36.158336831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls") pod "dns-default-q8g77" (UID: "63e25ce3-9fe4-4a91-a85c-2cf9bce6c306") : secret "dns-default-metrics-tls" not found
Jul 24 17:03:38.224680 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.224659    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3f3ba1e9-16df-42fc-801b-822202b455d8-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-d9jzg\" (UID: \"3f3ba1e9-16df-42fc-801b-822202b455d8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg"
Jul 24 17:03:38.224772 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.224752    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/42e2f9ae-322f-4796-8440-bf12d50a8283-trusted-ca\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.227587 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.227559    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/42e2f9ae-322f-4796-8440-bf12d50a8283-installation-pull-secrets\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.227680 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.227592    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/42e2f9ae-322f-4796-8440-bf12d50a8283-image-registry-private-configuration\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.227727 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.227711    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0d0a73d-6ae3-4e09-8853-510f01311e43-cert\") pod \"ingress-canary-x9wf4\" (UID: \"c0d0a73d-6ae3-4e09-8853-510f01311e43\") " pod="openshift-ingress-canary/ingress-canary-x9wf4"
Jul 24 17:03:38.235595 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.235573    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt9nk\" (UniqueName: \"kubernetes.io/projected/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-kube-api-access-gt9nk\") pod \"dns-default-q8g77\" (UID: \"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306\") " pod="openshift-dns/dns-default-q8g77"
Jul 24 17:03:38.236142 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.236116    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-bound-sa-token\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.236691 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.236664    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptm4m\" (UniqueName: \"kubernetes.io/projected/c0d0a73d-6ae3-4e09-8853-510f01311e43-kube-api-access-ptm4m\") pod \"ingress-canary-x9wf4\" (UID: \"c0d0a73d-6ae3-4e09-8853-510f01311e43\") " pod="openshift-ingress-canary/ingress-canary-x9wf4"
Jul 24 17:03:38.237935 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.237911    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pft85\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-kube-api-access-pft85\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.297877 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.297833    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x9wf4"
Jul 24 17:03:38.321698 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.321655    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lz86b_b4e94037-5cfa-4bdf-b325-58bdaa8a6bb5/konnectivity-agent/0.log" limit=1024
Jul 24 17:03:38.728049 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.728009    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-d9jzg\" (UID: \"3f3ba1e9-16df-42fc-801b-822202b455d8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg"
Jul 24 17:03:38.728049 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.728053    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:38.728330 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:38.728114    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls\") pod \"dns-default-q8g77\" (UID: \"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306\") " pod="openshift-dns/dns-default-q8g77"
Jul 24 17:03:38.728330 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:38.728193    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 17:03:38.728330 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:38.728253    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:03:38.728330 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:38.728303    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert podName:3f3ba1e9-16df-42fc-801b-822202b455d8 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:39.728286909 +0000 UTC m=+37.162502479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-d9jzg" (UID: "3f3ba1e9-16df-42fc-801b-822202b455d8") : secret "networking-console-plugin-cert" not found
Jul 24 17:03:38.728330 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:38.728321    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls podName:63e25ce3-9fe4-4a91-a85c-2cf9bce6c306 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:39.728313552 +0000 UTC m=+37.162529097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls") pod "dns-default-q8g77" (UID: "63e25ce3-9fe4-4a91-a85c-2cf9bce6c306") : secret "dns-default-metrics-tls" not found
Jul 24 17:03:38.728330 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:38.728321    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:03:38.728572 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:38.728341    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78998df997-xrrv4: secret "image-registry-tls" not found
Jul 24 17:03:38.728572 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:38.728395    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls podName:42e2f9ae-322f-4796-8440-bf12d50a8283 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:39.728377626 +0000 UTC m=+37.162593174 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls") pod "image-registry-78998df997-xrrv4" (UID: "42e2f9ae-322f-4796-8440-bf12d50a8283") : secret "image-registry-tls" not found
Jul 24 17:03:39.298721 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:39.298074    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x9wf4"]
Jul 24 17:03:39.300646 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:03:39.300609    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0d0a73d_6ae3_4e09_8853_510f01311e43.slice/crio-a696ba1a1fd7902910cfa81815480276270e21775d49f4787ba65560aa9d946e WatchSource:0}: Error finding container a696ba1a1fd7902910cfa81815480276270e21775d49f4787ba65560aa9d946e: Status 404 returned error can't find the container with id a696ba1a1fd7902910cfa81815480276270e21775d49f4787ba65560aa9d946e
Jul 24 17:03:39.737673 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:39.737588    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-d9jzg\" (UID: \"3f3ba1e9-16df-42fc-801b-822202b455d8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg"
Jul 24 17:03:39.737673 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:39.737629    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:39.737673 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:39.737659    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls\") pod \"dns-default-q8g77\" (UID: \"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306\") " pod="openshift-dns/dns-default-q8g77"
Jul 24 17:03:39.737904 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:39.737747    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:03:39.737904 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:39.737751    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 17:03:39.737904 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:39.737757    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:03:39.737904 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:39.737776    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78998df997-xrrv4: secret "image-registry-tls" not found
Jul 24 17:03:39.737904 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:39.737797    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls podName:63e25ce3-9fe4-4a91-a85c-2cf9bce6c306 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:41.737784543 +0000 UTC m=+39.172000088 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls") pod "dns-default-q8g77" (UID: "63e25ce3-9fe4-4a91-a85c-2cf9bce6c306") : secret "dns-default-metrics-tls" not found
Jul 24 17:03:39.737904 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:39.737816    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert podName:3f3ba1e9-16df-42fc-801b-822202b455d8 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:41.737803293 +0000 UTC m=+39.172018858 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-d9jzg" (UID: "3f3ba1e9-16df-42fc-801b-822202b455d8") : secret "networking-console-plugin-cert" not found
Jul 24 17:03:39.737904 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:39.737831    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls podName:42e2f9ae-322f-4796-8440-bf12d50a8283 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:41.73782479 +0000 UTC m=+39.172040335 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls") pod "image-registry-78998df997-xrrv4" (UID: "42e2f9ae-322f-4796-8440-bf12d50a8283") : secret "image-registry-tls" not found
Jul 24 17:03:40.286265 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:40.286213    2572 generic.go:356] "Generic (PLEG): container finished" podID="75173365-4f71-459a-8957-a7b81a803a31" containerID="20db13cc2245a4ff91b5e17df91a34a20a860ab0a64961d53650d63b4b552dd3" exitCode=0
Jul 24 17:03:40.286425 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:40.286272    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llp7b" event={"ID":"75173365-4f71-459a-8957-a7b81a803a31","Type":"ContainerDied","Data":"20db13cc2245a4ff91b5e17df91a34a20a860ab0a64961d53650d63b4b552dd3"}
Jul 24 17:03:40.288049 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:40.288019    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x9wf4" event={"ID":"c0d0a73d-6ae3-4e09-8853-510f01311e43","Type":"ContainerStarted","Data":"a696ba1a1fd7902910cfa81815480276270e21775d49f4787ba65560aa9d946e"}
Jul 24 17:03:41.293912 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:41.293869    2572 generic.go:356] "Generic (PLEG): container finished" podID="75173365-4f71-459a-8957-a7b81a803a31" containerID="2561d8a8ad84ea504188a1d01b4a2f033c9549c2c454f5006a70db75d4c35306" exitCode=0
Jul 24 17:03:41.294376 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:41.293912    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llp7b" event={"ID":"75173365-4f71-459a-8957-a7b81a803a31","Type":"ContainerDied","Data":"2561d8a8ad84ea504188a1d01b4a2f033c9549c2c454f5006a70db75d4c35306"}
Jul 24 17:03:41.755961 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:41.755136    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-d9jzg\" (UID: \"3f3ba1e9-16df-42fc-801b-822202b455d8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg"
Jul 24 17:03:41.755961 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:41.755190    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:41.755961 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:41.755258    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls\") pod \"dns-default-q8g77\" (UID: \"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306\") " pod="openshift-dns/dns-default-q8g77"
Jul 24 17:03:41.755961 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:41.755374    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:03:41.755961 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:41.755424    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls podName:63e25ce3-9fe4-4a91-a85c-2cf9bce6c306 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:45.755404915 +0000 UTC m=+43.189620477 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls") pod "dns-default-q8g77" (UID: "63e25ce3-9fe4-4a91-a85c-2cf9bce6c306") : secret "dns-default-metrics-tls" not found
Jul 24 17:03:41.755961 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:41.755794    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 17:03:41.755961 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:41.755835    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert podName:3f3ba1e9-16df-42fc-801b-822202b455d8 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:45.75582435 +0000 UTC m=+43.190039895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-d9jzg" (UID: "3f3ba1e9-16df-42fc-801b-822202b455d8") : secret "networking-console-plugin-cert" not found
Jul 24 17:03:41.755961 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:41.755885    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:03:41.755961 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:41.755897    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78998df997-xrrv4: secret "image-registry-tls" not found
Jul 24 17:03:41.755961 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:41.755929    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls podName:42e2f9ae-322f-4796-8440-bf12d50a8283 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:45.755918028 +0000 UTC m=+43.190133588 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls") pod "image-registry-78998df997-xrrv4" (UID: "42e2f9ae-322f-4796-8440-bf12d50a8283") : secret "image-registry-tls" not found
Jul 24 17:03:42.299756 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:42.299525    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llp7b" event={"ID":"75173365-4f71-459a-8957-a7b81a803a31","Type":"ContainerStarted","Data":"c9d42886c681c03e45401e35060872328243cc486f411cea03ac4c406985c803"}
Jul 24 17:03:42.301005 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:42.300976    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x9wf4" event={"ID":"c0d0a73d-6ae3-4e09-8853-510f01311e43","Type":"ContainerStarted","Data":"cd7de6c249d34b98604ebfb5a05902b02e262a07d2f1c998c0a3a7adf5d873c5"}
Jul 24 17:03:42.320635 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:42.320595    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-llp7b" podStartSLOduration=9.707637456 podStartE2EDuration="39.320581587s" totalImagesPullingTime="29.612944131s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:42.319500706 +0000 UTC m=+39.753716272" watchObservedRunningTime="2026-07-24 17:03:42.320581587 +0000 UTC m=+39.754797153"
Jul 24 17:03:42.334634 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:42.334594    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x9wf4" podStartSLOduration=2.731177791 podStartE2EDuration="5.334579113s" totalImagesPullingTime="2.603401322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:42.333915678 +0000 UTC m=+39.768131245" watchObservedRunningTime="2026-07-24 17:03:42.334579113 +0000 UTC m=+39.768794679"
Jul 24 17:03:45.786154 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:45.786112    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-d9jzg\" (UID: \"3f3ba1e9-16df-42fc-801b-822202b455d8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg"
Jul 24 17:03:45.786154 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:45.786158    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:45.786624 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:45.786271    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 17:03:45.786624 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:45.786289    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls\") pod \"dns-default-q8g77\" (UID: \"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306\") " pod="openshift-dns/dns-default-q8g77"
Jul 24 17:03:45.786624 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:45.786334    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert podName:3f3ba1e9-16df-42fc-801b-822202b455d8 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:53.786319317 +0000 UTC m=+51.220534862 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-d9jzg" (UID: "3f3ba1e9-16df-42fc-801b-822202b455d8") : secret "networking-console-plugin-cert" not found
Jul 24 17:03:45.786624 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:45.786274    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:03:45.786624 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:45.786362    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78998df997-xrrv4: secret "image-registry-tls" not found
Jul 24 17:03:45.786624 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:45.786371    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:03:45.786624 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:45.786414    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls podName:42e2f9ae-322f-4796-8440-bf12d50a8283 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:53.786398285 +0000 UTC m=+51.220613843 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls") pod "image-registry-78998df997-xrrv4" (UID: "42e2f9ae-322f-4796-8440-bf12d50a8283") : secret "image-registry-tls" not found
Jul 24 17:03:45.786624 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:45.786430    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls podName:63e25ce3-9fe4-4a91-a85c-2cf9bce6c306 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:53.786421315 +0000 UTC m=+51.220636867 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls") pod "dns-default-q8g77" (UID: "63e25ce3-9fe4-4a91-a85c-2cf9bce6c306") : secret "dns-default-metrics-tls" not found
Jul 24 17:03:53.843390 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:53.843346    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-d9jzg\" (UID: \"3f3ba1e9-16df-42fc-801b-822202b455d8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg"
Jul 24 17:03:53.843390 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:53.843392    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:03:53.843893 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:03:53.843422    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls\") pod \"dns-default-q8g77\" (UID: \"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306\") " pod="openshift-dns/dns-default-q8g77"
Jul 24 17:03:53.843893 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:53.843505    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 17:03:53.843893 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:53.843521    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:03:53.843893 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:53.843522    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:03:53.843893 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:53.843544    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78998df997-xrrv4: secret "image-registry-tls" not found
Jul 24 17:03:53.843893 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:53.843573    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert podName:3f3ba1e9-16df-42fc-801b-822202b455d8 nodeName:}" failed. No retries permitted until 2026-07-24 17:04:09.843557411 +0000 UTC m=+67.277772955 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-d9jzg" (UID: "3f3ba1e9-16df-42fc-801b-822202b455d8") : secret "networking-console-plugin-cert" not found
Jul 24 17:03:53.843893 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:53.843588    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls podName:63e25ce3-9fe4-4a91-a85c-2cf9bce6c306 nodeName:}" failed. No retries permitted until 2026-07-24 17:04:09.843581488 +0000 UTC m=+67.277797033 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls") pod "dns-default-q8g77" (UID: "63e25ce3-9fe4-4a91-a85c-2cf9bce6c306") : secret "dns-default-metrics-tls" not found
Jul 24 17:03:53.843893 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:03:53.843597    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls podName:42e2f9ae-322f-4796-8440-bf12d50a8283 nodeName:}" failed. No retries permitted until 2026-07-24 17:04:09.843592628 +0000 UTC m=+67.277808172 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls") pod "image-registry-78998df997-xrrv4" (UID: "42e2f9ae-322f-4796-8440-bf12d50a8283") : secret "image-registry-tls" not found
Jul 24 17:04:04.276896 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:04.276861    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zq9nc"
Jul 24 17:04:08.852788 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:08.852751    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret\") pod \"global-pull-secret-syncer-2dlhn\" (UID: \"eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7\") " pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:04:08.852788 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:08.852795    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p2s9\" (UniqueName: \"kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9\") pod \"network-check-target-4fk6m\" (UID: \"ea693e0b-70ff-4a94-80a0-ce8688fb1449\") " pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:04:08.853317 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:08.852851    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs\") pod \"network-metrics-daemon-td8qt\" (UID: \"ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b\") " pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:04:08.855448 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:08.855426    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 17:04:08.855488 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:08.855426    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 17:04:08.855520 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:08.855482    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 17:04:08.863504 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:04:08.863484    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 17:04:08.863577 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:04:08.863566    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs podName:ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b nodeName:}" failed. No retries permitted until 2026-07-24 17:05:12.863545955 +0000 UTC m=+130.297761514 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs") pod "network-metrics-daemon-td8qt" (UID: "ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b") : secret "metrics-daemon-secret" not found
Jul 24 17:04:08.865724 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:08.865703    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 17:04:08.867312 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:08.867286    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7-original-pull-secret\") pod \"global-pull-secret-syncer-2dlhn\" (UID: \"eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7\") " pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:04:08.876712 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:08.876686    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p2s9\" (UniqueName: \"kubernetes.io/projected/ea693e0b-70ff-4a94-80a0-ce8688fb1449-kube-api-access-4p2s9\") pod \"network-check-target-4fk6m\" (UID: \"ea693e0b-70ff-4a94-80a0-ce8688fb1449\") " pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:04:08.993296 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:08.993264    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2xn4k\""
Jul 24 17:04:09.000558 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:09.000538    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:04:09.005516 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:09.005498    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dlhn"
Jul 24 17:04:09.160055 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:09.160026    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4fk6m"]
Jul 24 17:04:09.163035 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:04:09.163007    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea693e0b_70ff_4a94_80a0_ce8688fb1449.slice/crio-303e9b13c386bcfd5ab7d690f8cdf6e0aad75cfffb5c1286d4532c9900588a96 WatchSource:0}: Error finding container 303e9b13c386bcfd5ab7d690f8cdf6e0aad75cfffb5c1286d4532c9900588a96: Status 404 returned error can't find the container with id 303e9b13c386bcfd5ab7d690f8cdf6e0aad75cfffb5c1286d4532c9900588a96
Jul 24 17:04:09.172351 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:09.172329    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2dlhn"]
Jul 24 17:04:09.174977 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:04:09.174956    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeebea2cf_2c71_48e8_bdd9_cb59bcb96fc7.slice/crio-36a96680a1cbd3144acb79861d402a13b12c0195f5cf508ce16fe78fc315cdf4 WatchSource:0}: Error finding container 36a96680a1cbd3144acb79861d402a13b12c0195f5cf508ce16fe78fc315cdf4: Status 404 returned error can't find the container with id 36a96680a1cbd3144acb79861d402a13b12c0195f5cf508ce16fe78fc315cdf4
Jul 24 17:04:09.369109 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:09.369026    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4fk6m" event={"ID":"ea693e0b-70ff-4a94-80a0-ce8688fb1449","Type":"ContainerStarted","Data":"303e9b13c386bcfd5ab7d690f8cdf6e0aad75cfffb5c1286d4532c9900588a96"}
Jul 24 17:04:09.370141 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:09.370114    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2dlhn" event={"ID":"eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7","Type":"ContainerStarted","Data":"36a96680a1cbd3144acb79861d402a13b12c0195f5cf508ce16fe78fc315cdf4"}
Jul 24 17:04:09.861315 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:09.861276    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-d9jzg\" (UID: \"3f3ba1e9-16df-42fc-801b-822202b455d8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg"
Jul 24 17:04:09.861803 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:09.861333    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:04:09.861803 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:09.861380    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls\") pod \"dns-default-q8g77\" (UID: \"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306\") " pod="openshift-dns/dns-default-q8g77"
Jul 24 17:04:09.861803 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:04:09.861448    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 17:04:09.861803 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:04:09.861499    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:04:09.861803 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:04:09.861513    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:04:09.861803 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:04:09.861532    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78998df997-xrrv4: secret "image-registry-tls" not found
Jul 24 17:04:09.861803 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:04:09.861535    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert podName:3f3ba1e9-16df-42fc-801b-822202b455d8 nodeName:}" failed. No retries permitted until 2026-07-24 17:04:41.861515095 +0000 UTC m=+99.295730658 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-d9jzg" (UID: "3f3ba1e9-16df-42fc-801b-822202b455d8") : secret "networking-console-plugin-cert" not found
Jul 24 17:04:09.861803 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:04:09.861556    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls podName:63e25ce3-9fe4-4a91-a85c-2cf9bce6c306 nodeName:}" failed. No retries permitted until 2026-07-24 17:04:41.861545638 +0000 UTC m=+99.295761185 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls") pod "dns-default-q8g77" (UID: "63e25ce3-9fe4-4a91-a85c-2cf9bce6c306") : secret "dns-default-metrics-tls" not found
Jul 24 17:04:09.861803 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:04:09.861575    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls podName:42e2f9ae-322f-4796-8440-bf12d50a8283 nodeName:}" failed. No retries permitted until 2026-07-24 17:04:41.861561439 +0000 UTC m=+99.295777016 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls") pod "image-registry-78998df997-xrrv4" (UID: "42e2f9ae-322f-4796-8440-bf12d50a8283") : secret "image-registry-tls" not found
Jul 24 17:04:14.384793 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:14.384754    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2dlhn" event={"ID":"eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7","Type":"ContainerStarted","Data":"9348b2db7c647d39b456c7b480b32055607e867188117625d3a8cf4f06febc0c"}
Jul 24 17:04:14.386254 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:14.386216    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4fk6m" event={"ID":"ea693e0b-70ff-4a94-80a0-ce8688fb1449","Type":"ContainerStarted","Data":"1b6f70ac58160e2b735da89eb9581a2b6f95e90f280234e5d147919018078473"}
Jul 24 17:04:14.386378 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:14.386362    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:04:14.400353 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:14.400166    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2dlhn" podStartSLOduration=66.869925748 podStartE2EDuration="1m11.400151009s" totalImagesPullingTime="4.530225261s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:14.399879438 +0000 UTC m=+71.834095007" watchObservedRunningTime="2026-07-24 17:04:14.400151009 +0000 UTC m=+71.834366576"
Jul 24 17:04:14.413670 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:14.413624    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4fk6m" podStartSLOduration=66.874471987 podStartE2EDuration="1m11.413610626s" totalImagesPullingTime="4.539138639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:03:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:14.412920573 +0000 UTC m=+71.847136142" watchObservedRunningTime="2026-07-24 17:04:14.413610626 +0000 UTC m=+71.847826192"
Jul 24 17:04:18.216844 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:18.216810    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd"]
Jul 24 17:04:18.218876 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:18.218857    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd"
Jul 24 17:04:18.221350 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:18.221319    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 24 17:04:18.221350 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:18.221335    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 24 17:04:18.222171 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:18.222155    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 24 17:04:18.222270 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:18.222160    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 24 17:04:18.227477 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:18.227457    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd"]
Jul 24 17:04:18.326634 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:18.326597    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pgh8\" (UniqueName: \"kubernetes.io/projected/151e3c7c-54c3-47f8-a9e1-6fa5411eec42-kube-api-access-8pgh8\") pod \"klusterlet-addon-workmgr-786bdfdcb8-qhbqd\" (UID: \"151e3c7c-54c3-47f8-a9e1-6fa5411eec42\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd"
Jul 24 17:04:18.326807 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:18.326700    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/151e3c7c-54c3-47f8-a9e1-6fa5411eec42-klusterlet-config\") pod \"klusterlet-addon-workmgr-786bdfdcb8-qhbqd\" (UID: \"151e3c7c-54c3-47f8-a9e1-6fa5411eec42\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd"
Jul 24 17:04:18.326807 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:18.326727    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/151e3c7c-54c3-47f8-a9e1-6fa5411eec42-tmp\") pod \"klusterlet-addon-workmgr-786bdfdcb8-qhbqd\" (UID: \"151e3c7c-54c3-47f8-a9e1-6fa5411eec42\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd"
Jul 24 17:04:18.427716 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:18.427673    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pgh8\" (UniqueName: \"kubernetes.io/projected/151e3c7c-54c3-47f8-a9e1-6fa5411eec42-kube-api-access-8pgh8\") pod \"klusterlet-addon-workmgr-786bdfdcb8-qhbqd\" (UID: \"151e3c7c-54c3-47f8-a9e1-6fa5411eec42\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd"
Jul 24 17:04:18.427879 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:18.427766    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/151e3c7c-54c3-47f8-a9e1-6fa5411eec42-klusterlet-config\") pod \"klusterlet-addon-workmgr-786bdfdcb8-qhbqd\" (UID: \"151e3c7c-54c3-47f8-a9e1-6fa5411eec42\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd"
Jul 24 17:04:18.427879 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:18.427792    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/151e3c7c-54c3-47f8-a9e1-6fa5411eec42-tmp\") pod \"klusterlet-addon-workmgr-786bdfdcb8-qhbqd\" (UID: \"151e3c7c-54c3-47f8-a9e1-6fa5411eec42\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd"
Jul 24 17:04:18.428191 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:18.428167    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/151e3c7c-54c3-47f8-a9e1-6fa5411eec42-tmp\") pod \"klusterlet-addon-workmgr-786bdfdcb8-qhbqd\" (UID: \"151e3c7c-54c3-47f8-a9e1-6fa5411eec42\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd"
Jul 24 17:04:18.430369 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:18.430346    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/151e3c7c-54c3-47f8-a9e1-6fa5411eec42-klusterlet-config\") pod \"klusterlet-addon-workmgr-786bdfdcb8-qhbqd\" (UID: \"151e3c7c-54c3-47f8-a9e1-6fa5411eec42\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd"
Jul 24 17:04:18.435443 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:18.435419    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pgh8\" (UniqueName: \"kubernetes.io/projected/151e3c7c-54c3-47f8-a9e1-6fa5411eec42-kube-api-access-8pgh8\") pod \"klusterlet-addon-workmgr-786bdfdcb8-qhbqd\" (UID: \"151e3c7c-54c3-47f8-a9e1-6fa5411eec42\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd"
Jul 24 17:04:18.527768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:18.527677    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd"
Jul 24 17:04:18.645154 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:18.645125    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd"]
Jul 24 17:04:18.648400 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:04:18.648375    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod151e3c7c_54c3_47f8_a9e1_6fa5411eec42.slice/crio-1e9c6a115d2fa929b99a0d5bef571298ec66f506859935a0299cb2b52e62f75a WatchSource:0}: Error finding container 1e9c6a115d2fa929b99a0d5bef571298ec66f506859935a0299cb2b52e62f75a: Status 404 returned error can't find the container with id 1e9c6a115d2fa929b99a0d5bef571298ec66f506859935a0299cb2b52e62f75a
Jul 24 17:04:19.398850 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:19.398818    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd" event={"ID":"151e3c7c-54c3-47f8-a9e1-6fa5411eec42","Type":"ContainerStarted","Data":"1e9c6a115d2fa929b99a0d5bef571298ec66f506859935a0299cb2b52e62f75a"}
Jul 24 17:04:22.409134 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:22.409097    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd" event={"ID":"151e3c7c-54c3-47f8-a9e1-6fa5411eec42","Type":"ContainerStarted","Data":"5c93fb0969f4a15240a9500dc2676ca8f2696a920ac42e122cbf2cb95db3f680"}
Jul 24 17:04:22.409551 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:22.409341    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd"
Jul 24 17:04:22.410691 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:22.410661    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd" podUID="151e3c7c-54c3-47f8-a9e1-6fa5411eec42" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/readyz\": dial tcp 10.132.0.10:8000: connect: connection refused"
Jul 24 17:04:22.426471 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:22.426423    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd" podStartSLOduration=0.747316824 podStartE2EDuration="4.426394783s" totalImagesPullingTime="3.679077959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:22.425269658 +0000 UTC m=+79.859485225" watchObservedRunningTime="2026-07-24 17:04:22.426394783 +0000 UTC m=+79.860610350"
Jul 24 17:04:23.413077 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:23.413047    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd"
Jul 24 17:04:41.904175 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:41.904122    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-d9jzg\" (UID: \"3f3ba1e9-16df-42fc-801b-822202b455d8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg"
Jul 24 17:04:41.904175 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:41.904178    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:04:41.904639 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:04:41.904287    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:04:41.904639 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:04:41.904298    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78998df997-xrrv4: secret "image-registry-tls" not found
Jul 24 17:04:41.904639 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:04:41.904295    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 17:04:41.904639 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:41.904316    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls\") pod \"dns-default-q8g77\" (UID: \"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306\") " pod="openshift-dns/dns-default-q8g77"
Jul 24 17:04:41.904639 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:04:41.904357    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls podName:42e2f9ae-322f-4796-8440-bf12d50a8283 nodeName:}" failed. No retries permitted until 2026-07-24 17:05:45.904342364 +0000 UTC m=+163.338557910 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls") pod "image-registry-78998df997-xrrv4" (UID: "42e2f9ae-322f-4796-8440-bf12d50a8283") : secret "image-registry-tls" not found
Jul 24 17:04:41.904639 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:04:41.904400    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert podName:3f3ba1e9-16df-42fc-801b-822202b455d8 nodeName:}" failed. No retries permitted until 2026-07-24 17:05:45.904387685 +0000 UTC m=+163.338603256 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-d9jzg" (UID: "3f3ba1e9-16df-42fc-801b-822202b455d8") : secret "networking-console-plugin-cert" not found
Jul 24 17:04:41.904639 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:04:41.904401    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:04:41.904639 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:04:41.904462    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls podName:63e25ce3-9fe4-4a91-a85c-2cf9bce6c306 nodeName:}" failed. No retries permitted until 2026-07-24 17:05:45.904449524 +0000 UTC m=+163.338665076 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls") pod "dns-default-q8g77" (UID: "63e25ce3-9fe4-4a91-a85c-2cf9bce6c306") : secret "dns-default-metrics-tls" not found
Jul 24 17:04:45.391026 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:04:45.391000    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4fk6m"
Jul 24 17:05:12.925888 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:05:12.925840    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs\") pod \"network-metrics-daemon-td8qt\" (UID: \"ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b\") " pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:05:12.926493 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:05:12.926010    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 17:05:12.926493 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:05:12.926102    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs podName:ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b nodeName:}" failed. No retries permitted until 2026-07-24 17:07:14.926081499 +0000 UTC m=+252.360297067 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs") pod "network-metrics-daemon-td8qt" (UID: "ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b") : secret "metrics-daemon-secret" not found
Jul 24 17:05:40.973224 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:05:40.973163    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-78998df997-xrrv4" podUID="42e2f9ae-322f-4796-8440-bf12d50a8283"
Jul 24 17:05:40.980323 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:05:40.980293    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg" podUID="3f3ba1e9-16df-42fc-801b-822202b455d8"
Jul 24 17:05:40.992429 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:05:40.992405    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-q8g77" podUID="63e25ce3-9fe4-4a91-a85c-2cf9bce6c306"
Jul 24 17:05:41.099197 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:05:41.099162    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-td8qt" podUID="ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b"
Jul 24 17:05:41.596090 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:05:41.596061    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q8g77"
Jul 24 17:05:41.596090 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:05:41.596084    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg"
Jul 24 17:05:41.596363 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:05:41.596102    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:05:45.955918 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:05:45.955878    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls\") pod \"dns-default-q8g77\" (UID: \"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306\") " pod="openshift-dns/dns-default-q8g77"
Jul 24 17:05:45.956451 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:05:45.955959    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-d9jzg\" (UID: \"3f3ba1e9-16df-42fc-801b-822202b455d8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg"
Jul 24 17:05:45.956451 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:05:45.955992    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:05:45.956451 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:05:45.956038    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:05:45.956451 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:05:45.956092    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 17:05:45.956451 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:05:45.956104    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls podName:63e25ce3-9fe4-4a91-a85c-2cf9bce6c306 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:47.956088664 +0000 UTC m=+285.390304210 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls") pod "dns-default-q8g77" (UID: "63e25ce3-9fe4-4a91-a85c-2cf9bce6c306") : secret "dns-default-metrics-tls" not found
Jul 24 17:05:45.956451 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:05:45.956098    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:05:45.956451 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:05:45.956119    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78998df997-xrrv4: secret "image-registry-tls" not found
Jul 24 17:05:45.956451 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:05:45.956141    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls podName:42e2f9ae-322f-4796-8440-bf12d50a8283 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:47.956135433 +0000 UTC m=+285.390350978 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls") pod "image-registry-78998df997-xrrv4" (UID: "42e2f9ae-322f-4796-8440-bf12d50a8283") : secret "image-registry-tls" not found
Jul 24 17:05:45.956451 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:05:45.956158    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert podName:3f3ba1e9-16df-42fc-801b-822202b455d8 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:47.956144977 +0000 UTC m=+285.390360522 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-d9jzg" (UID: "3f3ba1e9-16df-42fc-801b-822202b455d8") : secret "networking-console-plugin-cert" not found
Jul 24 17:05:55.079388 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:05:55.079296    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:06:22.694119 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:06:22.694027    2572 generic.go:356] "Generic (PLEG): container finished" podID="151e3c7c-54c3-47f8-a9e1-6fa5411eec42" containerID="5c93fb0969f4a15240a9500dc2676ca8f2696a920ac42e122cbf2cb95db3f680" exitCode=1
Jul 24 17:06:22.694119 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:06:22.694099    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd" event={"ID":"151e3c7c-54c3-47f8-a9e1-6fa5411eec42","Type":"ContainerDied","Data":"5c93fb0969f4a15240a9500dc2676ca8f2696a920ac42e122cbf2cb95db3f680"}
Jul 24 17:06:22.694648 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:06:22.694417    2572 scope.go:117] "RemoveContainer" containerID="5c93fb0969f4a15240a9500dc2676ca8f2696a920ac42e122cbf2cb95db3f680"
Jul 24 17:06:23.412581 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:06:23.412540    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd"
Jul 24 17:06:23.697949 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:06:23.697866    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd" event={"ID":"151e3c7c-54c3-47f8-a9e1-6fa5411eec42","Type":"ContainerStarted","Data":"e5dcb875bef2b8aefb0a03a85fdfbc7d194db023fdf459c749660f7c57707ca8"}
Jul 24 17:06:23.698409 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:06:23.698064    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd"
Jul 24 17:06:23.698648 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:06:23.698632    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786bdfdcb8-qhbqd"
Jul 24 17:07:14.993044 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:14.992991    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs\") pod \"network-metrics-daemon-td8qt\" (UID: \"ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b\") " pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:07:14.993568 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:14.993148    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 17:07:14.993568 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:14.993220    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs podName:ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b nodeName:}" failed. No retries permitted until 2026-07-24 17:09:16.993204707 +0000 UTC m=+374.427420256 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs") pod "network-metrics-daemon-td8qt" (UID: "ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b") : secret "metrics-daemon-secret" not found
Jul 24 17:07:15.289704 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.289623    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-c2v6b"]
Jul 24 17:07:15.291402 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.291387    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-b8b6894cc-sf8bk"]
Jul 24 17:07:15.291528 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.291510    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-c2v6b"
Jul 24 17:07:15.293035 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.293016    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:15.298750 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.298495    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 24 17:07:15.298750 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.298560    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-sjgf8"]
Jul 24 17:07:15.298919 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.298847    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 17:07:15.298919 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.298881    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-66c9k\""
Jul 24 17:07:15.298919 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.298917    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 24 17:07:15.299132 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.299111    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 24 17:07:15.299415 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.299309    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 17:07:15.299507 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.299472    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 24 17:07:15.299702 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.299642    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-62j5x\""
Jul 24 17:07:15.300371 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.300351    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl"]
Jul 24 17:07:15.300467 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.300452    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8"
Jul 24 17:07:15.302027 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.302010    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl"
Jul 24 17:07:15.311451 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.311432    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 24 17:07:15.312125 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.312110    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 24 17:07:15.317336 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.317317    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 24 17:07:15.317483 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.317317    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:07:15.317571 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.317509    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vm6rs\""
Jul 24 17:07:15.317571 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.317546    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 24 17:07:15.317656 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.317634    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 24 17:07:15.317691 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.317670    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 24 17:07:15.317991 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.317978    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:07:15.318527 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.318512    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7bgms\""
Jul 24 17:07:15.329917 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.329896    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-c2v6b"]
Jul 24 17:07:15.343416 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.343389    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-sjgf8"]
Jul 24 17:07:15.343539 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.343482    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl"]
Jul 24 17:07:15.345030 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.345009    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 24 17:07:15.348313 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.348295    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-b8b6894cc-sf8bk"]
Jul 24 17:07:15.395474 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.395442    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f065120-142c-45cb-bde8-c925bc9af828-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl\" (UID: \"0f065120-142c-45cb-bde8-c925bc9af828\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl"
Jul 24 17:07:15.395631 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.395479    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxtlp\" (UniqueName: \"kubernetes.io/projected/0f065120-142c-45cb-bde8-c925bc9af828-kube-api-access-pxtlp\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl\" (UID: \"0f065120-142c-45cb-bde8-c925bc9af828\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl"
Jul 24 17:07:15.395631 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.395499    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-stats-auth\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:15.395631 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.395521    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7820ccc-4ae6-492b-824f-62b30aaaf133-serving-cert\") pod \"console-operator-584dcb6b54-sjgf8\" (UID: \"a7820ccc-4ae6-492b-824f-62b30aaaf133\") " pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8"
Jul 24 17:07:15.395631 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.395572    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f065120-142c-45cb-bde8-c925bc9af828-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl\" (UID: \"0f065120-142c-45cb-bde8-c925bc9af828\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl"
Jul 24 17:07:15.395631 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.395597    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwghw\" (UniqueName: \"kubernetes.io/projected/a7820ccc-4ae6-492b-824f-62b30aaaf133-kube-api-access-wwghw\") pod \"console-operator-584dcb6b54-sjgf8\" (UID: \"a7820ccc-4ae6-492b-824f-62b30aaaf133\") " pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8"
Jul 24 17:07:15.395792 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.395671    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-metrics-certs\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:15.395792 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.395704    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-service-ca-bundle\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:15.395792 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.395722    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcmjc\" (UniqueName: \"kubernetes.io/projected/4646fd1d-669c-4714-8ef6-9511046f174e-kube-api-access-mcmjc\") pod \"network-check-source-7d88cb55d8-c2v6b\" (UID: \"4646fd1d-669c-4714-8ef6-9511046f174e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-c2v6b"
Jul 24 17:07:15.395792 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.395739    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvrmf\" (UniqueName: \"kubernetes.io/projected/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-kube-api-access-rvrmf\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:15.395907 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.395801    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7820ccc-4ae6-492b-824f-62b30aaaf133-config\") pod \"console-operator-584dcb6b54-sjgf8\" (UID: \"a7820ccc-4ae6-492b-824f-62b30aaaf133\") " pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8"
Jul 24 17:07:15.395907 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.395820    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-default-certificate\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:15.395907 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.395848    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7820ccc-4ae6-492b-824f-62b30aaaf133-trusted-ca\") pod \"console-operator-584dcb6b54-sjgf8\" (UID: \"a7820ccc-4ae6-492b-824f-62b30aaaf133\") " pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8"
Jul 24 17:07:15.496433 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.496401    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f065120-142c-45cb-bde8-c925bc9af828-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl\" (UID: \"0f065120-142c-45cb-bde8-c925bc9af828\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl"
Jul 24 17:07:15.496614 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.496444    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwghw\" (UniqueName: \"kubernetes.io/projected/a7820ccc-4ae6-492b-824f-62b30aaaf133-kube-api-access-wwghw\") pod \"console-operator-584dcb6b54-sjgf8\" (UID: \"a7820ccc-4ae6-492b-824f-62b30aaaf133\") " pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8"
Jul 24 17:07:15.496614 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.496470    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-metrics-certs\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:15.496614 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.496493    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-service-ca-bundle\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:15.496614 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.496512    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcmjc\" (UniqueName: \"kubernetes.io/projected/4646fd1d-669c-4714-8ef6-9511046f174e-kube-api-access-mcmjc\") pod \"network-check-source-7d88cb55d8-c2v6b\" (UID: \"4646fd1d-669c-4714-8ef6-9511046f174e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-c2v6b"
Jul 24 17:07:15.496614 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.496528    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvrmf\" (UniqueName: \"kubernetes.io/projected/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-kube-api-access-rvrmf\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:15.496846 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:15.496622    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 17:07:15.496846 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:15.496669    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-service-ca-bundle podName:d6ad8405-43ea-45ca-8735-4ca4e9cc3350 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:15.996647087 +0000 UTC m=+253.430862652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-service-ca-bundle") pod "router-default-b8b6894cc-sf8bk" (UID: "d6ad8405-43ea-45ca-8735-4ca4e9cc3350") : configmap references non-existent config key: service-ca.crt
Jul 24 17:07:15.496846 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:15.496702    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-metrics-certs podName:d6ad8405-43ea-45ca-8735-4ca4e9cc3350 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:15.996683741 +0000 UTC m=+253.430899286 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-metrics-certs") pod "router-default-b8b6894cc-sf8bk" (UID: "d6ad8405-43ea-45ca-8735-4ca4e9cc3350") : secret "router-metrics-certs-default" not found
Jul 24 17:07:15.496846 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.496754    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7820ccc-4ae6-492b-824f-62b30aaaf133-config\") pod \"console-operator-584dcb6b54-sjgf8\" (UID: \"a7820ccc-4ae6-492b-824f-62b30aaaf133\") " pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8"
Jul 24 17:07:15.496846 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.496789    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-default-certificate\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:15.496846 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.496829    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7820ccc-4ae6-492b-824f-62b30aaaf133-trusted-ca\") pod \"console-operator-584dcb6b54-sjgf8\" (UID: \"a7820ccc-4ae6-492b-824f-62b30aaaf133\") " pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8"
Jul 24 17:07:15.497407 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.496861    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f065120-142c-45cb-bde8-c925bc9af828-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl\" (UID: \"0f065120-142c-45cb-bde8-c925bc9af828\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl"
Jul 24 17:07:15.497407 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.496891    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxtlp\" (UniqueName: \"kubernetes.io/projected/0f065120-142c-45cb-bde8-c925bc9af828-kube-api-access-pxtlp\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl\" (UID: \"0f065120-142c-45cb-bde8-c925bc9af828\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl"
Jul 24 17:07:15.497407 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.496928    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-stats-auth\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:15.497407 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.496950    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7820ccc-4ae6-492b-824f-62b30aaaf133-serving-cert\") pod \"console-operator-584dcb6b54-sjgf8\" (UID: \"a7820ccc-4ae6-492b-824f-62b30aaaf133\") " pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8"
Jul 24 17:07:15.497667 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.497546    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f065120-142c-45cb-bde8-c925bc9af828-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl\" (UID: \"0f065120-142c-45cb-bde8-c925bc9af828\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl"
Jul 24 17:07:15.497667 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.497616    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7820ccc-4ae6-492b-824f-62b30aaaf133-config\") pod \"console-operator-584dcb6b54-sjgf8\" (UID: \"a7820ccc-4ae6-492b-824f-62b30aaaf133\") " pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8"
Jul 24 17:07:15.497914 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.497888    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7820ccc-4ae6-492b-824f-62b30aaaf133-trusted-ca\") pod \"console-operator-584dcb6b54-sjgf8\" (UID: \"a7820ccc-4ae6-492b-824f-62b30aaaf133\") " pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8"
Jul 24 17:07:15.499014 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.498989    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f065120-142c-45cb-bde8-c925bc9af828-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl\" (UID: \"0f065120-142c-45cb-bde8-c925bc9af828\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl"
Jul 24 17:07:15.499405 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.499389    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7820ccc-4ae6-492b-824f-62b30aaaf133-serving-cert\") pod \"console-operator-584dcb6b54-sjgf8\" (UID: \"a7820ccc-4ae6-492b-824f-62b30aaaf133\") " pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8"
Jul 24 17:07:15.499560 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.499542    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-default-certificate\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:15.500151 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.500124    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-stats-auth\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:15.511848 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.511825    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxtlp\" (UniqueName: \"kubernetes.io/projected/0f065120-142c-45cb-bde8-c925bc9af828-kube-api-access-pxtlp\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl\" (UID: \"0f065120-142c-45cb-bde8-c925bc9af828\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl"
Jul 24 17:07:15.512400 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.512380    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwghw\" (UniqueName: \"kubernetes.io/projected/a7820ccc-4ae6-492b-824f-62b30aaaf133-kube-api-access-wwghw\") pod \"console-operator-584dcb6b54-sjgf8\" (UID: \"a7820ccc-4ae6-492b-824f-62b30aaaf133\") " pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8"
Jul 24 17:07:15.512655 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.512636    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcmjc\" (UniqueName: \"kubernetes.io/projected/4646fd1d-669c-4714-8ef6-9511046f174e-kube-api-access-mcmjc\") pod \"network-check-source-7d88cb55d8-c2v6b\" (UID: \"4646fd1d-669c-4714-8ef6-9511046f174e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-c2v6b"
Jul 24 17:07:15.513803 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.513784    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvrmf\" (UniqueName: \"kubernetes.io/projected/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-kube-api-access-rvrmf\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:15.601765 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.601690    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-c2v6b"
Jul 24 17:07:15.613463 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.613438    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8"
Jul 24 17:07:15.619265 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.619227    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl"
Jul 24 17:07:15.747045 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.747013    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-c2v6b"]
Jul 24 17:07:15.750766 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:07:15.750740    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4646fd1d_669c_4714_8ef6_9511046f174e.slice/crio-ee735f7df57bde805688fd64601413ffc472f495da309dc5cbaa9daa9b118348 WatchSource:0}: Error finding container ee735f7df57bde805688fd64601413ffc472f495da309dc5cbaa9daa9b118348: Status 404 returned error can't find the container with id ee735f7df57bde805688fd64601413ffc472f495da309dc5cbaa9daa9b118348
Jul 24 17:07:15.823095 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.823061    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-c2v6b" event={"ID":"4646fd1d-669c-4714-8ef6-9511046f174e","Type":"ContainerStarted","Data":"f2377ca7dae8016c6accf3745bc0932680fcd2a134c4db855e8bab63c2f03aeb"}
Jul 24 17:07:15.823257 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.823125    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-c2v6b" event={"ID":"4646fd1d-669c-4714-8ef6-9511046f174e","Type":"ContainerStarted","Data":"ee735f7df57bde805688fd64601413ffc472f495da309dc5cbaa9daa9b118348"}
Jul 24 17:07:15.838480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.838434    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-c2v6b" podStartSLOduration=0.838417458 podStartE2EDuration="838.417458ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:15.837390137 +0000 UTC m=+253.271605703" watchObservedRunningTime="2026-07-24 17:07:15.838417458 +0000 UTC m=+253.272633003"
Jul 24 17:07:15.972219 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.972186    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl"]
Jul 24 17:07:15.974505 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:15.974483    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-sjgf8"]
Jul 24 17:07:15.975312 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:07:15.975283    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f065120_142c_45cb_bde8_c925bc9af828.slice/crio-2c838b6be61cd459f6e6c47c3df452e2a781d106d1d7aacc426ac2dc7e6a035f WatchSource:0}: Error finding container 2c838b6be61cd459f6e6c47c3df452e2a781d106d1d7aacc426ac2dc7e6a035f: Status 404 returned error can't find the container with id 2c838b6be61cd459f6e6c47c3df452e2a781d106d1d7aacc426ac2dc7e6a035f
Jul 24 17:07:15.977355 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:07:15.977338    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7820ccc_4ae6_492b_824f_62b30aaaf133.slice/crio-8125c9f6ab7c6d3ff4f159f3ff3e95b1ddbba065b8d1f2c8b117188baf79caa8 WatchSource:0}: Error finding container 8125c9f6ab7c6d3ff4f159f3ff3e95b1ddbba065b8d1f2c8b117188baf79caa8: Status 404 returned error can't find the container with id 8125c9f6ab7c6d3ff4f159f3ff3e95b1ddbba065b8d1f2c8b117188baf79caa8
Jul 24 17:07:16.001758 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:16.001737    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-metrics-certs\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:16.002292 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:16.001773    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-service-ca-bundle\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:16.002292 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:16.001873    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 17:07:16.002292 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:16.001931    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-service-ca-bundle podName:d6ad8405-43ea-45ca-8735-4ca4e9cc3350 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:17.001913605 +0000 UTC m=+254.436129155 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-service-ca-bundle") pod "router-default-b8b6894cc-sf8bk" (UID: "d6ad8405-43ea-45ca-8735-4ca4e9cc3350") : configmap references non-existent config key: service-ca.crt
Jul 24 17:07:16.002292 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:16.001953    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-metrics-certs podName:d6ad8405-43ea-45ca-8735-4ca4e9cc3350 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:17.001941847 +0000 UTC m=+254.436157395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-metrics-certs") pod "router-default-b8b6894cc-sf8bk" (UID: "d6ad8405-43ea-45ca-8735-4ca4e9cc3350") : secret "router-metrics-certs-default" not found
Jul 24 17:07:16.829837 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:16.829799    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8" event={"ID":"a7820ccc-4ae6-492b-824f-62b30aaaf133","Type":"ContainerStarted","Data":"8125c9f6ab7c6d3ff4f159f3ff3e95b1ddbba065b8d1f2c8b117188baf79caa8"}
Jul 24 17:07:16.831135 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:16.831102    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl" event={"ID":"0f065120-142c-45cb-bde8-c925bc9af828","Type":"ContainerStarted","Data":"2c838b6be61cd459f6e6c47c3df452e2a781d106d1d7aacc426ac2dc7e6a035f"}
Jul 24 17:07:17.010650 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:17.010609    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-metrics-certs\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:17.011084 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:17.010667    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-service-ca-bundle\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:17.011084 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:17.010777    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 17:07:17.011084 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:17.010833    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-service-ca-bundle podName:d6ad8405-43ea-45ca-8735-4ca4e9cc3350 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:19.010813599 +0000 UTC m=+256.445029146 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-service-ca-bundle") pod "router-default-b8b6894cc-sf8bk" (UID: "d6ad8405-43ea-45ca-8735-4ca4e9cc3350") : configmap references non-existent config key: service-ca.crt
Jul 24 17:07:17.011084 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:17.010856    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-metrics-certs podName:d6ad8405-43ea-45ca-8735-4ca4e9cc3350 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:19.010846337 +0000 UTC m=+256.445061885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-metrics-certs") pod "router-default-b8b6894cc-sf8bk" (UID: "d6ad8405-43ea-45ca-8735-4ca4e9cc3350") : secret "router-metrics-certs-default" not found
Jul 24 17:07:18.840346 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:18.840267    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/0.log"
Jul 24 17:07:18.840346 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:18.840311    2572 generic.go:356] "Generic (PLEG): container finished" podID="a7820ccc-4ae6-492b-824f-62b30aaaf133" containerID="fde764a3147c76af02fd0370cf1368cdd50bea542f9bb6606ed4e26ec4191316" exitCode=255
Jul 24 17:07:18.840819 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:18.840391    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8" event={"ID":"a7820ccc-4ae6-492b-824f-62b30aaaf133","Type":"ContainerDied","Data":"fde764a3147c76af02fd0370cf1368cdd50bea542f9bb6606ed4e26ec4191316"}
Jul 24 17:07:18.840819 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:18.840642    2572 scope.go:117] "RemoveContainer" containerID="fde764a3147c76af02fd0370cf1368cdd50bea542f9bb6606ed4e26ec4191316"
Jul 24 17:07:18.842072 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:18.842049    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl" event={"ID":"0f065120-142c-45cb-bde8-c925bc9af828","Type":"ContainerStarted","Data":"e44127628574bce7d30df20198857a43acc38d71e56848d755bd88d765c1890b"}
Jul 24 17:07:18.871995 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:18.871951    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl" podStartSLOduration=1.279211669 podStartE2EDuration="3.871935499s" totalImagesPullingTime="2.59272383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:18.87118102 +0000 UTC m=+256.305396589" watchObservedRunningTime="2026-07-24 17:07:18.871935499 +0000 UTC m=+256.306151100"
Jul 24 17:07:19.032604 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.032568    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-service-ca-bundle\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:19.032773 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.032707    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-metrics-certs\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:19.032773 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:19.032761    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-service-ca-bundle podName:d6ad8405-43ea-45ca-8735-4ca4e9cc3350 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:23.032740386 +0000 UTC m=+260.466955954 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-service-ca-bundle") pod "router-default-b8b6894cc-sf8bk" (UID: "d6ad8405-43ea-45ca-8735-4ca4e9cc3350") : configmap references non-existent config key: service-ca.crt
Jul 24 17:07:19.032869 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:19.032809    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 17:07:19.032869 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:19.032849    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-metrics-certs podName:d6ad8405-43ea-45ca-8735-4ca4e9cc3350 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:23.032837558 +0000 UTC m=+260.467053103 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-metrics-certs") pod "router-default-b8b6894cc-sf8bk" (UID: "d6ad8405-43ea-45ca-8735-4ca4e9cc3350") : secret "router-metrics-certs-default" not found
Jul 24 17:07:19.342329 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.342298    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sgb5b"]
Jul 24 17:07:19.344443 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.344428    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:19.347321 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.347298    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2qh5k\""
Jul 24 17:07:19.347636 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.347620    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 17:07:19.347700 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.347639    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 17:07:19.347700 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.347641    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 17:07:19.347700 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.347695    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 17:07:19.376763 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.376727    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sgb5b"]
Jul 24 17:07:19.435416 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.435386    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0575d1d-500e-47d7-b295-d58875e5a242-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:19.435590 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.435461    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k5h6\" (UniqueName: \"kubernetes.io/projected/c0575d1d-500e-47d7-b295-d58875e5a242-kube-api-access-4k5h6\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:19.435590 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.435485    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0575d1d-500e-47d7-b295-d58875e5a242-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:19.435590 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.435511    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c0575d1d-500e-47d7-b295-d58875e5a242-crio-socket\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:19.435590 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.435547    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0575d1d-500e-47d7-b295-d58875e5a242-data-volume\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:19.535976 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.535948    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0575d1d-500e-47d7-b295-d58875e5a242-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:19.536128 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.536021    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k5h6\" (UniqueName: \"kubernetes.io/projected/c0575d1d-500e-47d7-b295-d58875e5a242-kube-api-access-4k5h6\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:19.536128 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.536038    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0575d1d-500e-47d7-b295-d58875e5a242-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:19.536128 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.536065    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c0575d1d-500e-47d7-b295-d58875e5a242-crio-socket\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:19.536128 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.536089    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0575d1d-500e-47d7-b295-d58875e5a242-data-volume\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:19.536128 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:19.536096    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:07:19.536343 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:19.536129    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:07:19.536343 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:19.536165    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0575d1d-500e-47d7-b295-d58875e5a242-insights-runtime-extractor-tls podName:c0575d1d-500e-47d7-b295-d58875e5a242 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:20.036144966 +0000 UTC m=+257.470360526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0575d1d-500e-47d7-b295-d58875e5a242-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sgb5b" (UID: "c0575d1d-500e-47d7-b295-d58875e5a242") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:07:19.536343 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:19.536184    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0575d1d-500e-47d7-b295-d58875e5a242-kube-rbac-proxy-cm podName:c0575d1d-500e-47d7-b295-d58875e5a242 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:20.036172969 +0000 UTC m=+257.470388545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c0575d1d-500e-47d7-b295-d58875e5a242-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sgb5b" (UID: "c0575d1d-500e-47d7-b295-d58875e5a242") : configmap "kube-rbac-proxy" not found
Jul 24 17:07:19.536343 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.536181    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c0575d1d-500e-47d7-b295-d58875e5a242-crio-socket\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:19.536494 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.536476    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0575d1d-500e-47d7-b295-d58875e5a242-data-volume\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:19.547317 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.547287    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k5h6\" (UniqueName: \"kubernetes.io/projected/c0575d1d-500e-47d7-b295-d58875e5a242-kube-api-access-4k5h6\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:19.847103 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.847078    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:07:19.847558 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.847541    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/0.log"
Jul 24 17:07:19.847628 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.847577    2572 generic.go:356] "Generic (PLEG): container finished" podID="a7820ccc-4ae6-492b-824f-62b30aaaf133" containerID="d32f5722e850bbc7c07803e71710699246b9b4a7f763834954d096201bdd8f08" exitCode=255
Jul 24 17:07:19.847692 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.847672    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8" event={"ID":"a7820ccc-4ae6-492b-824f-62b30aaaf133","Type":"ContainerDied","Data":"d32f5722e850bbc7c07803e71710699246b9b4a7f763834954d096201bdd8f08"}
Jul 24 17:07:19.847750 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.847721    2572 scope.go:117] "RemoveContainer" containerID="fde764a3147c76af02fd0370cf1368cdd50bea542f9bb6606ed4e26ec4191316"
Jul 24 17:07:19.847970 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:19.847898    2572 scope.go:117] "RemoveContainer" containerID="d32f5722e850bbc7c07803e71710699246b9b4a7f763834954d096201bdd8f08"
Jul 24 17:07:19.848112 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:19.848091    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-sjgf8_openshift-console-operator(a7820ccc-4ae6-492b-824f-62b30aaaf133)\"" pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8" podUID="a7820ccc-4ae6-492b-824f-62b30aaaf133"
Jul 24 17:07:20.040452 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:20.040415    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0575d1d-500e-47d7-b295-d58875e5a242-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:20.040595 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:20.040526    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0575d1d-500e-47d7-b295-d58875e5a242-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:20.040595 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:20.040557    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:07:20.040682 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:20.040621    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0575d1d-500e-47d7-b295-d58875e5a242-insights-runtime-extractor-tls podName:c0575d1d-500e-47d7-b295-d58875e5a242 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:21.040605459 +0000 UTC m=+258.474821004 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0575d1d-500e-47d7-b295-d58875e5a242-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sgb5b" (UID: "c0575d1d-500e-47d7-b295-d58875e5a242") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:07:20.040682 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:20.040646    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:07:20.040792 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:20.040692    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0575d1d-500e-47d7-b295-d58875e5a242-kube-rbac-proxy-cm podName:c0575d1d-500e-47d7-b295-d58875e5a242 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:21.04067827 +0000 UTC m=+258.474893820 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c0575d1d-500e-47d7-b295-d58875e5a242-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sgb5b" (UID: "c0575d1d-500e-47d7-b295-d58875e5a242") : configmap "kube-rbac-proxy" not found
Jul 24 17:07:20.432549 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:20.432516    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-wwwb7"]
Jul 24 17:07:20.435311 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:20.435288    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wwwb7"
Jul 24 17:07:20.437869 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:20.437680    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 24 17:07:20.437984 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:20.437871    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-b9fkz\""
Jul 24 17:07:20.438119 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:20.438089    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 24 17:07:20.444007 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:20.443692    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-wwwb7"]
Jul 24 17:07:20.544162 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:20.544135    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-492dz\" (UniqueName: \"kubernetes.io/projected/d21277aa-8e88-4163-8ebb-46705de9e3f0-kube-api-access-492dz\") pod \"migrator-6865c9967-wwwb7\" (UID: \"d21277aa-8e88-4163-8ebb-46705de9e3f0\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wwwb7"
Jul 24 17:07:20.644867 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:20.644828    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-492dz\" (UniqueName: \"kubernetes.io/projected/d21277aa-8e88-4163-8ebb-46705de9e3f0-kube-api-access-492dz\") pod \"migrator-6865c9967-wwwb7\" (UID: \"d21277aa-8e88-4163-8ebb-46705de9e3f0\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wwwb7"
Jul 24 17:07:20.654504 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:20.654478    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-492dz\" (UniqueName: \"kubernetes.io/projected/d21277aa-8e88-4163-8ebb-46705de9e3f0-kube-api-access-492dz\") pod \"migrator-6865c9967-wwwb7\" (UID: \"d21277aa-8e88-4163-8ebb-46705de9e3f0\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wwwb7"
Jul 24 17:07:20.746094 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:20.746014    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wwwb7"
Jul 24 17:07:20.852206 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:20.852183    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:07:20.852671 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:20.852594    2572 scope.go:117] "RemoveContainer" containerID="d32f5722e850bbc7c07803e71710699246b9b4a7f763834954d096201bdd8f08"
Jul 24 17:07:20.852803 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:20.852780    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-sjgf8_openshift-console-operator(a7820ccc-4ae6-492b-824f-62b30aaaf133)\"" pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8" podUID="a7820ccc-4ae6-492b-824f-62b30aaaf133"
Jul 24 17:07:20.871938 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:20.871915    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-wwwb7"]
Jul 24 17:07:20.875365 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:07:20.875342    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21277aa_8e88_4163_8ebb_46705de9e3f0.slice/crio-cb71f19b7e26706855d629e9c443284258463e8f1f63c8b72cd651ec726ecc4e WatchSource:0}: Error finding container cb71f19b7e26706855d629e9c443284258463e8f1f63c8b72cd651ec726ecc4e: Status 404 returned error can't find the container with id cb71f19b7e26706855d629e9c443284258463e8f1f63c8b72cd651ec726ecc4e
Jul 24 17:07:21.049377 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:21.049289    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0575d1d-500e-47d7-b295-d58875e5a242-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:21.049377 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:21.049370    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0575d1d-500e-47d7-b295-d58875e5a242-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:21.049556 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:21.049436    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:07:21.049556 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:21.049474    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:07:21.049556 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:21.049509    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0575d1d-500e-47d7-b295-d58875e5a242-kube-rbac-proxy-cm podName:c0575d1d-500e-47d7-b295-d58875e5a242 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:23.049493932 +0000 UTC m=+260.483709478 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c0575d1d-500e-47d7-b295-d58875e5a242-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sgb5b" (UID: "c0575d1d-500e-47d7-b295-d58875e5a242") : configmap "kube-rbac-proxy" not found
Jul 24 17:07:21.049556 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:21.049526    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0575d1d-500e-47d7-b295-d58875e5a242-insights-runtime-extractor-tls podName:c0575d1d-500e-47d7-b295-d58875e5a242 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:23.049515615 +0000 UTC m=+260.483731160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0575d1d-500e-47d7-b295-d58875e5a242-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sgb5b" (UID: "c0575d1d-500e-47d7-b295-d58875e5a242") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:07:21.336878 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:21.336804    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c6q8k_db2edea8-70c4-4ab5-898c-e0db3a2dacbe/dns-node-resolver/0.log"
Jul 24 17:07:21.856958 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:21.856922    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wwwb7" event={"ID":"d21277aa-8e88-4163-8ebb-46705de9e3f0","Type":"ContainerStarted","Data":"cb71f19b7e26706855d629e9c443284258463e8f1f63c8b72cd651ec726ecc4e"}
Jul 24 17:07:22.133977 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:22.133918    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cc5xn_8ff2442b-1e6e-4d7e-9e4b-289e4b74517a/node-ca/0.log"
Jul 24 17:07:22.861740 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:22.861709    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wwwb7" event={"ID":"d21277aa-8e88-4163-8ebb-46705de9e3f0","Type":"ContainerStarted","Data":"3b13a39b787b07ead05dcceb09f00b51fbf8c10699d75ea386881ee2129a4746"}
Jul 24 17:07:22.862122 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:22.861760    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wwwb7" event={"ID":"d21277aa-8e88-4163-8ebb-46705de9e3f0","Type":"ContainerStarted","Data":"01661d9732401d15f7aad7acb7f18fa29ba9eae6be318aabecd627be3b87be70"}
Jul 24 17:07:22.878091 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:22.878039    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wwwb7" podStartSLOduration=1.768656443 podStartE2EDuration="2.878025883s" totalImagesPullingTime="1.10936944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:22.876605008 +0000 UTC m=+260.310820584" watchObservedRunningTime="2026-07-24 17:07:22.878025883 +0000 UTC m=+260.312241491"
Jul 24 17:07:23.066325 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:23.066297    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0575d1d-500e-47d7-b295-d58875e5a242-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:23.066508 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:23.066354    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-metrics-certs\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:23.066508 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:23.066373    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-service-ca-bundle\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:23.066508 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:23.066393    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0575d1d-500e-47d7-b295-d58875e5a242-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:23.066508 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:23.066462    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:07:23.066508 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:23.066474    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:07:23.066508 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:23.066487    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-service-ca-bundle podName:d6ad8405-43ea-45ca-8735-4ca4e9cc3350 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:31.066471485 +0000 UTC m=+268.500687033 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-service-ca-bundle") pod "router-default-b8b6894cc-sf8bk" (UID: "d6ad8405-43ea-45ca-8735-4ca4e9cc3350") : configmap references non-existent config key: service-ca.crt
Jul 24 17:07:23.066715 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:23.066511    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0575d1d-500e-47d7-b295-d58875e5a242-insights-runtime-extractor-tls podName:c0575d1d-500e-47d7-b295-d58875e5a242 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:27.066499479 +0000 UTC m=+264.500715024 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0575d1d-500e-47d7-b295-d58875e5a242-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sgb5b" (UID: "c0575d1d-500e-47d7-b295-d58875e5a242") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:07:23.066715 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:23.066525    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0575d1d-500e-47d7-b295-d58875e5a242-kube-rbac-proxy-cm podName:c0575d1d-500e-47d7-b295-d58875e5a242 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:27.066519382 +0000 UTC m=+264.500734926 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c0575d1d-500e-47d7-b295-d58875e5a242-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sgb5b" (UID: "c0575d1d-500e-47d7-b295-d58875e5a242") : configmap "kube-rbac-proxy" not found
Jul 24 17:07:23.066715 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:23.066462    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 17:07:23.066715 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:23.066554    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-metrics-certs podName:d6ad8405-43ea-45ca-8735-4ca4e9cc3350 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:31.066548459 +0000 UTC m=+268.500764006 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-metrics-certs") pod "router-default-b8b6894cc-sf8bk" (UID: "d6ad8405-43ea-45ca-8735-4ca4e9cc3350") : secret "router-metrics-certs-default" not found
Jul 24 17:07:23.333920 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:23.333808    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x9wf4_c0d0a73d-6ae3-4e09-8853-510f01311e43/serve-healthcheck-canary/0.log"
Jul 24 17:07:25.614175 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:25.614143    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8"
Jul 24 17:07:25.614551 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:25.614203    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8"
Jul 24 17:07:25.614551 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:25.614545    2572 scope.go:117] "RemoveContainer" containerID="d32f5722e850bbc7c07803e71710699246b9b4a7f763834954d096201bdd8f08"
Jul 24 17:07:25.614693 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:25.614675    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-sjgf8_openshift-console-operator(a7820ccc-4ae6-492b-824f-62b30aaaf133)\"" pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8" podUID="a7820ccc-4ae6-492b-824f-62b30aaaf133"
Jul 24 17:07:27.098941 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:27.098907    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0575d1d-500e-47d7-b295-d58875e5a242-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:27.099409 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:27.099007    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0575d1d-500e-47d7-b295-d58875e5a242-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:27.099409 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:27.099043    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:07:27.099409 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:27.099119    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0575d1d-500e-47d7-b295-d58875e5a242-insights-runtime-extractor-tls podName:c0575d1d-500e-47d7-b295-d58875e5a242 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:35.099100585 +0000 UTC m=+272.533316133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0575d1d-500e-47d7-b295-d58875e5a242-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sgb5b" (UID: "c0575d1d-500e-47d7-b295-d58875e5a242") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:07:27.099409 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:27.099117    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:07:27.099409 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:27.099179    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0575d1d-500e-47d7-b295-d58875e5a242-kube-rbac-proxy-cm podName:c0575d1d-500e-47d7-b295-d58875e5a242 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:35.099165638 +0000 UTC m=+272.533381183 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c0575d1d-500e-47d7-b295-d58875e5a242-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sgb5b" (UID: "c0575d1d-500e-47d7-b295-d58875e5a242") : configmap "kube-rbac-proxy" not found
Jul 24 17:07:31.134723 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:31.134666    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-service-ca-bundle\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:31.135125 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:31.134819    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-metrics-certs\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:31.135310 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:31.135291    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-service-ca-bundle\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:31.137260 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:31.137223    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6ad8405-43ea-45ca-8735-4ca4e9cc3350-metrics-certs\") pod \"router-default-b8b6894cc-sf8bk\" (UID: \"d6ad8405-43ea-45ca-8735-4ca4e9cc3350\") " pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:31.207655 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:31.207616    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:31.334786 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:31.334746    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-b8b6894cc-sf8bk"]
Jul 24 17:07:31.337367 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:07:31.337338    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6ad8405_43ea_45ca_8735_4ca4e9cc3350.slice/crio-b5961d9c5538232f558c989528dafcb1a8729a94aa434c88906b4ef304aceaec WatchSource:0}: Error finding container b5961d9c5538232f558c989528dafcb1a8729a94aa434c88906b4ef304aceaec: Status 404 returned error can't find the container with id b5961d9c5538232f558c989528dafcb1a8729a94aa434c88906b4ef304aceaec
Jul 24 17:07:31.891196 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:31.891160    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-b8b6894cc-sf8bk" event={"ID":"d6ad8405-43ea-45ca-8735-4ca4e9cc3350","Type":"ContainerStarted","Data":"2454140b642d74f6d4ae4502a67765c632e86d0b506c52e7b5235e4dd7f522db"}
Jul 24 17:07:31.891419 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:31.891263    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-b8b6894cc-sf8bk" event={"ID":"d6ad8405-43ea-45ca-8735-4ca4e9cc3350","Type":"ContainerStarted","Data":"b5961d9c5538232f558c989528dafcb1a8729a94aa434c88906b4ef304aceaec"}
Jul 24 17:07:31.910391 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:31.910334    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-b8b6894cc-sf8bk" podStartSLOduration=16.910313112 podStartE2EDuration="16.910313112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:31.90914667 +0000 UTC m=+269.343362239" watchObservedRunningTime="2026-07-24 17:07:31.910313112 +0000 UTC m=+269.344528681"
Jul 24 17:07:32.208788 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:32.208699    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:32.211195 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:32.211161    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:32.895002 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:32.894975    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:32.896212 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:32.896194    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-b8b6894cc-sf8bk"
Jul 24 17:07:35.171620 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:35.171567    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0575d1d-500e-47d7-b295-d58875e5a242-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:35.172017 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:35.171671    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0575d1d-500e-47d7-b295-d58875e5a242-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:35.172113 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:35.172094    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0575d1d-500e-47d7-b295-d58875e5a242-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:35.173959 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:35.173941    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0575d1d-500e-47d7-b295-d58875e5a242-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sgb5b\" (UID: \"c0575d1d-500e-47d7-b295-d58875e5a242\") " pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:35.252528 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:35.252494    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sgb5b"
Jul 24 17:07:35.383290 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:35.383259    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sgb5b"]
Jul 24 17:07:35.386270 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:07:35.386224    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0575d1d_500e_47d7_b295_d58875e5a242.slice/crio-8d455facc57c66fe37753610ce619edfd8af3d021bb6121909e85ed4a310dece WatchSource:0}: Error finding container 8d455facc57c66fe37753610ce619edfd8af3d021bb6121909e85ed4a310dece: Status 404 returned error can't find the container with id 8d455facc57c66fe37753610ce619edfd8af3d021bb6121909e85ed4a310dece
Jul 24 17:07:35.906805 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:35.906764    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sgb5b" event={"ID":"c0575d1d-500e-47d7-b295-d58875e5a242","Type":"ContainerStarted","Data":"8d455facc57c66fe37753610ce619edfd8af3d021bb6121909e85ed4a310dece"}
Jul 24 17:07:39.080339 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:39.080294    2572 scope.go:117] "RemoveContainer" containerID="d32f5722e850bbc7c07803e71710699246b9b4a7f763834954d096201bdd8f08"
Jul 24 17:07:40.926287 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:40.926254    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:07:40.926761 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:40.926359    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8" event={"ID":"a7820ccc-4ae6-492b-824f-62b30aaaf133","Type":"ContainerStarted","Data":"4220b8a2efe84c7aec4cf18d2ff59db4111c7e1051e2b3a3773f8b11d0711af4"}
Jul 24 17:07:40.926761 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:40.926656    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8"
Jul 24 17:07:40.929073 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:40.929043    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sgb5b" event={"ID":"c0575d1d-500e-47d7-b295-d58875e5a242","Type":"ContainerStarted","Data":"bba71135e68f9011f1cc5573aa39464d6cd5154cf49634237d36babd833fd68c"}
Jul 24 17:07:40.933020 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:40.932997    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8"
Jul 24 17:07:40.942600 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:40.942514    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-sjgf8" podStartSLOduration=23.351223575 podStartE2EDuration="25.942499145s" totalImagesPullingTime="2.59127557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:40.942337898 +0000 UTC m=+278.376553465" watchObservedRunningTime="2026-07-24 17:07:40.942499145 +0000 UTC m=+278.376714714"
Jul 24 17:07:43.941748 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:43.941713    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sgb5b" event={"ID":"c0575d1d-500e-47d7-b295-d58875e5a242","Type":"ContainerStarted","Data":"261d2536acbb4a22bf63b2fb4f07a87d7e746a66504d64dafd8d6ce70e41954d"}
Jul 24 17:07:44.597083 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:44.597031    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-q8g77" podUID="63e25ce3-9fe4-4a91-a85c-2cf9bce6c306"
Jul 24 17:07:44.597083 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:44.597035    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-78998df997-xrrv4" podUID="42e2f9ae-322f-4796-8440-bf12d50a8283"
Jul 24 17:07:44.597357 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:44.597047    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg" podUID="3f3ba1e9-16df-42fc-801b-822202b455d8"
Jul 24 17:07:44.945343 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:44.945309    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg"
Jul 24 17:07:44.945803 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:44.945437    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q8g77"
Jul 24 17:07:44.945803 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:44.945479    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:07:47.140562 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.140533    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-779cb4695b-jzv5t"]
Jul 24 17:07:47.167917 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.167889    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-779cb4695b-jzv5t"]
Jul 24 17:07:47.168250 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.167980    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:07:47.170705 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.170679    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 24 17:07:47.170822 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.170680    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 24 17:07:47.171594 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.171572    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 24 17:07:47.171696 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.171631    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 24 17:07:47.172084 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.171914    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 24 17:07:47.172084 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.171950    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 24 17:07:47.172084 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.171979    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hjbgn\""
Jul 24 17:07:47.172084 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.172022    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 24 17:07:47.181955 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.181932    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwrvr\" (UniqueName: \"kubernetes.io/projected/839bf379-6c8c-413c-b406-4b438e1d3f55-kube-api-access-hwrvr\") pod \"console-779cb4695b-jzv5t\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") " pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:07:47.182060 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.182022    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/839bf379-6c8c-413c-b406-4b438e1d3f55-console-config\") pod \"console-779cb4695b-jzv5t\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") " pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:07:47.182060 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.182054    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/839bf379-6c8c-413c-b406-4b438e1d3f55-console-serving-cert\") pod \"console-779cb4695b-jzv5t\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") " pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:07:47.182165 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.182091    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/839bf379-6c8c-413c-b406-4b438e1d3f55-oauth-serving-cert\") pod \"console-779cb4695b-jzv5t\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") " pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:07:47.182165 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.182126    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/839bf379-6c8c-413c-b406-4b438e1d3f55-service-ca\") pod \"console-779cb4695b-jzv5t\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") " pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:07:47.182165 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.182145    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/839bf379-6c8c-413c-b406-4b438e1d3f55-console-oauth-config\") pod \"console-779cb4695b-jzv5t\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") " pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:07:47.282721 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.282684    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/839bf379-6c8c-413c-b406-4b438e1d3f55-console-config\") pod \"console-779cb4695b-jzv5t\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") " pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:07:47.282721 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.282719    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/839bf379-6c8c-413c-b406-4b438e1d3f55-console-serving-cert\") pod \"console-779cb4695b-jzv5t\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") " pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:07:47.282891 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.282757    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/839bf379-6c8c-413c-b406-4b438e1d3f55-oauth-serving-cert\") pod \"console-779cb4695b-jzv5t\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") " pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:07:47.282891 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.282786    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/839bf379-6c8c-413c-b406-4b438e1d3f55-service-ca\") pod \"console-779cb4695b-jzv5t\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") " pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:07:47.282891 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.282808    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/839bf379-6c8c-413c-b406-4b438e1d3f55-console-oauth-config\") pod \"console-779cb4695b-jzv5t\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") " pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:07:47.282891 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.282843    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwrvr\" (UniqueName: \"kubernetes.io/projected/839bf379-6c8c-413c-b406-4b438e1d3f55-kube-api-access-hwrvr\") pod \"console-779cb4695b-jzv5t\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") " pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:07:47.283558 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.283482    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/839bf379-6c8c-413c-b406-4b438e1d3f55-oauth-serving-cert\") pod \"console-779cb4695b-jzv5t\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") " pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:07:47.283558 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.283500    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/839bf379-6c8c-413c-b406-4b438e1d3f55-service-ca\") pod \"console-779cb4695b-jzv5t\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") " pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:07:47.283558 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.283500    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/839bf379-6c8c-413c-b406-4b438e1d3f55-console-config\") pod \"console-779cb4695b-jzv5t\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") " pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:07:47.285267 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.285222    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/839bf379-6c8c-413c-b406-4b438e1d3f55-console-serving-cert\") pod \"console-779cb4695b-jzv5t\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") " pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:07:47.285267 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.285227    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/839bf379-6c8c-413c-b406-4b438e1d3f55-console-oauth-config\") pod \"console-779cb4695b-jzv5t\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") " pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:07:47.291322 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.291294    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwrvr\" (UniqueName: \"kubernetes.io/projected/839bf379-6c8c-413c-b406-4b438e1d3f55-kube-api-access-hwrvr\") pod \"console-779cb4695b-jzv5t\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") " pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:07:47.478508 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.478428    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:07:47.604953 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.604932    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-779cb4695b-jzv5t"]
Jul 24 17:07:47.607207 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:07:47.607188    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod839bf379_6c8c_413c_b406_4b438e1d3f55.slice/crio-905f1730f95f7a968bed560cee057ad9d075a0f41b1dd267362b16e4a579cf86 WatchSource:0}: Error finding container 905f1730f95f7a968bed560cee057ad9d075a0f41b1dd267362b16e4a579cf86: Status 404 returned error can't find the container with id 905f1730f95f7a968bed560cee057ad9d075a0f41b1dd267362b16e4a579cf86
Jul 24 17:07:47.961106 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.961050    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sgb5b" event={"ID":"c0575d1d-500e-47d7-b295-d58875e5a242","Type":"ContainerStarted","Data":"203cac08b853d7ec05efbcca28a16aa9058865a257c990e25c3268dc9b1670c1"}
Jul 24 17:07:47.962347 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.962313    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-779cb4695b-jzv5t" event={"ID":"839bf379-6c8c-413c-b406-4b438e1d3f55","Type":"ContainerStarted","Data":"905f1730f95f7a968bed560cee057ad9d075a0f41b1dd267362b16e4a579cf86"}
Jul 24 17:07:47.977227 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.977181    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sgb5b" podStartSLOduration=17.227068326 podStartE2EDuration="28.977164369s" totalImagesPullingTime="11.750096043s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:07:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:47.976611548 +0000 UTC m=+285.410827114" watchObservedRunningTime="2026-07-24 17:07:47.977164369 +0000 UTC m=+285.411379937"
Jul 24 17:07:47.989417 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.989392    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls\") pod \"dns-default-q8g77\" (UID: \"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306\") " pod="openshift-dns/dns-default-q8g77"
Jul 24 17:07:47.989540 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.989451    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-d9jzg\" (UID: \"3f3ba1e9-16df-42fc-801b-822202b455d8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg"
Jul 24 17:07:47.989619 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.989601    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:07:47.991906 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.991882    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63e25ce3-9fe4-4a91-a85c-2cf9bce6c306-metrics-tls\") pod \"dns-default-q8g77\" (UID: \"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306\") " pod="openshift-dns/dns-default-q8g77"
Jul 24 17:07:47.992067 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.992050    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f3ba1e9-16df-42fc-801b-822202b455d8-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-d9jzg\" (UID: \"3f3ba1e9-16df-42fc-801b-822202b455d8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg"
Jul 24 17:07:47.992220 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:47.992203    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls\") pod \"image-registry-78998df997-xrrv4\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") " pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:07:48.248773 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:48.248665    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-57f2l\""
Jul 24 17:07:48.248773 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:48.248736    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pst72\""
Jul 24 17:07:48.249387 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:48.249369    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-sbg9g\""
Jul 24 17:07:48.256214 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:48.256175    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg"
Jul 24 17:07:48.256214 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:48.256201    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:07:48.256411 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:48.256302    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q8g77"
Jul 24 17:07:48.465000 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:48.464920    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78998df997-xrrv4"]
Jul 24 17:07:48.475598 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:48.475571    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg"]
Jul 24 17:07:48.480800 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:07:48.480768    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3ba1e9_16df_42fc_801b_822202b455d8.slice/crio-cadd5a4ab8abc474c83a8c5d6f0d6ae1520af2bd1f1781de36a8a493703fc8f2 WatchSource:0}: Error finding container cadd5a4ab8abc474c83a8c5d6f0d6ae1520af2bd1f1781de36a8a493703fc8f2: Status 404 returned error can't find the container with id cadd5a4ab8abc474c83a8c5d6f0d6ae1520af2bd1f1781de36a8a493703fc8f2
Jul 24 17:07:48.502072 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:48.502012    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q8g77"]
Jul 24 17:07:48.512346 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:07:48.512318    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63e25ce3_9fe4_4a91_a85c_2cf9bce6c306.slice/crio-700e11ef3c5ce300de0b2cd9effb544b32e35091315db41ad49d68affbe115bd WatchSource:0}: Error finding container 700e11ef3c5ce300de0b2cd9effb544b32e35091315db41ad49d68affbe115bd: Status 404 returned error can't find the container with id 700e11ef3c5ce300de0b2cd9effb544b32e35091315db41ad49d68affbe115bd
Jul 24 17:07:48.968166 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:48.968076    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q8g77" event={"ID":"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306","Type":"ContainerStarted","Data":"700e11ef3c5ce300de0b2cd9effb544b32e35091315db41ad49d68affbe115bd"}
Jul 24 17:07:48.969736 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:48.969664    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg" event={"ID":"3f3ba1e9-16df-42fc-801b-822202b455d8","Type":"ContainerStarted","Data":"cadd5a4ab8abc474c83a8c5d6f0d6ae1520af2bd1f1781de36a8a493703fc8f2"}
Jul 24 17:07:48.971613 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:48.971589    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78998df997-xrrv4" event={"ID":"42e2f9ae-322f-4796-8440-bf12d50a8283","Type":"ContainerStarted","Data":"883fbf9a09d605ce0c5a1e1751fe04454fab31b94b7973ece2172a6b621d52ef"}
Jul 24 17:07:48.971724 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:48.971634    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78998df997-xrrv4" event={"ID":"42e2f9ae-322f-4796-8440-bf12d50a8283","Type":"ContainerStarted","Data":"1f7e97d07da4fbaa94708ff94c7fd87c4b93d2793ffbd90563fbf32a8c38b159"}
Jul 24 17:07:48.971991 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:48.971863    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:07:48.991893 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:48.991837    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78998df997-xrrv4" podStartSLOduration=285.991819828 podStartE2EDuration="4m45.991819828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:03:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:48.990735322 +0000 UTC m=+286.424950905" watchObservedRunningTime="2026-07-24 17:07:48.991819828 +0000 UTC m=+286.426035395"
Jul 24 17:07:51.984188 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:51.984146    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-779cb4695b-jzv5t" event={"ID":"839bf379-6c8c-413c-b406-4b438e1d3f55","Type":"ContainerStarted","Data":"b9fc72a0cb4cca3ab3462f7593c9ca83f877416eeab580ae8480f99b6c329609"}
Jul 24 17:07:51.985913 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:51.985890    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q8g77" event={"ID":"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306","Type":"ContainerStarted","Data":"441768309eb559860b5bfd1a2a663f9f49a8d924f342c74c9e9a0e5f69dd6e71"}
Jul 24 17:07:51.986027 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:51.985929    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q8g77" event={"ID":"63e25ce3-9fe4-4a91-a85c-2cf9bce6c306","Type":"ContainerStarted","Data":"def740b5dc11e1432f2a7c494142bed4ec868a7ac6b464dc146c01adc5624909"}
Jul 24 17:07:51.986072 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:51.986030    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-q8g77"
Jul 24 17:07:51.987314 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:51.987294    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg" event={"ID":"3f3ba1e9-16df-42fc-801b-822202b455d8","Type":"ContainerStarted","Data":"4caba744e6c36af16bcd1d0414c7d9f88c0c28bddf72091052228bb01bf0e712"}
Jul 24 17:07:52.010735 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:52.010695    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-779cb4695b-jzv5t" podStartSLOduration=1.074935568 podStartE2EDuration="5.010680797s" totalImagesPullingTime="3.935745229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:52.009403519 +0000 UTC m=+289.443619085" watchObservedRunningTime="2026-07-24 17:07:52.010680797 +0000 UTC m=+289.444896363"
Jul 24 17:07:52.078840 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:52.078791    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-d9jzg" podStartSLOduration=277.019229085 podStartE2EDuration="4m40.078769152s" totalImagesPullingTime="3.059540067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:03:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:52.042528005 +0000 UTC m=+289.476743572" watchObservedRunningTime="2026-07-24 17:07:52.078769152 +0000 UTC m=+289.512984720"
Jul 24 17:07:52.079223 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:52.079194    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-q8g77" podStartSLOduration=252.044086411 podStartE2EDuration="4m15.079184583s" totalImagesPullingTime="3.035098172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:52.078953977 +0000 UTC m=+289.513169533" watchObservedRunningTime="2026-07-24 17:07:52.079184583 +0000 UTC m=+289.513400149"
Jul 24 17:07:57.478573 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.478539    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:07:57.478962 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.478615    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:07:57.479977 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.479952    2572 patch_prober.go:28] interesting pod/console-779cb4695b-jzv5t container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.17:8443/health\": dial tcp 10.132.0.17:8443: connect: connection refused" start-of-body=
Jul 24 17:07:57.480086 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.480000    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-779cb4695b-jzv5t" podUID="839bf379-6c8c-413c-b406-4b438e1d3f55" containerName="console" probeResult="failure" output="Get \"https://10.132.0.17:8443/health\": dial tcp 10.132.0.17:8443: connect: connection refused"
Jul 24 17:07:57.610270 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.610227    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5c6vr"]
Jul 24 17:07:57.613177 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.613160    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.615797 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.615766    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 17:07:57.616007 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.615986    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 17:07:57.616193 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.616175    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dktwt\""
Jul 24 17:07:57.617152 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.617135    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 17:07:57.617279 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.617168    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 17:07:57.617279 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.617170    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 17:07:57.617279 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.617134    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 17:07:57.669922 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.669893    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf2f99c8-82f2-4859-8330-c504b241f19f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.670072 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.669946    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf2f99c8-82f2-4859-8330-c504b241f19f-root\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.670072 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.670002    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf2f99c8-82f2-4859-8330-c504b241f19f-sys\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.670072 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.670029    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf2f99c8-82f2-4859-8330-c504b241f19f-node-exporter-wtmp\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.670217 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.670079    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf2f99c8-82f2-4859-8330-c504b241f19f-node-exporter-accelerators-collector-config\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.670217 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.670110    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkd8d\" (UniqueName: \"kubernetes.io/projected/cf2f99c8-82f2-4859-8330-c504b241f19f-kube-api-access-zkd8d\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.670217 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.670147    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf2f99c8-82f2-4859-8330-c504b241f19f-metrics-client-ca\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.670217 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.670207    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf2f99c8-82f2-4859-8330-c504b241f19f-node-exporter-textfile\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.670390 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.670261    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf2f99c8-82f2-4859-8330-c504b241f19f-node-exporter-tls\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.771192 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.771104    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf2f99c8-82f2-4859-8330-c504b241f19f-sys\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.771192 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.771144    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf2f99c8-82f2-4859-8330-c504b241f19f-node-exporter-wtmp\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.771192 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.771176    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf2f99c8-82f2-4859-8330-c504b241f19f-node-exporter-accelerators-collector-config\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.771464 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.771204    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkd8d\" (UniqueName: \"kubernetes.io/projected/cf2f99c8-82f2-4859-8330-c504b241f19f-kube-api-access-zkd8d\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.771464 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.771227    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf2f99c8-82f2-4859-8330-c504b241f19f-sys\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.771464 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.771258    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf2f99c8-82f2-4859-8330-c504b241f19f-metrics-client-ca\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.771464 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.771319    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf2f99c8-82f2-4859-8330-c504b241f19f-node-exporter-wtmp\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.771464 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.771341    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf2f99c8-82f2-4859-8330-c504b241f19f-node-exporter-textfile\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.771464 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.771372    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf2f99c8-82f2-4859-8330-c504b241f19f-node-exporter-tls\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.771464 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.771404    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf2f99c8-82f2-4859-8330-c504b241f19f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.771791 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:57.771485    2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 24 17:07:57.771791 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:57.771547    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf2f99c8-82f2-4859-8330-c504b241f19f-node-exporter-tls podName:cf2f99c8-82f2-4859-8330-c504b241f19f nodeName:}" failed. No retries permitted until 2026-07-24 17:07:58.271529961 +0000 UTC m=+295.705745506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/cf2f99c8-82f2-4859-8330-c504b241f19f-node-exporter-tls") pod "node-exporter-5c6vr" (UID: "cf2f99c8-82f2-4859-8330-c504b241f19f") : secret "node-exporter-tls" not found
Jul 24 17:07:57.771791 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.771578    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf2f99c8-82f2-4859-8330-c504b241f19f-root\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.771791 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.771653    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf2f99c8-82f2-4859-8330-c504b241f19f-root\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.771791 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.771695    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf2f99c8-82f2-4859-8330-c504b241f19f-node-exporter-textfile\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.772018 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.771824    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf2f99c8-82f2-4859-8330-c504b241f19f-node-exporter-accelerators-collector-config\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.772018 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.771900    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf2f99c8-82f2-4859-8330-c504b241f19f-metrics-client-ca\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.773768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.773752    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf2f99c8-82f2-4859-8330-c504b241f19f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:57.780177 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:57.780156    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkd8d\" (UniqueName: \"kubernetes.io/projected/cf2f99c8-82f2-4859-8330-c504b241f19f-kube-api-access-zkd8d\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:58.080670 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:58.080589    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-td8qt" podUID="ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b"
Jul 24 17:07:58.275951 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:58.275918    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf2f99c8-82f2-4859-8330-c504b241f19f-node-exporter-tls\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:58.276123 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:58.276024    2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 24 17:07:58.276123 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:07:58.276072    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf2f99c8-82f2-4859-8330-c504b241f19f-node-exporter-tls podName:cf2f99c8-82f2-4859-8330-c504b241f19f nodeName:}" failed. No retries permitted until 2026-07-24 17:07:59.276060153 +0000 UTC m=+296.710275698 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/cf2f99c8-82f2-4859-8330-c504b241f19f-node-exporter-tls") pod "node-exporter-5c6vr" (UID: "cf2f99c8-82f2-4859-8330-c504b241f19f") : secret "node-exporter-tls" not found
Jul 24 17:07:59.284718 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:59.284685    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf2f99c8-82f2-4859-8330-c504b241f19f-node-exporter-tls\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:59.287041 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:59.287022    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf2f99c8-82f2-4859-8330-c504b241f19f-node-exporter-tls\") pod \"node-exporter-5c6vr\" (UID: \"cf2f99c8-82f2-4859-8330-c504b241f19f\") " pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:59.423190 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:07:59.423147    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5c6vr"
Jul 24 17:07:59.433394 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:07:59.433371    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf2f99c8_82f2_4859_8330_c504b241f19f.slice/crio-93fb13f1d4c0769ca13b3ad5dc78c2d3edb828d6a913d229a4f39abf7e838e03 WatchSource:0}: Error finding container 93fb13f1d4c0769ca13b3ad5dc78c2d3edb828d6a913d229a4f39abf7e838e03: Status 404 returned error can't find the container with id 93fb13f1d4c0769ca13b3ad5dc78c2d3edb828d6a913d229a4f39abf7e838e03
Jul 24 17:08:00.015153 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:00.015117    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5c6vr" event={"ID":"cf2f99c8-82f2-4859-8330-c504b241f19f","Type":"ContainerStarted","Data":"93fb13f1d4c0769ca13b3ad5dc78c2d3edb828d6a913d229a4f39abf7e838e03"}
Jul 24 17:08:01.019969 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:01.019935    2572 generic.go:356] "Generic (PLEG): container finished" podID="cf2f99c8-82f2-4859-8330-c504b241f19f" containerID="238280e50ea33835b300c24e521834507fe7c509d6eae1b7955b9d65691bcab9" exitCode=0
Jul 24 17:08:01.020364 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:01.019981    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5c6vr" event={"ID":"cf2f99c8-82f2-4859-8330-c504b241f19f","Type":"ContainerDied","Data":"238280e50ea33835b300c24e521834507fe7c509d6eae1b7955b9d65691bcab9"}
Jul 24 17:08:01.992710 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:01.992681    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-q8g77"
Jul 24 17:08:02.025804 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.025763    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5c6vr" event={"ID":"cf2f99c8-82f2-4859-8330-c504b241f19f","Type":"ContainerStarted","Data":"04cf2e9e50459219b1735c6120c09a7d9fdc20565f2d9921132159233d606f95"}
Jul 24 17:08:02.026288 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.025866    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5c6vr" event={"ID":"cf2f99c8-82f2-4859-8330-c504b241f19f","Type":"ContainerStarted","Data":"bc490a2a144fcbeba9a73e1e27db7c034d7b5839c16a13cc65436c4292144d28"}
Jul 24 17:08:02.046705 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.046655    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5c6vr" podStartSLOduration=4.157052663 podStartE2EDuration="5.046639077s" totalImagesPullingTime="817.97217ms" totalInitContainerRuntime="71.614244ms" isStatefulPod=true podCreationTimestamp="2026-07-24 17:07:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:08:02.045495272 +0000 UTC m=+299.479710839" watchObservedRunningTime="2026-07-24 17:08:02.046639077 +0000 UTC m=+299.480854643"
Jul 24 17:08:02.344002 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.343921    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-x62n9"]
Jul 24 17:08:02.346121 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.346098    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x62n9"
Jul 24 17:08:02.348674 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.348658    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 24 17:08:02.348757 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.348695    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-bsxfd\""
Jul 24 17:08:02.355097 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.355071    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-x62n9"]
Jul 24 17:08:02.409443 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.409403    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d3478829-1a11-4ed0-9fa2-da1e1517869c-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-x62n9\" (UID: \"d3478829-1a11-4ed0-9fa2-da1e1517869c\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x62n9"
Jul 24 17:08:02.409443 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.409449    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72xr5\" (UniqueName: \"kubernetes.io/projected/d3478829-1a11-4ed0-9fa2-da1e1517869c-kube-api-access-72xr5\") pod \"monitoring-plugin-68b7fc9574-x62n9\" (UID: \"d3478829-1a11-4ed0-9fa2-da1e1517869c\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x62n9"
Jul 24 17:08:02.510400 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.510365    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72xr5\" (UniqueName: \"kubernetes.io/projected/d3478829-1a11-4ed0-9fa2-da1e1517869c-kube-api-access-72xr5\") pod \"monitoring-plugin-68b7fc9574-x62n9\" (UID: \"d3478829-1a11-4ed0-9fa2-da1e1517869c\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x62n9"
Jul 24 17:08:02.510595 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.510459    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d3478829-1a11-4ed0-9fa2-da1e1517869c-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-x62n9\" (UID: \"d3478829-1a11-4ed0-9fa2-da1e1517869c\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x62n9"
Jul 24 17:08:02.513106 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.513082    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d3478829-1a11-4ed0-9fa2-da1e1517869c-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-x62n9\" (UID: \"d3478829-1a11-4ed0-9fa2-da1e1517869c\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x62n9"
Jul 24 17:08:02.523454 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.523429    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72xr5\" (UniqueName: \"kubernetes.io/projected/d3478829-1a11-4ed0-9fa2-da1e1517869c-kube-api-access-72xr5\") pod \"monitoring-plugin-68b7fc9574-x62n9\" (UID: \"d3478829-1a11-4ed0-9fa2-da1e1517869c\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x62n9"
Jul 24 17:08:02.565226 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.565188    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-779cb4695b-jzv5t"]
Jul 24 17:08:02.601614 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.601538    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5df8845f4c-sc4qd"]
Jul 24 17:08:02.603675 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.603658    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:02.611938 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.611910    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 24 17:08:02.617090 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.617060    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5df8845f4c-sc4qd"]
Jul 24 17:08:02.655192 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.655156    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x62n9"
Jul 24 17:08:02.711542 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.711513    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-service-ca\") pod \"console-5df8845f4c-sc4qd\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") " pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:02.711687 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.711556    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e035117b-abb4-4efa-9216-b6fdb65f2b7e-console-oauth-config\") pod \"console-5df8845f4c-sc4qd\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") " pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:02.711687 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.711628    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-oauth-serving-cert\") pod \"console-5df8845f4c-sc4qd\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") " pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:02.711687 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.711672    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-console-config\") pod \"console-5df8845f4c-sc4qd\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") " pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:02.711823 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.711726    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-trusted-ca-bundle\") pod \"console-5df8845f4c-sc4qd\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") " pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:02.711823 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.711763    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e035117b-abb4-4efa-9216-b6fdb65f2b7e-console-serving-cert\") pod \"console-5df8845f4c-sc4qd\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") " pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:02.711823 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.711796    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8cx5\" (UniqueName: \"kubernetes.io/projected/e035117b-abb4-4efa-9216-b6fdb65f2b7e-kube-api-access-q8cx5\") pod \"console-5df8845f4c-sc4qd\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") " pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:02.787859 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.787819    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-x62n9"]
Jul 24 17:08:02.790655 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:08:02.790628    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3478829_1a11_4ed0_9fa2_da1e1517869c.slice/crio-929ef4205039d647862b65647fb3ec2a71b636ed7852cc6a93309249445e6c54 WatchSource:0}: Error finding container 929ef4205039d647862b65647fb3ec2a71b636ed7852cc6a93309249445e6c54: Status 404 returned error can't find the container with id 929ef4205039d647862b65647fb3ec2a71b636ed7852cc6a93309249445e6c54
Jul 24 17:08:02.812422 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.812384    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8cx5\" (UniqueName: \"kubernetes.io/projected/e035117b-abb4-4efa-9216-b6fdb65f2b7e-kube-api-access-q8cx5\") pod \"console-5df8845f4c-sc4qd\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") " pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:02.812598 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.812446    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-service-ca\") pod \"console-5df8845f4c-sc4qd\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") " pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:02.812598 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.812469    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e035117b-abb4-4efa-9216-b6fdb65f2b7e-console-oauth-config\") pod \"console-5df8845f4c-sc4qd\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") " pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:02.812598 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.812501    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-oauth-serving-cert\") pod \"console-5df8845f4c-sc4qd\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") " pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:02.812598 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.812525    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-console-config\") pod \"console-5df8845f4c-sc4qd\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") " pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:02.812598 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.812561    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-trusted-ca-bundle\") pod \"console-5df8845f4c-sc4qd\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") " pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:02.812855 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.812597    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e035117b-abb4-4efa-9216-b6fdb65f2b7e-console-serving-cert\") pod \"console-5df8845f4c-sc4qd\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") " pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:02.813198 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.813173    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-service-ca\") pod \"console-5df8845f4c-sc4qd\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") " pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:02.813510 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.813378    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-console-config\") pod \"console-5df8845f4c-sc4qd\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") " pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:02.813510 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.813414    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-oauth-serving-cert\") pod \"console-5df8845f4c-sc4qd\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") " pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:02.813790 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.813764    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-trusted-ca-bundle\") pod \"console-5df8845f4c-sc4qd\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") " pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:02.815329 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.815286    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e035117b-abb4-4efa-9216-b6fdb65f2b7e-console-oauth-config\") pod \"console-5df8845f4c-sc4qd\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") " pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:02.816071 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.815488    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e035117b-abb4-4efa-9216-b6fdb65f2b7e-console-serving-cert\") pod \"console-5df8845f4c-sc4qd\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") " pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:02.820463 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.820437    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8cx5\" (UniqueName: \"kubernetes.io/projected/e035117b-abb4-4efa-9216-b6fdb65f2b7e-kube-api-access-q8cx5\") pod \"console-5df8845f4c-sc4qd\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") " pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:02.913098 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.913052    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:02.959556 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.959525    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:08:02.959717 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.959658    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:08:02.986484 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:02.985987    2572 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 17:08:03.031395 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:03.031352    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x62n9" event={"ID":"d3478829-1a11-4ed0-9fa2-da1e1517869c","Type":"ContainerStarted","Data":"929ef4205039d647862b65647fb3ec2a71b636ed7852cc6a93309249445e6c54"}
Jul 24 17:08:03.060343 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:03.060321    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5df8845f4c-sc4qd"]
Jul 24 17:08:03.063167 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:08:03.063139    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode035117b_abb4_4efa_9216_b6fdb65f2b7e.slice/crio-6de23ca8301c072937d0d3e821b436461a62abd5cabe8deceb2086fdb649def1 WatchSource:0}: Error finding container 6de23ca8301c072937d0d3e821b436461a62abd5cabe8deceb2086fdb649def1: Status 404 returned error can't find the container with id 6de23ca8301c072937d0d3e821b436461a62abd5cabe8deceb2086fdb649def1
Jul 24 17:08:04.037413 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:04.037368    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5df8845f4c-sc4qd" event={"ID":"e035117b-abb4-4efa-9216-b6fdb65f2b7e","Type":"ContainerStarted","Data":"5b492fed13722513fe217fdc1996d2c603068bc04a1ddfe0380193ae2bc641b0"}
Jul 24 17:08:04.037913 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:04.037441    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5df8845f4c-sc4qd" event={"ID":"e035117b-abb4-4efa-9216-b6fdb65f2b7e","Type":"ContainerStarted","Data":"6de23ca8301c072937d0d3e821b436461a62abd5cabe8deceb2086fdb649def1"}
Jul 24 17:08:04.055170 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:04.055122    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5df8845f4c-sc4qd" podStartSLOduration=2.055104943 podStartE2EDuration="2.055104943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:08:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:08:04.05364517 +0000 UTC m=+301.487860738" watchObservedRunningTime="2026-07-24 17:08:04.055104943 +0000 UTC m=+301.489320509"
Jul 24 17:08:05.042417 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:05.042375    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x62n9" event={"ID":"d3478829-1a11-4ed0-9fa2-da1e1517869c","Type":"ContainerStarted","Data":"b712742e1a06679846127fc6a03af1e07e8f00a0326ed82791cffb793d5a8f46"}
Jul 24 17:08:05.042881 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:05.042699    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x62n9"
Jul 24 17:08:05.047274 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:05.047251    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x62n9"
Jul 24 17:08:05.059369 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:05.059328    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x62n9" podStartSLOduration=1.737462613 podStartE2EDuration="3.059314438s" totalImagesPullingTime="1.321851825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:08:05.058299909 +0000 UTC m=+302.492515477" watchObservedRunningTime="2026-07-24 17:08:05.059314438 +0000 UTC m=+302.493530004"
Jul 24 17:08:08.260552 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:08.260508    2572 patch_prober.go:28] interesting pod/image-registry-78998df997-xrrv4 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 24 17:08:08.260967 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:08.260561    2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-78998df997-xrrv4" podUID="42e2f9ae-322f-4796-8440-bf12d50a8283" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:08:09.079089 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:09.079050    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:08:09.980903 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:09.980871    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:08:10.777550 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:10.777513    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78998df997-xrrv4"]
Jul 24 17:08:12.913724 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:12.913685    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:12.914143 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:12.913748    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:12.918503 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:12.918481    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:13.075824 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:13.075790    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:08:25.112328 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:25.112293    2572 generic.go:356] "Generic (PLEG): container finished" podID="0f065120-142c-45cb-bde8-c925bc9af828" containerID="e44127628574bce7d30df20198857a43acc38d71e56848d755bd88d765c1890b" exitCode=0
Jul 24 17:08:25.112328 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:25.112333    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl" event={"ID":"0f065120-142c-45cb-bde8-c925bc9af828","Type":"ContainerDied","Data":"e44127628574bce7d30df20198857a43acc38d71e56848d755bd88d765c1890b"}
Jul 24 17:08:25.112767 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:25.112613    2572 scope.go:117] "RemoveContainer" containerID="e44127628574bce7d30df20198857a43acc38d71e56848d755bd88d765c1890b"
Jul 24 17:08:26.118304 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:26.118268    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8qwdl" event={"ID":"0f065120-142c-45cb-bde8-c925bc9af828","Type":"ContainerStarted","Data":"eb025727f47ebe7f77372eececd8386945e146e7027a7e138d46b02c1c077fb2"}
Jul 24 17:08:27.584584 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:27.584543    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-779cb4695b-jzv5t" podUID="839bf379-6c8c-413c-b406-4b438e1d3f55" containerName="console" containerID="cri-o://b9fc72a0cb4cca3ab3462f7593c9ca83f877416eeab580ae8480f99b6c329609" gracePeriod=15
Jul 24 17:08:27.823128 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:27.823107    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:08:27.932787 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:27.932755    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/839bf379-6c8c-413c-b406-4b438e1d3f55-oauth-serving-cert\") pod \"839bf379-6c8c-413c-b406-4b438e1d3f55\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") "
Jul 24 17:08:27.932787 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:27.932792    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/839bf379-6c8c-413c-b406-4b438e1d3f55-service-ca\") pod \"839bf379-6c8c-413c-b406-4b438e1d3f55\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") "
Jul 24 17:08:27.933024 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:27.932845    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/839bf379-6c8c-413c-b406-4b438e1d3f55-console-config\") pod \"839bf379-6c8c-413c-b406-4b438e1d3f55\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") "
Jul 24 17:08:27.933024 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:27.932881    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/839bf379-6c8c-413c-b406-4b438e1d3f55-console-oauth-config\") pod \"839bf379-6c8c-413c-b406-4b438e1d3f55\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") "
Jul 24 17:08:27.933024 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:27.932915    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwrvr\" (UniqueName: \"kubernetes.io/projected/839bf379-6c8c-413c-b406-4b438e1d3f55-kube-api-access-hwrvr\") pod \"839bf379-6c8c-413c-b406-4b438e1d3f55\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") "
Jul 24 17:08:27.933024 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:27.932941    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/839bf379-6c8c-413c-b406-4b438e1d3f55-console-serving-cert\") pod \"839bf379-6c8c-413c-b406-4b438e1d3f55\" (UID: \"839bf379-6c8c-413c-b406-4b438e1d3f55\") "
Jul 24 17:08:27.933302 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:27.933272    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/839bf379-6c8c-413c-b406-4b438e1d3f55-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "839bf379-6c8c-413c-b406-4b438e1d3f55" (UID: "839bf379-6c8c-413c-b406-4b438e1d3f55"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:08:27.933382 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:27.933361    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/839bf379-6c8c-413c-b406-4b438e1d3f55-service-ca" (OuterVolumeSpecName: "service-ca") pod "839bf379-6c8c-413c-b406-4b438e1d3f55" (UID: "839bf379-6c8c-413c-b406-4b438e1d3f55"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:08:27.933382 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:27.933367    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/839bf379-6c8c-413c-b406-4b438e1d3f55-console-config" (OuterVolumeSpecName: "console-config") pod "839bf379-6c8c-413c-b406-4b438e1d3f55" (UID: "839bf379-6c8c-413c-b406-4b438e1d3f55"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:08:27.935461 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:27.935436    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/839bf379-6c8c-413c-b406-4b438e1d3f55-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "839bf379-6c8c-413c-b406-4b438e1d3f55" (UID: "839bf379-6c8c-413c-b406-4b438e1d3f55"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:08:27.935553 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:27.935503    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/839bf379-6c8c-413c-b406-4b438e1d3f55-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "839bf379-6c8c-413c-b406-4b438e1d3f55" (UID: "839bf379-6c8c-413c-b406-4b438e1d3f55"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:08:27.935553 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:27.935513    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/839bf379-6c8c-413c-b406-4b438e1d3f55-kube-api-access-hwrvr" (OuterVolumeSpecName: "kube-api-access-hwrvr") pod "839bf379-6c8c-413c-b406-4b438e1d3f55" (UID: "839bf379-6c8c-413c-b406-4b438e1d3f55"). InnerVolumeSpecName "kube-api-access-hwrvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:08:28.033849 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:28.033815    2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/839bf379-6c8c-413c-b406-4b438e1d3f55-console-config\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:08:28.033849 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:28.033842    2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/839bf379-6c8c-413c-b406-4b438e1d3f55-console-oauth-config\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:08:28.033849 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:28.033852    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwrvr\" (UniqueName: \"kubernetes.io/projected/839bf379-6c8c-413c-b406-4b438e1d3f55-kube-api-access-hwrvr\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:08:28.033849 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:28.033860    2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/839bf379-6c8c-413c-b406-4b438e1d3f55-console-serving-cert\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:08:28.034097 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:28.033870    2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/839bf379-6c8c-413c-b406-4b438e1d3f55-oauth-serving-cert\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:08:28.034097 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:28.033878    2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/839bf379-6c8c-413c-b406-4b438e1d3f55-service-ca\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:08:28.125797 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:28.125758    2572 generic.go:356] "Generic (PLEG): container finished" podID="839bf379-6c8c-413c-b406-4b438e1d3f55" containerID="b9fc72a0cb4cca3ab3462f7593c9ca83f877416eeab580ae8480f99b6c329609" exitCode=0
Jul 24 17:08:28.125967 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:28.125805    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-779cb4695b-jzv5t"
Jul 24 17:08:28.125967 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:28.125835    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-779cb4695b-jzv5t" event={"ID":"839bf379-6c8c-413c-b406-4b438e1d3f55","Type":"ContainerDied","Data":"b9fc72a0cb4cca3ab3462f7593c9ca83f877416eeab580ae8480f99b6c329609"}
Jul 24 17:08:28.125967 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:28.125877    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-779cb4695b-jzv5t" event={"ID":"839bf379-6c8c-413c-b406-4b438e1d3f55","Type":"ContainerDied","Data":"905f1730f95f7a968bed560cee057ad9d075a0f41b1dd267362b16e4a579cf86"}
Jul 24 17:08:28.125967 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:28.125901    2572 scope.go:117] "RemoveContainer" containerID="b9fc72a0cb4cca3ab3462f7593c9ca83f877416eeab580ae8480f99b6c329609"
Jul 24 17:08:28.134406 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:28.134387    2572 scope.go:117] "RemoveContainer" containerID="b9fc72a0cb4cca3ab3462f7593c9ca83f877416eeab580ae8480f99b6c329609"
Jul 24 17:08:28.134696 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:08:28.134676    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9fc72a0cb4cca3ab3462f7593c9ca83f877416eeab580ae8480f99b6c329609\": container with ID starting with b9fc72a0cb4cca3ab3462f7593c9ca83f877416eeab580ae8480f99b6c329609 not found: ID does not exist" containerID="b9fc72a0cb4cca3ab3462f7593c9ca83f877416eeab580ae8480f99b6c329609"
Jul 24 17:08:28.134740 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:28.134706    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9fc72a0cb4cca3ab3462f7593c9ca83f877416eeab580ae8480f99b6c329609"} err="failed to get container status \"b9fc72a0cb4cca3ab3462f7593c9ca83f877416eeab580ae8480f99b6c329609\": rpc error: code = NotFound desc = could not find container \"b9fc72a0cb4cca3ab3462f7593c9ca83f877416eeab580ae8480f99b6c329609\": container with ID starting with b9fc72a0cb4cca3ab3462f7593c9ca83f877416eeab580ae8480f99b6c329609 not found: ID does not exist"
Jul 24 17:08:28.145049 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:28.145027    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-779cb4695b-jzv5t"]
Jul 24 17:08:28.147094 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:28.147067    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-779cb4695b-jzv5t"]
Jul 24 17:08:29.083410 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:29.083374    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="839bf379-6c8c-413c-b406-4b438e1d3f55" path="/var/lib/kubelet/pods/839bf379-6c8c-413c-b406-4b438e1d3f55/volumes"
Jul 24 17:08:35.797511 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:35.797415    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-78998df997-xrrv4" podUID="42e2f9ae-322f-4796-8440-bf12d50a8283" containerName="registry" containerID="cri-o://883fbf9a09d605ce0c5a1e1751fe04454fab31b94b7973ece2172a6b621d52ef" gracePeriod=30
Jul 24 17:08:36.055330 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.055270    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:08:36.101375 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.101346    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-bound-sa-token\") pod \"42e2f9ae-322f-4796-8440-bf12d50a8283\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") "
Jul 24 17:08:36.101375 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.101375    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls\") pod \"42e2f9ae-322f-4796-8440-bf12d50a8283\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") "
Jul 24 17:08:36.101622 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.101407    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pft85\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-kube-api-access-pft85\") pod \"42e2f9ae-322f-4796-8440-bf12d50a8283\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") "
Jul 24 17:08:36.101622 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.101440    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-certificates\") pod \"42e2f9ae-322f-4796-8440-bf12d50a8283\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") "
Jul 24 17:08:36.101622 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.101477    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/42e2f9ae-322f-4796-8440-bf12d50a8283-ca-trust-extracted\") pod \"42e2f9ae-322f-4796-8440-bf12d50a8283\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") "
Jul 24 17:08:36.101622 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.101502    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/42e2f9ae-322f-4796-8440-bf12d50a8283-image-registry-private-configuration\") pod \"42e2f9ae-322f-4796-8440-bf12d50a8283\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") "
Jul 24 17:08:36.101622 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.101533    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/42e2f9ae-322f-4796-8440-bf12d50a8283-trusted-ca\") pod \"42e2f9ae-322f-4796-8440-bf12d50a8283\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") "
Jul 24 17:08:36.101879 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.101634    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/42e2f9ae-322f-4796-8440-bf12d50a8283-installation-pull-secrets\") pod \"42e2f9ae-322f-4796-8440-bf12d50a8283\" (UID: \"42e2f9ae-322f-4796-8440-bf12d50a8283\") "
Jul 24 17:08:36.102497 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.102450    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e2f9ae-322f-4796-8440-bf12d50a8283-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "42e2f9ae-322f-4796-8440-bf12d50a8283" (UID: "42e2f9ae-322f-4796-8440-bf12d50a8283"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:08:36.103013 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.102971    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "42e2f9ae-322f-4796-8440-bf12d50a8283" (UID: "42e2f9ae-322f-4796-8440-bf12d50a8283"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:08:36.105540 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.105489    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "42e2f9ae-322f-4796-8440-bf12d50a8283" (UID: "42e2f9ae-322f-4796-8440-bf12d50a8283"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:08:36.105540 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.105510    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "42e2f9ae-322f-4796-8440-bf12d50a8283" (UID: "42e2f9ae-322f-4796-8440-bf12d50a8283"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:08:36.105742 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.105709    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-kube-api-access-pft85" (OuterVolumeSpecName: "kube-api-access-pft85") pod "42e2f9ae-322f-4796-8440-bf12d50a8283" (UID: "42e2f9ae-322f-4796-8440-bf12d50a8283"). InnerVolumeSpecName "kube-api-access-pft85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:08:36.105742 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.105710    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42e2f9ae-322f-4796-8440-bf12d50a8283-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "42e2f9ae-322f-4796-8440-bf12d50a8283" (UID: "42e2f9ae-322f-4796-8440-bf12d50a8283"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:08:36.106289 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.106259    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42e2f9ae-322f-4796-8440-bf12d50a8283-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "42e2f9ae-322f-4796-8440-bf12d50a8283" (UID: "42e2f9ae-322f-4796-8440-bf12d50a8283"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:08:36.114604 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.114559    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42e2f9ae-322f-4796-8440-bf12d50a8283-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "42e2f9ae-322f-4796-8440-bf12d50a8283" (UID: "42e2f9ae-322f-4796-8440-bf12d50a8283"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:08:36.154996 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.154967    2572 generic.go:356] "Generic (PLEG): container finished" podID="42e2f9ae-322f-4796-8440-bf12d50a8283" containerID="883fbf9a09d605ce0c5a1e1751fe04454fab31b94b7973ece2172a6b621d52ef" exitCode=0
Jul 24 17:08:36.155163 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.155011    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78998df997-xrrv4"
Jul 24 17:08:36.155163 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.155049    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78998df997-xrrv4" event={"ID":"42e2f9ae-322f-4796-8440-bf12d50a8283","Type":"ContainerDied","Data":"883fbf9a09d605ce0c5a1e1751fe04454fab31b94b7973ece2172a6b621d52ef"}
Jul 24 17:08:36.155163 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.155104    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78998df997-xrrv4" event={"ID":"42e2f9ae-322f-4796-8440-bf12d50a8283","Type":"ContainerDied","Data":"1f7e97d07da4fbaa94708ff94c7fd87c4b93d2793ffbd90563fbf32a8c38b159"}
Jul 24 17:08:36.155163 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.155131    2572 scope.go:117] "RemoveContainer" containerID="883fbf9a09d605ce0c5a1e1751fe04454fab31b94b7973ece2172a6b621d52ef"
Jul 24 17:08:36.163362 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.163342    2572 scope.go:117] "RemoveContainer" containerID="883fbf9a09d605ce0c5a1e1751fe04454fab31b94b7973ece2172a6b621d52ef"
Jul 24 17:08:36.163661 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:08:36.163632    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"883fbf9a09d605ce0c5a1e1751fe04454fab31b94b7973ece2172a6b621d52ef\": container with ID starting with 883fbf9a09d605ce0c5a1e1751fe04454fab31b94b7973ece2172a6b621d52ef not found: ID does not exist" containerID="883fbf9a09d605ce0c5a1e1751fe04454fab31b94b7973ece2172a6b621d52ef"
Jul 24 17:08:36.163739 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.163670    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"883fbf9a09d605ce0c5a1e1751fe04454fab31b94b7973ece2172a6b621d52ef"} err="failed to get container status \"883fbf9a09d605ce0c5a1e1751fe04454fab31b94b7973ece2172a6b621d52ef\": rpc error: code = NotFound desc = could not find container \"883fbf9a09d605ce0c5a1e1751fe04454fab31b94b7973ece2172a6b621d52ef\": container with ID starting with 883fbf9a09d605ce0c5a1e1751fe04454fab31b94b7973ece2172a6b621d52ef not found: ID does not exist"
Jul 24 17:08:36.187207 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.187178    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78998df997-xrrv4"]
Jul 24 17:08:36.200146 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.200121    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78998df997-xrrv4"]
Jul 24 17:08:36.202279 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.202257    2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/42e2f9ae-322f-4796-8440-bf12d50a8283-installation-pull-secrets\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:08:36.202279 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.202277    2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-bound-sa-token\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:08:36.202418 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.202288    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-tls\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:08:36.202418 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.202296    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pft85\" (UniqueName: \"kubernetes.io/projected/42e2f9ae-322f-4796-8440-bf12d50a8283-kube-api-access-pft85\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:08:36.202418 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.202304    2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/42e2f9ae-322f-4796-8440-bf12d50a8283-registry-certificates\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:08:36.202418 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.202312    2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/42e2f9ae-322f-4796-8440-bf12d50a8283-ca-trust-extracted\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:08:36.202418 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.202320    2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/42e2f9ae-322f-4796-8440-bf12d50a8283-image-registry-private-configuration\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:08:36.202418 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:36.202329    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/42e2f9ae-322f-4796-8440-bf12d50a8283-trusted-ca\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:08:37.084417 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:08:37.084377    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42e2f9ae-322f-4796-8440-bf12d50a8283" path="/var/lib/kubelet/pods/42e2f9ae-322f-4796-8440-bf12d50a8283/volumes"
Jul 24 17:09:17.024990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:17.024949    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs\") pod \"network-metrics-daemon-td8qt\" (UID: \"ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b\") " pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:09:17.027503 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:17.027479    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b-metrics-certs\") pod \"network-metrics-daemon-td8qt\" (UID: \"ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b\") " pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:09:17.182220 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:17.182191    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pgbn9\""
Jul 24 17:09:17.190710 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:17.190686    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td8qt"
Jul 24 17:09:17.332061 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:17.331951    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-td8qt"]
Jul 24 17:09:17.334615 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:09:17.334584    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded7e9f0a_fbfc_4e51_8f70_4b71e55e5a4b.slice/crio-a25172d5ac123a7163594e4517a8f972b518f05f2bb15789015f6cde2513220b WatchSource:0}: Error finding container a25172d5ac123a7163594e4517a8f972b518f05f2bb15789015f6cde2513220b: Status 404 returned error can't find the container with id a25172d5ac123a7163594e4517a8f972b518f05f2bb15789015f6cde2513220b
Jul 24 17:09:17.336758 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:17.336743    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:09:18.302561 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:18.302526    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-td8qt" event={"ID":"ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b","Type":"ContainerStarted","Data":"a25172d5ac123a7163594e4517a8f972b518f05f2bb15789015f6cde2513220b"}
Jul 24 17:09:19.308676 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:19.308644    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-td8qt" event={"ID":"ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b","Type":"ContainerStarted","Data":"fec3225a39da3fc04f4e2373f9037f2a2a63fcd6571313ef80ca22b19ece10d4"}
Jul 24 17:09:19.309052 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:19.308695    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-td8qt" event={"ID":"ed7e9f0a-fbfc-4e51-8f70-4b71e55e5a4b","Type":"ContainerStarted","Data":"21f507baf54a4e719cffaaa6c3380c656da5170548d4b1a5f71e5e0e0cd8a507"}
Jul 24 17:09:19.325472 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:19.325424    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-td8qt" podStartSLOduration=375.289250074 podStartE2EDuration="6m16.325407945s" totalImagesPullingTime="1.036157871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:03:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:09:19.323381068 +0000 UTC m=+376.757596636" watchObservedRunningTime="2026-07-24 17:09:19.325407945 +0000 UTC m=+376.759623535"
Jul 24 17:09:21.878684 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.878647    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"]
Jul 24 17:09:21.879126 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.878909    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="839bf379-6c8c-413c-b406-4b438e1d3f55" containerName="console"
Jul 24 17:09:21.879126 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.878920    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="839bf379-6c8c-413c-b406-4b438e1d3f55" containerName="console"
Jul 24 17:09:21.879126 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.878950    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42e2f9ae-322f-4796-8440-bf12d50a8283" containerName="registry"
Jul 24 17:09:21.879126 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.878956    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="42e2f9ae-322f-4796-8440-bf12d50a8283" containerName="registry"
Jul 24 17:09:21.879126 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.879010    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="42e2f9ae-322f-4796-8440-bf12d50a8283" containerName="registry"
Jul 24 17:09:21.879126 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.879022    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="839bf379-6c8c-413c-b406-4b438e1d3f55" containerName="console"
Jul 24 17:09:21.881361 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.881343    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:21.883851 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.883799    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 24 17:09:21.883851 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.883819    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 24 17:09:21.884035 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.883853    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-zmtdd\""
Jul 24 17:09:21.884097 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.884066    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 24 17:09:21.884097 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.884067    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 24 17:09:21.884199 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.884165    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 24 17:09:21.889001 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.888976    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 24 17:09:21.893908 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.893875    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"]
Jul 24 17:09:21.966816 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.966785    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a61295f-d33e-49b5-94ed-239751e85f25-metrics-client-ca\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:21.966985 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.966832    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a61295f-d33e-49b5-94ed-239751e85f25-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:21.966985 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.966860    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm7xg\" (UniqueName: \"kubernetes.io/projected/4a61295f-d33e-49b5-94ed-239751e85f25-kube-api-access-bm7xg\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:21.966985 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.966892    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a61295f-d33e-49b5-94ed-239751e85f25-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:21.966985 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.966920    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4a61295f-d33e-49b5-94ed-239751e85f25-secret-telemeter-client\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:21.966985 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.966938    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4a61295f-d33e-49b5-94ed-239751e85f25-telemeter-client-tls\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:21.966985 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.966953    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a61295f-d33e-49b5-94ed-239751e85f25-serving-certs-ca-bundle\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:21.966985 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:21.966982    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4a61295f-d33e-49b5-94ed-239751e85f25-federate-client-tls\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:22.068215 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:22.068178    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4a61295f-d33e-49b5-94ed-239751e85f25-secret-telemeter-client\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:22.068215 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:22.068215    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4a61295f-d33e-49b5-94ed-239751e85f25-telemeter-client-tls\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:22.068432 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:22.068253    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a61295f-d33e-49b5-94ed-239751e85f25-serving-certs-ca-bundle\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:22.068432 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:22.068285    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4a61295f-d33e-49b5-94ed-239751e85f25-federate-client-tls\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:22.068432 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:22.068314    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a61295f-d33e-49b5-94ed-239751e85f25-metrics-client-ca\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:22.068432 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:22.068355    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a61295f-d33e-49b5-94ed-239751e85f25-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:22.068432 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:22.068386    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm7xg\" (UniqueName: \"kubernetes.io/projected/4a61295f-d33e-49b5-94ed-239751e85f25-kube-api-access-bm7xg\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:22.068432 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:22.068413    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a61295f-d33e-49b5-94ed-239751e85f25-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:22.069448 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:22.069414    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a61295f-d33e-49b5-94ed-239751e85f25-metrics-client-ca\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:22.069570 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:22.069422    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a61295f-d33e-49b5-94ed-239751e85f25-serving-certs-ca-bundle\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:22.069834 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:22.069810    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a61295f-d33e-49b5-94ed-239751e85f25-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:22.071154 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:22.071131    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4a61295f-d33e-49b5-94ed-239751e85f25-federate-client-tls\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:22.071265 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:22.071165    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a61295f-d33e-49b5-94ed-239751e85f25-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:22.071265 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:22.071220    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4a61295f-d33e-49b5-94ed-239751e85f25-secret-telemeter-client\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:22.071340 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:22.071281    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4a61295f-d33e-49b5-94ed-239751e85f25-telemeter-client-tls\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:22.076087 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:22.076066    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm7xg\" (UniqueName: \"kubernetes.io/projected/4a61295f-d33e-49b5-94ed-239751e85f25-kube-api-access-bm7xg\") pod \"telemeter-client-5f86f9cff7-n56ts\" (UID: \"4a61295f-d33e-49b5-94ed-239751e85f25\") " pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:22.190707 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:22.190614    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"
Jul 24 17:09:22.326726 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:22.326697    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5f86f9cff7-n56ts"]
Jul 24 17:09:22.333404 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:09:22.333373    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a61295f_d33e_49b5_94ed_239751e85f25.slice/crio-dd98cb2a8ae413af7f86de40633c9cb951a91bcd895e23bc6deb88568e2c046e WatchSource:0}: Error finding container dd98cb2a8ae413af7f86de40633c9cb951a91bcd895e23bc6deb88568e2c046e: Status 404 returned error can't find the container with id dd98cb2a8ae413af7f86de40633c9cb951a91bcd895e23bc6deb88568e2c046e
Jul 24 17:09:23.323859 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:23.323824    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts" event={"ID":"4a61295f-d33e-49b5-94ed-239751e85f25","Type":"ContainerStarted","Data":"dd98cb2a8ae413af7f86de40633c9cb951a91bcd895e23bc6deb88568e2c046e"}
Jul 24 17:09:25.334639 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:25.334589    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts" event={"ID":"4a61295f-d33e-49b5-94ed-239751e85f25","Type":"ContainerStarted","Data":"9f5efca2aaaedca297986e1888134365569db2f146b520f455e465478f6ca204"}
Jul 24 17:09:26.340447 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:26.340407    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts" event={"ID":"4a61295f-d33e-49b5-94ed-239751e85f25","Type":"ContainerStarted","Data":"5375c13b13bfb736d58de54b302e2c226240779468d7564319128bc8f205ac34"}
Jul 24 17:09:26.340810 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:26.340471    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts" event={"ID":"4a61295f-d33e-49b5-94ed-239751e85f25","Type":"ContainerStarted","Data":"68a9b5a12340daef3d90fa8bcef6d6bea355a05ba0a72f5ded5113bddbec0ddd"}
Jul 24 17:09:26.362309 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:26.362265    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5f86f9cff7-n56ts" podStartSLOduration=2.362381916 podStartE2EDuration="5.362252657s" totalImagesPullingTime="2.999870741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:09:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:09:26.36083118 +0000 UTC m=+383.795046747" watchObservedRunningTime="2026-07-24 17:09:26.362252657 +0000 UTC m=+383.796468220"
Jul 24 17:09:27.183708 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.183675    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c5c58d7b5-5k482"]
Jul 24 17:09:27.187204 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.187174    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:27.198663 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.198634    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c5c58d7b5-5k482"]
Jul 24 17:09:27.311794 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.311760    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bdkh\" (UniqueName: \"kubernetes.io/projected/51aa7239-7351-4576-b128-523c59cf67af-kube-api-access-7bdkh\") pod \"console-c5c58d7b5-5k482\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") " pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:27.311937 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.311803    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-service-ca\") pod \"console-c5c58d7b5-5k482\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") " pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:27.311937 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.311830    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-trusted-ca-bundle\") pod \"console-c5c58d7b5-5k482\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") " pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:27.311937 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.311917    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51aa7239-7351-4576-b128-523c59cf67af-console-oauth-config\") pod \"console-c5c58d7b5-5k482\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") " pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:27.312070 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.311949    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-console-config\") pod \"console-c5c58d7b5-5k482\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") " pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:27.312070 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.312019    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-oauth-serving-cert\") pod \"console-c5c58d7b5-5k482\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") " pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:27.312070 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.312065    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51aa7239-7351-4576-b128-523c59cf67af-console-serving-cert\") pod \"console-c5c58d7b5-5k482\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") " pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:27.412660 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.412622    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-oauth-serving-cert\") pod \"console-c5c58d7b5-5k482\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") " pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:27.413115 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.412672    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51aa7239-7351-4576-b128-523c59cf67af-console-serving-cert\") pod \"console-c5c58d7b5-5k482\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") " pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:27.413115 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.412698    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bdkh\" (UniqueName: \"kubernetes.io/projected/51aa7239-7351-4576-b128-523c59cf67af-kube-api-access-7bdkh\") pod \"console-c5c58d7b5-5k482\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") " pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:27.413115 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.412726    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-service-ca\") pod \"console-c5c58d7b5-5k482\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") " pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:27.413115 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.412754    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-trusted-ca-bundle\") pod \"console-c5c58d7b5-5k482\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") " pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:27.413115 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.412800    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51aa7239-7351-4576-b128-523c59cf67af-console-oauth-config\") pod \"console-c5c58d7b5-5k482\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") " pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:27.413115 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.412929    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-console-config\") pod \"console-c5c58d7b5-5k482\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") " pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:27.413518 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.413497    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-oauth-serving-cert\") pod \"console-c5c58d7b5-5k482\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") " pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:27.413867 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.413845    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-console-config\") pod \"console-c5c58d7b5-5k482\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") " pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:27.413902 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.413850    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-trusted-ca-bundle\") pod \"console-c5c58d7b5-5k482\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") " pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:27.413935 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.413849    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-service-ca\") pod \"console-c5c58d7b5-5k482\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") " pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:27.415359 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.415339    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51aa7239-7351-4576-b128-523c59cf67af-console-oauth-config\") pod \"console-c5c58d7b5-5k482\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") " pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:27.415546 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.415530    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51aa7239-7351-4576-b128-523c59cf67af-console-serving-cert\") pod \"console-c5c58d7b5-5k482\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") " pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:27.422683 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.422665    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bdkh\" (UniqueName: \"kubernetes.io/projected/51aa7239-7351-4576-b128-523c59cf67af-kube-api-access-7bdkh\") pod \"console-c5c58d7b5-5k482\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") " pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:27.496832 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.496758    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:27.628813 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:27.628784    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c5c58d7b5-5k482"]
Jul 24 17:09:27.631664 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:09:27.631633    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51aa7239_7351_4576_b128_523c59cf67af.slice/crio-9cd071e1e55da72b9585ef4ddcb144652a1f0641c92b6fde8b42409b34dde429 WatchSource:0}: Error finding container 9cd071e1e55da72b9585ef4ddcb144652a1f0641c92b6fde8b42409b34dde429: Status 404 returned error can't find the container with id 9cd071e1e55da72b9585ef4ddcb144652a1f0641c92b6fde8b42409b34dde429
Jul 24 17:09:28.353818 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:28.353783    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c5c58d7b5-5k482" event={"ID":"51aa7239-7351-4576-b128-523c59cf67af","Type":"ContainerStarted","Data":"8e101d631aa8ad849ba5fb5f36e3491ae1349ad192376c409be70a264d070554"}
Jul 24 17:09:28.354016 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:28.353857    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c5c58d7b5-5k482" event={"ID":"51aa7239-7351-4576-b128-523c59cf67af","Type":"ContainerStarted","Data":"9cd071e1e55da72b9585ef4ddcb144652a1f0641c92b6fde8b42409b34dde429"}
Jul 24 17:09:28.371278 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:28.371212    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c5c58d7b5-5k482" podStartSLOduration=1.3711974599999999 podStartE2EDuration="1.37119746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:09:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:09:28.369779119 +0000 UTC m=+385.803994685" watchObservedRunningTime="2026-07-24 17:09:28.37119746 +0000 UTC m=+385.805413026"
Jul 24 17:09:34.328875 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.328836    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c5c58d7b5-5k482"]
Jul 24 17:09:34.359439 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.359406    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55bb7fb8f8-6hvpg"]
Jul 24 17:09:34.362939 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.362913    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:34.374111 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.374084    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55bb7fb8f8-6hvpg"]
Jul 24 17:09:34.467767 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.467734    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqtsp\" (UniqueName: \"kubernetes.io/projected/75906dcb-8145-43a2-ac3d-294afcd6ea35-kube-api-access-hqtsp\") pod \"console-55bb7fb8f8-6hvpg\" (UID: \"75906dcb-8145-43a2-ac3d-294afcd6ea35\") " pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:34.467929 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.467792    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75906dcb-8145-43a2-ac3d-294afcd6ea35-console-oauth-config\") pod \"console-55bb7fb8f8-6hvpg\" (UID: \"75906dcb-8145-43a2-ac3d-294afcd6ea35\") " pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:34.467929 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.467882    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75906dcb-8145-43a2-ac3d-294afcd6ea35-console-config\") pod \"console-55bb7fb8f8-6hvpg\" (UID: \"75906dcb-8145-43a2-ac3d-294afcd6ea35\") " pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:34.468023 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.467933    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75906dcb-8145-43a2-ac3d-294afcd6ea35-service-ca\") pod \"console-55bb7fb8f8-6hvpg\" (UID: \"75906dcb-8145-43a2-ac3d-294afcd6ea35\") " pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:34.468023 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.467960    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75906dcb-8145-43a2-ac3d-294afcd6ea35-oauth-serving-cert\") pod \"console-55bb7fb8f8-6hvpg\" (UID: \"75906dcb-8145-43a2-ac3d-294afcd6ea35\") " pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:34.468023 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.467997    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75906dcb-8145-43a2-ac3d-294afcd6ea35-trusted-ca-bundle\") pod \"console-55bb7fb8f8-6hvpg\" (UID: \"75906dcb-8145-43a2-ac3d-294afcd6ea35\") " pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:34.468023 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.468019    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75906dcb-8145-43a2-ac3d-294afcd6ea35-console-serving-cert\") pod \"console-55bb7fb8f8-6hvpg\" (UID: \"75906dcb-8145-43a2-ac3d-294afcd6ea35\") " pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:34.568807 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.568772    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75906dcb-8145-43a2-ac3d-294afcd6ea35-console-oauth-config\") pod \"console-55bb7fb8f8-6hvpg\" (UID: \"75906dcb-8145-43a2-ac3d-294afcd6ea35\") " pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:34.569010 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.568822    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75906dcb-8145-43a2-ac3d-294afcd6ea35-console-config\") pod \"console-55bb7fb8f8-6hvpg\" (UID: \"75906dcb-8145-43a2-ac3d-294afcd6ea35\") " pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:34.569010 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.568844    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75906dcb-8145-43a2-ac3d-294afcd6ea35-service-ca\") pod \"console-55bb7fb8f8-6hvpg\" (UID: \"75906dcb-8145-43a2-ac3d-294afcd6ea35\") " pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:34.569010 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.568858    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75906dcb-8145-43a2-ac3d-294afcd6ea35-oauth-serving-cert\") pod \"console-55bb7fb8f8-6hvpg\" (UID: \"75906dcb-8145-43a2-ac3d-294afcd6ea35\") " pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:34.569010 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.568874    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75906dcb-8145-43a2-ac3d-294afcd6ea35-trusted-ca-bundle\") pod \"console-55bb7fb8f8-6hvpg\" (UID: \"75906dcb-8145-43a2-ac3d-294afcd6ea35\") " pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:34.569010 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.568889    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75906dcb-8145-43a2-ac3d-294afcd6ea35-console-serving-cert\") pod \"console-55bb7fb8f8-6hvpg\" (UID: \"75906dcb-8145-43a2-ac3d-294afcd6ea35\") " pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:34.569010 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.568912    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqtsp\" (UniqueName: \"kubernetes.io/projected/75906dcb-8145-43a2-ac3d-294afcd6ea35-kube-api-access-hqtsp\") pod \"console-55bb7fb8f8-6hvpg\" (UID: \"75906dcb-8145-43a2-ac3d-294afcd6ea35\") " pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:34.569745 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.569717    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75906dcb-8145-43a2-ac3d-294afcd6ea35-oauth-serving-cert\") pod \"console-55bb7fb8f8-6hvpg\" (UID: \"75906dcb-8145-43a2-ac3d-294afcd6ea35\") " pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:34.569847 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.569717    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75906dcb-8145-43a2-ac3d-294afcd6ea35-console-config\") pod \"console-55bb7fb8f8-6hvpg\" (UID: \"75906dcb-8145-43a2-ac3d-294afcd6ea35\") " pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:34.569901 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.569839    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75906dcb-8145-43a2-ac3d-294afcd6ea35-trusted-ca-bundle\") pod \"console-55bb7fb8f8-6hvpg\" (UID: \"75906dcb-8145-43a2-ac3d-294afcd6ea35\") " pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:34.569993 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.569970    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75906dcb-8145-43a2-ac3d-294afcd6ea35-service-ca\") pod \"console-55bb7fb8f8-6hvpg\" (UID: \"75906dcb-8145-43a2-ac3d-294afcd6ea35\") " pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:34.571477 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.571452    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75906dcb-8145-43a2-ac3d-294afcd6ea35-console-serving-cert\") pod \"console-55bb7fb8f8-6hvpg\" (UID: \"75906dcb-8145-43a2-ac3d-294afcd6ea35\") " pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:34.571590 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.571576    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75906dcb-8145-43a2-ac3d-294afcd6ea35-console-oauth-config\") pod \"console-55bb7fb8f8-6hvpg\" (UID: \"75906dcb-8145-43a2-ac3d-294afcd6ea35\") " pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:34.576724 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.576707    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqtsp\" (UniqueName: \"kubernetes.io/projected/75906dcb-8145-43a2-ac3d-294afcd6ea35-kube-api-access-hqtsp\") pod \"console-55bb7fb8f8-6hvpg\" (UID: \"75906dcb-8145-43a2-ac3d-294afcd6ea35\") " pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:34.671836 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.671800    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:34.804084 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:34.804048    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55bb7fb8f8-6hvpg"]
Jul 24 17:09:34.807182 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:09:34.807150    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75906dcb_8145_43a2_ac3d_294afcd6ea35.slice/crio-1919826178a6ca49228b8351db014faa7878296a229ef8461b5b07fada46edb2 WatchSource:0}: Error finding container 1919826178a6ca49228b8351db014faa7878296a229ef8461b5b07fada46edb2: Status 404 returned error can't find the container with id 1919826178a6ca49228b8351db014faa7878296a229ef8461b5b07fada46edb2
Jul 24 17:09:35.381793 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:35.381757    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55bb7fb8f8-6hvpg" event={"ID":"75906dcb-8145-43a2-ac3d-294afcd6ea35","Type":"ContainerStarted","Data":"516ea1cb185cd5673fea8a28d3d3f4703dde90512f4d75ce3202062a1e41747f"}
Jul 24 17:09:35.382168 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:35.381813    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55bb7fb8f8-6hvpg" event={"ID":"75906dcb-8145-43a2-ac3d-294afcd6ea35","Type":"ContainerStarted","Data":"1919826178a6ca49228b8351db014faa7878296a229ef8461b5b07fada46edb2"}
Jul 24 17:09:35.399151 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:35.399106    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55bb7fb8f8-6hvpg" podStartSLOduration=1.399091035 podStartE2EDuration="1.399091035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:09:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:09:35.398082248 +0000 UTC m=+392.832297815" watchObservedRunningTime="2026-07-24 17:09:35.399091035 +0000 UTC m=+392.833306601"
Jul 24 17:09:37.497015 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:37.496982    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:44.672619 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:44.672583    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:44.673087 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:44.672634    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:44.677303 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:44.677283    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:45.423877 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:45.423847    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55bb7fb8f8-6hvpg"
Jul 24 17:09:45.478276 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:45.478212    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5df8845f4c-sc4qd"]
Jul 24 17:09:59.348660 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.348614    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c5c58d7b5-5k482" podUID="51aa7239-7351-4576-b128-523c59cf67af" containerName="console" containerID="cri-o://8e101d631aa8ad849ba5fb5f36e3491ae1349ad192376c409be70a264d070554" gracePeriod=15
Jul 24 17:09:59.471612 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.471585    2572 generic.go:356] "Generic (PLEG): container finished" podID="51aa7239-7351-4576-b128-523c59cf67af" containerID="8e101d631aa8ad849ba5fb5f36e3491ae1349ad192376c409be70a264d070554" exitCode=0
Jul 24 17:09:59.471735 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.471653    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c5c58d7b5-5k482" event={"ID":"51aa7239-7351-4576-b128-523c59cf67af","Type":"ContainerDied","Data":"8e101d631aa8ad849ba5fb5f36e3491ae1349ad192376c409be70a264d070554"}
Jul 24 17:09:59.589574 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.589552    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:09:59.660727 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.660695    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-oauth-serving-cert\") pod \"51aa7239-7351-4576-b128-523c59cf67af\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") "
Jul 24 17:09:59.660895 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.660752    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-trusted-ca-bundle\") pod \"51aa7239-7351-4576-b128-523c59cf67af\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") "
Jul 24 17:09:59.660895 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.660811    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bdkh\" (UniqueName: \"kubernetes.io/projected/51aa7239-7351-4576-b128-523c59cf67af-kube-api-access-7bdkh\") pod \"51aa7239-7351-4576-b128-523c59cf67af\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") "
Jul 24 17:09:59.660895 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.660836    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-console-config\") pod \"51aa7239-7351-4576-b128-523c59cf67af\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") "
Jul 24 17:09:59.660895 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.660866    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51aa7239-7351-4576-b128-523c59cf67af-console-oauth-config\") pod \"51aa7239-7351-4576-b128-523c59cf67af\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") "
Jul 24 17:09:59.661088 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.660913    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-service-ca\") pod \"51aa7239-7351-4576-b128-523c59cf67af\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") "
Jul 24 17:09:59.661088 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.660941    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51aa7239-7351-4576-b128-523c59cf67af-console-serving-cert\") pod \"51aa7239-7351-4576-b128-523c59cf67af\" (UID: \"51aa7239-7351-4576-b128-523c59cf67af\") "
Jul 24 17:09:59.661267 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.661210    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "51aa7239-7351-4576-b128-523c59cf67af" (UID: "51aa7239-7351-4576-b128-523c59cf67af"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:09:59.661368 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.661282    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "51aa7239-7351-4576-b128-523c59cf67af" (UID: "51aa7239-7351-4576-b128-523c59cf67af"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:09:59.661428 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.661392    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-console-config" (OuterVolumeSpecName: "console-config") pod "51aa7239-7351-4576-b128-523c59cf67af" (UID: "51aa7239-7351-4576-b128-523c59cf67af"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:09:59.661428 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.661398    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-service-ca" (OuterVolumeSpecName: "service-ca") pod "51aa7239-7351-4576-b128-523c59cf67af" (UID: "51aa7239-7351-4576-b128-523c59cf67af"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:09:59.663179 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.663159    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51aa7239-7351-4576-b128-523c59cf67af-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "51aa7239-7351-4576-b128-523c59cf67af" (UID: "51aa7239-7351-4576-b128-523c59cf67af"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:09:59.663265 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.663217    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51aa7239-7351-4576-b128-523c59cf67af-kube-api-access-7bdkh" (OuterVolumeSpecName: "kube-api-access-7bdkh") pod "51aa7239-7351-4576-b128-523c59cf67af" (UID: "51aa7239-7351-4576-b128-523c59cf67af"). InnerVolumeSpecName "kube-api-access-7bdkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:09:59.663317 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.663299    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51aa7239-7351-4576-b128-523c59cf67af-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "51aa7239-7351-4576-b128-523c59cf67af" (UID: "51aa7239-7351-4576-b128-523c59cf67af"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:09:59.761923 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.761889    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bdkh\" (UniqueName: \"kubernetes.io/projected/51aa7239-7351-4576-b128-523c59cf67af-kube-api-access-7bdkh\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:09:59.761923 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.761918    2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-console-config\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:09:59.761923 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.761931    2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51aa7239-7351-4576-b128-523c59cf67af-console-oauth-config\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:09:59.762148 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.761942    2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-service-ca\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:09:59.762148 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.761953    2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51aa7239-7351-4576-b128-523c59cf67af-console-serving-cert\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:09:59.762148 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.761966    2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-oauth-serving-cert\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:09:59.762148 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:09:59.761978    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51aa7239-7351-4576-b128-523c59cf67af-trusted-ca-bundle\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:10:00.476766 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:00.476739    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c5c58d7b5-5k482"
Jul 24 17:10:00.476766 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:00.476748    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c5c58d7b5-5k482" event={"ID":"51aa7239-7351-4576-b128-523c59cf67af","Type":"ContainerDied","Data":"9cd071e1e55da72b9585ef4ddcb144652a1f0641c92b6fde8b42409b34dde429"}
Jul 24 17:10:00.477265 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:00.476800    2572 scope.go:117] "RemoveContainer" containerID="8e101d631aa8ad849ba5fb5f36e3491ae1349ad192376c409be70a264d070554"
Jul 24 17:10:00.498391 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:00.498366    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c5c58d7b5-5k482"]
Jul 24 17:10:00.501981 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:00.501959    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c5c58d7b5-5k482"]
Jul 24 17:10:01.084325 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:01.084292    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51aa7239-7351-4576-b128-523c59cf67af" path="/var/lib/kubelet/pods/51aa7239-7351-4576-b128-523c59cf67af/volumes"
Jul 24 17:10:10.499780 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:10.499715    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5df8845f4c-sc4qd" podUID="e035117b-abb4-4efa-9216-b6fdb65f2b7e" containerName="console" containerID="cri-o://5b492fed13722513fe217fdc1996d2c603068bc04a1ddfe0380193ae2bc641b0" gracePeriod=15
Jul 24 17:10:10.750386 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:10.750329    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:10:10.848927 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:10.848893    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-oauth-serving-cert\") pod \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") "
Jul 24 17:10:10.849091 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:10.848938    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-console-config\") pod \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") "
Jul 24 17:10:10.849091 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:10.848968    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8cx5\" (UniqueName: \"kubernetes.io/projected/e035117b-abb4-4efa-9216-b6fdb65f2b7e-kube-api-access-q8cx5\") pod \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") "
Jul 24 17:10:10.849091 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:10.848995    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e035117b-abb4-4efa-9216-b6fdb65f2b7e-console-oauth-config\") pod \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") "
Jul 24 17:10:10.849091 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:10.849037    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e035117b-abb4-4efa-9216-b6fdb65f2b7e-console-serving-cert\") pod \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") "
Jul 24 17:10:10.849091 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:10.849080    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-service-ca\") pod \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") "
Jul 24 17:10:10.849385 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:10.849102    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-trusted-ca-bundle\") pod \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\" (UID: \"e035117b-abb4-4efa-9216-b6fdb65f2b7e\") "
Jul 24 17:10:10.849385 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:10.849345    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e035117b-abb4-4efa-9216-b6fdb65f2b7e" (UID: "e035117b-abb4-4efa-9216-b6fdb65f2b7e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:10:10.849571 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:10.849541    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-console-config" (OuterVolumeSpecName: "console-config") pod "e035117b-abb4-4efa-9216-b6fdb65f2b7e" (UID: "e035117b-abb4-4efa-9216-b6fdb65f2b7e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:10:10.849659 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:10.849588    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-service-ca" (OuterVolumeSpecName: "service-ca") pod "e035117b-abb4-4efa-9216-b6fdb65f2b7e" (UID: "e035117b-abb4-4efa-9216-b6fdb65f2b7e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:10:10.849712 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:10.849665    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e035117b-abb4-4efa-9216-b6fdb65f2b7e" (UID: "e035117b-abb4-4efa-9216-b6fdb65f2b7e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:10:10.851298 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:10.851278    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e035117b-abb4-4efa-9216-b6fdb65f2b7e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e035117b-abb4-4efa-9216-b6fdb65f2b7e" (UID: "e035117b-abb4-4efa-9216-b6fdb65f2b7e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:10:10.851769 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:10.851751    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e035117b-abb4-4efa-9216-b6fdb65f2b7e-kube-api-access-q8cx5" (OuterVolumeSpecName: "kube-api-access-q8cx5") pod "e035117b-abb4-4efa-9216-b6fdb65f2b7e" (UID: "e035117b-abb4-4efa-9216-b6fdb65f2b7e"). InnerVolumeSpecName "kube-api-access-q8cx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:10:10.851813 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:10.851767    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e035117b-abb4-4efa-9216-b6fdb65f2b7e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e035117b-abb4-4efa-9216-b6fdb65f2b7e" (UID: "e035117b-abb4-4efa-9216-b6fdb65f2b7e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:10:10.950253 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:10.950206    2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-oauth-serving-cert\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:10:10.950253 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:10.950252    2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-console-config\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:10:10.950253 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:10.950262    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8cx5\" (UniqueName: \"kubernetes.io/projected/e035117b-abb4-4efa-9216-b6fdb65f2b7e-kube-api-access-q8cx5\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:10:10.950481 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:10.950271    2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e035117b-abb4-4efa-9216-b6fdb65f2b7e-console-oauth-config\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:10:10.950481 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:10.950279    2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e035117b-abb4-4efa-9216-b6fdb65f2b7e-console-serving-cert\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:10:10.950481 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:10.950292    2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-service-ca\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:10:10.950481 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:10.950305    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e035117b-abb4-4efa-9216-b6fdb65f2b7e-trusted-ca-bundle\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:10:11.519345 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:11.519308    2572 generic.go:356] "Generic (PLEG): container finished" podID="e035117b-abb4-4efa-9216-b6fdb65f2b7e" containerID="5b492fed13722513fe217fdc1996d2c603068bc04a1ddfe0380193ae2bc641b0" exitCode=0
Jul 24 17:10:11.519802 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:11.519356    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5df8845f4c-sc4qd"
Jul 24 17:10:11.519802 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:11.519401    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5df8845f4c-sc4qd" event={"ID":"e035117b-abb4-4efa-9216-b6fdb65f2b7e","Type":"ContainerDied","Data":"5b492fed13722513fe217fdc1996d2c603068bc04a1ddfe0380193ae2bc641b0"}
Jul 24 17:10:11.519802 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:11.519462    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5df8845f4c-sc4qd" event={"ID":"e035117b-abb4-4efa-9216-b6fdb65f2b7e","Type":"ContainerDied","Data":"6de23ca8301c072937d0d3e821b436461a62abd5cabe8deceb2086fdb649def1"}
Jul 24 17:10:11.519802 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:11.519499    2572 scope.go:117] "RemoveContainer" containerID="5b492fed13722513fe217fdc1996d2c603068bc04a1ddfe0380193ae2bc641b0"
Jul 24 17:10:11.527606 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:11.527585    2572 scope.go:117] "RemoveContainer" containerID="5b492fed13722513fe217fdc1996d2c603068bc04a1ddfe0380193ae2bc641b0"
Jul 24 17:10:11.527858 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:10:11.527839    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b492fed13722513fe217fdc1996d2c603068bc04a1ddfe0380193ae2bc641b0\": container with ID starting with 5b492fed13722513fe217fdc1996d2c603068bc04a1ddfe0380193ae2bc641b0 not found: ID does not exist" containerID="5b492fed13722513fe217fdc1996d2c603068bc04a1ddfe0380193ae2bc641b0"
Jul 24 17:10:11.527920 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:11.527868    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b492fed13722513fe217fdc1996d2c603068bc04a1ddfe0380193ae2bc641b0"} err="failed to get container status \"5b492fed13722513fe217fdc1996d2c603068bc04a1ddfe0380193ae2bc641b0\": rpc error: code = NotFound desc = could not find container \"5b492fed13722513fe217fdc1996d2c603068bc04a1ddfe0380193ae2bc641b0\": container with ID starting with 5b492fed13722513fe217fdc1996d2c603068bc04a1ddfe0380193ae2bc641b0 not found: ID does not exist"
Jul 24 17:10:11.554951 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:11.554918    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5df8845f4c-sc4qd"]
Jul 24 17:10:11.575715 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:11.575682    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5df8845f4c-sc4qd"]
Jul 24 17:10:13.084174 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:13.084139    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e035117b-abb4-4efa-9216-b6fdb65f2b7e" path="/var/lib/kubelet/pods/e035117b-abb4-4efa-9216-b6fdb65f2b7e/volumes"
Jul 24 17:10:20.654975 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:20.654942    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl"]
Jul 24 17:10:20.655605 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:20.655380    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51aa7239-7351-4576-b128-523c59cf67af" containerName="console"
Jul 24 17:10:20.655605 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:20.655399    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="51aa7239-7351-4576-b128-523c59cf67af" containerName="console"
Jul 24 17:10:20.655605 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:20.655436    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e035117b-abb4-4efa-9216-b6fdb65f2b7e" containerName="console"
Jul 24 17:10:20.655605 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:20.655444    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e035117b-abb4-4efa-9216-b6fdb65f2b7e" containerName="console"
Jul 24 17:10:20.655605 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:20.655514    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="51aa7239-7351-4576-b128-523c59cf67af" containerName="console"
Jul 24 17:10:20.655605 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:20.655526    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e035117b-abb4-4efa-9216-b6fdb65f2b7e" containerName="console"
Jul 24 17:10:20.658910 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:20.658888    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl"
Jul 24 17:10:20.661485 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:20.661466    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 17:10:20.662321 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:20.662301    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 17:10:20.662321 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:20.662312    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-l2ztc\""
Jul 24 17:10:20.667669 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:20.667648    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl"]
Jul 24 17:10:20.725342 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:20.725314    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4363225-d993-42ac-8c91-968b4e3935b7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl\" (UID: \"e4363225-d993-42ac-8c91-968b4e3935b7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl"
Jul 24 17:10:20.725503 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:20.725349    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtzmw\" (UniqueName: \"kubernetes.io/projected/e4363225-d993-42ac-8c91-968b4e3935b7-kube-api-access-dtzmw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl\" (UID: \"e4363225-d993-42ac-8c91-968b4e3935b7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl"
Jul 24 17:10:20.725503 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:20.725425    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4363225-d993-42ac-8c91-968b4e3935b7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl\" (UID: \"e4363225-d993-42ac-8c91-968b4e3935b7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl"
Jul 24 17:10:20.826676 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:20.826644    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4363225-d993-42ac-8c91-968b4e3935b7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl\" (UID: \"e4363225-d993-42ac-8c91-968b4e3935b7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl"
Jul 24 17:10:20.826829 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:20.826705    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4363225-d993-42ac-8c91-968b4e3935b7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl\" (UID: \"e4363225-d993-42ac-8c91-968b4e3935b7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl"
Jul 24 17:10:20.826874 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:20.826820    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtzmw\" (UniqueName: \"kubernetes.io/projected/e4363225-d993-42ac-8c91-968b4e3935b7-kube-api-access-dtzmw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl\" (UID: \"e4363225-d993-42ac-8c91-968b4e3935b7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl"
Jul 24 17:10:20.827038 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:20.827022    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4363225-d993-42ac-8c91-968b4e3935b7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl\" (UID: \"e4363225-d993-42ac-8c91-968b4e3935b7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl"
Jul 24 17:10:20.827082 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:20.827038    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4363225-d993-42ac-8c91-968b4e3935b7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl\" (UID: \"e4363225-d993-42ac-8c91-968b4e3935b7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl"
Jul 24 17:10:20.834664 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:20.834636    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtzmw\" (UniqueName: \"kubernetes.io/projected/e4363225-d993-42ac-8c91-968b4e3935b7-kube-api-access-dtzmw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl\" (UID: \"e4363225-d993-42ac-8c91-968b4e3935b7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl"
Jul 24 17:10:20.969490 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:20.969409    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl"
Jul 24 17:10:21.098357 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:21.098334    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl"]
Jul 24 17:10:21.100794 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:10:21.100768    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4363225_d993_42ac_8c91_968b4e3935b7.slice/crio-1a0afd97c5d5dcc185e26be832653221cc77fb46b363913b7fbff6bea8495b30 WatchSource:0}: Error finding container 1a0afd97c5d5dcc185e26be832653221cc77fb46b363913b7fbff6bea8495b30: Status 404 returned error can't find the container with id 1a0afd97c5d5dcc185e26be832653221cc77fb46b363913b7fbff6bea8495b30
Jul 24 17:10:21.557272 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:21.557223    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl" event={"ID":"e4363225-d993-42ac-8c91-968b4e3935b7","Type":"ContainerStarted","Data":"1a0afd97c5d5dcc185e26be832653221cc77fb46b363913b7fbff6bea8495b30"}
Jul 24 17:10:28.588488 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:28.588453    2572 generic.go:356] "Generic (PLEG): container finished" podID="e4363225-d993-42ac-8c91-968b4e3935b7" containerID="c1678936166045780081fc250e4dbb3c71921bb118744dd0d190a7ba2e79671e" exitCode=0
Jul 24 17:10:28.588869 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:28.588543    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl" event={"ID":"e4363225-d993-42ac-8c91-968b4e3935b7","Type":"ContainerDied","Data":"c1678936166045780081fc250e4dbb3c71921bb118744dd0d190a7ba2e79671e"}
Jul 24 17:10:31.601933 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:31.601896    2572 generic.go:356] "Generic (PLEG): container finished" podID="e4363225-d993-42ac-8c91-968b4e3935b7" containerID="c7a16f89b693a7c142ee86431f16f18e2e26dd9f56d6a23a3723068f955bf390" exitCode=0
Jul 24 17:10:31.602363 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:31.601940    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl" event={"ID":"e4363225-d993-42ac-8c91-968b4e3935b7","Type":"ContainerDied","Data":"c7a16f89b693a7c142ee86431f16f18e2e26dd9f56d6a23a3723068f955bf390"}
Jul 24 17:10:40.641609 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:40.641576    2572 generic.go:356] "Generic (PLEG): container finished" podID="e4363225-d993-42ac-8c91-968b4e3935b7" containerID="89c7965bddff5f9a31af04b8c28efa60ac8e18cca543ec8ca32672ee81c3962b" exitCode=0
Jul 24 17:10:40.642022 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:40.641622    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl" event={"ID":"e4363225-d993-42ac-8c91-968b4e3935b7","Type":"ContainerDied","Data":"89c7965bddff5f9a31af04b8c28efa60ac8e18cca543ec8ca32672ee81c3962b"}
Jul 24 17:10:41.771592 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:41.771569    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl"
Jul 24 17:10:41.902290 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:41.902212    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtzmw\" (UniqueName: \"kubernetes.io/projected/e4363225-d993-42ac-8c91-968b4e3935b7-kube-api-access-dtzmw\") pod \"e4363225-d993-42ac-8c91-968b4e3935b7\" (UID: \"e4363225-d993-42ac-8c91-968b4e3935b7\") "
Jul 24 17:10:41.902290 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:41.902269    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4363225-d993-42ac-8c91-968b4e3935b7-util\") pod \"e4363225-d993-42ac-8c91-968b4e3935b7\" (UID: \"e4363225-d993-42ac-8c91-968b4e3935b7\") "
Jul 24 17:10:41.902460 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:41.902322    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4363225-d993-42ac-8c91-968b4e3935b7-bundle\") pod \"e4363225-d993-42ac-8c91-968b4e3935b7\" (UID: \"e4363225-d993-42ac-8c91-968b4e3935b7\") "
Jul 24 17:10:41.902981 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:41.902952    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4363225-d993-42ac-8c91-968b4e3935b7-bundle" (OuterVolumeSpecName: "bundle") pod "e4363225-d993-42ac-8c91-968b4e3935b7" (UID: "e4363225-d993-42ac-8c91-968b4e3935b7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:10:41.904595 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:41.904568    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4363225-d993-42ac-8c91-968b4e3935b7-kube-api-access-dtzmw" (OuterVolumeSpecName: "kube-api-access-dtzmw") pod "e4363225-d993-42ac-8c91-968b4e3935b7" (UID: "e4363225-d993-42ac-8c91-968b4e3935b7"). InnerVolumeSpecName "kube-api-access-dtzmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:10:41.906632 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:41.906606    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4363225-d993-42ac-8c91-968b4e3935b7-util" (OuterVolumeSpecName: "util") pod "e4363225-d993-42ac-8c91-968b4e3935b7" (UID: "e4363225-d993-42ac-8c91-968b4e3935b7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:10:42.002936 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:42.002901    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4363225-d993-42ac-8c91-968b4e3935b7-bundle\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:10:42.002936 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:42.002933    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtzmw\" (UniqueName: \"kubernetes.io/projected/e4363225-d993-42ac-8c91-968b4e3935b7-kube-api-access-dtzmw\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:10:42.002936 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:42.002942    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4363225-d993-42ac-8c91-968b4e3935b7-util\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:10:42.651133 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:42.651091    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl" event={"ID":"e4363225-d993-42ac-8c91-968b4e3935b7","Type":"ContainerDied","Data":"1a0afd97c5d5dcc185e26be832653221cc77fb46b363913b7fbff6bea8495b30"}
Jul 24 17:10:42.651133 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:42.651137    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a0afd97c5d5dcc185e26be832653221cc77fb46b363913b7fbff6bea8495b30"
Jul 24 17:10:42.651370 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:42.651142    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540262rl"
Jul 24 17:10:48.766697 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:48.766667    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s9zqh"]
Jul 24 17:10:48.767071 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:48.766924    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4363225-d993-42ac-8c91-968b4e3935b7" containerName="util"
Jul 24 17:10:48.767071 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:48.766935    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4363225-d993-42ac-8c91-968b4e3935b7" containerName="util"
Jul 24 17:10:48.767071 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:48.766945    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4363225-d993-42ac-8c91-968b4e3935b7" containerName="pull"
Jul 24 17:10:48.767071 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:48.766950    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4363225-d993-42ac-8c91-968b4e3935b7" containerName="pull"
Jul 24 17:10:48.767071 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:48.766968    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4363225-d993-42ac-8c91-968b4e3935b7" containerName="extract"
Jul 24 17:10:48.767071 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:48.766973    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4363225-d993-42ac-8c91-968b4e3935b7" containerName="extract"
Jul 24 17:10:48.767071 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:48.767016    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4363225-d993-42ac-8c91-968b4e3935b7" containerName="extract"
Jul 24 17:10:48.772033 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:48.772017    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s9zqh"
Jul 24 17:10:48.774716 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:48.774695    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-2pct7\""
Jul 24 17:10:48.775068 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:48.775051    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:10:48.775140 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:48.775065    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 24 17:10:48.785690 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:48.785672    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s9zqh"]
Jul 24 17:10:48.952864 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:48.952830    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/099d783c-60ce-4cdf-8be6-c54b88cf7195-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-s9zqh\" (UID: \"099d783c-60ce-4cdf-8be6-c54b88cf7195\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s9zqh"
Jul 24 17:10:48.952864 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:48.952864    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pd7j\" (UniqueName: \"kubernetes.io/projected/099d783c-60ce-4cdf-8be6-c54b88cf7195-kube-api-access-4pd7j\") pod \"cert-manager-operator-controller-manager-55c444bf86-s9zqh\" (UID: \"099d783c-60ce-4cdf-8be6-c54b88cf7195\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s9zqh"
Jul 24 17:10:49.053319 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:49.053211    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/099d783c-60ce-4cdf-8be6-c54b88cf7195-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-s9zqh\" (UID: \"099d783c-60ce-4cdf-8be6-c54b88cf7195\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s9zqh"
Jul 24 17:10:49.053319 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:49.053283    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pd7j\" (UniqueName: \"kubernetes.io/projected/099d783c-60ce-4cdf-8be6-c54b88cf7195-kube-api-access-4pd7j\") pod \"cert-manager-operator-controller-manager-55c444bf86-s9zqh\" (UID: \"099d783c-60ce-4cdf-8be6-c54b88cf7195\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s9zqh"
Jul 24 17:10:49.053596 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:49.053575    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/099d783c-60ce-4cdf-8be6-c54b88cf7195-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-s9zqh\" (UID: \"099d783c-60ce-4cdf-8be6-c54b88cf7195\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s9zqh"
Jul 24 17:10:49.062006 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:49.061984    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pd7j\" (UniqueName: \"kubernetes.io/projected/099d783c-60ce-4cdf-8be6-c54b88cf7195-kube-api-access-4pd7j\") pod \"cert-manager-operator-controller-manager-55c444bf86-s9zqh\" (UID: \"099d783c-60ce-4cdf-8be6-c54b88cf7195\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s9zqh"
Jul 24 17:10:49.080931 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:49.080902    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s9zqh"
Jul 24 17:10:49.239022 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:49.238989    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s9zqh"]
Jul 24 17:10:49.243539 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:10:49.243512    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod099d783c_60ce_4cdf_8be6_c54b88cf7195.slice/crio-2c66d73a4d4e930c80903fbae1e94a48356791ceefa1384155f61efd45aa09ad WatchSource:0}: Error finding container 2c66d73a4d4e930c80903fbae1e94a48356791ceefa1384155f61efd45aa09ad: Status 404 returned error can't find the container with id 2c66d73a4d4e930c80903fbae1e94a48356791ceefa1384155f61efd45aa09ad
Jul 24 17:10:49.680524 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:49.680493    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s9zqh" event={"ID":"099d783c-60ce-4cdf-8be6-c54b88cf7195","Type":"ContainerStarted","Data":"2c66d73a4d4e930c80903fbae1e94a48356791ceefa1384155f61efd45aa09ad"}
Jul 24 17:10:50.691901 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:50.691858    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s9zqh" event={"ID":"099d783c-60ce-4cdf-8be6-c54b88cf7195","Type":"ContainerStarted","Data":"2114d68b9dc00d5be86a7919346c14166ff288be30ad9f3b231f4128604d5961"}
Jul 24 17:10:50.714819 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:50.714770    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s9zqh" podStartSLOduration=1.423625103 podStartE2EDuration="2.7147504s" totalImagesPullingTime="1.291125297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:10:50.712400718 +0000 UTC m=+468.146616287" watchObservedRunningTime="2026-07-24 17:10:50.7147504 +0000 UTC m=+468.148965970"
Jul 24 17:10:51.984571 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:51.984532    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf"]
Jul 24 17:10:51.987072 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:51.987048    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf"
Jul 24 17:10:51.989490 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:51.989462    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 17:10:51.989609 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:51.989515    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-l2ztc\""
Jul 24 17:10:51.989609 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:51.989599    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 17:10:51.996748 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:51.996729    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf"]
Jul 24 17:10:52.177297 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.177266    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd6dbfbf-3777-4207-bb06-70b1485ea43a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf\" (UID: \"dd6dbfbf-3777-4207-bb06-70b1485ea43a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf"
Jul 24 17:10:52.177465 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.177339    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c5bk\" (UniqueName: \"kubernetes.io/projected/dd6dbfbf-3777-4207-bb06-70b1485ea43a-kube-api-access-4c5bk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf\" (UID: \"dd6dbfbf-3777-4207-bb06-70b1485ea43a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf"
Jul 24 17:10:52.177465 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.177390    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd6dbfbf-3777-4207-bb06-70b1485ea43a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf\" (UID: \"dd6dbfbf-3777-4207-bb06-70b1485ea43a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf"
Jul 24 17:10:52.278593 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.278526    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd6dbfbf-3777-4207-bb06-70b1485ea43a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf\" (UID: \"dd6dbfbf-3777-4207-bb06-70b1485ea43a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf"
Jul 24 17:10:52.278593 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.278569    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c5bk\" (UniqueName: \"kubernetes.io/projected/dd6dbfbf-3777-4207-bb06-70b1485ea43a-kube-api-access-4c5bk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf\" (UID: \"dd6dbfbf-3777-4207-bb06-70b1485ea43a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf"
Jul 24 17:10:52.278757 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.278589    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd6dbfbf-3777-4207-bb06-70b1485ea43a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf\" (UID: \"dd6dbfbf-3777-4207-bb06-70b1485ea43a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf"
Jul 24 17:10:52.278908 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.278891    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd6dbfbf-3777-4207-bb06-70b1485ea43a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf\" (UID: \"dd6dbfbf-3777-4207-bb06-70b1485ea43a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf"
Jul 24 17:10:52.278956 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.278942    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd6dbfbf-3777-4207-bb06-70b1485ea43a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf\" (UID: \"dd6dbfbf-3777-4207-bb06-70b1485ea43a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf"
Jul 24 17:10:52.287292 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.287269    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c5bk\" (UniqueName: \"kubernetes.io/projected/dd6dbfbf-3777-4207-bb06-70b1485ea43a-kube-api-access-4c5bk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf\" (UID: \"dd6dbfbf-3777-4207-bb06-70b1485ea43a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf"
Jul 24 17:10:52.296090 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.296072    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf"
Jul 24 17:10:52.426893 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.426861    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-59z6p"]
Jul 24 17:10:52.429805 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.429783    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf"]
Jul 24 17:10:52.429929 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.429878    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-59z6p"
Jul 24 17:10:52.432442 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.432420    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 24 17:10:52.432442 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.432435    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-xwzj6\""
Jul 24 17:10:52.432692 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.432678    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 24 17:10:52.433316 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:10:52.433291    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd6dbfbf_3777_4207_bb06_70b1485ea43a.slice/crio-095d5a10f46a49b1a988049d70b4946ea3ee9834e3d2bf7496f2a6ff96d1d0f1 WatchSource:0}: Error finding container 095d5a10f46a49b1a988049d70b4946ea3ee9834e3d2bf7496f2a6ff96d1d0f1: Status 404 returned error can't find the container with id 095d5a10f46a49b1a988049d70b4946ea3ee9834e3d2bf7496f2a6ff96d1d0f1
Jul 24 17:10:52.440063 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.440039    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-59z6p"]
Jul 24 17:10:52.581416 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.581389    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62a07a74-e465-4f05-bef1-84fd9b30cb84-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-59z6p\" (UID: \"62a07a74-e465-4f05-bef1-84fd9b30cb84\") " pod="cert-manager/cert-manager-webhook-6486ffd997-59z6p"
Jul 24 17:10:52.581542 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.581454    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rgj4\" (UniqueName: \"kubernetes.io/projected/62a07a74-e465-4f05-bef1-84fd9b30cb84-kube-api-access-4rgj4\") pod \"cert-manager-webhook-6486ffd997-59z6p\" (UID: \"62a07a74-e465-4f05-bef1-84fd9b30cb84\") " pod="cert-manager/cert-manager-webhook-6486ffd997-59z6p"
Jul 24 17:10:52.682062 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.682032    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rgj4\" (UniqueName: \"kubernetes.io/projected/62a07a74-e465-4f05-bef1-84fd9b30cb84-kube-api-access-4rgj4\") pod \"cert-manager-webhook-6486ffd997-59z6p\" (UID: \"62a07a74-e465-4f05-bef1-84fd9b30cb84\") " pod="cert-manager/cert-manager-webhook-6486ffd997-59z6p"
Jul 24 17:10:52.682191 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.682095    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62a07a74-e465-4f05-bef1-84fd9b30cb84-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-59z6p\" (UID: \"62a07a74-e465-4f05-bef1-84fd9b30cb84\") " pod="cert-manager/cert-manager-webhook-6486ffd997-59z6p"
Jul 24 17:10:52.690749 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.690721    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62a07a74-e465-4f05-bef1-84fd9b30cb84-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-59z6p\" (UID: \"62a07a74-e465-4f05-bef1-84fd9b30cb84\") " pod="cert-manager/cert-manager-webhook-6486ffd997-59z6p"
Jul 24 17:10:52.690857 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.690840    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rgj4\" (UniqueName: \"kubernetes.io/projected/62a07a74-e465-4f05-bef1-84fd9b30cb84-kube-api-access-4rgj4\") pod \"cert-manager-webhook-6486ffd997-59z6p\" (UID: \"62a07a74-e465-4f05-bef1-84fd9b30cb84\") " pod="cert-manager/cert-manager-webhook-6486ffd997-59z6p"
Jul 24 17:10:52.701462 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.701439    2572 generic.go:356] "Generic (PLEG): container finished" podID="dd6dbfbf-3777-4207-bb06-70b1485ea43a" containerID="a5292cc145ac1e83fc46ddd93d3ad80200b5208fdddcb9fdb2f2c68ae0632eb8" exitCode=0
Jul 24 17:10:52.701550 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.701529    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf" event={"ID":"dd6dbfbf-3777-4207-bb06-70b1485ea43a","Type":"ContainerDied","Data":"a5292cc145ac1e83fc46ddd93d3ad80200b5208fdddcb9fdb2f2c68ae0632eb8"}
Jul 24 17:10:52.701602 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.701581    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf" event={"ID":"dd6dbfbf-3777-4207-bb06-70b1485ea43a","Type":"ContainerStarted","Data":"095d5a10f46a49b1a988049d70b4946ea3ee9834e3d2bf7496f2a6ff96d1d0f1"}
Jul 24 17:10:52.755096 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.755069    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-59z6p"
Jul 24 17:10:52.879719 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:52.879695    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-59z6p"]
Jul 24 17:10:52.881962 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:10:52.881938    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62a07a74_e465_4f05_bef1_84fd9b30cb84.slice/crio-f40e58b5a72a428fe169ac6e42b52a77006da10e1c595d6d96f6b04d53515e46 WatchSource:0}: Error finding container f40e58b5a72a428fe169ac6e42b52a77006da10e1c595d6d96f6b04d53515e46: Status 404 returned error can't find the container with id f40e58b5a72a428fe169ac6e42b52a77006da10e1c595d6d96f6b04d53515e46
Jul 24 17:10:53.708472 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:53.708411    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-59z6p" event={"ID":"62a07a74-e465-4f05-bef1-84fd9b30cb84","Type":"ContainerStarted","Data":"f40e58b5a72a428fe169ac6e42b52a77006da10e1c595d6d96f6b04d53515e46"}
Jul 24 17:10:55.720527 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:55.720501    2572 generic.go:356] "Generic (PLEG): container finished" podID="dd6dbfbf-3777-4207-bb06-70b1485ea43a" containerID="286fd640c82b9581ec7559b5ab07f49d1937c7a8bab9363e5b532acddaed90a8" exitCode=0
Jul 24 17:10:55.720829 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:55.720590    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf" event={"ID":"dd6dbfbf-3777-4207-bb06-70b1485ea43a","Type":"ContainerDied","Data":"286fd640c82b9581ec7559b5ab07f49d1937c7a8bab9363e5b532acddaed90a8"}
Jul 24 17:10:56.726477 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:56.726437    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-59z6p" event={"ID":"62a07a74-e465-4f05-bef1-84fd9b30cb84","Type":"ContainerStarted","Data":"6060a742a1014b90c9fbf86e417bedf1c3a6fc1bc95ed777e8963ab399af3764"}
Jul 24 17:10:56.726899 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:56.726558    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-59z6p"
Jul 24 17:10:56.728460 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:56.728437    2572 generic.go:356] "Generic (PLEG): container finished" podID="dd6dbfbf-3777-4207-bb06-70b1485ea43a" containerID="a880f27de28123ade15d4e98bd878ee307af155af46a6ca5d14573c6a4fbca61" exitCode=0
Jul 24 17:10:56.728555 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:56.728479    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf" event={"ID":"dd6dbfbf-3777-4207-bb06-70b1485ea43a","Type":"ContainerDied","Data":"a880f27de28123ade15d4e98bd878ee307af155af46a6ca5d14573c6a4fbca61"}
Jul 24 17:10:56.742796 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:56.742748    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-59z6p" podStartSLOduration=1.9278432319999999 podStartE2EDuration="4.742737043s" totalImagesPullingTime="2.814893811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:10:56.741193363 +0000 UTC m=+474.175408931" watchObservedRunningTime="2026-07-24 17:10:56.742737043 +0000 UTC m=+474.176952609"
Jul 24 17:10:57.857044 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:57.857023    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf"
Jul 24 17:10:57.923240 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:57.923214    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4c5bk\" (UniqueName: \"kubernetes.io/projected/dd6dbfbf-3777-4207-bb06-70b1485ea43a-kube-api-access-4c5bk\") pod \"dd6dbfbf-3777-4207-bb06-70b1485ea43a\" (UID: \"dd6dbfbf-3777-4207-bb06-70b1485ea43a\") "
Jul 24 17:10:57.923362 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:57.923271    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd6dbfbf-3777-4207-bb06-70b1485ea43a-bundle\") pod \"dd6dbfbf-3777-4207-bb06-70b1485ea43a\" (UID: \"dd6dbfbf-3777-4207-bb06-70b1485ea43a\") "
Jul 24 17:10:57.923415 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:57.923389    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd6dbfbf-3777-4207-bb06-70b1485ea43a-util\") pod \"dd6dbfbf-3777-4207-bb06-70b1485ea43a\" (UID: \"dd6dbfbf-3777-4207-bb06-70b1485ea43a\") "
Jul 24 17:10:57.923678 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:57.923651    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd6dbfbf-3777-4207-bb06-70b1485ea43a-bundle" (OuterVolumeSpecName: "bundle") pod "dd6dbfbf-3777-4207-bb06-70b1485ea43a" (UID: "dd6dbfbf-3777-4207-bb06-70b1485ea43a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:10:57.925479 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:57.925458    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd6dbfbf-3777-4207-bb06-70b1485ea43a-kube-api-access-4c5bk" (OuterVolumeSpecName: "kube-api-access-4c5bk") pod "dd6dbfbf-3777-4207-bb06-70b1485ea43a" (UID: "dd6dbfbf-3777-4207-bb06-70b1485ea43a"). InnerVolumeSpecName "kube-api-access-4c5bk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:10:57.928601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:57.928576    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd6dbfbf-3777-4207-bb06-70b1485ea43a-util" (OuterVolumeSpecName: "util") pod "dd6dbfbf-3777-4207-bb06-70b1485ea43a" (UID: "dd6dbfbf-3777-4207-bb06-70b1485ea43a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:10:58.024367 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:58.024297    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4c5bk\" (UniqueName: \"kubernetes.io/projected/dd6dbfbf-3777-4207-bb06-70b1485ea43a-kube-api-access-4c5bk\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:10:58.024367 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:58.024319    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd6dbfbf-3777-4207-bb06-70b1485ea43a-bundle\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:10:58.024367 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:58.024328    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd6dbfbf-3777-4207-bb06-70b1485ea43a-util\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:10:58.738905 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:58.738870    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf" event={"ID":"dd6dbfbf-3777-4207-bb06-70b1485ea43a","Type":"ContainerDied","Data":"095d5a10f46a49b1a988049d70b4946ea3ee9834e3d2bf7496f2a6ff96d1d0f1"}
Jul 24 17:10:58.738905 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:58.738888    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7kcf"
Jul 24 17:10:58.739107 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:10:58.738917    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="095d5a10f46a49b1a988049d70b4946ea3ee9834e3d2bf7496f2a6ff96d1d0f1"
Jul 24 17:11:02.736039 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:02.736008    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-59z6p"
Jul 24 17:11:03.638330 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:03.638288    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ddtzq"]
Jul 24 17:11:03.638637 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:03.638620    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd6dbfbf-3777-4207-bb06-70b1485ea43a" containerName="pull"
Jul 24 17:11:03.638718 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:03.638642    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd6dbfbf-3777-4207-bb06-70b1485ea43a" containerName="pull"
Jul 24 17:11:03.638718 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:03.638656    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd6dbfbf-3777-4207-bb06-70b1485ea43a" containerName="util"
Jul 24 17:11:03.638718 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:03.638664    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd6dbfbf-3777-4207-bb06-70b1485ea43a" containerName="util"
Jul 24 17:11:03.638718 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:03.638676    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd6dbfbf-3777-4207-bb06-70b1485ea43a" containerName="extract"
Jul 24 17:11:03.638718 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:03.638684    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd6dbfbf-3777-4207-bb06-70b1485ea43a" containerName="extract"
Jul 24 17:11:03.638955 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:03.638789    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd6dbfbf-3777-4207-bb06-70b1485ea43a" containerName="extract"
Jul 24 17:11:03.643136 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:03.643114    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ddtzq"
Jul 24 17:11:03.645324 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:03.645304    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-c7mzh\""
Jul 24 17:11:03.648633 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:03.648613    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ddtzq"]
Jul 24 17:11:03.664712 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:03.664688    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtm6j\" (UniqueName: \"kubernetes.io/projected/54694d37-3936-44da-a1c8-dcff0e9ec0bf-kube-api-access-xtm6j\") pod \"cert-manager-55b4d954d5-ddtzq\" (UID: \"54694d37-3936-44da-a1c8-dcff0e9ec0bf\") " pod="cert-manager/cert-manager-55b4d954d5-ddtzq"
Jul 24 17:11:03.664808 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:03.664740    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54694d37-3936-44da-a1c8-dcff0e9ec0bf-bound-sa-token\") pod \"cert-manager-55b4d954d5-ddtzq\" (UID: \"54694d37-3936-44da-a1c8-dcff0e9ec0bf\") " pod="cert-manager/cert-manager-55b4d954d5-ddtzq"
Jul 24 17:11:03.765833 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:03.765807    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54694d37-3936-44da-a1c8-dcff0e9ec0bf-bound-sa-token\") pod \"cert-manager-55b4d954d5-ddtzq\" (UID: \"54694d37-3936-44da-a1c8-dcff0e9ec0bf\") " pod="cert-manager/cert-manager-55b4d954d5-ddtzq"
Jul 24 17:11:03.766286 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:03.765852    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtm6j\" (UniqueName: \"kubernetes.io/projected/54694d37-3936-44da-a1c8-dcff0e9ec0bf-kube-api-access-xtm6j\") pod \"cert-manager-55b4d954d5-ddtzq\" (UID: \"54694d37-3936-44da-a1c8-dcff0e9ec0bf\") " pod="cert-manager/cert-manager-55b4d954d5-ddtzq"
Jul 24 17:11:03.773817 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:03.773791    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54694d37-3936-44da-a1c8-dcff0e9ec0bf-bound-sa-token\") pod \"cert-manager-55b4d954d5-ddtzq\" (UID: \"54694d37-3936-44da-a1c8-dcff0e9ec0bf\") " pod="cert-manager/cert-manager-55b4d954d5-ddtzq"
Jul 24 17:11:03.773905 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:03.773883    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtm6j\" (UniqueName: \"kubernetes.io/projected/54694d37-3936-44da-a1c8-dcff0e9ec0bf-kube-api-access-xtm6j\") pod \"cert-manager-55b4d954d5-ddtzq\" (UID: \"54694d37-3936-44da-a1c8-dcff0e9ec0bf\") " pod="cert-manager/cert-manager-55b4d954d5-ddtzq"
Jul 24 17:11:03.952493 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:03.952404    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ddtzq"
Jul 24 17:11:04.084079 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:04.084047    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ddtzq"]
Jul 24 17:11:04.086663 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:11:04.086636    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54694d37_3936_44da_a1c8_dcff0e9ec0bf.slice/crio-2c2036ca1251edc8b2c26efe532f3bddc782e091ec08ef018581cea87093e20e WatchSource:0}: Error finding container 2c2036ca1251edc8b2c26efe532f3bddc782e091ec08ef018581cea87093e20e: Status 404 returned error can't find the container with id 2c2036ca1251edc8b2c26efe532f3bddc782e091ec08ef018581cea87093e20e
Jul 24 17:11:04.764482 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:04.764444    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ddtzq" event={"ID":"54694d37-3936-44da-a1c8-dcff0e9ec0bf","Type":"ContainerStarted","Data":"1dfd55253ff9431858e319da9333f3d5e591bfa65ced7a1b113bbda6aba7aaa0"}
Jul 24 17:11:04.764650 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:04.764492    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ddtzq" event={"ID":"54694d37-3936-44da-a1c8-dcff0e9ec0bf","Type":"ContainerStarted","Data":"2c2036ca1251edc8b2c26efe532f3bddc782e091ec08ef018581cea87093e20e"}
Jul 24 17:11:04.780987 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:04.780916    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-ddtzq" podStartSLOduration=1.780902168 podStartE2EDuration="1.780902168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:11:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:04.779145582 +0000 UTC m=+482.213361150" watchObservedRunningTime="2026-07-24 17:11:04.780902168 +0000 UTC m=+482.215117735"
Jul 24 17:11:10.842345 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:10.842304    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf"]
Jul 24 17:11:10.895139 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:10.895100    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf"]
Jul 24 17:11:10.895377 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:10.895204    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf"
Jul 24 17:11:10.897666 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:10.897643    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-l2ztc\""
Jul 24 17:11:10.897666 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:10.897659    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 17:11:10.898439 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:10.898424    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 17:11:10.924386 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:10.924359    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52b8ed14-7cb0-4c13-a658-c0a0dd897781-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf\" (UID: \"52b8ed14-7cb0-4c13-a658-c0a0dd897781\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf"
Jul 24 17:11:10.924481 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:10.924394    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52b8ed14-7cb0-4c13-a658-c0a0dd897781-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf\" (UID: \"52b8ed14-7cb0-4c13-a658-c0a0dd897781\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf"
Jul 24 17:11:10.924481 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:10.924460    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz4d6\" (UniqueName: \"kubernetes.io/projected/52b8ed14-7cb0-4c13-a658-c0a0dd897781-kube-api-access-tz4d6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf\" (UID: \"52b8ed14-7cb0-4c13-a658-c0a0dd897781\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf"
Jul 24 17:11:11.025192 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:11.025158    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52b8ed14-7cb0-4c13-a658-c0a0dd897781-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf\" (UID: \"52b8ed14-7cb0-4c13-a658-c0a0dd897781\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf"
Jul 24 17:11:11.025404 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:11.025199    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52b8ed14-7cb0-4c13-a658-c0a0dd897781-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf\" (UID: \"52b8ed14-7cb0-4c13-a658-c0a0dd897781\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf"
Jul 24 17:11:11.025404 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:11.025277    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz4d6\" (UniqueName: \"kubernetes.io/projected/52b8ed14-7cb0-4c13-a658-c0a0dd897781-kube-api-access-tz4d6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf\" (UID: \"52b8ed14-7cb0-4c13-a658-c0a0dd897781\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf"
Jul 24 17:11:11.025645 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:11.025622    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52b8ed14-7cb0-4c13-a658-c0a0dd897781-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf\" (UID: \"52b8ed14-7cb0-4c13-a658-c0a0dd897781\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf"
Jul 24 17:11:11.025734 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:11.025634    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52b8ed14-7cb0-4c13-a658-c0a0dd897781-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf\" (UID: \"52b8ed14-7cb0-4c13-a658-c0a0dd897781\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf"
Jul 24 17:11:11.033687 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:11.033657    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz4d6\" (UniqueName: \"kubernetes.io/projected/52b8ed14-7cb0-4c13-a658-c0a0dd897781-kube-api-access-tz4d6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf\" (UID: \"52b8ed14-7cb0-4c13-a658-c0a0dd897781\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf"
Jul 24 17:11:11.204444 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:11.204407    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf"
Jul 24 17:11:11.376853 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:11.376821    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf"]
Jul 24 17:11:11.379914 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:11:11.379890    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b8ed14_7cb0_4c13_a658_c0a0dd897781.slice/crio-f68bddb6dcb697b0b1ac90ba54a3c2d447ef34563e65ae8e8afa9418ee6419af WatchSource:0}: Error finding container f68bddb6dcb697b0b1ac90ba54a3c2d447ef34563e65ae8e8afa9418ee6419af: Status 404 returned error can't find the container with id f68bddb6dcb697b0b1ac90ba54a3c2d447ef34563e65ae8e8afa9418ee6419af
Jul 24 17:11:11.793864 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:11.793775    2572 generic.go:356] "Generic (PLEG): container finished" podID="52b8ed14-7cb0-4c13-a658-c0a0dd897781" containerID="325cb798d4caa3a66cbc698858f01c0ba0b236e0ff5fb8142e26a96025853418" exitCode=0
Jul 24 17:11:11.793864 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:11.793827    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf" event={"ID":"52b8ed14-7cb0-4c13-a658-c0a0dd897781","Type":"ContainerDied","Data":"325cb798d4caa3a66cbc698858f01c0ba0b236e0ff5fb8142e26a96025853418"}
Jul 24 17:11:11.793864 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:11.793862    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf" event={"ID":"52b8ed14-7cb0-4c13-a658-c0a0dd897781","Type":"ContainerStarted","Data":"f68bddb6dcb697b0b1ac90ba54a3c2d447ef34563e65ae8e8afa9418ee6419af"}
Jul 24 17:11:12.799981 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:12.799895    2572 generic.go:356] "Generic (PLEG): container finished" podID="52b8ed14-7cb0-4c13-a658-c0a0dd897781" containerID="ed12046a1e3b8d57584c452c42d67040c25c8ac74bcada39dc90ee2e200fc6e3" exitCode=0
Jul 24 17:11:12.799981 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:12.799957    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf" event={"ID":"52b8ed14-7cb0-4c13-a658-c0a0dd897781","Type":"ContainerDied","Data":"ed12046a1e3b8d57584c452c42d67040c25c8ac74bcada39dc90ee2e200fc6e3"}
Jul 24 17:11:13.806405 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:13.806371    2572 generic.go:356] "Generic (PLEG): container finished" podID="52b8ed14-7cb0-4c13-a658-c0a0dd897781" containerID="ce3d7337eca3974bae1f1f226a6e4c4819ad50189bdd36ce118f87b8612253f3" exitCode=0
Jul 24 17:11:13.806809 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:13.806456    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf" event={"ID":"52b8ed14-7cb0-4c13-a658-c0a0dd897781","Type":"ContainerDied","Data":"ce3d7337eca3974bae1f1f226a6e4c4819ad50189bdd36ce118f87b8612253f3"}
Jul 24 17:11:14.934126 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:14.934105    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf"
Jul 24 17:11:15.056951 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:15.056924    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52b8ed14-7cb0-4c13-a658-c0a0dd897781-util\") pod \"52b8ed14-7cb0-4c13-a658-c0a0dd897781\" (UID: \"52b8ed14-7cb0-4c13-a658-c0a0dd897781\") "
Jul 24 17:11:15.057145 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:15.057028    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52b8ed14-7cb0-4c13-a658-c0a0dd897781-bundle\") pod \"52b8ed14-7cb0-4c13-a658-c0a0dd897781\" (UID: \"52b8ed14-7cb0-4c13-a658-c0a0dd897781\") "
Jul 24 17:11:15.057145 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:15.057059    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tz4d6\" (UniqueName: \"kubernetes.io/projected/52b8ed14-7cb0-4c13-a658-c0a0dd897781-kube-api-access-tz4d6\") pod \"52b8ed14-7cb0-4c13-a658-c0a0dd897781\" (UID: \"52b8ed14-7cb0-4c13-a658-c0a0dd897781\") "
Jul 24 17:11:15.057736 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:15.057707    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b8ed14-7cb0-4c13-a658-c0a0dd897781-bundle" (OuterVolumeSpecName: "bundle") pod "52b8ed14-7cb0-4c13-a658-c0a0dd897781" (UID: "52b8ed14-7cb0-4c13-a658-c0a0dd897781"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:11:15.059263 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:15.059216    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52b8ed14-7cb0-4c13-a658-c0a0dd897781-kube-api-access-tz4d6" (OuterVolumeSpecName: "kube-api-access-tz4d6") pod "52b8ed14-7cb0-4c13-a658-c0a0dd897781" (UID: "52b8ed14-7cb0-4c13-a658-c0a0dd897781"). InnerVolumeSpecName "kube-api-access-tz4d6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:11:15.063000 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:15.062941    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b8ed14-7cb0-4c13-a658-c0a0dd897781-util" (OuterVolumeSpecName: "util") pod "52b8ed14-7cb0-4c13-a658-c0a0dd897781" (UID: "52b8ed14-7cb0-4c13-a658-c0a0dd897781"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:11:15.158710 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:15.158665    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52b8ed14-7cb0-4c13-a658-c0a0dd897781-bundle\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:11:15.158710 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:15.158693    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tz4d6\" (UniqueName: \"kubernetes.io/projected/52b8ed14-7cb0-4c13-a658-c0a0dd897781-kube-api-access-tz4d6\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:11:15.158710 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:15.158704    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52b8ed14-7cb0-4c13-a658-c0a0dd897781-util\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:11:15.816793 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:15.816758    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf" event={"ID":"52b8ed14-7cb0-4c13-a658-c0a0dd897781","Type":"ContainerDied","Data":"f68bddb6dcb697b0b1ac90ba54a3c2d447ef34563e65ae8e8afa9418ee6419af"}
Jul 24 17:11:15.816793 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:15.816796    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqplqf"
Jul 24 17:11:15.816995 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:15.816815    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f68bddb6dcb697b0b1ac90ba54a3c2d447ef34563e65ae8e8afa9418ee6419af"
Jul 24 17:11:26.778382 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.778348    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p"]
Jul 24 17:11:26.778734 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.778623    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52b8ed14-7cb0-4c13-a658-c0a0dd897781" containerName="pull"
Jul 24 17:11:26.778734 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.778634    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="52b8ed14-7cb0-4c13-a658-c0a0dd897781" containerName="pull"
Jul 24 17:11:26.778734 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.778644    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52b8ed14-7cb0-4c13-a658-c0a0dd897781" containerName="util"
Jul 24 17:11:26.778734 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.778649    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="52b8ed14-7cb0-4c13-a658-c0a0dd897781" containerName="util"
Jul 24 17:11:26.778734 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.778658    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52b8ed14-7cb0-4c13-a658-c0a0dd897781" containerName="extract"
Jul 24 17:11:26.778734 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.778663    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="52b8ed14-7cb0-4c13-a658-c0a0dd897781" containerName="extract"
Jul 24 17:11:26.778734 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.778718    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="52b8ed14-7cb0-4c13-a658-c0a0dd897781" containerName="extract"
Jul 24 17:11:26.780652 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.780637    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p"
Jul 24 17:11:26.783442 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.783410    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pksz9\""
Jul 24 17:11:26.783442 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.783429    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 17:11:26.783668 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.783654    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 17:11:26.785720 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.785696    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 17:11:26.786345 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.786256    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 17:11:26.800413 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.800386    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p"]
Jul 24 17:11:26.855283 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.855258    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-775k2\" (UniqueName: \"kubernetes.io/projected/871530fe-ba09-4793-9890-a3845f7e2ee0-kube-api-access-775k2\") pod \"opendatahub-operator-controller-manager-645867896-hgk2p\" (UID: \"871530fe-ba09-4793-9890-a3845f7e2ee0\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p"
Jul 24 17:11:26.855414 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.855324    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/871530fe-ba09-4793-9890-a3845f7e2ee0-manifests\") pod \"opendatahub-operator-controller-manager-645867896-hgk2p\" (UID: \"871530fe-ba09-4793-9890-a3845f7e2ee0\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p"
Jul 24 17:11:26.855414 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.855344    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/871530fe-ba09-4793-9890-a3845f7e2ee0-tmp\") pod \"opendatahub-operator-controller-manager-645867896-hgk2p\" (UID: \"871530fe-ba09-4793-9890-a3845f7e2ee0\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p"
Jul 24 17:11:26.855414 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.855364    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/871530fe-ba09-4793-9890-a3845f7e2ee0-webhook-cert\") pod \"opendatahub-operator-controller-manager-645867896-hgk2p\" (UID: \"871530fe-ba09-4793-9890-a3845f7e2ee0\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p"
Jul 24 17:11:26.855414 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.855394    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/871530fe-ba09-4793-9890-a3845f7e2ee0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-645867896-hgk2p\" (UID: \"871530fe-ba09-4793-9890-a3845f7e2ee0\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p"
Jul 24 17:11:26.956551 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.956521    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/871530fe-ba09-4793-9890-a3845f7e2ee0-manifests\") pod \"opendatahub-operator-controller-manager-645867896-hgk2p\" (UID: \"871530fe-ba09-4793-9890-a3845f7e2ee0\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p"
Jul 24 17:11:26.956551 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.956552    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/871530fe-ba09-4793-9890-a3845f7e2ee0-tmp\") pod \"opendatahub-operator-controller-manager-645867896-hgk2p\" (UID: \"871530fe-ba09-4793-9890-a3845f7e2ee0\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p"
Jul 24 17:11:26.956773 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.956573    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/871530fe-ba09-4793-9890-a3845f7e2ee0-webhook-cert\") pod \"opendatahub-operator-controller-manager-645867896-hgk2p\" (UID: \"871530fe-ba09-4793-9890-a3845f7e2ee0\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p"
Jul 24 17:11:26.956773 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.956595    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/871530fe-ba09-4793-9890-a3845f7e2ee0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-645867896-hgk2p\" (UID: \"871530fe-ba09-4793-9890-a3845f7e2ee0\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p"
Jul 24 17:11:26.956773 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.956632    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-775k2\" (UniqueName: \"kubernetes.io/projected/871530fe-ba09-4793-9890-a3845f7e2ee0-kube-api-access-775k2\") pod \"opendatahub-operator-controller-manager-645867896-hgk2p\" (UID: \"871530fe-ba09-4793-9890-a3845f7e2ee0\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p"
Jul 24 17:11:26.956986 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.956962    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/871530fe-ba09-4793-9890-a3845f7e2ee0-manifests\") pod \"opendatahub-operator-controller-manager-645867896-hgk2p\" (UID: \"871530fe-ba09-4793-9890-a3845f7e2ee0\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p"
Jul 24 17:11:26.959080 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.959060    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/871530fe-ba09-4793-9890-a3845f7e2ee0-tmp\") pod \"opendatahub-operator-controller-manager-645867896-hgk2p\" (UID: \"871530fe-ba09-4793-9890-a3845f7e2ee0\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p"
Jul 24 17:11:26.959195 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.959180    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/871530fe-ba09-4793-9890-a3845f7e2ee0-webhook-cert\") pod \"opendatahub-operator-controller-manager-645867896-hgk2p\" (UID: \"871530fe-ba09-4793-9890-a3845f7e2ee0\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p"
Jul 24 17:11:26.959330 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.959312    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/871530fe-ba09-4793-9890-a3845f7e2ee0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-645867896-hgk2p\" (UID: \"871530fe-ba09-4793-9890-a3845f7e2ee0\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p"
Jul 24 17:11:26.970083 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:26.970059    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-775k2\" (UniqueName: \"kubernetes.io/projected/871530fe-ba09-4793-9890-a3845f7e2ee0-kube-api-access-775k2\") pod \"opendatahub-operator-controller-manager-645867896-hgk2p\" (UID: \"871530fe-ba09-4793-9890-a3845f7e2ee0\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p"
Jul 24 17:11:27.090560 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:27.090487    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p"
Jul 24 17:11:27.243224 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:27.243194    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p"]
Jul 24 17:11:27.247064 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:11:27.247042    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod871530fe_ba09_4793_9890_a3845f7e2ee0.slice/crio-0a7501ccd8f91703bf48fa4d72beddf73f92bbf02ca54b42cff543d489993d4c WatchSource:0}: Error finding container 0a7501ccd8f91703bf48fa4d72beddf73f92bbf02ca54b42cff543d489993d4c: Status 404 returned error can't find the container with id 0a7501ccd8f91703bf48fa4d72beddf73f92bbf02ca54b42cff543d489993d4c
Jul 24 17:11:27.869616 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:27.869543    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p" event={"ID":"871530fe-ba09-4793-9890-a3845f7e2ee0","Type":"ContainerStarted","Data":"0a7501ccd8f91703bf48fa4d72beddf73f92bbf02ca54b42cff543d489993d4c"}
Jul 24 17:11:30.888995 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:30.888959    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p" event={"ID":"871530fe-ba09-4793-9890-a3845f7e2ee0","Type":"ContainerStarted","Data":"a1e7e38363279b825db3c2230291ff8a3a139510ddb4bc0a994207e4179c986d"}
Jul 24 17:11:31.894251 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:31.894204    2572 generic.go:356] "Generic (PLEG): container finished" podID="871530fe-ba09-4793-9890-a3845f7e2ee0" containerID="a1e7e38363279b825db3c2230291ff8a3a139510ddb4bc0a994207e4179c986d" exitCode=0
Jul 24 17:11:31.894648 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:31.894291    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p" event={"ID":"871530fe-ba09-4793-9890-a3845f7e2ee0","Type":"ContainerDied","Data":"a1e7e38363279b825db3c2230291ff8a3a139510ddb4bc0a994207e4179c986d"}
Jul 24 17:11:32.901400 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:32.901367    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p" event={"ID":"871530fe-ba09-4793-9890-a3845f7e2ee0","Type":"ContainerStarted","Data":"5771d26ca2319a29b80c72357b0dad102ff3f4353baee1723fc939d1b4352f08"}
Jul 24 17:11:32.901869 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:32.901477    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p"
Jul 24 17:11:32.939201 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:32.939148    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p" podStartSLOduration=2.650155716 podStartE2EDuration="6.939131538s" totalImagesPullingTime="3.200940279s" totalInitContainerRuntime="1.088035543s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:11:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:32.937062659 +0000 UTC m=+510.371278223" watchObservedRunningTime="2026-07-24 17:11:32.939131538 +0000 UTC m=+510.373347104"
Jul 24 17:11:43.908218 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:43.908186    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-645867896-hgk2p"
Jul 24 17:11:46.320543 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.320512    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8cdf7544b-fxfn4"]
Jul 24 17:11:46.334921 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.334889    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8cdf7544b-fxfn4"
Jul 24 17:11:46.337976 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.337948    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 24 17:11:46.338243 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.338213    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 24 17:11:46.338390 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.338375    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fwj8w\""
Jul 24 17:11:46.367059 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.367033    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8cdf7544b-fxfn4"]
Jul 24 17:11:46.524375 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.524339    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/698b7d8f-da2d-470d-9499-f29bd91eb9ab-tmp\") pod \"kube-auth-proxy-8cdf7544b-fxfn4\" (UID: \"698b7d8f-da2d-470d-9499-f29bd91eb9ab\") " pod="openshift-ingress/kube-auth-proxy-8cdf7544b-fxfn4"
Jul 24 17:11:46.524558 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.524422    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/698b7d8f-da2d-470d-9499-f29bd91eb9ab-tls-certs\") pod \"kube-auth-proxy-8cdf7544b-fxfn4\" (UID: \"698b7d8f-da2d-470d-9499-f29bd91eb9ab\") " pod="openshift-ingress/kube-auth-proxy-8cdf7544b-fxfn4"
Jul 24 17:11:46.524558 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.524472    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrqbh\" (UniqueName: \"kubernetes.io/projected/698b7d8f-da2d-470d-9499-f29bd91eb9ab-kube-api-access-hrqbh\") pod \"kube-auth-proxy-8cdf7544b-fxfn4\" (UID: \"698b7d8f-da2d-470d-9499-f29bd91eb9ab\") " pod="openshift-ingress/kube-auth-proxy-8cdf7544b-fxfn4"
Jul 24 17:11:46.541912 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.541876    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-89xqj"]
Jul 24 17:11:46.545039 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.545022    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-89xqj"
Jul 24 17:11:46.550671 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.550037    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 24 17:11:46.550671 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.550324    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lp7p8\""
Jul 24 17:11:46.560555 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.560533    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-89xqj"]
Jul 24 17:11:46.625796 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.625765    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrqbh\" (UniqueName: \"kubernetes.io/projected/698b7d8f-da2d-470d-9499-f29bd91eb9ab-kube-api-access-hrqbh\") pod \"kube-auth-proxy-8cdf7544b-fxfn4\" (UID: \"698b7d8f-da2d-470d-9499-f29bd91eb9ab\") " pod="openshift-ingress/kube-auth-proxy-8cdf7544b-fxfn4"
Jul 24 17:11:46.625952 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.625807    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/698b7d8f-da2d-470d-9499-f29bd91eb9ab-tmp\") pod \"kube-auth-proxy-8cdf7544b-fxfn4\" (UID: \"698b7d8f-da2d-470d-9499-f29bd91eb9ab\") " pod="openshift-ingress/kube-auth-proxy-8cdf7544b-fxfn4"
Jul 24 17:11:46.625952 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.625863    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/698b7d8f-da2d-470d-9499-f29bd91eb9ab-tls-certs\") pod \"kube-auth-proxy-8cdf7544b-fxfn4\" (UID: \"698b7d8f-da2d-470d-9499-f29bd91eb9ab\") " pod="openshift-ingress/kube-auth-proxy-8cdf7544b-fxfn4"
Jul 24 17:11:46.628257 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.628204    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/698b7d8f-da2d-470d-9499-f29bd91eb9ab-tmp\") pod \"kube-auth-proxy-8cdf7544b-fxfn4\" (UID: \"698b7d8f-da2d-470d-9499-f29bd91eb9ab\") " pod="openshift-ingress/kube-auth-proxy-8cdf7544b-fxfn4"
Jul 24 17:11:46.628403 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.628388    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/698b7d8f-da2d-470d-9499-f29bd91eb9ab-tls-certs\") pod \"kube-auth-proxy-8cdf7544b-fxfn4\" (UID: \"698b7d8f-da2d-470d-9499-f29bd91eb9ab\") " pod="openshift-ingress/kube-auth-proxy-8cdf7544b-fxfn4"
Jul 24 17:11:46.658990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.658961    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrqbh\" (UniqueName: \"kubernetes.io/projected/698b7d8f-da2d-470d-9499-f29bd91eb9ab-kube-api-access-hrqbh\") pod \"kube-auth-proxy-8cdf7544b-fxfn4\" (UID: \"698b7d8f-da2d-470d-9499-f29bd91eb9ab\") " pod="openshift-ingress/kube-auth-proxy-8cdf7544b-fxfn4"
Jul 24 17:11:46.726644 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.726610    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa8a48cb-3a36-41db-a32f-566d6a2feea3-cert\") pod \"odh-model-controller-7998c67dc4-89xqj\" (UID: \"aa8a48cb-3a36-41db-a32f-566d6a2feea3\") " pod="opendatahub/odh-model-controller-7998c67dc4-89xqj"
Jul 24 17:11:46.726823 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.726772    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk25g\" (UniqueName: \"kubernetes.io/projected/aa8a48cb-3a36-41db-a32f-566d6a2feea3-kube-api-access-fk25g\") pod \"odh-model-controller-7998c67dc4-89xqj\" (UID: \"aa8a48cb-3a36-41db-a32f-566d6a2feea3\") " pod="opendatahub/odh-model-controller-7998c67dc4-89xqj"
Jul 24 17:11:46.827309 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.827275    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk25g\" (UniqueName: \"kubernetes.io/projected/aa8a48cb-3a36-41db-a32f-566d6a2feea3-kube-api-access-fk25g\") pod \"odh-model-controller-7998c67dc4-89xqj\" (UID: \"aa8a48cb-3a36-41db-a32f-566d6a2feea3\") " pod="opendatahub/odh-model-controller-7998c67dc4-89xqj"
Jul 24 17:11:46.827309 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.827316    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa8a48cb-3a36-41db-a32f-566d6a2feea3-cert\") pod \"odh-model-controller-7998c67dc4-89xqj\" (UID: \"aa8a48cb-3a36-41db-a32f-566d6a2feea3\") " pod="opendatahub/odh-model-controller-7998c67dc4-89xqj"
Jul 24 17:11:46.827511 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:11:46.827414    2572 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 24 17:11:46.827511 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:11:46.827475    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa8a48cb-3a36-41db-a32f-566d6a2feea3-cert podName:aa8a48cb-3a36-41db-a32f-566d6a2feea3 nodeName:}" failed. No retries permitted until 2026-07-24 17:11:47.327459384 +0000 UTC m=+524.761674929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/aa8a48cb-3a36-41db-a32f-566d6a2feea3-cert") pod "odh-model-controller-7998c67dc4-89xqj" (UID: "aa8a48cb-3a36-41db-a32f-566d6a2feea3") : secret "odh-model-controller-webhook-cert" not found
Jul 24 17:11:46.866219 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.866188    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk25g\" (UniqueName: \"kubernetes.io/projected/aa8a48cb-3a36-41db-a32f-566d6a2feea3-kube-api-access-fk25g\") pod \"odh-model-controller-7998c67dc4-89xqj\" (UID: \"aa8a48cb-3a36-41db-a32f-566d6a2feea3\") " pod="opendatahub/odh-model-controller-7998c67dc4-89xqj"
Jul 24 17:11:46.943530 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:46.943455    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8cdf7544b-fxfn4"
Jul 24 17:11:47.098083 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:47.098049    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8cdf7544b-fxfn4"]
Jul 24 17:11:47.100797 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:11:47.100770    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod698b7d8f_da2d_470d_9499_f29bd91eb9ab.slice/crio-7dcf64e1bca4194f0614fafc0e63d1986898fb195aa0dcf25dbb8e51aed8122e WatchSource:0}: Error finding container 7dcf64e1bca4194f0614fafc0e63d1986898fb195aa0dcf25dbb8e51aed8122e: Status 404 returned error can't find the container with id 7dcf64e1bca4194f0614fafc0e63d1986898fb195aa0dcf25dbb8e51aed8122e
Jul 24 17:11:47.330966 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:47.330882    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa8a48cb-3a36-41db-a32f-566d6a2feea3-cert\") pod \"odh-model-controller-7998c67dc4-89xqj\" (UID: \"aa8a48cb-3a36-41db-a32f-566d6a2feea3\") " pod="opendatahub/odh-model-controller-7998c67dc4-89xqj"
Jul 24 17:11:47.333350 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:47.333330    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa8a48cb-3a36-41db-a32f-566d6a2feea3-cert\") pod \"odh-model-controller-7998c67dc4-89xqj\" (UID: \"aa8a48cb-3a36-41db-a32f-566d6a2feea3\") " pod="opendatahub/odh-model-controller-7998c67dc4-89xqj"
Jul 24 17:11:47.461522 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:47.461491    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-89xqj"
Jul 24 17:11:47.472247 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:47.472203    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wzrk5"]
Jul 24 17:11:47.475633 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:47.475613    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wzrk5"
Jul 24 17:11:47.478031 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:47.478007    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 24 17:11:47.496033 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:47.496008    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wzrk5"]
Jul 24 17:11:47.633885 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:47.633770    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f73bb355-5517-498e-88d6-b2fe2282c086-tls-certs\") pod \"model-serving-api-54d89bd5fc-wzrk5\" (UID: \"f73bb355-5517-498e-88d6-b2fe2282c086\") " pod="opendatahub/model-serving-api-54d89bd5fc-wzrk5"
Jul 24 17:11:47.633885 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:47.633818    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn92h\" (UniqueName: \"kubernetes.io/projected/f73bb355-5517-498e-88d6-b2fe2282c086-kube-api-access-pn92h\") pod \"model-serving-api-54d89bd5fc-wzrk5\" (UID: \"f73bb355-5517-498e-88d6-b2fe2282c086\") " pod="opendatahub/model-serving-api-54d89bd5fc-wzrk5"
Jul 24 17:11:47.636854 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:47.636826    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-89xqj"]
Jul 24 17:11:47.639795 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:11:47.639768    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa8a48cb_3a36_41db_a32f_566d6a2feea3.slice/crio-d4aaf2443f2857ec32460e8e1cf40f76b4f0ec141cc49449e377da2f4ebd70c1 WatchSource:0}: Error finding container d4aaf2443f2857ec32460e8e1cf40f76b4f0ec141cc49449e377da2f4ebd70c1: Status 404 returned error can't find the container with id d4aaf2443f2857ec32460e8e1cf40f76b4f0ec141cc49449e377da2f4ebd70c1
Jul 24 17:11:47.734608 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:47.734569    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f73bb355-5517-498e-88d6-b2fe2282c086-tls-certs\") pod \"model-serving-api-54d89bd5fc-wzrk5\" (UID: \"f73bb355-5517-498e-88d6-b2fe2282c086\") " pod="opendatahub/model-serving-api-54d89bd5fc-wzrk5"
Jul 24 17:11:47.734798 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:47.734629    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn92h\" (UniqueName: \"kubernetes.io/projected/f73bb355-5517-498e-88d6-b2fe2282c086-kube-api-access-pn92h\") pod \"model-serving-api-54d89bd5fc-wzrk5\" (UID: \"f73bb355-5517-498e-88d6-b2fe2282c086\") " pod="opendatahub/model-serving-api-54d89bd5fc-wzrk5"
Jul 24 17:11:47.737669 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:47.737645    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f73bb355-5517-498e-88d6-b2fe2282c086-tls-certs\") pod \"model-serving-api-54d89bd5fc-wzrk5\" (UID: \"f73bb355-5517-498e-88d6-b2fe2282c086\") " pod="opendatahub/model-serving-api-54d89bd5fc-wzrk5"
Jul 24 17:11:47.746786 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:47.746755    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn92h\" (UniqueName: \"kubernetes.io/projected/f73bb355-5517-498e-88d6-b2fe2282c086-kube-api-access-pn92h\") pod \"model-serving-api-54d89bd5fc-wzrk5\" (UID: \"f73bb355-5517-498e-88d6-b2fe2282c086\") " pod="opendatahub/model-serving-api-54d89bd5fc-wzrk5"
Jul 24 17:11:47.786142 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:47.786101    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wzrk5"
Jul 24 17:11:47.943826 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:47.943800    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wzrk5"]
Jul 24 17:11:47.946090 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:11:47.946068    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf73bb355_5517_498e_88d6_b2fe2282c086.slice/crio-2f404c05610ed88c2dd64dd7d792fa806b02f8b72f6b2942c7d9027a274e483d WatchSource:0}: Error finding container 2f404c05610ed88c2dd64dd7d792fa806b02f8b72f6b2942c7d9027a274e483d: Status 404 returned error can't find the container with id 2f404c05610ed88c2dd64dd7d792fa806b02f8b72f6b2942c7d9027a274e483d
Jul 24 17:11:47.970494 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:47.970459    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-89xqj" event={"ID":"aa8a48cb-3a36-41db-a32f-566d6a2feea3","Type":"ContainerStarted","Data":"d4aaf2443f2857ec32460e8e1cf40f76b4f0ec141cc49449e377da2f4ebd70c1"}
Jul 24 17:11:47.971838 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:47.971807    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wzrk5" event={"ID":"f73bb355-5517-498e-88d6-b2fe2282c086","Type":"ContainerStarted","Data":"2f404c05610ed88c2dd64dd7d792fa806b02f8b72f6b2942c7d9027a274e483d"}
Jul 24 17:11:47.973069 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:47.973046    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8cdf7544b-fxfn4" event={"ID":"698b7d8f-da2d-470d-9499-f29bd91eb9ab","Type":"ContainerStarted","Data":"7dcf64e1bca4194f0614fafc0e63d1986898fb195aa0dcf25dbb8e51aed8122e"}
Jul 24 17:11:48.270421 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.270339    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"]
Jul 24 17:11:48.273759 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.273738    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:48.279110 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.278194    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-l95pf\""
Jul 24 17:11:48.279110 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.278467    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 24 17:11:48.279110 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.278631    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 24 17:11:48.279110 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.278798    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 24 17:11:48.279110 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.278959    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 17:11:48.292979 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.292924    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"]
Jul 24 17:11:48.440606 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.440566    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-fgx2r\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:48.441087 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.440622    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-fgx2r\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:48.441087 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.440688    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84dk9\" (UniqueName: \"kubernetes.io/projected/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-kube-api-access-84dk9\") pod \"istiod-openshift-gateway-7b7995d5cd-fgx2r\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:48.441087 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.440769    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-fgx2r\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:48.441087 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.440806    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-fgx2r\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:48.441087 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.440839    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-fgx2r\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:48.441087 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.440917    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-fgx2r\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:48.543757 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.542397    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-fgx2r\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:48.543757 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.542467    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-fgx2r\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:48.543757 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.542523    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-fgx2r\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:48.543757 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.542553    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-fgx2r\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:48.543757 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.542578    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84dk9\" (UniqueName: \"kubernetes.io/projected/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-kube-api-access-84dk9\") pod \"istiod-openshift-gateway-7b7995d5cd-fgx2r\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:48.543757 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.542627    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-fgx2r\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:48.543757 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.542663    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-fgx2r\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:48.545647 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.545337    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-fgx2r\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:48.548709 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.548370    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-fgx2r\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:48.548709 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.548496    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-fgx2r\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:48.548709 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.548647    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-fgx2r\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:48.549929 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.549881    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-fgx2r\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:48.552397 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.552356    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-fgx2r\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:48.553038 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.553017    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84dk9\" (UniqueName: \"kubernetes.io/projected/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-kube-api-access-84dk9\") pod \"istiod-openshift-gateway-7b7995d5cd-fgx2r\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:48.588761 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.588711    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:48.821249 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.821132    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"]
Jul 24 17:11:48.823927 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:11:48.823894    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8427d6bf_1c6c_4f07_bcab_d8f5f03f42b2.slice/crio-407603f1d75bdb1a9d71bf2f21e21f5e86401a878a319531939c1a7cf3218b09 WatchSource:0}: Error finding container 407603f1d75bdb1a9d71bf2f21e21f5e86401a878a319531939c1a7cf3218b09: Status 404 returned error can't find the container with id 407603f1d75bdb1a9d71bf2f21e21f5e86401a878a319531939c1a7cf3218b09
Jul 24 17:11:48.988256 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:48.988194    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r" event={"ID":"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2","Type":"ContainerStarted","Data":"407603f1d75bdb1a9d71bf2f21e21f5e86401a878a319531939c1a7cf3218b09"}
Jul 24 17:11:52.007735 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:52.007699    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wzrk5" event={"ID":"f73bb355-5517-498e-88d6-b2fe2282c086","Type":"ContainerStarted","Data":"57e4455bf593150f11de68879c9a5227aa03971e180970d4158cf56c3c17010a"}
Jul 24 17:11:52.008291 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:52.007853    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-wzrk5"
Jul 24 17:11:52.010336 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:52.010275    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8cdf7544b-fxfn4" event={"ID":"698b7d8f-da2d-470d-9499-f29bd91eb9ab","Type":"ContainerStarted","Data":"16f86d19be82d6cedcf2880339541d19ebaee812f025c2b7e2e1f2410e62a391"}
Jul 24 17:11:52.012597 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:52.012569    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-89xqj" event={"ID":"aa8a48cb-3a36-41db-a32f-566d6a2feea3","Type":"ContainerStarted","Data":"84fa9c4b67fe071dd0be18a0eb4565e165190b2207831a43d527d5691a785498"}
Jul 24 17:11:52.012732 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:52.012651    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-89xqj"
Jul 24 17:11:52.026957 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:52.026699    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-wzrk5" podStartSLOduration=1.540404589 podStartE2EDuration="5.026677764s" totalImagesPullingTime="3.486273175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:11:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:52.0258998 +0000 UTC m=+529.460115369" watchObservedRunningTime="2026-07-24 17:11:52.026677764 +0000 UTC m=+529.460893348"
Jul 24 17:11:52.045437 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:52.045393    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-89xqj" podStartSLOduration=2.242727673 podStartE2EDuration="6.045377001s" totalImagesPullingTime="3.802649328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:11:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:52.042737049 +0000 UTC m=+529.476952616" watchObservedRunningTime="2026-07-24 17:11:52.045377001 +0000 UTC m=+529.479592571"
Jul 24 17:11:52.059909 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:52.059867    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8cdf7544b-fxfn4" podStartSLOduration=1.7319297200000001 podStartE2EDuration="6.059853053s" totalImagesPullingTime="4.327923333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:11:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:52.058200866 +0000 UTC m=+529.492416434" watchObservedRunningTime="2026-07-24 17:11:52.059853053 +0000 UTC m=+529.494068620"
Jul 24 17:11:52.852433 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:52.852393    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:11:52.852559 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:52.852476    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:11:53.019106 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:53.019060    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r" event={"ID":"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2","Type":"ContainerStarted","Data":"bc08a6b6762baa515b15d89dfdb3e0c2caf4f36fbb37f578aeb212f5a681aa9f"}
Jul 24 17:11:53.040243 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:53.040191    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r" podStartSLOduration=1.017459738 podStartE2EDuration="5.040171922s" totalImagesPullingTime="4.022712184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:11:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:53.038403466 +0000 UTC m=+530.472619033" watchObservedRunningTime="2026-07-24 17:11:53.040171922 +0000 UTC m=+530.474387489"
Jul 24 17:11:54.024763 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.024668    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:54.026426 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.026399    2572 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-fgx2r container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 17:11:54.026528 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.026454    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r" podUID="8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:11:54.320696 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.320615    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"]
Jul 24 17:11:54.324129 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.324106    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.326556 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.326538    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-5jwhs\""
Jul 24 17:11:54.345558 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.345533    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"]
Jul 24 17:11:54.393370 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.393338    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7pfd\" (UniqueName: \"kubernetes.io/projected/176af051-6515-45d7-a5ef-7a4abcec5b06-kube-api-access-h7pfd\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.393370 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.393376    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/176af051-6515-45d7-a5ef-7a4abcec5b06-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.393577 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.393393    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/176af051-6515-45d7-a5ef-7a4abcec5b06-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.393577 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.393426    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/176af051-6515-45d7-a5ef-7a4abcec5b06-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.393577 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.393521    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/176af051-6515-45d7-a5ef-7a4abcec5b06-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.393577 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.393563    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/176af051-6515-45d7-a5ef-7a4abcec5b06-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.393700 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.393617    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/176af051-6515-45d7-a5ef-7a4abcec5b06-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.393700 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.393648    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/176af051-6515-45d7-a5ef-7a4abcec5b06-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.393758 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.393700    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/176af051-6515-45d7-a5ef-7a4abcec5b06-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.494564 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.494528    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/176af051-6515-45d7-a5ef-7a4abcec5b06-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.494564 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.494568    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/176af051-6515-45d7-a5ef-7a4abcec5b06-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.494771 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.494586    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/176af051-6515-45d7-a5ef-7a4abcec5b06-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.494771 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.494713    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/176af051-6515-45d7-a5ef-7a4abcec5b06-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.494771 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.494762    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7pfd\" (UniqueName: \"kubernetes.io/projected/176af051-6515-45d7-a5ef-7a4abcec5b06-kube-api-access-h7pfd\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.494907 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.494794    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/176af051-6515-45d7-a5ef-7a4abcec5b06-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.494907 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.494816    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/176af051-6515-45d7-a5ef-7a4abcec5b06-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.494907 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.494866    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/176af051-6515-45d7-a5ef-7a4abcec5b06-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.495060 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.494936    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/176af051-6515-45d7-a5ef-7a4abcec5b06-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.495571 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.495484    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/176af051-6515-45d7-a5ef-7a4abcec5b06-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.495571 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.495517    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/176af051-6515-45d7-a5ef-7a4abcec5b06-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.495571 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.495535    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/176af051-6515-45d7-a5ef-7a4abcec5b06-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.495810 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.494998    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/176af051-6515-45d7-a5ef-7a4abcec5b06-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.496009 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.495934    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/176af051-6515-45d7-a5ef-7a4abcec5b06-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.498282 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.498257    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/176af051-6515-45d7-a5ef-7a4abcec5b06-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.502726 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.502707    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/176af051-6515-45d7-a5ef-7a4abcec5b06-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.509192 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.509170    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7pfd\" (UniqueName: \"kubernetes.io/projected/176af051-6515-45d7-a5ef-7a4abcec5b06-kube-api-access-h7pfd\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.509365 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.509348    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/176af051-6515-45d7-a5ef-7a4abcec5b06-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r\" (UID: \"176af051-6515-45d7-a5ef-7a4abcec5b06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.634461 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.634425    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:54.812336 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:54.812304    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"]
Jul 24 17:11:54.817687 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:11:54.817659    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod176af051_6515_45d7_a5ef_7a4abcec5b06.slice/crio-7b70f81240f62c35efbd0aea2bfe6ce6072cd5657639926102b7597c42ba75e8 WatchSource:0}: Error finding container 7b70f81240f62c35efbd0aea2bfe6ce6072cd5657639926102b7597c42ba75e8: Status 404 returned error can't find the container with id 7b70f81240f62c35efbd0aea2bfe6ce6072cd5657639926102b7597c42ba75e8
Jul 24 17:11:55.030110 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:55.030020    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r" event={"ID":"176af051-6515-45d7-a5ef-7a4abcec5b06","Type":"ContainerStarted","Data":"7b70f81240f62c35efbd0aea2bfe6ce6072cd5657639926102b7597c42ba75e8"}
Jul 24 17:11:55.030846 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:55.030826    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:11:57.029199 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.029155    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-jbbqt"]
Jul 24 17:11:57.036255 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.036212    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jbbqt"
Jul 24 17:11:57.038853 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.038824    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 24 17:11:57.040350 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.040321    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-ltrsl\""
Jul 24 17:11:57.049446 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.049423    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-lmgvt"]
Jul 24 17:11:57.053430 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.053392    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-jbbqt"]
Jul 24 17:11:57.053555 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.053501    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmgvt"
Jul 24 17:11:57.057007 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.056983    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-m7kqf\""
Jul 24 17:11:57.059987 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.059967    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 24 17:11:57.074400 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.074369    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-lmgvt"]
Jul 24 17:11:57.118821 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.118783    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe00b76d-9b28-40f0-b92d-53ee51ed11c5-cert\") pod \"kserve-controller-manager-d6f4b65b8-jbbqt\" (UID: \"fe00b76d-9b28-40f0-b92d-53ee51ed11c5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jbbqt"
Jul 24 17:11:57.118992 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.118909    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxxwc\" (UniqueName: \"kubernetes.io/projected/edcb2b5d-276c-4b17-9841-4480bb1e0814-kube-api-access-gxxwc\") pod \"llmisvc-controller-manager-777c6bd7d5-lmgvt\" (UID: \"edcb2b5d-276c-4b17-9841-4480bb1e0814\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmgvt"
Jul 24 17:11:57.118992 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.118958    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/edcb2b5d-276c-4b17-9841-4480bb1e0814-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lmgvt\" (UID: \"edcb2b5d-276c-4b17-9841-4480bb1e0814\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmgvt"
Jul 24 17:11:57.118992 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.118989    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jktb\" (UniqueName: \"kubernetes.io/projected/fe00b76d-9b28-40f0-b92d-53ee51ed11c5-kube-api-access-4jktb\") pod \"kserve-controller-manager-d6f4b65b8-jbbqt\" (UID: \"fe00b76d-9b28-40f0-b92d-53ee51ed11c5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jbbqt"
Jul 24 17:11:57.220353 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.220319    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxxwc\" (UniqueName: \"kubernetes.io/projected/edcb2b5d-276c-4b17-9841-4480bb1e0814-kube-api-access-gxxwc\") pod \"llmisvc-controller-manager-777c6bd7d5-lmgvt\" (UID: \"edcb2b5d-276c-4b17-9841-4480bb1e0814\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmgvt"
Jul 24 17:11:57.220543 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.220369    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/edcb2b5d-276c-4b17-9841-4480bb1e0814-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lmgvt\" (UID: \"edcb2b5d-276c-4b17-9841-4480bb1e0814\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmgvt"
Jul 24 17:11:57.220543 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.220407    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jktb\" (UniqueName: \"kubernetes.io/projected/fe00b76d-9b28-40f0-b92d-53ee51ed11c5-kube-api-access-4jktb\") pod \"kserve-controller-manager-d6f4b65b8-jbbqt\" (UID: \"fe00b76d-9b28-40f0-b92d-53ee51ed11c5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jbbqt"
Jul 24 17:11:57.220543 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.220447    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe00b76d-9b28-40f0-b92d-53ee51ed11c5-cert\") pod \"kserve-controller-manager-d6f4b65b8-jbbqt\" (UID: \"fe00b76d-9b28-40f0-b92d-53ee51ed11c5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jbbqt"
Jul 24 17:11:57.223315 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.223287    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/edcb2b5d-276c-4b17-9841-4480bb1e0814-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lmgvt\" (UID: \"edcb2b5d-276c-4b17-9841-4480bb1e0814\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmgvt"
Jul 24 17:11:57.223452 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.223287    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe00b76d-9b28-40f0-b92d-53ee51ed11c5-cert\") pod \"kserve-controller-manager-d6f4b65b8-jbbqt\" (UID: \"fe00b76d-9b28-40f0-b92d-53ee51ed11c5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jbbqt"
Jul 24 17:11:57.233906 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.233884    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jktb\" (UniqueName: \"kubernetes.io/projected/fe00b76d-9b28-40f0-b92d-53ee51ed11c5-kube-api-access-4jktb\") pod \"kserve-controller-manager-d6f4b65b8-jbbqt\" (UID: \"fe00b76d-9b28-40f0-b92d-53ee51ed11c5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jbbqt"
Jul 24 17:11:57.234152 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.234131    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxxwc\" (UniqueName: \"kubernetes.io/projected/edcb2b5d-276c-4b17-9841-4480bb1e0814-kube-api-access-gxxwc\") pod \"llmisvc-controller-manager-777c6bd7d5-lmgvt\" (UID: \"edcb2b5d-276c-4b17-9841-4480bb1e0814\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmgvt"
Jul 24 17:11:57.351020 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.350931    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jbbqt"
Jul 24 17:11:57.366379 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.366349    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmgvt"
Jul 24 17:11:57.948723 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.948163    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:11:57.948723 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.948303    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:11:57.948723 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:57.948349    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:11:58.047896 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:58.047860    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-jbbqt"]
Jul 24 17:11:58.052399 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:58.052366    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r" event={"ID":"176af051-6515-45d7-a5ef-7a4abcec5b06","Type":"ContainerStarted","Data":"1a60b12cbcd36a8c85d704a3f9abb2eba2354ea5ecc560c09648e37a99a4ea25"}
Jul 24 17:11:58.053365 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:11:58.053341    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe00b76d_9b28_40f0_b92d_53ee51ed11c5.slice/crio-1ced5a31e6c57b64f810316bf000be92052dbd4e1915619513e1793aa7e504f9 WatchSource:0}: Error finding container 1ced5a31e6c57b64f810316bf000be92052dbd4e1915619513e1793aa7e504f9: Status 404 returned error can't find the container with id 1ced5a31e6c57b64f810316bf000be92052dbd4e1915619513e1793aa7e504f9
Jul 24 17:11:58.054141 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:58.054115    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-lmgvt"]
Jul 24 17:11:58.056728 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:11:58.056701    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podedcb2b5d_276c_4b17_9841_4480bb1e0814.slice/crio-85e83be6628c81475c37d6cd65b4c232e0464f19fb3421086c3fda4a0dd20425 WatchSource:0}: Error finding container 85e83be6628c81475c37d6cd65b4c232e0464f19fb3421086c3fda4a0dd20425: Status 404 returned error can't find the container with id 85e83be6628c81475c37d6cd65b4c232e0464f19fb3421086c3fda4a0dd20425
Jul 24 17:11:58.076354 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:58.076302    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r" podStartSLOduration=0.9481879 podStartE2EDuration="4.07628431s" totalImagesPullingTime="3.12809641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:11:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:58.074327004 +0000 UTC m=+535.508542596" watchObservedRunningTime="2026-07-24 17:11:58.07628431 +0000 UTC m=+535.510499876"
Jul 24 17:11:58.635301 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:58.635268    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:59.061572 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:59.061493    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmgvt" event={"ID":"edcb2b5d-276c-4b17-9841-4480bb1e0814","Type":"ContainerStarted","Data":"85e83be6628c81475c37d6cd65b4c232e0464f19fb3421086c3fda4a0dd20425"}
Jul 24 17:11:59.063157 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:59.063121    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jbbqt" event={"ID":"fe00b76d-9b28-40f0-b92d-53ee51ed11c5","Type":"ContainerStarted","Data":"1ced5a31e6c57b64f810316bf000be92052dbd4e1915619513e1793aa7e504f9"}
Jul 24 17:11:59.641001 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:59.640966    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:11:59.803982 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:59.803951    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"]
Jul 24 17:11:59.804172 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:11:59.804150    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r" podUID="8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2" containerName="discovery" containerID="cri-o://bc08a6b6762baa515b15d89dfdb3e0c2caf4f36fbb37f578aeb212f5a681aa9f" gracePeriod=30
Jul 24 17:12:00.069340 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:00.069253    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:12:00.070462 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:00.070437    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r"
Jul 24 17:12:00.982540 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:00.982515    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:12:01.055366 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.055337    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-kubeconfig\") pod \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") "
Jul 24 17:12:01.055503 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.055389    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-csr-dns-cert\") pod \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") "
Jul 24 17:12:01.055503 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.055437    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84dk9\" (UniqueName: \"kubernetes.io/projected/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-kube-api-access-84dk9\") pod \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") "
Jul 24 17:12:01.055604 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.055504    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-token\") pod \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") "
Jul 24 17:12:01.055604 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.055536    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-csr-ca-configmap\") pod \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") "
Jul 24 17:12:01.055604 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.055581    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-cacerts\") pod \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") "
Jul 24 17:12:01.055771 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.055614    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-local-certs\") pod \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\" (UID: \"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2\") "
Jul 24 17:12:01.056394 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.056361    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2" (UID: "8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:12:01.058467 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.058394    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2" (UID: "8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:12:01.058634 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.058530    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-token" (OuterVolumeSpecName: "istio-token") pod "8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2" (UID: "8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:12:01.058634 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.058583    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2" (UID: "8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:12:01.058804 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.058758    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-local-certs" (OuterVolumeSpecName: "local-certs") pod "8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2" (UID: "8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:12:01.058928 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.058880    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-cacerts" (OuterVolumeSpecName: "cacerts") pod "8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2" (UID: "8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:12:01.059534 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.059507    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-kube-api-access-84dk9" (OuterVolumeSpecName: "kube-api-access-84dk9") pod "8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2" (UID: "8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2"). InnerVolumeSpecName "kube-api-access-84dk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:12:01.076885 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.076860    2572 generic.go:356] "Generic (PLEG): container finished" podID="8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2" containerID="bc08a6b6762baa515b15d89dfdb3e0c2caf4f36fbb37f578aeb212f5a681aa9f" exitCode=0
Jul 24 17:12:01.077207 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.076920    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"
Jul 24 17:12:01.077207 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.076959    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r" event={"ID":"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2","Type":"ContainerDied","Data":"bc08a6b6762baa515b15d89dfdb3e0c2caf4f36fbb37f578aeb212f5a681aa9f"}
Jul 24 17:12:01.077207 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.077020    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r" event={"ID":"8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2","Type":"ContainerDied","Data":"407603f1d75bdb1a9d71bf2f21e21f5e86401a878a319531939c1a7cf3218b09"}
Jul 24 17:12:01.077207 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.077050    2572 scope.go:117] "RemoveContainer" containerID="bc08a6b6762baa515b15d89dfdb3e0c2caf4f36fbb37f578aeb212f5a681aa9f"
Jul 24 17:12:01.086508 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.086450    2572 scope.go:117] "RemoveContainer" containerID="bc08a6b6762baa515b15d89dfdb3e0c2caf4f36fbb37f578aeb212f5a681aa9f"
Jul 24 17:12:01.086929 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:12:01.086904    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc08a6b6762baa515b15d89dfdb3e0c2caf4f36fbb37f578aeb212f5a681aa9f\": container with ID starting with bc08a6b6762baa515b15d89dfdb3e0c2caf4f36fbb37f578aeb212f5a681aa9f not found: ID does not exist" containerID="bc08a6b6762baa515b15d89dfdb3e0c2caf4f36fbb37f578aeb212f5a681aa9f"
Jul 24 17:12:01.087013 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.086952    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc08a6b6762baa515b15d89dfdb3e0c2caf4f36fbb37f578aeb212f5a681aa9f"} err="failed to get container status \"bc08a6b6762baa515b15d89dfdb3e0c2caf4f36fbb37f578aeb212f5a681aa9f\": rpc error: code = NotFound desc = could not find container \"bc08a6b6762baa515b15d89dfdb3e0c2caf4f36fbb37f578aeb212f5a681aa9f\": container with ID starting with bc08a6b6762baa515b15d89dfdb3e0c2caf4f36fbb37f578aeb212f5a681aa9f not found: ID does not exist"
Jul 24 17:12:01.103598 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.103574    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"]
Jul 24 17:12:01.107455 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.107430    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r"]
Jul 24 17:12:01.156927 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.156889    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84dk9\" (UniqueName: \"kubernetes.io/projected/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-kube-api-access-84dk9\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:12:01.156927 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.156927    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-token\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:12:01.156927 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.156941    2572 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-csr-ca-configmap\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:12:01.157312 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.156958    2572 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-cacerts\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:12:01.157312 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.156972    2572 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-local-certs\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:12:01.157312 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.157065    2572 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-kubeconfig\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:12:01.157312 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:01.157089    2572 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2-istio-csr-dns-cert\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:12:02.083186 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:02.083141    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmgvt" event={"ID":"edcb2b5d-276c-4b17-9841-4480bb1e0814","Type":"ContainerStarted","Data":"701d95e3f3af2d57662a27f7b847e2ed3d653c8427aca24ed1f0be9068697533"}
Jul 24 17:12:02.083659 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:02.083325    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmgvt"
Jul 24 17:12:02.084747 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:02.084719    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jbbqt" event={"ID":"fe00b76d-9b28-40f0-b92d-53ee51ed11c5","Type":"ContainerStarted","Data":"132e1a7a8e1229d8d28d7091ed2aba83a5ed813041e2939a31e1b258ae007d8c"}
Jul 24 17:12:02.084871 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:02.084809    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jbbqt"
Jul 24 17:12:02.101856 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:02.101802    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmgvt" podStartSLOduration=2.152872349 podStartE2EDuration="5.101785721s" totalImagesPullingTime="2.948913372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:11:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:12:02.100106873 +0000 UTC m=+539.534322441" watchObservedRunningTime="2026-07-24 17:12:02.101785721 +0000 UTC m=+539.536001288"
Jul 24 17:12:02.119990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:02.119940    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jbbqt" podStartSLOduration=3.172939888 podStartE2EDuration="6.119923081s" totalImagesPullingTime="2.946983193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:12:02.118552216 +0000 UTC m=+539.552767808" watchObservedRunningTime="2026-07-24 17:12:02.119923081 +0000 UTC m=+539.554138648"
Jul 24 17:12:03.022206 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:03.022180    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-89xqj"
Jul 24 17:12:03.023981 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:03.023959    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-wzrk5"
Jul 24 17:12:03.088886 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:03.088850    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2" path="/var/lib/kubelet/pods/8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2/volumes"
Jul 24 17:12:33.095074 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:33.095044    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmgvt"
Jul 24 17:12:33.098824 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:33.098794    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jbbqt"
Jul 24 17:12:47.507863 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:47.507822    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c7lqm"]
Jul 24 17:12:47.508390 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:47.508371    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2" containerName="discovery"
Jul 24 17:12:47.508464 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:47.508393    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2" containerName="discovery"
Jul 24 17:12:47.508518 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:47.508496    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8427d6bf-1c6c-4f07-bcab-d8f5f03f42b2" containerName="discovery"
Jul 24 17:12:47.510525 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:47.510504    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c7lqm"
Jul 24 17:12:47.516305 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:47.516286    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 17:12:47.517324 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:47.517301    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-8qz6z\""
Jul 24 17:12:47.517408 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:47.517313    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 17:12:47.567474 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:47.567441    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c7lqm"]
Jul 24 17:12:47.637366 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:47.637337    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wckvh\" (UniqueName: \"kubernetes.io/projected/ecef575b-896d-447e-a100-01fe7ab73832-kube-api-access-wckvh\") pod \"kuadrant-operator-catalog-c7lqm\" (UID: \"ecef575b-896d-447e-a100-01fe7ab73832\") " pod="kuadrant-system/kuadrant-operator-catalog-c7lqm"
Jul 24 17:12:47.738791 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:47.738754    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wckvh\" (UniqueName: \"kubernetes.io/projected/ecef575b-896d-447e-a100-01fe7ab73832-kube-api-access-wckvh\") pod \"kuadrant-operator-catalog-c7lqm\" (UID: \"ecef575b-896d-447e-a100-01fe7ab73832\") " pod="kuadrant-system/kuadrant-operator-catalog-c7lqm"
Jul 24 17:12:47.749508 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:47.749479    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wckvh\" (UniqueName: \"kubernetes.io/projected/ecef575b-896d-447e-a100-01fe7ab73832-kube-api-access-wckvh\") pod \"kuadrant-operator-catalog-c7lqm\" (UID: \"ecef575b-896d-447e-a100-01fe7ab73832\") " pod="kuadrant-system/kuadrant-operator-catalog-c7lqm"
Jul 24 17:12:47.773557 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:47.773497    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c7lqm"]
Jul 24 17:12:47.773770 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:47.773757    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c7lqm"
Jul 24 17:12:47.944125 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:12:47.944099    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecef575b_896d_447e_a100_01fe7ab73832.slice/crio-e02102bd14232f22b36f45e79d8a244b9cb0cb153a2d39220b3e8657c7eeba5b WatchSource:0}: Error finding container e02102bd14232f22b36f45e79d8a244b9cb0cb153a2d39220b3e8657c7eeba5b: Status 404 returned error can't find the container with id e02102bd14232f22b36f45e79d8a244b9cb0cb153a2d39220b3e8657c7eeba5b
Jul 24 17:12:47.949414 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:47.949306    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c7lqm"]
Jul 24 17:12:47.951303 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:47.951281    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qmqrl"]
Jul 24 17:12:47.954304 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:47.954288    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qmqrl"
Jul 24 17:12:47.979341 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:47.979319    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qmqrl"]
Jul 24 17:12:48.041145 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:48.041072    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nkhs\" (UniqueName: \"kubernetes.io/projected/c317f443-a73b-4860-a72a-efebd04821ab-kube-api-access-5nkhs\") pod \"kuadrant-operator-catalog-qmqrl\" (UID: \"c317f443-a73b-4860-a72a-efebd04821ab\") " pod="kuadrant-system/kuadrant-operator-catalog-qmqrl"
Jul 24 17:12:48.142327 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:48.142300    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nkhs\" (UniqueName: \"kubernetes.io/projected/c317f443-a73b-4860-a72a-efebd04821ab-kube-api-access-5nkhs\") pod \"kuadrant-operator-catalog-qmqrl\" (UID: \"c317f443-a73b-4860-a72a-efebd04821ab\") " pod="kuadrant-system/kuadrant-operator-catalog-qmqrl"
Jul 24 17:12:48.156567 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:48.156540    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nkhs\" (UniqueName: \"kubernetes.io/projected/c317f443-a73b-4860-a72a-efebd04821ab-kube-api-access-5nkhs\") pod \"kuadrant-operator-catalog-qmqrl\" (UID: \"c317f443-a73b-4860-a72a-efebd04821ab\") " pod="kuadrant-system/kuadrant-operator-catalog-qmqrl"
Jul 24 17:12:48.263887 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:48.263859    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qmqrl"
Jul 24 17:12:48.307526 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:48.307437    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c7lqm" event={"ID":"ecef575b-896d-447e-a100-01fe7ab73832","Type":"ContainerStarted","Data":"e02102bd14232f22b36f45e79d8a244b9cb0cb153a2d39220b3e8657c7eeba5b"}
Jul 24 17:12:48.424556 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:48.424510    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qmqrl"]
Jul 24 17:12:48.428643 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:12:48.428614    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc317f443_a73b_4860_a72a_efebd04821ab.slice/crio-82c59fc248cc2cf9930d8217155cf21826b69986e2ee22f72c2ff2df6e0b39b1 WatchSource:0}: Error finding container 82c59fc248cc2cf9930d8217155cf21826b69986e2ee22f72c2ff2df6e0b39b1: Status 404 returned error can't find the container with id 82c59fc248cc2cf9930d8217155cf21826b69986e2ee22f72c2ff2df6e0b39b1
Jul 24 17:12:49.315091 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:49.315048    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qmqrl" event={"ID":"c317f443-a73b-4860-a72a-efebd04821ab","Type":"ContainerStarted","Data":"82c59fc248cc2cf9930d8217155cf21826b69986e2ee22f72c2ff2df6e0b39b1"}
Jul 24 17:12:50.321509 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:50.321411    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c7lqm" event={"ID":"ecef575b-896d-447e-a100-01fe7ab73832","Type":"ContainerStarted","Data":"b7f51ad946416a64b69ea2894eb48c0d8b066f476656d2303fa43f5d119dee1b"}
Jul 24 17:12:50.321509 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:50.321486    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-c7lqm" podUID="ecef575b-896d-447e-a100-01fe7ab73832" containerName="registry-server" containerID="cri-o://b7f51ad946416a64b69ea2894eb48c0d8b066f476656d2303fa43f5d119dee1b" gracePeriod=2
Jul 24 17:12:50.323002 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:50.322978    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qmqrl" event={"ID":"c317f443-a73b-4860-a72a-efebd04821ab","Type":"ContainerStarted","Data":"29d8ddf3ce9276f577f449973ebce34294d81d5abd617d61a2411d7a11fbd561"}
Jul 24 17:12:50.344859 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:50.344822    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-c7lqm" podStartSLOduration=1.392915559 podStartE2EDuration="3.344808705s" totalImagesPullingTime="1.951893146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:12:50.343547963 +0000 UTC m=+587.777763530" watchObservedRunningTime="2026-07-24 17:12:50.344808705 +0000 UTC m=+587.779024271"
Jul 24 17:12:50.364143 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:50.364104    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qmqrl" podStartSLOduration=1.893048515 podStartE2EDuration="3.364090847s" totalImagesPullingTime="1.471042332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:12:50.361672386 +0000 UTC m=+587.795887953" watchObservedRunningTime="2026-07-24 17:12:50.364090847 +0000 UTC m=+587.798306413"
Jul 24 17:12:50.572783 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:50.572727    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c7lqm"
Jul 24 17:12:50.664117 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:50.664088    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wckvh\" (UniqueName: \"kubernetes.io/projected/ecef575b-896d-447e-a100-01fe7ab73832-kube-api-access-wckvh\") pod \"ecef575b-896d-447e-a100-01fe7ab73832\" (UID: \"ecef575b-896d-447e-a100-01fe7ab73832\") "
Jul 24 17:12:50.666386 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:50.666361    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecef575b-896d-447e-a100-01fe7ab73832-kube-api-access-wckvh" (OuterVolumeSpecName: "kube-api-access-wckvh") pod "ecef575b-896d-447e-a100-01fe7ab73832" (UID: "ecef575b-896d-447e-a100-01fe7ab73832"). InnerVolumeSpecName "kube-api-access-wckvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:12:50.765689 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:50.765650    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wckvh\" (UniqueName: \"kubernetes.io/projected/ecef575b-896d-447e-a100-01fe7ab73832-kube-api-access-wckvh\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:12:51.328693 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:51.328601    2572 generic.go:356] "Generic (PLEG): container finished" podID="ecef575b-896d-447e-a100-01fe7ab73832" containerID="b7f51ad946416a64b69ea2894eb48c0d8b066f476656d2303fa43f5d119dee1b" exitCode=0
Jul 24 17:12:51.328693 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:51.328654    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c7lqm"
Jul 24 17:12:51.328693 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:51.328673    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c7lqm" event={"ID":"ecef575b-896d-447e-a100-01fe7ab73832","Type":"ContainerDied","Data":"b7f51ad946416a64b69ea2894eb48c0d8b066f476656d2303fa43f5d119dee1b"}
Jul 24 17:12:51.329228 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:51.328720    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c7lqm" event={"ID":"ecef575b-896d-447e-a100-01fe7ab73832","Type":"ContainerDied","Data":"e02102bd14232f22b36f45e79d8a244b9cb0cb153a2d39220b3e8657c7eeba5b"}
Jul 24 17:12:51.329228 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:51.328739    2572 scope.go:117] "RemoveContainer" containerID="b7f51ad946416a64b69ea2894eb48c0d8b066f476656d2303fa43f5d119dee1b"
Jul 24 17:12:51.337580 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:51.337561    2572 scope.go:117] "RemoveContainer" containerID="b7f51ad946416a64b69ea2894eb48c0d8b066f476656d2303fa43f5d119dee1b"
Jul 24 17:12:51.337817 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:12:51.337801    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7f51ad946416a64b69ea2894eb48c0d8b066f476656d2303fa43f5d119dee1b\": container with ID starting with b7f51ad946416a64b69ea2894eb48c0d8b066f476656d2303fa43f5d119dee1b not found: ID does not exist" containerID="b7f51ad946416a64b69ea2894eb48c0d8b066f476656d2303fa43f5d119dee1b"
Jul 24 17:12:51.337857 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:51.337824    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7f51ad946416a64b69ea2894eb48c0d8b066f476656d2303fa43f5d119dee1b"} err="failed to get container status \"b7f51ad946416a64b69ea2894eb48c0d8b066f476656d2303fa43f5d119dee1b\": rpc error: code = NotFound desc = could not find container \"b7f51ad946416a64b69ea2894eb48c0d8b066f476656d2303fa43f5d119dee1b\": container with ID starting with b7f51ad946416a64b69ea2894eb48c0d8b066f476656d2303fa43f5d119dee1b not found: ID does not exist"
Jul 24 17:12:51.348788 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:51.348768    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c7lqm"]
Jul 24 17:12:51.354487 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:51.354468    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c7lqm"]
Jul 24 17:12:53.084848 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:53.084815    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecef575b-896d-447e-a100-01fe7ab73832" path="/var/lib/kubelet/pods/ecef575b-896d-447e-a100-01fe7ab73832/volumes"
Jul 24 17:12:58.264998 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:58.264962    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-qmqrl"
Jul 24 17:12:58.265510 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:58.265056    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-qmqrl"
Jul 24 17:12:58.286901 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:58.286869    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-qmqrl"
Jul 24 17:12:58.386477 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:12:58.386449    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-qmqrl"
Jul 24 17:13:03.012956 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:03.012506    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:13:03.013337 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:03.013320    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:13:05.849473 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:05.849439    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95"]
Jul 24 17:13:05.850871 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:05.849927    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecef575b-896d-447e-a100-01fe7ab73832" containerName="registry-server"
Jul 24 17:13:05.850871 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:05.849942    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecef575b-896d-447e-a100-01fe7ab73832" containerName="registry-server"
Jul 24 17:13:05.850871 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:05.850011    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecef575b-896d-447e-a100-01fe7ab73832" containerName="registry-server"
Jul 24 17:13:05.852129 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:05.852108    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95"
Jul 24 17:13:05.856560 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:05.856544    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gttwz\""
Jul 24 17:13:05.876375 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:05.876346    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95"]
Jul 24 17:13:05.893282 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:05.893219    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xlcl\" (UniqueName: \"kubernetes.io/projected/6559a994-d707-4ab2-945f-8cc7196bde5c-kube-api-access-4xlcl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95\" (UID: \"6559a994-d707-4ab2-945f-8cc7196bde5c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95"
Jul 24 17:13:05.893409 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:05.893340    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6559a994-d707-4ab2-945f-8cc7196bde5c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95\" (UID: \"6559a994-d707-4ab2-945f-8cc7196bde5c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95"
Jul 24 17:13:05.893409 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:05.893374    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6559a994-d707-4ab2-945f-8cc7196bde5c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95\" (UID: \"6559a994-d707-4ab2-945f-8cc7196bde5c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95"
Jul 24 17:13:05.979566 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:05.979535    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn"]
Jul 24 17:13:05.982008 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:05.981993    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn"
Jul 24 17:13:05.996281 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:05.996220    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xlcl\" (UniqueName: \"kubernetes.io/projected/6559a994-d707-4ab2-945f-8cc7196bde5c-kube-api-access-4xlcl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95\" (UID: \"6559a994-d707-4ab2-945f-8cc7196bde5c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95"
Jul 24 17:13:05.996428 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:05.996307    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6559a994-d707-4ab2-945f-8cc7196bde5c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95\" (UID: \"6559a994-d707-4ab2-945f-8cc7196bde5c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95"
Jul 24 17:13:05.996428 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:05.996330    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6559a994-d707-4ab2-945f-8cc7196bde5c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95\" (UID: \"6559a994-d707-4ab2-945f-8cc7196bde5c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95"
Jul 24 17:13:05.996655 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:05.996639    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6559a994-d707-4ab2-945f-8cc7196bde5c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95\" (UID: \"6559a994-d707-4ab2-945f-8cc7196bde5c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95"
Jul 24 17:13:05.996694 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:05.996671    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6559a994-d707-4ab2-945f-8cc7196bde5c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95\" (UID: \"6559a994-d707-4ab2-945f-8cc7196bde5c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95"
Jul 24 17:13:06.011405 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.011374    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn"]
Jul 24 17:13:06.019374 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.019351    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xlcl\" (UniqueName: \"kubernetes.io/projected/6559a994-d707-4ab2-945f-8cc7196bde5c-kube-api-access-4xlcl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95\" (UID: \"6559a994-d707-4ab2-945f-8cc7196bde5c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95"
Jul 24 17:13:06.097387 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.097353    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4f9aaa6-5389-4d13-8152-3c256e9391a9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn\" (UID: \"a4f9aaa6-5389-4d13-8152-3c256e9391a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn"
Jul 24 17:13:06.097568 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.097393    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb58b\" (UniqueName: \"kubernetes.io/projected/a4f9aaa6-5389-4d13-8152-3c256e9391a9-kube-api-access-fb58b\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn\" (UID: \"a4f9aaa6-5389-4d13-8152-3c256e9391a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn"
Jul 24 17:13:06.097568 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.097450    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4f9aaa6-5389-4d13-8152-3c256e9391a9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn\" (UID: \"a4f9aaa6-5389-4d13-8152-3c256e9391a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn"
Jul 24 17:13:06.161316 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.161283    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95"
Jul 24 17:13:06.198515 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.198480    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4f9aaa6-5389-4d13-8152-3c256e9391a9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn\" (UID: \"a4f9aaa6-5389-4d13-8152-3c256e9391a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn"
Jul 24 17:13:06.198692 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.198558    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4f9aaa6-5389-4d13-8152-3c256e9391a9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn\" (UID: \"a4f9aaa6-5389-4d13-8152-3c256e9391a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn"
Jul 24 17:13:06.198692 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.198584    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb58b\" (UniqueName: \"kubernetes.io/projected/a4f9aaa6-5389-4d13-8152-3c256e9391a9-kube-api-access-fb58b\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn\" (UID: \"a4f9aaa6-5389-4d13-8152-3c256e9391a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn"
Jul 24 17:13:06.198942 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.198917    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4f9aaa6-5389-4d13-8152-3c256e9391a9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn\" (UID: \"a4f9aaa6-5389-4d13-8152-3c256e9391a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn"
Jul 24 17:13:06.199009 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.198944    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4f9aaa6-5389-4d13-8152-3c256e9391a9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn\" (UID: \"a4f9aaa6-5389-4d13-8152-3c256e9391a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn"
Jul 24 17:13:06.210589 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.210322    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb58b\" (UniqueName: \"kubernetes.io/projected/a4f9aaa6-5389-4d13-8152-3c256e9391a9-kube-api-access-fb58b\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn\" (UID: \"a4f9aaa6-5389-4d13-8152-3c256e9391a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn"
Jul 24 17:13:06.269021 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.268985    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n"]
Jul 24 17:13:06.272379 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.272356    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n"
Jul 24 17:13:06.291048 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.291027    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn"
Jul 24 17:13:06.299259 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.299210    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9c066fd-192f-4d8c-be57-7cea69f7d01a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n\" (UID: \"e9c066fd-192f-4d8c-be57-7cea69f7d01a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n"
Jul 24 17:13:06.299364 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.299267    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9c066fd-192f-4d8c-be57-7cea69f7d01a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n\" (UID: \"e9c066fd-192f-4d8c-be57-7cea69f7d01a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n"
Jul 24 17:13:06.299364 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.299287    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbfkw\" (UniqueName: \"kubernetes.io/projected/e9c066fd-192f-4d8c-be57-7cea69f7d01a-kube-api-access-rbfkw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n\" (UID: \"e9c066fd-192f-4d8c-be57-7cea69f7d01a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n"
Jul 24 17:13:06.308008 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.307984    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n"]
Jul 24 17:13:06.329151 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.329123    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95"]
Jul 24 17:13:06.333912 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:13:06.333888    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6559a994_d707_4ab2_945f_8cc7196bde5c.slice/crio-63aaf366de1c569e0fbc11412aa191b6db8757c1f68364bbe342c4f2505b0986 WatchSource:0}: Error finding container 63aaf366de1c569e0fbc11412aa191b6db8757c1f68364bbe342c4f2505b0986: Status 404 returned error can't find the container with id 63aaf366de1c569e0fbc11412aa191b6db8757c1f68364bbe342c4f2505b0986
Jul 24 17:13:06.399806 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.399778    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9c066fd-192f-4d8c-be57-7cea69f7d01a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n\" (UID: \"e9c066fd-192f-4d8c-be57-7cea69f7d01a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n"
Jul 24 17:13:06.399924 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.399820    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9c066fd-192f-4d8c-be57-7cea69f7d01a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n\" (UID: \"e9c066fd-192f-4d8c-be57-7cea69f7d01a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n"
Jul 24 17:13:06.399924 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.399847    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbfkw\" (UniqueName: \"kubernetes.io/projected/e9c066fd-192f-4d8c-be57-7cea69f7d01a-kube-api-access-rbfkw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n\" (UID: \"e9c066fd-192f-4d8c-be57-7cea69f7d01a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n"
Jul 24 17:13:06.400491 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.400184    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9c066fd-192f-4d8c-be57-7cea69f7d01a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n\" (UID: \"e9c066fd-192f-4d8c-be57-7cea69f7d01a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n"
Jul 24 17:13:06.400491 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.400413    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9c066fd-192f-4d8c-be57-7cea69f7d01a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n\" (UID: \"e9c066fd-192f-4d8c-be57-7cea69f7d01a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n"
Jul 24 17:13:06.406651 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.406603    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95" event={"ID":"6559a994-d707-4ab2-945f-8cc7196bde5c","Type":"ContainerStarted","Data":"63aaf366de1c569e0fbc11412aa191b6db8757c1f68364bbe342c4f2505b0986"}
Jul 24 17:13:06.412103 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.412047    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbfkw\" (UniqueName: \"kubernetes.io/projected/e9c066fd-192f-4d8c-be57-7cea69f7d01a-kube-api-access-rbfkw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n\" (UID: \"e9c066fd-192f-4d8c-be57-7cea69f7d01a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n"
Jul 24 17:13:06.459051 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.459019    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn"]
Jul 24 17:13:06.496216 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:13:06.496185    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4f9aaa6_5389_4d13_8152_3c256e9391a9.slice/crio-c9c891f93655b2eaaaabadeee6678837450aa627875638d49d99b9950a82f365 WatchSource:0}: Error finding container c9c891f93655b2eaaaabadeee6678837450aa627875638d49d99b9950a82f365: Status 404 returned error can't find the container with id c9c891f93655b2eaaaabadeee6678837450aa627875638d49d99b9950a82f365
Jul 24 17:13:06.582856 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.582827    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n"
Jul 24 17:13:06.763952 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.763922    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n"]
Jul 24 17:13:06.766931 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:13:06.766908    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9c066fd_192f_4d8c_be57_7cea69f7d01a.slice/crio-39dafd3b5786036bb4aac9948d875c2c28c335ec9e7c198e5c6e7e54d16d9223 WatchSource:0}: Error finding container 39dafd3b5786036bb4aac9948d875c2c28c335ec9e7c198e5c6e7e54d16d9223: Status 404 returned error can't find the container with id 39dafd3b5786036bb4aac9948d875c2c28c335ec9e7c198e5c6e7e54d16d9223
Jul 24 17:13:06.772827 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.772807    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq"]
Jul 24 17:13:06.775725 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.775707    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq"
Jul 24 17:13:06.798685 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.798659    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq"]
Jul 24 17:13:06.803225 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.803201    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c552b149-78af-4ebc-bc82-aeefb7220255-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq\" (UID: \"c552b149-78af-4ebc-bc82-aeefb7220255\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq"
Jul 24 17:13:06.803348 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.803261    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mplz\" (UniqueName: \"kubernetes.io/projected/c552b149-78af-4ebc-bc82-aeefb7220255-kube-api-access-8mplz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq\" (UID: \"c552b149-78af-4ebc-bc82-aeefb7220255\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq"
Jul 24 17:13:06.803348 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.803301    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c552b149-78af-4ebc-bc82-aeefb7220255-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq\" (UID: \"c552b149-78af-4ebc-bc82-aeefb7220255\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq"
Jul 24 17:13:06.904250 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.904207    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c552b149-78af-4ebc-bc82-aeefb7220255-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq\" (UID: \"c552b149-78af-4ebc-bc82-aeefb7220255\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq"
Jul 24 17:13:06.904640 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.904278    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mplz\" (UniqueName: \"kubernetes.io/projected/c552b149-78af-4ebc-bc82-aeefb7220255-kube-api-access-8mplz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq\" (UID: \"c552b149-78af-4ebc-bc82-aeefb7220255\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq"
Jul 24 17:13:06.904640 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.904305    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c552b149-78af-4ebc-bc82-aeefb7220255-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq\" (UID: \"c552b149-78af-4ebc-bc82-aeefb7220255\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq"
Jul 24 17:13:06.904640 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.904583    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c552b149-78af-4ebc-bc82-aeefb7220255-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq\" (UID: \"c552b149-78af-4ebc-bc82-aeefb7220255\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq"
Jul 24 17:13:06.904640 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.904609    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c552b149-78af-4ebc-bc82-aeefb7220255-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq\" (UID: \"c552b149-78af-4ebc-bc82-aeefb7220255\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq"
Jul 24 17:13:06.940030 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:06.939960    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mplz\" (UniqueName: \"kubernetes.io/projected/c552b149-78af-4ebc-bc82-aeefb7220255-kube-api-access-8mplz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq\" (UID: \"c552b149-78af-4ebc-bc82-aeefb7220255\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq"
Jul 24 17:13:07.084904 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:07.084876    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq"
Jul 24 17:13:07.245662 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:07.245472    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq"]
Jul 24 17:13:07.248121 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:13:07.248094    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc552b149_78af_4ebc_bc82_aeefb7220255.slice/crio-e8b80e89437b14cde3784a2cb5749e194c459751139d29e972f5d6b75ff03b29 WatchSource:0}: Error finding container e8b80e89437b14cde3784a2cb5749e194c459751139d29e972f5d6b75ff03b29: Status 404 returned error can't find the container with id e8b80e89437b14cde3784a2cb5749e194c459751139d29e972f5d6b75ff03b29
Jul 24 17:13:07.413839 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:07.413804    2572 generic.go:356] "Generic (PLEG): container finished" podID="e9c066fd-192f-4d8c-be57-7cea69f7d01a" containerID="19faa0c7b4aae748514c3540e6ca3c6b08d8d626ec0b980d3b2aa48fdadcfeae" exitCode=0
Jul 24 17:13:07.414013 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:07.413890    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n" event={"ID":"e9c066fd-192f-4d8c-be57-7cea69f7d01a","Type":"ContainerDied","Data":"19faa0c7b4aae748514c3540e6ca3c6b08d8d626ec0b980d3b2aa48fdadcfeae"}
Jul 24 17:13:07.414013 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:07.413940    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n" event={"ID":"e9c066fd-192f-4d8c-be57-7cea69f7d01a","Type":"ContainerStarted","Data":"39dafd3b5786036bb4aac9948d875c2c28c335ec9e7c198e5c6e7e54d16d9223"}
Jul 24 17:13:07.415567 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:07.415544    2572 generic.go:356] "Generic (PLEG): container finished" podID="a4f9aaa6-5389-4d13-8152-3c256e9391a9" containerID="18a19c71b2433fc5e48446fb86bc96245b56fad677931321180761595d6ded89" exitCode=0
Jul 24 17:13:07.415698 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:07.415629    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn" event={"ID":"a4f9aaa6-5389-4d13-8152-3c256e9391a9","Type":"ContainerDied","Data":"18a19c71b2433fc5e48446fb86bc96245b56fad677931321180761595d6ded89"}
Jul 24 17:13:07.415698 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:07.415674    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn" event={"ID":"a4f9aaa6-5389-4d13-8152-3c256e9391a9","Type":"ContainerStarted","Data":"c9c891f93655b2eaaaabadeee6678837450aa627875638d49d99b9950a82f365"}
Jul 24 17:13:07.417220 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:07.417199    2572 generic.go:356] "Generic (PLEG): container finished" podID="6559a994-d707-4ab2-945f-8cc7196bde5c" containerID="e7e5dfa964ed3e34bf3a298c4c712b4588da7d4ada74d7a4a0a809acb097ff0c" exitCode=0
Jul 24 17:13:07.417346 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:07.417261    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95" event={"ID":"6559a994-d707-4ab2-945f-8cc7196bde5c","Type":"ContainerDied","Data":"e7e5dfa964ed3e34bf3a298c4c712b4588da7d4ada74d7a4a0a809acb097ff0c"}
Jul 24 17:13:07.418923 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:07.418904    2572 generic.go:356] "Generic (PLEG): container finished" podID="c552b149-78af-4ebc-bc82-aeefb7220255" containerID="8f707b66c1e97b2c67f04698a1b97cf41543d2de2e85545747321f99ca764f8a" exitCode=0
Jul 24 17:13:07.419063 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:07.418957    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq" event={"ID":"c552b149-78af-4ebc-bc82-aeefb7220255","Type":"ContainerDied","Data":"8f707b66c1e97b2c67f04698a1b97cf41543d2de2e85545747321f99ca764f8a"}
Jul 24 17:13:07.419063 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:07.419001    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq" event={"ID":"c552b149-78af-4ebc-bc82-aeefb7220255","Type":"ContainerStarted","Data":"e8b80e89437b14cde3784a2cb5749e194c459751139d29e972f5d6b75ff03b29"}
Jul 24 17:13:08.440060 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:08.440017    2572 generic.go:356] "Generic (PLEG): container finished" podID="c552b149-78af-4ebc-bc82-aeefb7220255" containerID="bdb9c28479d67ddb9a7b289b3faaff51316de78c06b71400de3fecace007a462" exitCode=0
Jul 24 17:13:08.440466 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:08.440069    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq" event={"ID":"c552b149-78af-4ebc-bc82-aeefb7220255","Type":"ContainerDied","Data":"bdb9c28479d67ddb9a7b289b3faaff51316de78c06b71400de3fecace007a462"}
Jul 24 17:13:09.446958 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:09.446917    2572 generic.go:356] "Generic (PLEG): container finished" podID="a4f9aaa6-5389-4d13-8152-3c256e9391a9" containerID="6ec6b07cc735e267f2251682a1b5a6cb6c330ab381a43abccad9da7020ee0b4f" exitCode=0
Jul 24 17:13:09.447428 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:09.447002    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn" event={"ID":"a4f9aaa6-5389-4d13-8152-3c256e9391a9","Type":"ContainerDied","Data":"6ec6b07cc735e267f2251682a1b5a6cb6c330ab381a43abccad9da7020ee0b4f"}
Jul 24 17:13:09.449030 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:09.449010    2572 generic.go:356] "Generic (PLEG): container finished" podID="6559a994-d707-4ab2-945f-8cc7196bde5c" containerID="37ffa7735cf44d606bb28193f6bc69efb9f065a64d2861514b5643777e50eb1b" exitCode=0
Jul 24 17:13:09.449123 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:09.449086    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95" event={"ID":"6559a994-d707-4ab2-945f-8cc7196bde5c","Type":"ContainerDied","Data":"37ffa7735cf44d606bb28193f6bc69efb9f065a64d2861514b5643777e50eb1b"}
Jul 24 17:13:09.451188 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:09.451124    2572 generic.go:356] "Generic (PLEG): container finished" podID="c552b149-78af-4ebc-bc82-aeefb7220255" containerID="a9a0609ba82ab6951e7fc9bcbe153f89bf61656bdc0dc0de55c7c58df4849eca" exitCode=0
Jul 24 17:13:09.451285 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:09.451211    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq" event={"ID":"c552b149-78af-4ebc-bc82-aeefb7220255","Type":"ContainerDied","Data":"a9a0609ba82ab6951e7fc9bcbe153f89bf61656bdc0dc0de55c7c58df4849eca"}
Jul 24 17:13:09.453157 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:09.453140    2572 generic.go:356] "Generic (PLEG): container finished" podID="e9c066fd-192f-4d8c-be57-7cea69f7d01a" containerID="596b65635fc655aadda5a867ff98d6370d7854691254222872a5b6710fec391c" exitCode=0
Jul 24 17:13:09.453264 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:09.453193    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n" event={"ID":"e9c066fd-192f-4d8c-be57-7cea69f7d01a","Type":"ContainerDied","Data":"596b65635fc655aadda5a867ff98d6370d7854691254222872a5b6710fec391c"}
Jul 24 17:13:10.464005 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:10.463972    2572 generic.go:356] "Generic (PLEG): container finished" podID="e9c066fd-192f-4d8c-be57-7cea69f7d01a" containerID="c61131b5829d210796db0d9b6d7a98a1bf4e35f601b3368410e5b45e29fe95e3" exitCode=0
Jul 24 17:13:10.464419 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:10.464058    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n" event={"ID":"e9c066fd-192f-4d8c-be57-7cea69f7d01a","Type":"ContainerDied","Data":"c61131b5829d210796db0d9b6d7a98a1bf4e35f601b3368410e5b45e29fe95e3"}
Jul 24 17:13:10.465938 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:10.465898    2572 generic.go:356] "Generic (PLEG): container finished" podID="a4f9aaa6-5389-4d13-8152-3c256e9391a9" containerID="f00abde5a9e463822d390d76f544f887505c89ef2e76ebea7102c453977b9ec0" exitCode=0
Jul 24 17:13:10.466083 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:10.465975    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn" event={"ID":"a4f9aaa6-5389-4d13-8152-3c256e9391a9","Type":"ContainerDied","Data":"f00abde5a9e463822d390d76f544f887505c89ef2e76ebea7102c453977b9ec0"}
Jul 24 17:13:10.467857 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:10.467838    2572 generic.go:356] "Generic (PLEG): container finished" podID="6559a994-d707-4ab2-945f-8cc7196bde5c" containerID="cf4f9b708431926c196e2a8cc00716061f6d379dca0f1363bf82a4563e03bb96" exitCode=0
Jul 24 17:13:10.467983 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:10.467933    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95" event={"ID":"6559a994-d707-4ab2-945f-8cc7196bde5c","Type":"ContainerDied","Data":"cf4f9b708431926c196e2a8cc00716061f6d379dca0f1363bf82a4563e03bb96"}
Jul 24 17:13:10.589358 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:10.589335    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq"
Jul 24 17:13:10.639321 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:10.639293    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mplz\" (UniqueName: \"kubernetes.io/projected/c552b149-78af-4ebc-bc82-aeefb7220255-kube-api-access-8mplz\") pod \"c552b149-78af-4ebc-bc82-aeefb7220255\" (UID: \"c552b149-78af-4ebc-bc82-aeefb7220255\") "
Jul 24 17:13:10.639462 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:10.639409    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c552b149-78af-4ebc-bc82-aeefb7220255-bundle\") pod \"c552b149-78af-4ebc-bc82-aeefb7220255\" (UID: \"c552b149-78af-4ebc-bc82-aeefb7220255\") "
Jul 24 17:13:10.639462 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:10.639436    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c552b149-78af-4ebc-bc82-aeefb7220255-util\") pod \"c552b149-78af-4ebc-bc82-aeefb7220255\" (UID: \"c552b149-78af-4ebc-bc82-aeefb7220255\") "
Jul 24 17:13:10.639897 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:10.639865    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c552b149-78af-4ebc-bc82-aeefb7220255-bundle" (OuterVolumeSpecName: "bundle") pod "c552b149-78af-4ebc-bc82-aeefb7220255" (UID: "c552b149-78af-4ebc-bc82-aeefb7220255"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:13:10.641502 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:10.641481    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c552b149-78af-4ebc-bc82-aeefb7220255-kube-api-access-8mplz" (OuterVolumeSpecName: "kube-api-access-8mplz") pod "c552b149-78af-4ebc-bc82-aeefb7220255" (UID: "c552b149-78af-4ebc-bc82-aeefb7220255"). InnerVolumeSpecName "kube-api-access-8mplz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:13:10.644932 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:10.644905    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c552b149-78af-4ebc-bc82-aeefb7220255-util" (OuterVolumeSpecName: "util") pod "c552b149-78af-4ebc-bc82-aeefb7220255" (UID: "c552b149-78af-4ebc-bc82-aeefb7220255"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:13:10.745956 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:10.741300    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c552b149-78af-4ebc-bc82-aeefb7220255-bundle\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:13:10.745956 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:10.741332    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c552b149-78af-4ebc-bc82-aeefb7220255-util\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:13:10.745956 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:10.741347    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mplz\" (UniqueName: \"kubernetes.io/projected/c552b149-78af-4ebc-bc82-aeefb7220255-kube-api-access-8mplz\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:13:11.475637 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.475607    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq"
Jul 24 17:13:11.476075 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.475635    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq" event={"ID":"c552b149-78af-4ebc-bc82-aeefb7220255","Type":"ContainerDied","Data":"e8b80e89437b14cde3784a2cb5749e194c459751139d29e972f5d6b75ff03b29"}
Jul 24 17:13:11.476075 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.475685    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8b80e89437b14cde3784a2cb5749e194c459751139d29e972f5d6b75ff03b29"
Jul 24 17:13:11.625802 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.625775    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95"
Jul 24 17:13:11.664925 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.664897    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n"
Jul 24 17:13:11.667784 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.667765    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn"
Jul 24 17:13:11.750984 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.750906    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4f9aaa6-5389-4d13-8152-3c256e9391a9-util\") pod \"a4f9aaa6-5389-4d13-8152-3c256e9391a9\" (UID: \"a4f9aaa6-5389-4d13-8152-3c256e9391a9\") "
Jul 24 17:13:11.750984 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.750977    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xlcl\" (UniqueName: \"kubernetes.io/projected/6559a994-d707-4ab2-945f-8cc7196bde5c-kube-api-access-4xlcl\") pod \"6559a994-d707-4ab2-945f-8cc7196bde5c\" (UID: \"6559a994-d707-4ab2-945f-8cc7196bde5c\") "
Jul 24 17:13:11.751199 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.751004    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9c066fd-192f-4d8c-be57-7cea69f7d01a-util\") pod \"e9c066fd-192f-4d8c-be57-7cea69f7d01a\" (UID: \"e9c066fd-192f-4d8c-be57-7cea69f7d01a\") "
Jul 24 17:13:11.751199 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.751037    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6559a994-d707-4ab2-945f-8cc7196bde5c-util\") pod \"6559a994-d707-4ab2-945f-8cc7196bde5c\" (UID: \"6559a994-d707-4ab2-945f-8cc7196bde5c\") "
Jul 24 17:13:11.751199 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.751065    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9c066fd-192f-4d8c-be57-7cea69f7d01a-bundle\") pod \"e9c066fd-192f-4d8c-be57-7cea69f7d01a\" (UID: \"e9c066fd-192f-4d8c-be57-7cea69f7d01a\") "
Jul 24 17:13:11.751199 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.751105    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4f9aaa6-5389-4d13-8152-3c256e9391a9-bundle\") pod \"a4f9aaa6-5389-4d13-8152-3c256e9391a9\" (UID: \"a4f9aaa6-5389-4d13-8152-3c256e9391a9\") "
Jul 24 17:13:11.751199 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.751124    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fb58b\" (UniqueName: \"kubernetes.io/projected/a4f9aaa6-5389-4d13-8152-3c256e9391a9-kube-api-access-fb58b\") pod \"a4f9aaa6-5389-4d13-8152-3c256e9391a9\" (UID: \"a4f9aaa6-5389-4d13-8152-3c256e9391a9\") "
Jul 24 17:13:11.751199 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.751161    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6559a994-d707-4ab2-945f-8cc7196bde5c-bundle\") pod \"6559a994-d707-4ab2-945f-8cc7196bde5c\" (UID: \"6559a994-d707-4ab2-945f-8cc7196bde5c\") "
Jul 24 17:13:11.751199 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.751185    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbfkw\" (UniqueName: \"kubernetes.io/projected/e9c066fd-192f-4d8c-be57-7cea69f7d01a-kube-api-access-rbfkw\") pod \"e9c066fd-192f-4d8c-be57-7cea69f7d01a\" (UID: \"e9c066fd-192f-4d8c-be57-7cea69f7d01a\") "
Jul 24 17:13:11.751742 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.751685    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6559a994-d707-4ab2-945f-8cc7196bde5c-bundle" (OuterVolumeSpecName: "bundle") pod "6559a994-d707-4ab2-945f-8cc7196bde5c" (UID: "6559a994-d707-4ab2-945f-8cc7196bde5c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:13:11.752356 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.752330    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9c066fd-192f-4d8c-be57-7cea69f7d01a-bundle" (OuterVolumeSpecName: "bundle") pod "e9c066fd-192f-4d8c-be57-7cea69f7d01a" (UID: "e9c066fd-192f-4d8c-be57-7cea69f7d01a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:13:11.752515 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.752488    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4f9aaa6-5389-4d13-8152-3c256e9391a9-bundle" (OuterVolumeSpecName: "bundle") pod "a4f9aaa6-5389-4d13-8152-3c256e9391a9" (UID: "a4f9aaa6-5389-4d13-8152-3c256e9391a9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:13:11.753650 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.753617    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4f9aaa6-5389-4d13-8152-3c256e9391a9-kube-api-access-fb58b" (OuterVolumeSpecName: "kube-api-access-fb58b") pod "a4f9aaa6-5389-4d13-8152-3c256e9391a9" (UID: "a4f9aaa6-5389-4d13-8152-3c256e9391a9"). InnerVolumeSpecName "kube-api-access-fb58b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:13:11.753732 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.753626    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6559a994-d707-4ab2-945f-8cc7196bde5c-kube-api-access-4xlcl" (OuterVolumeSpecName: "kube-api-access-4xlcl") pod "6559a994-d707-4ab2-945f-8cc7196bde5c" (UID: "6559a994-d707-4ab2-945f-8cc7196bde5c"). InnerVolumeSpecName "kube-api-access-4xlcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:13:11.753732 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.753673    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9c066fd-192f-4d8c-be57-7cea69f7d01a-kube-api-access-rbfkw" (OuterVolumeSpecName: "kube-api-access-rbfkw") pod "e9c066fd-192f-4d8c-be57-7cea69f7d01a" (UID: "e9c066fd-192f-4d8c-be57-7cea69f7d01a"). InnerVolumeSpecName "kube-api-access-rbfkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:13:11.757387 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.757363    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9c066fd-192f-4d8c-be57-7cea69f7d01a-util" (OuterVolumeSpecName: "util") pod "e9c066fd-192f-4d8c-be57-7cea69f7d01a" (UID: "e9c066fd-192f-4d8c-be57-7cea69f7d01a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:13:11.852872 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.852823    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9c066fd-192f-4d8c-be57-7cea69f7d01a-bundle\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:13:11.852872 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.852865    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4f9aaa6-5389-4d13-8152-3c256e9391a9-bundle\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:13:11.852872 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.852878    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fb58b\" (UniqueName: \"kubernetes.io/projected/a4f9aaa6-5389-4d13-8152-3c256e9391a9-kube-api-access-fb58b\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:13:11.853101 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.852888    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6559a994-d707-4ab2-945f-8cc7196bde5c-bundle\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:13:11.853101 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.852898    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbfkw\" (UniqueName: \"kubernetes.io/projected/e9c066fd-192f-4d8c-be57-7cea69f7d01a-kube-api-access-rbfkw\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:13:11.853101 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.852907    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xlcl\" (UniqueName: \"kubernetes.io/projected/6559a994-d707-4ab2-945f-8cc7196bde5c-kube-api-access-4xlcl\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:13:11.853101 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.852915    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9c066fd-192f-4d8c-be57-7cea69f7d01a-util\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:13:11.905148 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.905090    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4f9aaa6-5389-4d13-8152-3c256e9391a9-util" (OuterVolumeSpecName: "util") pod "a4f9aaa6-5389-4d13-8152-3c256e9391a9" (UID: "a4f9aaa6-5389-4d13-8152-3c256e9391a9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:13:11.905369 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.905347    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6559a994-d707-4ab2-945f-8cc7196bde5c-util" (OuterVolumeSpecName: "util") pod "6559a994-d707-4ab2-945f-8cc7196bde5c" (UID: "6559a994-d707-4ab2-945f-8cc7196bde5c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:13:11.953486 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.953454    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4f9aaa6-5389-4d13-8152-3c256e9391a9-util\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:13:11.953486 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:11.953480    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6559a994-d707-4ab2-945f-8cc7196bde5c-util\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:13:12.482131 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:12.482101    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n"
Jul 24 17:13:12.482131 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:12.482111    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n" event={"ID":"e9c066fd-192f-4d8c-be57-7cea69f7d01a","Type":"ContainerDied","Data":"39dafd3b5786036bb4aac9948d875c2c28c335ec9e7c198e5c6e7e54d16d9223"}
Jul 24 17:13:12.482647 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:12.482151    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39dafd3b5786036bb4aac9948d875c2c28c335ec9e7c198e5c6e7e54d16d9223"
Jul 24 17:13:12.484127 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:12.484110    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn"
Jul 24 17:13:12.484248 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:12.484145    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn" event={"ID":"a4f9aaa6-5389-4d13-8152-3c256e9391a9","Type":"ContainerDied","Data":"c9c891f93655b2eaaaabadeee6678837450aa627875638d49d99b9950a82f365"}
Jul 24 17:13:12.484248 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:12.484189    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9c891f93655b2eaaaabadeee6678837450aa627875638d49d99b9950a82f365"
Jul 24 17:13:12.486167 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:12.486146    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95" event={"ID":"6559a994-d707-4ab2-945f-8cc7196bde5c","Type":"ContainerDied","Data":"63aaf366de1c569e0fbc11412aa191b6db8757c1f68364bbe342c4f2505b0986"}
Jul 24 17:13:12.486283 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:12.486170    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95"
Jul 24 17:13:12.486283 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:12.486177    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63aaf366de1c569e0fbc11412aa191b6db8757c1f68364bbe342c4f2505b0986"
Jul 24 17:13:18.324976 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.324940    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgzfg"]
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325312    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c552b149-78af-4ebc-bc82-aeefb7220255" containerName="pull"
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325324    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c552b149-78af-4ebc-bc82-aeefb7220255" containerName="pull"
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325331    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c552b149-78af-4ebc-bc82-aeefb7220255" containerName="extract"
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325337    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c552b149-78af-4ebc-bc82-aeefb7220255" containerName="extract"
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325345    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4f9aaa6-5389-4d13-8152-3c256e9391a9" containerName="util"
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325352    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4f9aaa6-5389-4d13-8152-3c256e9391a9" containerName="util"
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325359    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6559a994-d707-4ab2-945f-8cc7196bde5c" containerName="pull"
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325363    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6559a994-d707-4ab2-945f-8cc7196bde5c" containerName="pull"
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325372    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6559a994-d707-4ab2-945f-8cc7196bde5c" containerName="util"
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325377    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6559a994-d707-4ab2-945f-8cc7196bde5c" containerName="util"
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325383    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c552b149-78af-4ebc-bc82-aeefb7220255" containerName="util"
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325388    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c552b149-78af-4ebc-bc82-aeefb7220255" containerName="util"
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325394    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9c066fd-192f-4d8c-be57-7cea69f7d01a" containerName="extract"
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325399    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9c066fd-192f-4d8c-be57-7cea69f7d01a" containerName="extract"
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325406    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4f9aaa6-5389-4d13-8152-3c256e9391a9" containerName="pull"
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325410    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4f9aaa6-5389-4d13-8152-3c256e9391a9" containerName="pull"
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325416    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9c066fd-192f-4d8c-be57-7cea69f7d01a" containerName="util"
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325421    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9c066fd-192f-4d8c-be57-7cea69f7d01a" containerName="util"
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325427    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6559a994-d707-4ab2-945f-8cc7196bde5c" containerName="extract"
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325432    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6559a994-d707-4ab2-945f-8cc7196bde5c" containerName="extract"
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325441    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9c066fd-192f-4d8c-be57-7cea69f7d01a" containerName="pull"
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325446    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9c066fd-192f-4d8c-be57-7cea69f7d01a" containerName="pull"
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325454    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4f9aaa6-5389-4d13-8152-3c256e9391a9" containerName="extract"
Jul 24 17:13:18.325480 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325459    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4f9aaa6-5389-4d13-8152-3c256e9391a9" containerName="extract"
Jul 24 17:13:18.326265 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325513    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6559a994-d707-4ab2-945f-8cc7196bde5c" containerName="extract"
Jul 24 17:13:18.326265 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325521    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9c066fd-192f-4d8c-be57-7cea69f7d01a" containerName="extract"
Jul 24 17:13:18.326265 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325527    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4f9aaa6-5389-4d13-8152-3c256e9391a9" containerName="extract"
Jul 24 17:13:18.326265 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.325532    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c552b149-78af-4ebc-bc82-aeefb7220255" containerName="extract"
Jul 24 17:13:18.329787 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.329772    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgzfg"
Jul 24 17:13:18.333521 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.333498    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-9v6t5\""
Jul 24 17:13:18.333653 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.333543    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 24 17:13:18.345222 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.345200    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgzfg"]
Jul 24 17:13:18.407865 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.407834    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfhfg\" (UniqueName: \"kubernetes.io/projected/97fb2e6e-6748-49d9-9e04-a63e51a67337-kube-api-access-tfhfg\") pod \"dns-operator-controller-manager-864dd78c4c-cgzfg\" (UID: \"97fb2e6e-6748-49d9-9e04-a63e51a67337\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgzfg"
Jul 24 17:13:18.508908 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.508877    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfhfg\" (UniqueName: \"kubernetes.io/projected/97fb2e6e-6748-49d9-9e04-a63e51a67337-kube-api-access-tfhfg\") pod \"dns-operator-controller-manager-864dd78c4c-cgzfg\" (UID: \"97fb2e6e-6748-49d9-9e04-a63e51a67337\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgzfg"
Jul 24 17:13:18.537068 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.537044    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfhfg\" (UniqueName: \"kubernetes.io/projected/97fb2e6e-6748-49d9-9e04-a63e51a67337-kube-api-access-tfhfg\") pod \"dns-operator-controller-manager-864dd78c4c-cgzfg\" (UID: \"97fb2e6e-6748-49d9-9e04-a63e51a67337\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgzfg"
Jul 24 17:13:18.639312 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.639283    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgzfg"
Jul 24 17:13:18.784787 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:18.784762    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgzfg"]
Jul 24 17:13:18.786567 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:13:18.786532    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97fb2e6e_6748_49d9_9e04_a63e51a67337.slice/crio-c9b864b1fce9a39bd59556c70ca169accbd151505f8d51670b1b0c3ab3723d6f WatchSource:0}: Error finding container c9b864b1fce9a39bd59556c70ca169accbd151505f8d51670b1b0c3ab3723d6f: Status 404 returned error can't find the container with id c9b864b1fce9a39bd59556c70ca169accbd151505f8d51670b1b0c3ab3723d6f
Jul 24 17:13:19.531454 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:19.531364    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgzfg" event={"ID":"97fb2e6e-6748-49d9-9e04-a63e51a67337","Type":"ContainerStarted","Data":"c9b864b1fce9a39bd59556c70ca169accbd151505f8d51670b1b0c3ab3723d6f"}
Jul 24 17:13:21.544842 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:21.544809    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgzfg" event={"ID":"97fb2e6e-6748-49d9-9e04-a63e51a67337","Type":"ContainerStarted","Data":"57659f93122b832f331114c5c3162355de8fe836351c0631132955961b2c6913"}
Jul 24 17:13:21.545291 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:21.544939    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgzfg"
Jul 24 17:13:21.579135 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:21.579090    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgzfg" podStartSLOduration=1.4037286070000001 podStartE2EDuration="3.579075816s" totalImagesPullingTime="2.175347209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:13:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:13:21.578378287 +0000 UTC m=+619.012593854" watchObservedRunningTime="2026-07-24 17:13:21.579075816 +0000 UTC m=+619.013291383"
Jul 24 17:13:21.850164 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:21.850082    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7rhr9"]
Jul 24 17:13:21.853559 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:21.853545    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7rhr9"
Jul 24 17:13:21.857620 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:21.857592    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rsnxk\""
Jul 24 17:13:21.865826 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:21.865805    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7rhr9"]
Jul 24 17:13:21.941504 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:21.941473    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22n57\" (UniqueName: \"kubernetes.io/projected/c91b605a-e60c-4dd8-975f-f0b660af7583-kube-api-access-22n57\") pod \"limitador-operator-controller-manager-859d7b78bd-7rhr9\" (UID: \"c91b605a-e60c-4dd8-975f-f0b660af7583\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7rhr9"
Jul 24 17:13:22.042024 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:22.041997    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22n57\" (UniqueName: \"kubernetes.io/projected/c91b605a-e60c-4dd8-975f-f0b660af7583-kube-api-access-22n57\") pod \"limitador-operator-controller-manager-859d7b78bd-7rhr9\" (UID: \"c91b605a-e60c-4dd8-975f-f0b660af7583\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7rhr9"
Jul 24 17:13:22.062457 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:22.062434    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22n57\" (UniqueName: \"kubernetes.io/projected/c91b605a-e60c-4dd8-975f-f0b660af7583-kube-api-access-22n57\") pod \"limitador-operator-controller-manager-859d7b78bd-7rhr9\" (UID: \"c91b605a-e60c-4dd8-975f-f0b660af7583\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7rhr9"
Jul 24 17:13:22.165056 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:22.165034    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7rhr9"
Jul 24 17:13:22.360492 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:22.360455    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7rhr9"]
Jul 24 17:13:22.363625 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:13:22.363591    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc91b605a_e60c_4dd8_975f_f0b660af7583.slice/crio-abda52961a0be64e24065f1195727f9484117742c8c57d8693a828ce5216d721 WatchSource:0}: Error finding container abda52961a0be64e24065f1195727f9484117742c8c57d8693a828ce5216d721: Status 404 returned error can't find the container with id abda52961a0be64e24065f1195727f9484117742c8c57d8693a828ce5216d721
Jul 24 17:13:22.551534 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:22.551456    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7rhr9" event={"ID":"c91b605a-e60c-4dd8-975f-f0b660af7583","Type":"ContainerStarted","Data":"abda52961a0be64e24065f1195727f9484117742c8c57d8693a828ce5216d721"}
Jul 24 17:13:24.564859 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:24.564816    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7rhr9" event={"ID":"c91b605a-e60c-4dd8-975f-f0b660af7583","Type":"ContainerStarted","Data":"b7157d0c5bd279d6bb93f891b0f4652c31d4f10545a4babe3eb9fef161d6e689"}
Jul 24 17:13:24.565328 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:24.564880    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7rhr9"
Jul 24 17:13:24.610451 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:24.610407    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7rhr9" podStartSLOduration=2.040101431 podStartE2EDuration="3.610391613s" totalImagesPullingTime="1.570290182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:13:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:13:24.608541481 +0000 UTC m=+622.042757049" watchObservedRunningTime="2026-07-24 17:13:24.610391613 +0000 UTC m=+622.044607256"
Jul 24 17:13:27.560077 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:27.560046    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f22k"]
Jul 24 17:13:27.563437 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:27.563419    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f22k"
Jul 24 17:13:27.567378 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:27.567357    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hwmcx\""
Jul 24 17:13:27.584769 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:27.584744    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f22k"]
Jul 24 17:13:27.690930 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:27.690899    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdfkw\" (UniqueName: \"kubernetes.io/projected/131b78d1-d5c6-4b1c-8456-973ac6c9a008-kube-api-access-vdfkw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7f22k\" (UID: \"131b78d1-d5c6-4b1c-8456-973ac6c9a008\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f22k"
Jul 24 17:13:27.691106 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:27.691031    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/131b78d1-d5c6-4b1c-8456-973ac6c9a008-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7f22k\" (UID: \"131b78d1-d5c6-4b1c-8456-973ac6c9a008\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f22k"
Jul 24 17:13:27.791468 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:27.791437    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/131b78d1-d5c6-4b1c-8456-973ac6c9a008-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7f22k\" (UID: \"131b78d1-d5c6-4b1c-8456-973ac6c9a008\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f22k"
Jul 24 17:13:27.791613 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:27.791487    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdfkw\" (UniqueName: \"kubernetes.io/projected/131b78d1-d5c6-4b1c-8456-973ac6c9a008-kube-api-access-vdfkw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7f22k\" (UID: \"131b78d1-d5c6-4b1c-8456-973ac6c9a008\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f22k"
Jul 24 17:13:27.791779 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:27.791759    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/131b78d1-d5c6-4b1c-8456-973ac6c9a008-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7f22k\" (UID: \"131b78d1-d5c6-4b1c-8456-973ac6c9a008\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f22k"
Jul 24 17:13:27.803350 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:27.803332    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdfkw\" (UniqueName: \"kubernetes.io/projected/131b78d1-d5c6-4b1c-8456-973ac6c9a008-kube-api-access-vdfkw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7f22k\" (UID: \"131b78d1-d5c6-4b1c-8456-973ac6c9a008\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f22k"
Jul 24 17:13:27.872905 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:27.872880    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f22k"
Jul 24 17:13:28.018819 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:28.018792    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f22k"]
Jul 24 17:13:28.021151 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:13:28.021124    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod131b78d1_d5c6_4b1c_8456_973ac6c9a008.slice/crio-d16033309dd3fc2f55d289ea457746b8d195374c43709fab833f7dc1d605d35f WatchSource:0}: Error finding container d16033309dd3fc2f55d289ea457746b8d195374c43709fab833f7dc1d605d35f: Status 404 returned error can't find the container with id d16033309dd3fc2f55d289ea457746b8d195374c43709fab833f7dc1d605d35f
Jul 24 17:13:28.586099 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:28.586067    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f22k" event={"ID":"131b78d1-d5c6-4b1c-8456-973ac6c9a008","Type":"ContainerStarted","Data":"d16033309dd3fc2f55d289ea457746b8d195374c43709fab833f7dc1d605d35f"}
Jul 24 17:13:30.733678 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:30.733645    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dqtt5"]
Jul 24 17:13:30.737488 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:30.737468    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dqtt5"
Jul 24 17:13:30.747405 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:30.747382    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-n6ct4\""
Jul 24 17:13:30.761812 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:30.761789    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dqtt5"]
Jul 24 17:13:30.820779 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:30.820754    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64rzc\" (UniqueName: \"kubernetes.io/projected/bd09bc30-0a66-4918-ac7d-51562b4a1cbc-kube-api-access-64rzc\") pod \"authorino-operator-75cc8d5cb7-dqtt5\" (UID: \"bd09bc30-0a66-4918-ac7d-51562b4a1cbc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dqtt5"
Jul 24 17:13:30.921825 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:30.921790    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64rzc\" (UniqueName: \"kubernetes.io/projected/bd09bc30-0a66-4918-ac7d-51562b4a1cbc-kube-api-access-64rzc\") pod \"authorino-operator-75cc8d5cb7-dqtt5\" (UID: \"bd09bc30-0a66-4918-ac7d-51562b4a1cbc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dqtt5"
Jul 24 17:13:30.954906 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:30.954870    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64rzc\" (UniqueName: \"kubernetes.io/projected/bd09bc30-0a66-4918-ac7d-51562b4a1cbc-kube-api-access-64rzc\") pod \"authorino-operator-75cc8d5cb7-dqtt5\" (UID: \"bd09bc30-0a66-4918-ac7d-51562b4a1cbc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dqtt5"
Jul 24 17:13:31.050521 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:31.050444    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dqtt5"
Jul 24 17:13:31.243606 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:31.243451    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dqtt5"]
Jul 24 17:13:31.246632 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:13:31.246596    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd09bc30_0a66_4918_ac7d_51562b4a1cbc.slice/crio-4e74ae02037522165ff98a3572e1115e171823b015589ff5614a11ce23869d6d WatchSource:0}: Error finding container 4e74ae02037522165ff98a3572e1115e171823b015589ff5614a11ce23869d6d: Status 404 returned error can't find the container with id 4e74ae02037522165ff98a3572e1115e171823b015589ff5614a11ce23869d6d
Jul 24 17:13:31.605914 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:31.605881    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dqtt5" event={"ID":"bd09bc30-0a66-4918-ac7d-51562b4a1cbc","Type":"ContainerStarted","Data":"4e74ae02037522165ff98a3572e1115e171823b015589ff5614a11ce23869d6d"}
Jul 24 17:13:32.554262 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:32.554208    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgzfg"
Jul 24 17:13:33.622578 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:33.622035    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f22k" event={"ID":"131b78d1-d5c6-4b1c-8456-973ac6c9a008","Type":"ContainerStarted","Data":"6251a7df351894aae561f1bda75df5ec53f31328d8107ac4c271c9c2d360ffc3"}
Jul 24 17:13:33.622578 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:33.622268    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f22k"
Jul 24 17:13:33.667419 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:33.667364    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f22k" podStartSLOduration=1.7317265590000002 podStartE2EDuration="6.667346893s" totalImagesPullingTime="4.935620334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:13:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:13:33.666163195 +0000 UTC m=+631.100378764" watchObservedRunningTime="2026-07-24 17:13:33.667346893 +0000 UTC m=+631.101562459"
Jul 24 17:13:35.571923 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:35.571894    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7rhr9"
Jul 24 17:13:35.637430 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:35.637393    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dqtt5" event={"ID":"bd09bc30-0a66-4918-ac7d-51562b4a1cbc","Type":"ContainerStarted","Data":"b1fa9838a1cdebd8f26dc01ab7d7c0ab5b10cc76703c7e35406ce055f5df019a"}
Jul 24 17:13:35.637610 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:35.637591    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dqtt5"
Jul 24 17:13:35.676829 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:35.676780    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dqtt5" podStartSLOduration=2.142861322 podStartE2EDuration="5.676752699s" totalImagesPullingTime="3.533891377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:13:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:13:35.67639915 +0000 UTC m=+633.110614718" watchObservedRunningTime="2026-07-24 17:13:35.676752699 +0000 UTC m=+633.110968259"
Jul 24 17:13:44.630170 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:44.630140    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f22k"
Jul 24 17:13:46.645349 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:46.645317    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dqtt5"
Jul 24 17:13:46.917540 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:46.917415    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f22k"]
Jul 24 17:13:46.917722 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:46.917670    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f22k" podUID="131b78d1-d5c6-4b1c-8456-973ac6c9a008" containerName="manager" containerID="cri-o://6251a7df351894aae561f1bda75df5ec53f31328d8107ac4c271c9c2d360ffc3" gracePeriod=2
Jul 24 17:13:46.927053 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:46.927026    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f22k"]
Jul 24 17:13:46.973922 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:46.973892    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7rhr9"]
Jul 24 17:13:46.974103 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:46.974075    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7rhr9" podUID="c91b605a-e60c-4dd8-975f-f0b660af7583" containerName="manager" containerID="cri-o://b7157d0c5bd279d6bb93f891b0f4652c31d4f10545a4babe3eb9fef161d6e689" gracePeriod=2
Jul 24 17:13:46.996296 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:46.996271    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7rhr9"]
Jul 24 17:13:47.002705 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:13:47.002665    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7f22k\" is forbidden: User \"system:node:ip-10-0-135-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-233.ec2.internal' and this object" podUID="131b78d1-d5c6-4b1c-8456-973ac6c9a008" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f22k"
Jul 24 17:13:47.006157 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.006135    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn"]
Jul 24 17:13:47.007129 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.007114    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="131b78d1-d5c6-4b1c-8456-973ac6c9a008" containerName="manager"
Jul 24 17:13:47.007182 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.007132    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="131b78d1-d5c6-4b1c-8456-973ac6c9a008" containerName="manager"
Jul 24 17:13:47.007182 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.007153    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c91b605a-e60c-4dd8-975f-f0b660af7583" containerName="manager"
Jul 24 17:13:47.007182 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.007159    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c91b605a-e60c-4dd8-975f-f0b660af7583" containerName="manager"
Jul 24 17:13:47.007300 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.007211    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="131b78d1-d5c6-4b1c-8456-973ac6c9a008" containerName="manager"
Jul 24 17:13:47.007300 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.007218    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c91b605a-e60c-4dd8-975f-f0b660af7583" containerName="manager"
Jul 24 17:13:47.011337 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.011320    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn"
Jul 24 17:13:47.013447 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:13:47.013415    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7rhr9\" is forbidden: User \"system:node:ip-10-0-135-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-233.ec2.internal' and this object" podUID="c91b605a-e60c-4dd8-975f-f0b660af7583" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7rhr9"
Jul 24 17:13:47.019504 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:13:47.019481    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7f22k\" is forbidden: User \"system:node:ip-10-0-135-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-233.ec2.internal' and this object" podUID="131b78d1-d5c6-4b1c-8456-973ac6c9a008" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f22k"
Jul 24 17:13:47.053277 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.053257    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bac0c9b3-a6e9-4a6e-82d9-2b02153c350e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zdsgn\" (UID: \"bac0c9b3-a6e9-4a6e-82d9-2b02153c350e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn"
Jul 24 17:13:47.053373 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.053333    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k6bq\" (UniqueName: \"kubernetes.io/projected/bac0c9b3-a6e9-4a6e-82d9-2b02153c350e-kube-api-access-6k6bq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zdsgn\" (UID: \"bac0c9b3-a6e9-4a6e-82d9-2b02153c350e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn"
Jul 24 17:13:47.061844 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.061820    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn"]
Jul 24 17:13:47.064155 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.064133    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qnnx9"]
Jul 24 17:13:47.067496 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.067477    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qnnx9"
Jul 24 17:13:47.112103 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.112071    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qnnx9"]
Jul 24 17:13:47.154780 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.154746    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k6bq\" (UniqueName: \"kubernetes.io/projected/bac0c9b3-a6e9-4a6e-82d9-2b02153c350e-kube-api-access-6k6bq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zdsgn\" (UID: \"bac0c9b3-a6e9-4a6e-82d9-2b02153c350e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn"
Jul 24 17:13:47.154950 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.154803    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bac0c9b3-a6e9-4a6e-82d9-2b02153c350e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zdsgn\" (UID: \"bac0c9b3-a6e9-4a6e-82d9-2b02153c350e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn"
Jul 24 17:13:47.154950 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.154845    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcczt\" (UniqueName: \"kubernetes.io/projected/5f4b2492-962d-45d2-b880-d6ce8717b1f4-kube-api-access-bcczt\") pod \"limitador-operator-controller-manager-859d7b78bd-qnnx9\" (UID: \"5f4b2492-962d-45d2-b880-d6ce8717b1f4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qnnx9"
Jul 24 17:13:47.155251 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.155204    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bac0c9b3-a6e9-4a6e-82d9-2b02153c350e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zdsgn\" (UID: \"bac0c9b3-a6e9-4a6e-82d9-2b02153c350e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn"
Jul 24 17:13:47.200958 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.200925    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k6bq\" (UniqueName: \"kubernetes.io/projected/bac0c9b3-a6e9-4a6e-82d9-2b02153c350e-kube-api-access-6k6bq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zdsgn\" (UID: \"bac0c9b3-a6e9-4a6e-82d9-2b02153c350e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn"
Jul 24 17:13:47.244305 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.244276    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f22k"
Jul 24 17:13:47.255219 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.255197    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/131b78d1-d5c6-4b1c-8456-973ac6c9a008-extensions-socket-volume\") pod \"131b78d1-d5c6-4b1c-8456-973ac6c9a008\" (UID: \"131b78d1-d5c6-4b1c-8456-973ac6c9a008\") "
Jul 24 17:13:47.255361 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.255300    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdfkw\" (UniqueName: \"kubernetes.io/projected/131b78d1-d5c6-4b1c-8456-973ac6c9a008-kube-api-access-vdfkw\") pod \"131b78d1-d5c6-4b1c-8456-973ac6c9a008\" (UID: \"131b78d1-d5c6-4b1c-8456-973ac6c9a008\") "
Jul 24 17:13:47.255454 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.255413    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcczt\" (UniqueName: \"kubernetes.io/projected/5f4b2492-962d-45d2-b880-d6ce8717b1f4-kube-api-access-bcczt\") pod \"limitador-operator-controller-manager-859d7b78bd-qnnx9\" (UID: \"5f4b2492-962d-45d2-b880-d6ce8717b1f4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qnnx9"
Jul 24 17:13:47.255724 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.255702    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/131b78d1-d5c6-4b1c-8456-973ac6c9a008-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "131b78d1-d5c6-4b1c-8456-973ac6c9a008" (UID: "131b78d1-d5c6-4b1c-8456-973ac6c9a008"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:13:47.257582 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.257557    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/131b78d1-d5c6-4b1c-8456-973ac6c9a008-kube-api-access-vdfkw" (OuterVolumeSpecName: "kube-api-access-vdfkw") pod "131b78d1-d5c6-4b1c-8456-973ac6c9a008" (UID: "131b78d1-d5c6-4b1c-8456-973ac6c9a008"). InnerVolumeSpecName "kube-api-access-vdfkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:13:47.267509 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.267488    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7rhr9"
Jul 24 17:13:47.277708 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.277686    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcczt\" (UniqueName: \"kubernetes.io/projected/5f4b2492-962d-45d2-b880-d6ce8717b1f4-kube-api-access-bcczt\") pod \"limitador-operator-controller-manager-859d7b78bd-qnnx9\" (UID: \"5f4b2492-962d-45d2-b880-d6ce8717b1f4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qnnx9"
Jul 24 17:13:47.354810 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.354788    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn"
Jul 24 17:13:47.356088 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.356069    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22n57\" (UniqueName: \"kubernetes.io/projected/c91b605a-e60c-4dd8-975f-f0b660af7583-kube-api-access-22n57\") pod \"c91b605a-e60c-4dd8-975f-f0b660af7583\" (UID: \"c91b605a-e60c-4dd8-975f-f0b660af7583\") "
Jul 24 17:13:47.356291 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.356280    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdfkw\" (UniqueName: \"kubernetes.io/projected/131b78d1-d5c6-4b1c-8456-973ac6c9a008-kube-api-access-vdfkw\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:13:47.356338 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.356293    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/131b78d1-d5c6-4b1c-8456-973ac6c9a008-extensions-socket-volume\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:13:47.358281 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.358260    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c91b605a-e60c-4dd8-975f-f0b660af7583-kube-api-access-22n57" (OuterVolumeSpecName: "kube-api-access-22n57") pod "c91b605a-e60c-4dd8-975f-f0b660af7583" (UID: "c91b605a-e60c-4dd8-975f-f0b660af7583"). InnerVolumeSpecName "kube-api-access-22n57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:13:47.378291 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.378267    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qnnx9"
Jul 24 17:13:47.457156 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.457114    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22n57\" (UniqueName: \"kubernetes.io/projected/c91b605a-e60c-4dd8-975f-f0b660af7583-kube-api-access-22n57\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:13:47.550740 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:13:47.550714    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbac0c9b3_a6e9_4a6e_82d9_2b02153c350e.slice/crio-621cfed8297c948139b082b2edebd41828d58cfa13a34ecd14a7017547093753 WatchSource:0}: Error finding container 621cfed8297c948139b082b2edebd41828d58cfa13a34ecd14a7017547093753: Status 404 returned error can't find the container with id 621cfed8297c948139b082b2edebd41828d58cfa13a34ecd14a7017547093753
Jul 24 17:13:47.550838 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.550820    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn"]
Jul 24 17:13:47.565891 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.565869    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qnnx9"]
Jul 24 17:13:47.566763 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:13:47.566744    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f4b2492_962d_45d2_b880_d6ce8717b1f4.slice/crio-dcf80454d14291649973ab975a86683c85a9520c4c1598aa371962645e03a87d WatchSource:0}: Error finding container dcf80454d14291649973ab975a86683c85a9520c4c1598aa371962645e03a87d: Status 404 returned error can't find the container with id dcf80454d14291649973ab975a86683c85a9520c4c1598aa371962645e03a87d
Jul 24 17:13:47.703166 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.703058    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qnnx9" event={"ID":"5f4b2492-962d-45d2-b880-d6ce8717b1f4","Type":"ContainerStarted","Data":"6cd9c42d9fe886e5dbc82cd05f455f994138a53d32eeb625faab9ab07d8327f1"}
Jul 24 17:13:47.703166 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.703139    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qnnx9"
Jul 24 17:13:47.703166 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.703166    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qnnx9" event={"ID":"5f4b2492-962d-45d2-b880-d6ce8717b1f4","Type":"ContainerStarted","Data":"dcf80454d14291649973ab975a86683c85a9520c4c1598aa371962645e03a87d"}
Jul 24 17:13:47.704503 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.704478    2572 generic.go:356] "Generic (PLEG): container finished" podID="c91b605a-e60c-4dd8-975f-f0b660af7583" containerID="b7157d0c5bd279d6bb93f891b0f4652c31d4f10545a4babe3eb9fef161d6e689" exitCode=0
Jul 24 17:13:47.704638 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.704512    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7rhr9"
Jul 24 17:13:47.704638 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.704558    2572 scope.go:117] "RemoveContainer" containerID="b7157d0c5bd279d6bb93f891b0f4652c31d4f10545a4babe3eb9fef161d6e689"
Jul 24 17:13:47.706554 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.706524    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn" event={"ID":"bac0c9b3-a6e9-4a6e-82d9-2b02153c350e","Type":"ContainerStarted","Data":"2ac6367e0e43be8794bda3251b8f299c9c32f2bb32b9fd9f01dd64783ed1eca7"}
Jul 24 17:13:47.706656 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.706586    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn" event={"ID":"bac0c9b3-a6e9-4a6e-82d9-2b02153c350e","Type":"ContainerStarted","Data":"621cfed8297c948139b082b2edebd41828d58cfa13a34ecd14a7017547093753"}
Jul 24 17:13:47.706656 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.706621    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn"
Jul 24 17:13:47.708033 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.708003    2572 generic.go:356] "Generic (PLEG): container finished" podID="131b78d1-d5c6-4b1c-8456-973ac6c9a008" containerID="6251a7df351894aae561f1bda75df5ec53f31328d8107ac4c271c9c2d360ffc3" exitCode=0
Jul 24 17:13:47.708121 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.708062    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f22k"
Jul 24 17:13:47.714556 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.714541    2572 scope.go:117] "RemoveContainer" containerID="b7157d0c5bd279d6bb93f891b0f4652c31d4f10545a4babe3eb9fef161d6e689"
Jul 24 17:13:47.714850 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:13:47.714834    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7157d0c5bd279d6bb93f891b0f4652c31d4f10545a4babe3eb9fef161d6e689\": container with ID starting with b7157d0c5bd279d6bb93f891b0f4652c31d4f10545a4babe3eb9fef161d6e689 not found: ID does not exist" containerID="b7157d0c5bd279d6bb93f891b0f4652c31d4f10545a4babe3eb9fef161d6e689"
Jul 24 17:13:47.714907 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.714857    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7157d0c5bd279d6bb93f891b0f4652c31d4f10545a4babe3eb9fef161d6e689"} err="failed to get container status \"b7157d0c5bd279d6bb93f891b0f4652c31d4f10545a4babe3eb9fef161d6e689\": rpc error: code = NotFound desc = could not find container \"b7157d0c5bd279d6bb93f891b0f4652c31d4f10545a4babe3eb9fef161d6e689\": container with ID starting with b7157d0c5bd279d6bb93f891b0f4652c31d4f10545a4babe3eb9fef161d6e689 not found: ID does not exist"
Jul 24 17:13:47.714907 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.714879    2572 scope.go:117] "RemoveContainer" containerID="6251a7df351894aae561f1bda75df5ec53f31328d8107ac4c271c9c2d360ffc3"
Jul 24 17:13:47.723684 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.723666    2572 scope.go:117] "RemoveContainer" containerID="6251a7df351894aae561f1bda75df5ec53f31328d8107ac4c271c9c2d360ffc3"
Jul 24 17:13:47.723912 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:13:47.723895    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6251a7df351894aae561f1bda75df5ec53f31328d8107ac4c271c9c2d360ffc3\": container with ID starting with 6251a7df351894aae561f1bda75df5ec53f31328d8107ac4c271c9c2d360ffc3 not found: ID does not exist" containerID="6251a7df351894aae561f1bda75df5ec53f31328d8107ac4c271c9c2d360ffc3"
Jul 24 17:13:47.723958 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.723920    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6251a7df351894aae561f1bda75df5ec53f31328d8107ac4c271c9c2d360ffc3"} err="failed to get container status \"6251a7df351894aae561f1bda75df5ec53f31328d8107ac4c271c9c2d360ffc3\": rpc error: code = NotFound desc = could not find container \"6251a7df351894aae561f1bda75df5ec53f31328d8107ac4c271c9c2d360ffc3\": container with ID starting with 6251a7df351894aae561f1bda75df5ec53f31328d8107ac4c271c9c2d360ffc3 not found: ID does not exist"
Jul 24 17:13:47.764606 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.764563    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qnnx9" podStartSLOduration=0.764549103 podStartE2EDuration="764.549103ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:13:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:13:47.761207052 +0000 UTC m=+645.195422631" watchObservedRunningTime="2026-07-24 17:13:47.764549103 +0000 UTC m=+645.198764670"
Jul 24 17:13:47.803834 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:47.803798    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn" podStartSLOduration=1.8037846370000001 podStartE2EDuration="1.803784637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:13:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:13:47.801721437 +0000 UTC m=+645.235937005" watchObservedRunningTime="2026-07-24 17:13:47.803784637 +0000 UTC m=+645.238000204"
Jul 24 17:13:49.085552 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:49.085520    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="131b78d1-d5c6-4b1c-8456-973ac6c9a008" path="/var/lib/kubelet/pods/131b78d1-d5c6-4b1c-8456-973ac6c9a008/volumes"
Jul 24 17:13:49.085937 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:49.085843    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c91b605a-e60c-4dd8-975f-f0b660af7583" path="/var/lib/kubelet/pods/c91b605a-e60c-4dd8-975f-f0b660af7583/volumes"
Jul 24 17:13:50.485394 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:50.485361    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2"]
Jul 24 17:13:50.491400 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:50.491377    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2"
Jul 24 17:13:50.529253 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:50.514847    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2"]
Jul 24 17:13:50.580019 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:50.579974    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4999988a-c3bc-4fc4-8c10-ccaeeb29e636-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-c4xt2\" (UID: \"4999988a-c3bc-4fc4-8c10-ccaeeb29e636\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2"
Jul 24 17:13:50.580019 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:50.580011    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z5rd\" (UniqueName: \"kubernetes.io/projected/4999988a-c3bc-4fc4-8c10-ccaeeb29e636-kube-api-access-8z5rd\") pod \"kuadrant-operator-controller-manager-86878c769f-c4xt2\" (UID: \"4999988a-c3bc-4fc4-8c10-ccaeeb29e636\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2"
Jul 24 17:13:50.680972 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:50.680939    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4999988a-c3bc-4fc4-8c10-ccaeeb29e636-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-c4xt2\" (UID: \"4999988a-c3bc-4fc4-8c10-ccaeeb29e636\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2"
Jul 24 17:13:50.680972 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:50.680974    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z5rd\" (UniqueName: \"kubernetes.io/projected/4999988a-c3bc-4fc4-8c10-ccaeeb29e636-kube-api-access-8z5rd\") pod \"kuadrant-operator-controller-manager-86878c769f-c4xt2\" (UID: \"4999988a-c3bc-4fc4-8c10-ccaeeb29e636\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2"
Jul 24 17:13:50.681332 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:50.681312    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4999988a-c3bc-4fc4-8c10-ccaeeb29e636-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-c4xt2\" (UID: \"4999988a-c3bc-4fc4-8c10-ccaeeb29e636\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2"
Jul 24 17:13:50.691715 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:50.691692    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z5rd\" (UniqueName: \"kubernetes.io/projected/4999988a-c3bc-4fc4-8c10-ccaeeb29e636-kube-api-access-8z5rd\") pod \"kuadrant-operator-controller-manager-86878c769f-c4xt2\" (UID: \"4999988a-c3bc-4fc4-8c10-ccaeeb29e636\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2"
Jul 24 17:13:50.803161 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:50.803072    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2"
Jul 24 17:13:50.978407 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:50.978381    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2"]
Jul 24 17:13:50.980198 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:13:50.980171    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4999988a_c3bc_4fc4_8c10_ccaeeb29e636.slice/crio-9c77db1a2ae8b12185c29ac1b44b3c9c25c3d287e08403813acece31a693c661 WatchSource:0}: Error finding container 9c77db1a2ae8b12185c29ac1b44b3c9c25c3d287e08403813acece31a693c661: Status 404 returned error can't find the container with id 9c77db1a2ae8b12185c29ac1b44b3c9c25c3d287e08403813acece31a693c661
Jul 24 17:13:51.739151 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:51.739113    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2" event={"ID":"4999988a-c3bc-4fc4-8c10-ccaeeb29e636","Type":"ContainerStarted","Data":"5d3188b09fef559bccc1d8b7e1f022a0a98116266760a82da88d9755535473d8"}
Jul 24 17:13:51.739583 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:51.739172    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2" event={"ID":"4999988a-c3bc-4fc4-8c10-ccaeeb29e636","Type":"ContainerStarted","Data":"9c77db1a2ae8b12185c29ac1b44b3c9c25c3d287e08403813acece31a693c661"}
Jul 24 17:13:51.739583 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:51.739281    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2"
Jul 24 17:13:58.718739 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:58.718710    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qnnx9"
Jul 24 17:13:58.719150 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:58.718785    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn"
Jul 24 17:13:58.825533 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:13:58.825488    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2" podStartSLOduration=8.825472121 podStartE2EDuration="8.825472121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:13:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:13:51.790560577 +0000 UTC m=+649.224776156" watchObservedRunningTime="2026-07-24 17:13:58.825472121 +0000 UTC m=+656.259687697"
Jul 24 17:14:02.747657 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:02.747624    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2"
Jul 24 17:14:02.852294 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:02.852259    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn"]
Jul 24 17:14:02.852491 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:02.852449    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn" podUID="bac0c9b3-a6e9-4a6e-82d9-2b02153c350e" containerName="manager" containerID="cri-o://2ac6367e0e43be8794bda3251b8f299c9c32f2bb32b9fd9f01dd64783ed1eca7" gracePeriod=10
Jul 24 17:14:03.113815 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:03.113791    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn"
Jul 24 17:14:03.186118 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:03.186089    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6k6bq\" (UniqueName: \"kubernetes.io/projected/bac0c9b3-a6e9-4a6e-82d9-2b02153c350e-kube-api-access-6k6bq\") pod \"bac0c9b3-a6e9-4a6e-82d9-2b02153c350e\" (UID: \"bac0c9b3-a6e9-4a6e-82d9-2b02153c350e\") "
Jul 24 17:14:03.186313 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:03.186179    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bac0c9b3-a6e9-4a6e-82d9-2b02153c350e-extensions-socket-volume\") pod \"bac0c9b3-a6e9-4a6e-82d9-2b02153c350e\" (UID: \"bac0c9b3-a6e9-4a6e-82d9-2b02153c350e\") "
Jul 24 17:14:03.186533 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:03.186509    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bac0c9b3-a6e9-4a6e-82d9-2b02153c350e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bac0c9b3-a6e9-4a6e-82d9-2b02153c350e" (UID: "bac0c9b3-a6e9-4a6e-82d9-2b02153c350e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:14:03.188431 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:03.188404    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bac0c9b3-a6e9-4a6e-82d9-2b02153c350e-kube-api-access-6k6bq" (OuterVolumeSpecName: "kube-api-access-6k6bq") pod "bac0c9b3-a6e9-4a6e-82d9-2b02153c350e" (UID: "bac0c9b3-a6e9-4a6e-82d9-2b02153c350e"). InnerVolumeSpecName "kube-api-access-6k6bq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:14:03.286976 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:03.286891    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k6bq\" (UniqueName: \"kubernetes.io/projected/bac0c9b3-a6e9-4a6e-82d9-2b02153c350e-kube-api-access-6k6bq\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:14:03.286976 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:03.286920    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bac0c9b3-a6e9-4a6e-82d9-2b02153c350e-extensions-socket-volume\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:14:03.806669 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:03.806638    2572 generic.go:356] "Generic (PLEG): container finished" podID="bac0c9b3-a6e9-4a6e-82d9-2b02153c350e" containerID="2ac6367e0e43be8794bda3251b8f299c9c32f2bb32b9fd9f01dd64783ed1eca7" exitCode=0
Jul 24 17:14:03.807096 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:03.806683    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn"
Jul 24 17:14:03.807096 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:03.806734    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn" event={"ID":"bac0c9b3-a6e9-4a6e-82d9-2b02153c350e","Type":"ContainerDied","Data":"2ac6367e0e43be8794bda3251b8f299c9c32f2bb32b9fd9f01dd64783ed1eca7"}
Jul 24 17:14:03.807096 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:03.806779    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn" event={"ID":"bac0c9b3-a6e9-4a6e-82d9-2b02153c350e","Type":"ContainerDied","Data":"621cfed8297c948139b082b2edebd41828d58cfa13a34ecd14a7017547093753"}
Jul 24 17:14:03.807096 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:03.806804    2572 scope.go:117] "RemoveContainer" containerID="2ac6367e0e43be8794bda3251b8f299c9c32f2bb32b9fd9f01dd64783ed1eca7"
Jul 24 17:14:03.816624 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:03.816609    2572 scope.go:117] "RemoveContainer" containerID="2ac6367e0e43be8794bda3251b8f299c9c32f2bb32b9fd9f01dd64783ed1eca7"
Jul 24 17:14:03.816883 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:14:03.816868    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ac6367e0e43be8794bda3251b8f299c9c32f2bb32b9fd9f01dd64783ed1eca7\": container with ID starting with 2ac6367e0e43be8794bda3251b8f299c9c32f2bb32b9fd9f01dd64783ed1eca7 not found: ID does not exist" containerID="2ac6367e0e43be8794bda3251b8f299c9c32f2bb32b9fd9f01dd64783ed1eca7"
Jul 24 17:14:03.816932 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:03.816892    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ac6367e0e43be8794bda3251b8f299c9c32f2bb32b9fd9f01dd64783ed1eca7"} err="failed to get container status \"2ac6367e0e43be8794bda3251b8f299c9c32f2bb32b9fd9f01dd64783ed1eca7\": rpc error: code = NotFound desc = could not find container \"2ac6367e0e43be8794bda3251b8f299c9c32f2bb32b9fd9f01dd64783ed1eca7\": container with ID starting with 2ac6367e0e43be8794bda3251b8f299c9c32f2bb32b9fd9f01dd64783ed1eca7 not found: ID does not exist"
Jul 24 17:14:03.847801 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:03.847761    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn"]
Jul 24 17:14:03.881475 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:03.881448    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zdsgn"]
Jul 24 17:14:05.085592 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:05.085558    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bac0c9b3-a6e9-4a6e-82d9-2b02153c350e" path="/var/lib/kubelet/pods/bac0c9b3-a6e9-4a6e-82d9-2b02153c350e/volumes"
Jul 24 17:14:19.412679 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.412643    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"]
Jul 24 17:14:19.413142 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.413027    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bac0c9b3-a6e9-4a6e-82d9-2b02153c350e" containerName="manager"
Jul 24 17:14:19.413142 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.413038    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bac0c9b3-a6e9-4a6e-82d9-2b02153c350e" containerName="manager"
Jul 24 17:14:19.413142 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.413114    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="bac0c9b3-a6e9-4a6e-82d9-2b02153c350e" containerName="manager"
Jul 24 17:14:19.417952 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.417935    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.421268 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.421249    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-7lt9t\""
Jul 24 17:14:19.437028 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.436995    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"]
Jul 24 17:14:19.524372 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.524327    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.524544 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.524406    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.524544 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.524435    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.524544 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.524462    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.524544 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.524500    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.524544 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.524520    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.524544 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.524540    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhzwn\" (UniqueName: \"kubernetes.io/projected/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-kube-api-access-zhzwn\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.524740 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.524576    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.524740 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.524596    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.625055 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.625014    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.625289 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.625071    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.625289 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.625117    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.625289 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.625138    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.625289 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.625171    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhzwn\" (UniqueName: \"kubernetes.io/projected/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-kube-api-access-zhzwn\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.625289 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.625208    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.625289 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.625259    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.625626 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.625316    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.625626 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.625376    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.625626 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.625504    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.625626 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.625527    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.625999 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.625979    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.626073 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.625998    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.626135 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.626119    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.627954 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.627923    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.628153 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.628135    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.636790 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.636765    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhzwn\" (UniqueName: \"kubernetes.io/projected/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-kube-api-access-zhzwn\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.637669 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.637649    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ead329a-90b0-4c8b-8a97-3534ec4cbe76-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xq45x\" (UID: \"9ead329a-90b0-4c8b-8a97-3534ec4cbe76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.728294 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.728195    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:19.871715 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.871680    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"]
Jul 24 17:14:19.874648 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:14:19.874622    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ead329a_90b0_4c8b_8a97_3534ec4cbe76.slice/crio-9d1c74c84d6a98c32a34a6c29f01b3bbe7553d028d2fc9083e8f08fcb8263c5a WatchSource:0}: Error finding container 9d1c74c84d6a98c32a34a6c29f01b3bbe7553d028d2fc9083e8f08fcb8263c5a: Status 404 returned error can't find the container with id 9d1c74c84d6a98c32a34a6c29f01b3bbe7553d028d2fc9083e8f08fcb8263c5a
Jul 24 17:14:19.876651 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.876616    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:14:19.876731 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.876687    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:14:19.876731 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.876722    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:14:19.894577 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:19.894537    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x" event={"ID":"9ead329a-90b0-4c8b-8a97-3534ec4cbe76","Type":"ContainerStarted","Data":"9d1c74c84d6a98c32a34a6c29f01b3bbe7553d028d2fc9083e8f08fcb8263c5a"}
Jul 24 17:14:20.901685 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:20.901648    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x" event={"ID":"9ead329a-90b0-4c8b-8a97-3534ec4cbe76","Type":"ContainerStarted","Data":"bef6ab171f55ddb9643d0558144ca08942a90783274f7ad2c5574f3b15f92078"}
Jul 24 17:14:20.923288 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:20.923221    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x" podStartSLOduration=1.923205447 podStartE2EDuration="1.923205447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:14:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:14:20.921662075 +0000 UTC m=+678.355877643" watchObservedRunningTime="2026-07-24 17:14:20.923205447 +0000 UTC m=+678.357421014"
Jul 24 17:14:21.729048 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:21.729011    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:21.734011 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:21.733987    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:21.907364 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:21.907333    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:21.908377 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:21.908357    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:14:22.785868 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:22.785837    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-hrzth"]
Jul 24 17:14:22.788451 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:22.788434    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hrzth"
Jul 24 17:14:22.791097 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:22.791073    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hm8sc\""
Jul 24 17:14:22.795444 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:22.795420    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hrzth"]
Jul 24 17:14:22.929077 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:22.929052    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-hh2zt"]
Jul 24 17:14:22.931481 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:22.931461    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hh2zt"
Jul 24 17:14:22.940433 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:22.940412    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hh2zt"]
Jul 24 17:14:22.958726 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:22.958707    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8wxt\" (UniqueName: \"kubernetes.io/projected/5360c0c0-5367-4a27-b811-a71e51569f4d-kube-api-access-m8wxt\") pod \"authorino-58cd955675-hrzth\" (UID: \"5360c0c0-5367-4a27-b811-a71e51569f4d\") " pod="kuadrant-system/authorino-58cd955675-hrzth"
Jul 24 17:14:23.059811 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:23.059725    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8wxt\" (UniqueName: \"kubernetes.io/projected/5360c0c0-5367-4a27-b811-a71e51569f4d-kube-api-access-m8wxt\") pod \"authorino-58cd955675-hrzth\" (UID: \"5360c0c0-5367-4a27-b811-a71e51569f4d\") " pod="kuadrant-system/authorino-58cd955675-hrzth"
Jul 24 17:14:23.059960 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:23.059831    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hggfd\" (UniqueName: \"kubernetes.io/projected/69077e6b-1858-40bc-b029-d9748c360a14-kube-api-access-hggfd\") pod \"authorino-75d556bd77-hh2zt\" (UID: \"69077e6b-1858-40bc-b029-d9748c360a14\") " pod="kuadrant-system/authorino-75d556bd77-hh2zt"
Jul 24 17:14:23.067879 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:23.067849    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8wxt\" (UniqueName: \"kubernetes.io/projected/5360c0c0-5367-4a27-b811-a71e51569f4d-kube-api-access-m8wxt\") pod \"authorino-58cd955675-hrzth\" (UID: \"5360c0c0-5367-4a27-b811-a71e51569f4d\") " pod="kuadrant-system/authorino-58cd955675-hrzth"
Jul 24 17:14:23.099833 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:23.099805    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hrzth"
Jul 24 17:14:23.160541 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:23.160507    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hggfd\" (UniqueName: \"kubernetes.io/projected/69077e6b-1858-40bc-b029-d9748c360a14-kube-api-access-hggfd\") pod \"authorino-75d556bd77-hh2zt\" (UID: \"69077e6b-1858-40bc-b029-d9748c360a14\") " pod="kuadrant-system/authorino-75d556bd77-hh2zt"
Jul 24 17:14:23.170654 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:23.170619    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hggfd\" (UniqueName: \"kubernetes.io/projected/69077e6b-1858-40bc-b029-d9748c360a14-kube-api-access-hggfd\") pod \"authorino-75d556bd77-hh2zt\" (UID: \"69077e6b-1858-40bc-b029-d9748c360a14\") " pod="kuadrant-system/authorino-75d556bd77-hh2zt"
Jul 24 17:14:23.239143 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:23.239109    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hrzth"]
Jul 24 17:14:23.240142 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:23.240119    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hh2zt"
Jul 24 17:14:23.240744 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:14:23.240720    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5360c0c0_5367_4a27_b811_a71e51569f4d.slice/crio-c659452b507c0e71372e510377ac47e26ecd0aab83d7fafb418152ff90360bf4 WatchSource:0}: Error finding container c659452b507c0e71372e510377ac47e26ecd0aab83d7fafb418152ff90360bf4: Status 404 returned error can't find the container with id c659452b507c0e71372e510377ac47e26ecd0aab83d7fafb418152ff90360bf4
Jul 24 17:14:23.242206 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:23.242184    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:14:23.379042 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:23.379020    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hh2zt"]
Jul 24 17:14:23.380371 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:14:23.380346    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69077e6b_1858_40bc_b029_d9748c360a14.slice/crio-f465f0542440a4093e73ec5105cb8c4b4bd6b1f88046c83ece142e596647b0c2 WatchSource:0}: Error finding container f465f0542440a4093e73ec5105cb8c4b4bd6b1f88046c83ece142e596647b0c2: Status 404 returned error can't find the container with id f465f0542440a4093e73ec5105cb8c4b4bd6b1f88046c83ece142e596647b0c2
Jul 24 17:14:23.923364 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:23.923286    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hh2zt" event={"ID":"69077e6b-1858-40bc-b029-d9748c360a14","Type":"ContainerStarted","Data":"f465f0542440a4093e73ec5105cb8c4b4bd6b1f88046c83ece142e596647b0c2"}
Jul 24 17:14:23.925856 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:23.925803    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hrzth" event={"ID":"5360c0c0-5367-4a27-b811-a71e51569f4d","Type":"ContainerStarted","Data":"c659452b507c0e71372e510377ac47e26ecd0aab83d7fafb418152ff90360bf4"}
Jul 24 17:14:26.947572 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:26.947530    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hh2zt" event={"ID":"69077e6b-1858-40bc-b029-d9748c360a14","Type":"ContainerStarted","Data":"28429b83b8d6f9b93fdc2523f2007b754f2c6c9882201595a7664e5b569e7a2a"}
Jul 24 17:14:26.949080 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:26.949050    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hrzth" event={"ID":"5360c0c0-5367-4a27-b811-a71e51569f4d","Type":"ContainerStarted","Data":"8afd8186631c0135ccefec87270c56366c15a3cdf51e47cff187910ad1670bc7"}
Jul 24 17:14:26.966154 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:26.966109    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-hh2zt" podStartSLOduration=1.579368772 podStartE2EDuration="4.966094392s" totalImagesPullingTime="3.38672562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:14:26.965051707 +0000 UTC m=+684.399267274" watchObservedRunningTime="2026-07-24 17:14:26.966094392 +0000 UTC m=+684.400309959"
Jul 24 17:14:26.987217 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:26.987165    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-hrzth" podStartSLOduration=1.472368434 podStartE2EDuration="4.987150369s" totalImagesPullingTime="3.514781935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:14:26.985994774 +0000 UTC m=+684.420210340" watchObservedRunningTime="2026-07-24 17:14:26.987150369 +0000 UTC m=+684.421365935"
Jul 24 17:14:27.041970 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:27.041875    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hrzth"]
Jul 24 17:14:28.959861 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:28.959818    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-hrzth" podUID="5360c0c0-5367-4a27-b811-a71e51569f4d" containerName="authorino" containerID="cri-o://8afd8186631c0135ccefec87270c56366c15a3cdf51e47cff187910ad1670bc7" gracePeriod=30
Jul 24 17:14:29.211819 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:29.211763    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hrzth"
Jul 24 17:14:29.319499 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:29.319468    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8wxt\" (UniqueName: \"kubernetes.io/projected/5360c0c0-5367-4a27-b811-a71e51569f4d-kube-api-access-m8wxt\") pod \"5360c0c0-5367-4a27-b811-a71e51569f4d\" (UID: \"5360c0c0-5367-4a27-b811-a71e51569f4d\") "
Jul 24 17:14:29.321628 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:29.321606    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5360c0c0-5367-4a27-b811-a71e51569f4d-kube-api-access-m8wxt" (OuterVolumeSpecName: "kube-api-access-m8wxt") pod "5360c0c0-5367-4a27-b811-a71e51569f4d" (UID: "5360c0c0-5367-4a27-b811-a71e51569f4d"). InnerVolumeSpecName "kube-api-access-m8wxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:14:29.420451 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:29.420423    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8wxt\" (UniqueName: \"kubernetes.io/projected/5360c0c0-5367-4a27-b811-a71e51569f4d-kube-api-access-m8wxt\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:14:29.966879 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:29.966843    2572 generic.go:356] "Generic (PLEG): container finished" podID="5360c0c0-5367-4a27-b811-a71e51569f4d" containerID="8afd8186631c0135ccefec87270c56366c15a3cdf51e47cff187910ad1670bc7" exitCode=0
Jul 24 17:14:29.967396 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:29.966891    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hrzth"
Jul 24 17:14:29.967396 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:29.966932    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hrzth" event={"ID":"5360c0c0-5367-4a27-b811-a71e51569f4d","Type":"ContainerDied","Data":"8afd8186631c0135ccefec87270c56366c15a3cdf51e47cff187910ad1670bc7"}
Jul 24 17:14:29.967396 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:29.966980    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hrzth" event={"ID":"5360c0c0-5367-4a27-b811-a71e51569f4d","Type":"ContainerDied","Data":"c659452b507c0e71372e510377ac47e26ecd0aab83d7fafb418152ff90360bf4"}
Jul 24 17:14:29.967396 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:29.967004    2572 scope.go:117] "RemoveContainer" containerID="8afd8186631c0135ccefec87270c56366c15a3cdf51e47cff187910ad1670bc7"
Jul 24 17:14:29.976691 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:29.976673    2572 scope.go:117] "RemoveContainer" containerID="8afd8186631c0135ccefec87270c56366c15a3cdf51e47cff187910ad1670bc7"
Jul 24 17:14:29.976948 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:14:29.976928    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8afd8186631c0135ccefec87270c56366c15a3cdf51e47cff187910ad1670bc7\": container with ID starting with 8afd8186631c0135ccefec87270c56366c15a3cdf51e47cff187910ad1670bc7 not found: ID does not exist" containerID="8afd8186631c0135ccefec87270c56366c15a3cdf51e47cff187910ad1670bc7"
Jul 24 17:14:29.976989 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:29.976968    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8afd8186631c0135ccefec87270c56366c15a3cdf51e47cff187910ad1670bc7"} err="failed to get container status \"8afd8186631c0135ccefec87270c56366c15a3cdf51e47cff187910ad1670bc7\": rpc error: code = NotFound desc = could not find container \"8afd8186631c0135ccefec87270c56366c15a3cdf51e47cff187910ad1670bc7\": container with ID starting with 8afd8186631c0135ccefec87270c56366c15a3cdf51e47cff187910ad1670bc7 not found: ID does not exist"
Jul 24 17:14:29.992384 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:29.992356    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hrzth"]
Jul 24 17:14:29.999072 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:29.999053    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-hrzth"]
Jul 24 17:14:31.085997 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:31.085963    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5360c0c0-5367-4a27-b811-a71e51569f4d" path="/var/lib/kubelet/pods/5360c0c0-5367-4a27-b811-a71e51569f4d/volumes"
Jul 24 17:14:50.964778 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:50.964742    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4gmcd"]
Jul 24 17:14:50.965224 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:50.965155    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5360c0c0-5367-4a27-b811-a71e51569f4d" containerName="authorino"
Jul 24 17:14:50.965224 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:50.965167    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5360c0c0-5367-4a27-b811-a71e51569f4d" containerName="authorino"
Jul 24 17:14:50.965369 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:50.965306    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5360c0c0-5367-4a27-b811-a71e51569f4d" containerName="authorino"
Jul 24 17:14:50.969296 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:50.969280    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4gmcd"
Jul 24 17:14:50.975166 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:50.975140    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4gmcd"]
Jul 24 17:14:50.984858 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:50.984834    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjgjz\" (UniqueName: \"kubernetes.io/projected/c7c290de-328f-45f6-bd8d-abe36e38cda2-kube-api-access-gjgjz\") pod \"authorino-5d4b67c446-4gmcd\" (UID: \"c7c290de-328f-45f6-bd8d-abe36e38cda2\") " pod="kuadrant-system/authorino-5d4b67c446-4gmcd"
Jul 24 17:14:51.086664 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.086619    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjgjz\" (UniqueName: \"kubernetes.io/projected/c7c290de-328f-45f6-bd8d-abe36e38cda2-kube-api-access-gjgjz\") pod \"authorino-5d4b67c446-4gmcd\" (UID: \"c7c290de-328f-45f6-bd8d-abe36e38cda2\") " pod="kuadrant-system/authorino-5d4b67c446-4gmcd"
Jul 24 17:14:51.096298 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.096270    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjgjz\" (UniqueName: \"kubernetes.io/projected/c7c290de-328f-45f6-bd8d-abe36e38cda2-kube-api-access-gjgjz\") pod \"authorino-5d4b67c446-4gmcd\" (UID: \"c7c290de-328f-45f6-bd8d-abe36e38cda2\") " pod="kuadrant-system/authorino-5d4b67c446-4gmcd"
Jul 24 17:14:51.173675 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.173642    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4gmcd"]
Jul 24 17:14:51.173905 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.173889    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4gmcd"
Jul 24 17:14:51.198837 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.198805    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-6zwdf"]
Jul 24 17:14:51.204546 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.204525    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-6zwdf"
Jul 24 17:14:51.207078 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.207060    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 24 17:14:51.213133 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.213108    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-6zwdf"]
Jul 24 17:14:51.245576 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.245547    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-6zwdf"]
Jul 24 17:14:51.245842 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:14:51.245820    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-f7tsk tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-f7tsk tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-6zwdf" podUID="afee1f37-e77a-4712-8f73-6d5d00096591"
Jul 24 17:14:51.271052 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.271024    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b5677c9-t6m4t"]
Jul 24 17:14:51.274601 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.274582    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b5677c9-t6m4t"
Jul 24 17:14:51.286215 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.286180    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b5677c9-t6m4t"]
Jul 24 17:14:51.288623 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.288600    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7tsk\" (UniqueName: \"kubernetes.io/projected/afee1f37-e77a-4712-8f73-6d5d00096591-kube-api-access-f7tsk\") pod \"authorino-76877994-6zwdf\" (UID: \"afee1f37-e77a-4712-8f73-6d5d00096591\") " pod="kuadrant-system/authorino-76877994-6zwdf"
Jul 24 17:14:51.288718 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.288641    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/afee1f37-e77a-4712-8f73-6d5d00096591-tls-cert\") pod \"authorino-76877994-6zwdf\" (UID: \"afee1f37-e77a-4712-8f73-6d5d00096591\") " pod="kuadrant-system/authorino-76877994-6zwdf"
Jul 24 17:14:51.288766 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.288748    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slnzf\" (UniqueName: \"kubernetes.io/projected/1f97bd33-010a-4bd1-80d1-8b6082293c50-kube-api-access-slnzf\") pod \"authorino-8b5677c9-t6m4t\" (UID: \"1f97bd33-010a-4bd1-80d1-8b6082293c50\") " pod="kuadrant-system/authorino-8b5677c9-t6m4t"
Jul 24 17:14:51.288885 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.288803    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1f97bd33-010a-4bd1-80d1-8b6082293c50-tls-cert\") pod \"authorino-8b5677c9-t6m4t\" (UID: \"1f97bd33-010a-4bd1-80d1-8b6082293c50\") " pod="kuadrant-system/authorino-8b5677c9-t6m4t"
Jul 24 17:14:51.325320 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.325300    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4gmcd"]
Jul 24 17:14:51.327139 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:14:51.327109    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7c290de_328f_45f6_bd8d_abe36e38cda2.slice/crio-260f812d9829868126fac4c4b2fb37fa1abd8bb397bfb589d14428d0c43f4dfc WatchSource:0}: Error finding container 260f812d9829868126fac4c4b2fb37fa1abd8bb397bfb589d14428d0c43f4dfc: Status 404 returned error can't find the container with id 260f812d9829868126fac4c4b2fb37fa1abd8bb397bfb589d14428d0c43f4dfc
Jul 24 17:14:51.389653 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.389625    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1f97bd33-010a-4bd1-80d1-8b6082293c50-tls-cert\") pod \"authorino-8b5677c9-t6m4t\" (UID: \"1f97bd33-010a-4bd1-80d1-8b6082293c50\") " pod="kuadrant-system/authorino-8b5677c9-t6m4t"
Jul 24 17:14:51.389779 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.389675    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7tsk\" (UniqueName: \"kubernetes.io/projected/afee1f37-e77a-4712-8f73-6d5d00096591-kube-api-access-f7tsk\") pod \"authorino-76877994-6zwdf\" (UID: \"afee1f37-e77a-4712-8f73-6d5d00096591\") " pod="kuadrant-system/authorino-76877994-6zwdf"
Jul 24 17:14:51.389779 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.389696    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/afee1f37-e77a-4712-8f73-6d5d00096591-tls-cert\") pod \"authorino-76877994-6zwdf\" (UID: \"afee1f37-e77a-4712-8f73-6d5d00096591\") " pod="kuadrant-system/authorino-76877994-6zwdf"
Jul 24 17:14:51.389779 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.389757    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slnzf\" (UniqueName: \"kubernetes.io/projected/1f97bd33-010a-4bd1-80d1-8b6082293c50-kube-api-access-slnzf\") pod \"authorino-8b5677c9-t6m4t\" (UID: \"1f97bd33-010a-4bd1-80d1-8b6082293c50\") " pod="kuadrant-system/authorino-8b5677c9-t6m4t"
Jul 24 17:14:51.392247 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.392205    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/afee1f37-e77a-4712-8f73-6d5d00096591-tls-cert\") pod \"authorino-76877994-6zwdf\" (UID: \"afee1f37-e77a-4712-8f73-6d5d00096591\") " pod="kuadrant-system/authorino-76877994-6zwdf"
Jul 24 17:14:51.392348 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.392286    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1f97bd33-010a-4bd1-80d1-8b6082293c50-tls-cert\") pod \"authorino-8b5677c9-t6m4t\" (UID: \"1f97bd33-010a-4bd1-80d1-8b6082293c50\") " pod="kuadrant-system/authorino-8b5677c9-t6m4t"
Jul 24 17:14:51.397625 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.397597    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7tsk\" (UniqueName: \"kubernetes.io/projected/afee1f37-e77a-4712-8f73-6d5d00096591-kube-api-access-f7tsk\") pod \"authorino-76877994-6zwdf\" (UID: \"afee1f37-e77a-4712-8f73-6d5d00096591\") " pod="kuadrant-system/authorino-76877994-6zwdf"
Jul 24 17:14:51.397712 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.397670    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slnzf\" (UniqueName: \"kubernetes.io/projected/1f97bd33-010a-4bd1-80d1-8b6082293c50-kube-api-access-slnzf\") pod \"authorino-8b5677c9-t6m4t\" (UID: \"1f97bd33-010a-4bd1-80d1-8b6082293c50\") " pod="kuadrant-system/authorino-8b5677c9-t6m4t"
Jul 24 17:14:51.585514 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.585441    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b5677c9-t6m4t"
Jul 24 17:14:51.720845 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:51.720816    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b5677c9-t6m4t"]
Jul 24 17:14:51.723249 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:14:51.723215    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f97bd33_010a_4bd1_80d1_8b6082293c50.slice/crio-a54dc5f4360c49894cbf5f7dbdbc1fa5d390994af28720cf0db96573953cfa9e WatchSource:0}: Error finding container a54dc5f4360c49894cbf5f7dbdbc1fa5d390994af28720cf0db96573953cfa9e: Status 404 returned error can't find the container with id a54dc5f4360c49894cbf5f7dbdbc1fa5d390994af28720cf0db96573953cfa9e
Jul 24 17:14:52.095844 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:52.095783    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4gmcd" event={"ID":"c7c290de-328f-45f6-bd8d-abe36e38cda2","Type":"ContainerStarted","Data":"5bef8edca84b2619b418919266fa8c1e0aec9a33314d708accdaba1da95d3681"}
Jul 24 17:14:52.095844 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:52.095826    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4gmcd" event={"ID":"c7c290de-328f-45f6-bd8d-abe36e38cda2","Type":"ContainerStarted","Data":"260f812d9829868126fac4c4b2fb37fa1abd8bb397bfb589d14428d0c43f4dfc"}
Jul 24 17:14:52.095844 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:52.095825    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-4gmcd" podUID="c7c290de-328f-45f6-bd8d-abe36e38cda2" containerName="authorino" containerID="cri-o://5bef8edca84b2619b418919266fa8c1e0aec9a33314d708accdaba1da95d3681" gracePeriod=30
Jul 24 17:14:52.097564 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:52.097540    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b5677c9-t6m4t" event={"ID":"1f97bd33-010a-4bd1-80d1-8b6082293c50","Type":"ContainerStarted","Data":"a54dc5f4360c49894cbf5f7dbdbc1fa5d390994af28720cf0db96573953cfa9e"}
Jul 24 17:14:52.097564 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:52.097555    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-6zwdf"
Jul 24 17:14:52.114892 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:52.114822    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-4gmcd" podStartSLOduration=1.6459099830000001 podStartE2EDuration="2.114802682s" totalImagesPullingTime="468.892699ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:14:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:14:52.110959251 +0000 UTC m=+709.545174817" watchObservedRunningTime="2026-07-24 17:14:52.114802682 +0000 UTC m=+709.549018251"
Jul 24 17:14:52.182000 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:52.181974    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-6zwdf"
Jul 24 17:14:52.195600 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:52.195569    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7tsk\" (UniqueName: \"kubernetes.io/projected/afee1f37-e77a-4712-8f73-6d5d00096591-kube-api-access-f7tsk\") pod \"afee1f37-e77a-4712-8f73-6d5d00096591\" (UID: \"afee1f37-e77a-4712-8f73-6d5d00096591\") "
Jul 24 17:14:52.195783 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:52.195623    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/afee1f37-e77a-4712-8f73-6d5d00096591-tls-cert\") pod \"afee1f37-e77a-4712-8f73-6d5d00096591\" (UID: \"afee1f37-e77a-4712-8f73-6d5d00096591\") "
Jul 24 17:14:52.198740 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:52.198705    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afee1f37-e77a-4712-8f73-6d5d00096591-kube-api-access-f7tsk" (OuterVolumeSpecName: "kube-api-access-f7tsk") pod "afee1f37-e77a-4712-8f73-6d5d00096591" (UID: "afee1f37-e77a-4712-8f73-6d5d00096591"). InnerVolumeSpecName "kube-api-access-f7tsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:14:52.198941 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:52.198799    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afee1f37-e77a-4712-8f73-6d5d00096591-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "afee1f37-e77a-4712-8f73-6d5d00096591" (UID: "afee1f37-e77a-4712-8f73-6d5d00096591"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:14:52.297401 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:52.297361    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7tsk\" (UniqueName: \"kubernetes.io/projected/afee1f37-e77a-4712-8f73-6d5d00096591-kube-api-access-f7tsk\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:14:52.297401 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:52.297399    2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/afee1f37-e77a-4712-8f73-6d5d00096591-tls-cert\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:14:52.353357 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:52.353304    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4gmcd"
Jul 24 17:14:52.398645 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:52.398618    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjgjz\" (UniqueName: \"kubernetes.io/projected/c7c290de-328f-45f6-bd8d-abe36e38cda2-kube-api-access-gjgjz\") pod \"c7c290de-328f-45f6-bd8d-abe36e38cda2\" (UID: \"c7c290de-328f-45f6-bd8d-abe36e38cda2\") "
Jul 24 17:14:52.400758 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:52.400732    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7c290de-328f-45f6-bd8d-abe36e38cda2-kube-api-access-gjgjz" (OuterVolumeSpecName: "kube-api-access-gjgjz") pod "c7c290de-328f-45f6-bd8d-abe36e38cda2" (UID: "c7c290de-328f-45f6-bd8d-abe36e38cda2"). InnerVolumeSpecName "kube-api-access-gjgjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:14:52.499520 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:52.499479    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjgjz\" (UniqueName: \"kubernetes.io/projected/c7c290de-328f-45f6-bd8d-abe36e38cda2-kube-api-access-gjgjz\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:14:53.106035 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:53.105992    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b5677c9-t6m4t" event={"ID":"1f97bd33-010a-4bd1-80d1-8b6082293c50","Type":"ContainerStarted","Data":"c1b496f29622440df6acbe1d478f8db4d4305809ff57aff15a32613ded7c326a"}
Jul 24 17:14:53.107221 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:53.107200    2572 generic.go:356] "Generic (PLEG): container finished" podID="c7c290de-328f-45f6-bd8d-abe36e38cda2" containerID="5bef8edca84b2619b418919266fa8c1e0aec9a33314d708accdaba1da95d3681" exitCode=0
Jul 24 17:14:53.107321 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:53.107256    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4gmcd"
Jul 24 17:14:53.107321 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:53.107298    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4gmcd" event={"ID":"c7c290de-328f-45f6-bd8d-abe36e38cda2","Type":"ContainerDied","Data":"5bef8edca84b2619b418919266fa8c1e0aec9a33314d708accdaba1da95d3681"}
Jul 24 17:14:53.107394 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:53.107325    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4gmcd" event={"ID":"c7c290de-328f-45f6-bd8d-abe36e38cda2","Type":"ContainerDied","Data":"260f812d9829868126fac4c4b2fb37fa1abd8bb397bfb589d14428d0c43f4dfc"}
Jul 24 17:14:53.107394 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:53.107341    2572 scope.go:117] "RemoveContainer" containerID="5bef8edca84b2619b418919266fa8c1e0aec9a33314d708accdaba1da95d3681"
Jul 24 17:14:53.107465 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:53.107409    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-6zwdf"
Jul 24 17:14:53.116197 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:53.116182    2572 scope.go:117] "RemoveContainer" containerID="5bef8edca84b2619b418919266fa8c1e0aec9a33314d708accdaba1da95d3681"
Jul 24 17:14:53.116507 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:14:53.116489    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bef8edca84b2619b418919266fa8c1e0aec9a33314d708accdaba1da95d3681\": container with ID starting with 5bef8edca84b2619b418919266fa8c1e0aec9a33314d708accdaba1da95d3681 not found: ID does not exist" containerID="5bef8edca84b2619b418919266fa8c1e0aec9a33314d708accdaba1da95d3681"
Jul 24 17:14:53.116558 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:53.116516    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bef8edca84b2619b418919266fa8c1e0aec9a33314d708accdaba1da95d3681"} err="failed to get container status \"5bef8edca84b2619b418919266fa8c1e0aec9a33314d708accdaba1da95d3681\": rpc error: code = NotFound desc = could not find container \"5bef8edca84b2619b418919266fa8c1e0aec9a33314d708accdaba1da95d3681\": container with ID starting with 5bef8edca84b2619b418919266fa8c1e0aec9a33314d708accdaba1da95d3681 not found: ID does not exist"
Jul 24 17:14:53.124077 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:53.124037    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8b5677c9-t6m4t" podStartSLOduration=1.802476039 podStartE2EDuration="2.12402396s" totalImagesPullingTime="321.547921ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:14:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:14:53.122271536 +0000 UTC m=+710.556487104" watchObservedRunningTime="2026-07-24 17:14:53.12402396 +0000 UTC m=+710.558239527"
Jul 24 17:14:53.150943 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:53.150916    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hh2zt"]
Jul 24 17:14:53.151102 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:53.151083    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-hh2zt" podUID="69077e6b-1858-40bc-b029-d9748c360a14" containerName="authorino" containerID="cri-o://28429b83b8d6f9b93fdc2523f2007b754f2c6c9882201595a7664e5b569e7a2a" gracePeriod=30
Jul 24 17:14:53.161641 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:53.161613    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-6zwdf"]
Jul 24 17:14:53.168710 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:53.168684    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-6zwdf"]
Jul 24 17:14:53.188923 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:53.188896    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4gmcd"]
Jul 24 17:14:53.192196 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:53.192168    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4gmcd"]
Jul 24 17:14:53.415425 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:53.415403    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hh2zt"
Jul 24 17:14:53.508861 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:53.508829    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hggfd\" (UniqueName: \"kubernetes.io/projected/69077e6b-1858-40bc-b029-d9748c360a14-kube-api-access-hggfd\") pod \"69077e6b-1858-40bc-b029-d9748c360a14\" (UID: \"69077e6b-1858-40bc-b029-d9748c360a14\") "
Jul 24 17:14:53.510989 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:53.510964    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69077e6b-1858-40bc-b029-d9748c360a14-kube-api-access-hggfd" (OuterVolumeSpecName: "kube-api-access-hggfd") pod "69077e6b-1858-40bc-b029-d9748c360a14" (UID: "69077e6b-1858-40bc-b029-d9748c360a14"). InnerVolumeSpecName "kube-api-access-hggfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:14:53.610181 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:53.610150    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hggfd\" (UniqueName: \"kubernetes.io/projected/69077e6b-1858-40bc-b029-d9748c360a14-kube-api-access-hggfd\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:14:54.117801 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:54.117767    2572 generic.go:356] "Generic (PLEG): container finished" podID="69077e6b-1858-40bc-b029-d9748c360a14" containerID="28429b83b8d6f9b93fdc2523f2007b754f2c6c9882201595a7664e5b569e7a2a" exitCode=0
Jul 24 17:14:54.118278 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:54.117816    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hh2zt"
Jul 24 17:14:54.118278 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:54.117858    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hh2zt" event={"ID":"69077e6b-1858-40bc-b029-d9748c360a14","Type":"ContainerDied","Data":"28429b83b8d6f9b93fdc2523f2007b754f2c6c9882201595a7664e5b569e7a2a"}
Jul 24 17:14:54.118278 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:54.117893    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hh2zt" event={"ID":"69077e6b-1858-40bc-b029-d9748c360a14","Type":"ContainerDied","Data":"f465f0542440a4093e73ec5105cb8c4b4bd6b1f88046c83ece142e596647b0c2"}
Jul 24 17:14:54.118278 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:54.117909    2572 scope.go:117] "RemoveContainer" containerID="28429b83b8d6f9b93fdc2523f2007b754f2c6c9882201595a7664e5b569e7a2a"
Jul 24 17:14:54.126849 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:54.126831    2572 scope.go:117] "RemoveContainer" containerID="28429b83b8d6f9b93fdc2523f2007b754f2c6c9882201595a7664e5b569e7a2a"
Jul 24 17:14:54.127074 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:14:54.127055    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28429b83b8d6f9b93fdc2523f2007b754f2c6c9882201595a7664e5b569e7a2a\": container with ID starting with 28429b83b8d6f9b93fdc2523f2007b754f2c6c9882201595a7664e5b569e7a2a not found: ID does not exist" containerID="28429b83b8d6f9b93fdc2523f2007b754f2c6c9882201595a7664e5b569e7a2a"
Jul 24 17:14:54.127121 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:54.127084    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28429b83b8d6f9b93fdc2523f2007b754f2c6c9882201595a7664e5b569e7a2a"} err="failed to get container status \"28429b83b8d6f9b93fdc2523f2007b754f2c6c9882201595a7664e5b569e7a2a\": rpc error: code = NotFound desc = could not find container \"28429b83b8d6f9b93fdc2523f2007b754f2c6c9882201595a7664e5b569e7a2a\": container with ID starting with 28429b83b8d6f9b93fdc2523f2007b754f2c6c9882201595a7664e5b569e7a2a not found: ID does not exist"
Jul 24 17:14:54.141303 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:54.141278    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hh2zt"]
Jul 24 17:14:54.145874 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:54.145853    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hh2zt"]
Jul 24 17:14:55.085822 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:55.085789    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69077e6b-1858-40bc-b029-d9748c360a14" path="/var/lib/kubelet/pods/69077e6b-1858-40bc-b029-d9748c360a14/volumes"
Jul 24 17:14:55.086137 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:55.086124    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afee1f37-e77a-4712-8f73-6d5d00096591" path="/var/lib/kubelet/pods/afee1f37-e77a-4712-8f73-6d5d00096591/volumes"
Jul 24 17:14:55.086335 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:14:55.086324    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7c290de-328f-45f6-bd8d-abe36e38cda2" path="/var/lib/kubelet/pods/c7c290de-328f-45f6-bd8d-abe36e38cda2/volumes"
Jul 24 17:15:33.246535 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:33.246494    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7b675d968d-zxw7q"]
Jul 24 17:15:33.247127 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:33.247036    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7c290de-328f-45f6-bd8d-abe36e38cda2" containerName="authorino"
Jul 24 17:15:33.247127 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:33.247054    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7c290de-328f-45f6-bd8d-abe36e38cda2" containerName="authorino"
Jul 24 17:15:33.247127 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:33.247070    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69077e6b-1858-40bc-b029-d9748c360a14" containerName="authorino"
Jul 24 17:15:33.247127 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:33.247079    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="69077e6b-1858-40bc-b029-d9748c360a14" containerName="authorino"
Jul 24 17:15:33.247422 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:33.247182    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7c290de-328f-45f6-bd8d-abe36e38cda2" containerName="authorino"
Jul 24 17:15:33.247422 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:33.247195    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="69077e6b-1858-40bc-b029-d9748c360a14" containerName="authorino"
Jul 24 17:15:33.250478 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:33.250456    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b675d968d-zxw7q"
Jul 24 17:15:33.252924 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:33.252902    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:15:33.253047 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:33.252973    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 17:15:33.253145 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:33.253039    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 24 17:15:33.253145 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:33.253064    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9md79\""
Jul 24 17:15:33.265683 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:33.265657    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b675d968d-zxw7q"]
Jul 24 17:15:33.357909 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:33.357881    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f168564-3d72-4566-8424-e189f7717396-maas-api-tls\") pod \"maas-api-7b675d968d-zxw7q\" (UID: \"4f168564-3d72-4566-8424-e189f7717396\") " pod="odh-ai-gateway-infra/maas-api-7b675d968d-zxw7q"
Jul 24 17:15:33.358098 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:33.357939    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb4fq\" (UniqueName: \"kubernetes.io/projected/4f168564-3d72-4566-8424-e189f7717396-kube-api-access-nb4fq\") pod \"maas-api-7b675d968d-zxw7q\" (UID: \"4f168564-3d72-4566-8424-e189f7717396\") " pod="odh-ai-gateway-infra/maas-api-7b675d968d-zxw7q"
Jul 24 17:15:33.358098 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:33.358051    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f168564-3d72-4566-8424-e189f7717396-openshift-service-ca\") pod \"maas-api-7b675d968d-zxw7q\" (UID: \"4f168564-3d72-4566-8424-e189f7717396\") " pod="odh-ai-gateway-infra/maas-api-7b675d968d-zxw7q"
Jul 24 17:15:33.458804 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:33.458763    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f168564-3d72-4566-8424-e189f7717396-openshift-service-ca\") pod \"maas-api-7b675d968d-zxw7q\" (UID: \"4f168564-3d72-4566-8424-e189f7717396\") " pod="odh-ai-gateway-infra/maas-api-7b675d968d-zxw7q"
Jul 24 17:15:33.458980 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:33.458813    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f168564-3d72-4566-8424-e189f7717396-maas-api-tls\") pod \"maas-api-7b675d968d-zxw7q\" (UID: \"4f168564-3d72-4566-8424-e189f7717396\") " pod="odh-ai-gateway-infra/maas-api-7b675d968d-zxw7q"
Jul 24 17:15:33.458980 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:33.458878    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb4fq\" (UniqueName: \"kubernetes.io/projected/4f168564-3d72-4566-8424-e189f7717396-kube-api-access-nb4fq\") pod \"maas-api-7b675d968d-zxw7q\" (UID: \"4f168564-3d72-4566-8424-e189f7717396\") " pod="odh-ai-gateway-infra/maas-api-7b675d968d-zxw7q"
Jul 24 17:15:33.459060 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:15:33.458992    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 24 17:15:33.459098 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:15:33.459062    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f168564-3d72-4566-8424-e189f7717396-maas-api-tls podName:4f168564-3d72-4566-8424-e189f7717396 nodeName:}" failed. No retries permitted until 2026-07-24 17:15:33.959043327 +0000 UTC m=+751.393258876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4f168564-3d72-4566-8424-e189f7717396-maas-api-tls") pod "maas-api-7b675d968d-zxw7q" (UID: "4f168564-3d72-4566-8424-e189f7717396") : secret "maas-api-serving-cert" not found
Jul 24 17:15:33.459542 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:33.459525    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f168564-3d72-4566-8424-e189f7717396-openshift-service-ca\") pod \"maas-api-7b675d968d-zxw7q\" (UID: \"4f168564-3d72-4566-8424-e189f7717396\") " pod="odh-ai-gateway-infra/maas-api-7b675d968d-zxw7q"
Jul 24 17:15:33.471281 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:33.471218    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb4fq\" (UniqueName: \"kubernetes.io/projected/4f168564-3d72-4566-8424-e189f7717396-kube-api-access-nb4fq\") pod \"maas-api-7b675d968d-zxw7q\" (UID: \"4f168564-3d72-4566-8424-e189f7717396\") " pod="odh-ai-gateway-infra/maas-api-7b675d968d-zxw7q"
Jul 24 17:15:33.964353 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:33.964320    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f168564-3d72-4566-8424-e189f7717396-maas-api-tls\") pod \"maas-api-7b675d968d-zxw7q\" (UID: \"4f168564-3d72-4566-8424-e189f7717396\") " pod="odh-ai-gateway-infra/maas-api-7b675d968d-zxw7q"
Jul 24 17:15:33.964543 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:15:33.964487    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 24 17:15:33.964587 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:15:33.964569    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f168564-3d72-4566-8424-e189f7717396-maas-api-tls podName:4f168564-3d72-4566-8424-e189f7717396 nodeName:}" failed. No retries permitted until 2026-07-24 17:15:34.964553046 +0000 UTC m=+752.398768592 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4f168564-3d72-4566-8424-e189f7717396-maas-api-tls") pod "maas-api-7b675d968d-zxw7q" (UID: "4f168564-3d72-4566-8424-e189f7717396") : secret "maas-api-serving-cert" not found
Jul 24 17:15:34.974064 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:34.974026    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f168564-3d72-4566-8424-e189f7717396-maas-api-tls\") pod \"maas-api-7b675d968d-zxw7q\" (UID: \"4f168564-3d72-4566-8424-e189f7717396\") " pod="odh-ai-gateway-infra/maas-api-7b675d968d-zxw7q"
Jul 24 17:15:34.976638 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:34.976610    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f168564-3d72-4566-8424-e189f7717396-maas-api-tls\") pod \"maas-api-7b675d968d-zxw7q\" (UID: \"4f168564-3d72-4566-8424-e189f7717396\") " pod="odh-ai-gateway-infra/maas-api-7b675d968d-zxw7q"
Jul 24 17:15:35.061110 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:35.061073    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b675d968d-zxw7q"
Jul 24 17:15:35.249897 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:35.249862    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b675d968d-zxw7q"]
Jul 24 17:15:35.251131 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:15:35.251109    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f168564_3d72_4566_8424_e189f7717396.slice/crio-5508437ac071cc12e10a3d18dc9b49f999850f01557d0f0162e5078181f70491 WatchSource:0}: Error finding container 5508437ac071cc12e10a3d18dc9b49f999850f01557d0f0162e5078181f70491: Status 404 returned error can't find the container with id 5508437ac071cc12e10a3d18dc9b49f999850f01557d0f0162e5078181f70491
Jul 24 17:15:35.349785 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:35.349753    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b675d968d-zxw7q" event={"ID":"4f168564-3d72-4566-8424-e189f7717396","Type":"ContainerStarted","Data":"5508437ac071cc12e10a3d18dc9b49f999850f01557d0f0162e5078181f70491"}
Jul 24 17:15:39.375458 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:39.375412    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b675d968d-zxw7q" event={"ID":"4f168564-3d72-4566-8424-e189f7717396","Type":"ContainerStarted","Data":"c7d959219daec1c14c89a9112c9defcc902a7e979aa56507c97900bd9bcef548"}
Jul 24 17:15:39.375883 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:39.375537    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7b675d968d-zxw7q"
Jul 24 17:15:39.394840 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:39.394790    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7b675d968d-zxw7q" podStartSLOduration=3.327478499 podStartE2EDuration="6.394771607s" totalImagesPullingTime="3.067293108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:15:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:15:39.393501754 +0000 UTC m=+756.827717322" watchObservedRunningTime="2026-07-24 17:15:39.394771607 +0000 UTC m=+756.828987174"
Jul 24 17:15:42.402370 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:42.402340    2572 generic.go:356] "Generic (PLEG): container finished" podID="9ead329a-90b0-4c8b-8a97-3534ec4cbe76" containerID="bef6ab171f55ddb9643d0558144ca08942a90783274f7ad2c5574f3b15f92078" exitCode=0
Jul 24 17:15:42.402852 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:42.402406    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x" event={"ID":"9ead329a-90b0-4c8b-8a97-3534ec4cbe76","Type":"ContainerDied","Data":"bef6ab171f55ddb9643d0558144ca08942a90783274f7ad2c5574f3b15f92078"}
Jul 24 17:15:42.402852 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:42.402762    2572 scope.go:117] "RemoveContainer" containerID="bef6ab171f55ddb9643d0558144ca08942a90783274f7ad2c5574f3b15f92078"
Jul 24 17:15:42.403716 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:42.403685    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:15:42.403808 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:42.403757    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:15:42.403808 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:42.403791    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:15:43.410002 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:43.409971    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x" event={"ID":"9ead329a-90b0-4c8b-8a97-3534ec4cbe76","Type":"ContainerStarted","Data":"721076a87e71806f17b8fa09bffc3ebdb60e7e8ac9f35e0ff54eb00d0a6a1035"}
Jul 24 17:15:43.729208 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:43.729095    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:15:43.729434 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:43.729400    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-xq45x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 24 17:15:43.729512 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:43.729459    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x" podUID="9ead329a-90b0-4c8b-8a97-3534ec4cbe76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 24 17:15:44.729543 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:44.729503    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-xq45x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 24 17:15:44.729954 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:44.729581    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x" podUID="9ead329a-90b0-4c8b-8a97-3534ec4cbe76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 24 17:15:45.390546 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:45.390510    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7b675d968d-zxw7q"
Jul 24 17:15:45.729268 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:45.729154    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-xq45x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 24 17:15:45.729268 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:45.729214    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x" podUID="9ead329a-90b0-4c8b-8a97-3534ec4cbe76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 24 17:15:46.729023 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:46.728981    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-xq45x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 24 17:15:46.729488 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:46.729042    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x" podUID="9ead329a-90b0-4c8b-8a97-3534ec4cbe76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 24 17:15:47.729631 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:47.729599    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-xq45x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 24 17:15:47.730080 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:47.729931    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x" podUID="9ead329a-90b0-4c8b-8a97-3534ec4cbe76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 24 17:15:48.732459 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:48.732428    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:15:48.732922 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:48.732814    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:15:48.733453 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:15:48.733433    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x"
Jul 24 17:16:05.058679 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.058642    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"]
Jul 24 17:16:05.062600 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.062579    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:05.065695 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.065669    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 17:16:05.065818 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.065683    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 17:16:05.066586 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.066570    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6kmdn\""
Jul 24 17:16:05.066688 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.066570    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 24 17:16:05.076356 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.076329    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"]
Jul 24 17:16:05.181870 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.181830    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f9a495f-8657-4eb2-86ce-55bae56e787b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m\" (UID: \"8f9a495f-8657-4eb2-86ce-55bae56e787b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:05.182049 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.181880    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f9a495f-8657-4eb2-86ce-55bae56e787b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m\" (UID: \"8f9a495f-8657-4eb2-86ce-55bae56e787b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:05.182049 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.181898    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f9a495f-8657-4eb2-86ce-55bae56e787b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m\" (UID: \"8f9a495f-8657-4eb2-86ce-55bae56e787b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:05.182049 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.182007    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f9a495f-8657-4eb2-86ce-55bae56e787b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m\" (UID: \"8f9a495f-8657-4eb2-86ce-55bae56e787b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:05.182049 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.182047    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f9a495f-8657-4eb2-86ce-55bae56e787b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m\" (UID: \"8f9a495f-8657-4eb2-86ce-55bae56e787b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:05.182194 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.182077    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc2m6\" (UniqueName: \"kubernetes.io/projected/8f9a495f-8657-4eb2-86ce-55bae56e787b-kube-api-access-sc2m6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m\" (UID: \"8f9a495f-8657-4eb2-86ce-55bae56e787b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:05.282851 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.282820    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc2m6\" (UniqueName: \"kubernetes.io/projected/8f9a495f-8657-4eb2-86ce-55bae56e787b-kube-api-access-sc2m6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m\" (UID: \"8f9a495f-8657-4eb2-86ce-55bae56e787b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:05.283027 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.282904    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f9a495f-8657-4eb2-86ce-55bae56e787b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m\" (UID: \"8f9a495f-8657-4eb2-86ce-55bae56e787b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:05.283027 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.282947    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f9a495f-8657-4eb2-86ce-55bae56e787b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m\" (UID: \"8f9a495f-8657-4eb2-86ce-55bae56e787b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:05.283027 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.282968    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f9a495f-8657-4eb2-86ce-55bae56e787b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m\" (UID: \"8f9a495f-8657-4eb2-86ce-55bae56e787b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:05.283027 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.283022    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f9a495f-8657-4eb2-86ce-55bae56e787b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m\" (UID: \"8f9a495f-8657-4eb2-86ce-55bae56e787b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:05.283339 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.283055    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f9a495f-8657-4eb2-86ce-55bae56e787b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m\" (UID: \"8f9a495f-8657-4eb2-86ce-55bae56e787b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:05.283397 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.283376    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f9a495f-8657-4eb2-86ce-55bae56e787b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m\" (UID: \"8f9a495f-8657-4eb2-86ce-55bae56e787b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:05.283466 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.283443    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f9a495f-8657-4eb2-86ce-55bae56e787b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m\" (UID: \"8f9a495f-8657-4eb2-86ce-55bae56e787b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:05.283529 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.283475    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f9a495f-8657-4eb2-86ce-55bae56e787b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m\" (UID: \"8f9a495f-8657-4eb2-86ce-55bae56e787b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:05.285396 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.285370    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f9a495f-8657-4eb2-86ce-55bae56e787b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m\" (UID: \"8f9a495f-8657-4eb2-86ce-55bae56e787b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:05.285537 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.285516    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f9a495f-8657-4eb2-86ce-55bae56e787b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m\" (UID: \"8f9a495f-8657-4eb2-86ce-55bae56e787b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:05.292056 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.292030    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc2m6\" (UniqueName: \"kubernetes.io/projected/8f9a495f-8657-4eb2-86ce-55bae56e787b-kube-api-access-sc2m6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m\" (UID: \"8f9a495f-8657-4eb2-86ce-55bae56e787b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:05.372968 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.372941    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:05.525261 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.525219    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"]
Jul 24 17:16:05.526689 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:16:05.526661    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f9a495f_8657_4eb2_86ce_55bae56e787b.slice/crio-cf0f62a97dab4cae4e5ac78144afd8c222fdf3e309354c36ed9fea27947e169f WatchSource:0}: Error finding container cf0f62a97dab4cae4e5ac78144afd8c222fdf3e309354c36ed9fea27947e169f: Status 404 returned error can't find the container with id cf0f62a97dab4cae4e5ac78144afd8c222fdf3e309354c36ed9fea27947e169f
Jul 24 17:16:05.534625 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:05.534596    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m" event={"ID":"8f9a495f-8657-4eb2-86ce-55bae56e787b","Type":"ContainerStarted","Data":"cf0f62a97dab4cae4e5ac78144afd8c222fdf3e309354c36ed9fea27947e169f"}
Jul 24 17:16:07.548189 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:07.548157    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m" event={"ID":"8f9a495f-8657-4eb2-86ce-55bae56e787b","Type":"ContainerStarted","Data":"2b2426155475107e73eb08ce3d3b4e1bad46dcbaae0f6c656861c337d131c407"}
Jul 24 17:16:07.564826 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:07.564761    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m" podStartSLOduration=1.424551568 podStartE2EDuration="2.564743876s" totalImagesPullingTime="1.140192308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:16:07.564320914 +0000 UTC m=+784.998536482" watchObservedRunningTime="2026-07-24 17:16:07.564743876 +0000 UTC m=+784.998959443"
Jul 24 17:16:15.373837 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:15.373801    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:15.374216 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:15.373903    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:15.386919 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:15.386895    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:15.606242 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:15.606213    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m"
Jul 24 17:16:51.753816 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:51.753780    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"]
Jul 24 17:16:51.757664 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:51.757644    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:16:51.760623 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:51.760605    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 24 17:16:51.767806 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:51.767783    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"]
Jul 24 17:16:51.894953 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:51.894914    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8ed4bb8-8cdb-4f72-a733-df0b55138ac2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc\" (UID: \"a8ed4bb8-8cdb-4f72-a733-df0b55138ac2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:16:51.895113 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:51.894978    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8ed4bb8-8cdb-4f72-a733-df0b55138ac2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc\" (UID: \"a8ed4bb8-8cdb-4f72-a733-df0b55138ac2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:16:51.895113 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:51.895048    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8ed4bb8-8cdb-4f72-a733-df0b55138ac2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc\" (UID: \"a8ed4bb8-8cdb-4f72-a733-df0b55138ac2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:16:51.895113 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:51.895077    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrlb9\" (UniqueName: \"kubernetes.io/projected/a8ed4bb8-8cdb-4f72-a733-df0b55138ac2-kube-api-access-hrlb9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc\" (UID: \"a8ed4bb8-8cdb-4f72-a733-df0b55138ac2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:16:51.895223 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:51.895117    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8ed4bb8-8cdb-4f72-a733-df0b55138ac2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc\" (UID: \"a8ed4bb8-8cdb-4f72-a733-df0b55138ac2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:16:51.895223 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:51.895166    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8ed4bb8-8cdb-4f72-a733-df0b55138ac2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc\" (UID: \"a8ed4bb8-8cdb-4f72-a733-df0b55138ac2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:16:51.995947 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:51.995912    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8ed4bb8-8cdb-4f72-a733-df0b55138ac2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc\" (UID: \"a8ed4bb8-8cdb-4f72-a733-df0b55138ac2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:16:51.996113 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:51.995991    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8ed4bb8-8cdb-4f72-a733-df0b55138ac2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc\" (UID: \"a8ed4bb8-8cdb-4f72-a733-df0b55138ac2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:16:51.996113 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:51.996028    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8ed4bb8-8cdb-4f72-a733-df0b55138ac2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc\" (UID: \"a8ed4bb8-8cdb-4f72-a733-df0b55138ac2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:16:51.996113 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:51.996056    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrlb9\" (UniqueName: \"kubernetes.io/projected/a8ed4bb8-8cdb-4f72-a733-df0b55138ac2-kube-api-access-hrlb9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc\" (UID: \"a8ed4bb8-8cdb-4f72-a733-df0b55138ac2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:16:51.996113 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:51.996103    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8ed4bb8-8cdb-4f72-a733-df0b55138ac2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc\" (UID: \"a8ed4bb8-8cdb-4f72-a733-df0b55138ac2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:16:51.996373 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:51.996153    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8ed4bb8-8cdb-4f72-a733-df0b55138ac2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc\" (UID: \"a8ed4bb8-8cdb-4f72-a733-df0b55138ac2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:16:51.996578 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:51.996441    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8ed4bb8-8cdb-4f72-a733-df0b55138ac2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc\" (UID: \"a8ed4bb8-8cdb-4f72-a733-df0b55138ac2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:16:51.996578 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:51.996474    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8ed4bb8-8cdb-4f72-a733-df0b55138ac2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc\" (UID: \"a8ed4bb8-8cdb-4f72-a733-df0b55138ac2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:16:51.996578 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:51.996524    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8ed4bb8-8cdb-4f72-a733-df0b55138ac2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc\" (UID: \"a8ed4bb8-8cdb-4f72-a733-df0b55138ac2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:16:51.999024 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:51.999003    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8ed4bb8-8cdb-4f72-a733-df0b55138ac2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc\" (UID: \"a8ed4bb8-8cdb-4f72-a733-df0b55138ac2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:16:51.999522 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:51.999502    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8ed4bb8-8cdb-4f72-a733-df0b55138ac2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc\" (UID: \"a8ed4bb8-8cdb-4f72-a733-df0b55138ac2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:16:52.006380 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:52.006322    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrlb9\" (UniqueName: \"kubernetes.io/projected/a8ed4bb8-8cdb-4f72-a733-df0b55138ac2-kube-api-access-hrlb9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc\" (UID: \"a8ed4bb8-8cdb-4f72-a733-df0b55138ac2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:16:52.068206 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:52.068175    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:16:52.213582 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:52.213558    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"]
Jul 24 17:16:52.214968 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:16:52.214937    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8ed4bb8_8cdb_4f72_a733_df0b55138ac2.slice/crio-6aab2974c67e2ebceaa0576b5189768b5b0b12dc76140f0af1e58dc4cdd549fb WatchSource:0}: Error finding container 6aab2974c67e2ebceaa0576b5189768b5b0b12dc76140f0af1e58dc4cdd549fb: Status 404 returned error can't find the container with id 6aab2974c67e2ebceaa0576b5189768b5b0b12dc76140f0af1e58dc4cdd549fb
Jul 24 17:16:52.801495 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:52.801405    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc" event={"ID":"a8ed4bb8-8cdb-4f72-a733-df0b55138ac2","Type":"ContainerStarted","Data":"f6e2fa30635a5d67bb677b8f985bf5c9ac5878bb7bf961dfe1fbff79e03c45f3"}
Jul 24 17:16:52.801495 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:52.801463    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc" event={"ID":"a8ed4bb8-8cdb-4f72-a733-df0b55138ac2","Type":"ContainerStarted","Data":"6aab2974c67e2ebceaa0576b5189768b5b0b12dc76140f0af1e58dc4cdd549fb"}
Jul 24 17:16:52.819823 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:16:52.819778    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc" podStartSLOduration=1.642764568 podStartE2EDuration="1.819763678s" totalImagesPullingTime="176.99911ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:16:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:16:52.818781133 +0000 UTC m=+830.252996699" watchObservedRunningTime="2026-07-24 17:16:52.819763678 +0000 UTC m=+830.253979253"
Jul 24 17:17:02.068610 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:02.068572    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:17:02.069054 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:02.068629    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:17:02.081080 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:02.081049    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:17:02.868169 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:02.868136    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc"
Jul 24 17:17:12.746973 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:12.746943    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"]
Jul 24 17:17:12.750549 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:12.750529    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:17:12.753165 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:12.753145    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 24 17:17:12.762883 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:12.762863    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"]
Jul 24 17:17:12.899943 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:12.899908    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/594ac27f-4030-4032-9acd-376c116dd419-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mb626\" (UID: \"594ac27f-4030-4032-9acd-376c116dd419\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:17:12.899943 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:12.899950    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fqfn\" (UniqueName: \"kubernetes.io/projected/594ac27f-4030-4032-9acd-376c116dd419-kube-api-access-9fqfn\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mb626\" (UID: \"594ac27f-4030-4032-9acd-376c116dd419\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:17:12.900177 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:12.899987    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/594ac27f-4030-4032-9acd-376c116dd419-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mb626\" (UID: \"594ac27f-4030-4032-9acd-376c116dd419\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:17:12.900177 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:12.900035    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/594ac27f-4030-4032-9acd-376c116dd419-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mb626\" (UID: \"594ac27f-4030-4032-9acd-376c116dd419\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:17:12.900177 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:12.900079    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/594ac27f-4030-4032-9acd-376c116dd419-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mb626\" (UID: \"594ac27f-4030-4032-9acd-376c116dd419\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:17:12.900177 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:12.900147    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/594ac27f-4030-4032-9acd-376c116dd419-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mb626\" (UID: \"594ac27f-4030-4032-9acd-376c116dd419\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:17:13.001018 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:13.000918    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/594ac27f-4030-4032-9acd-376c116dd419-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mb626\" (UID: \"594ac27f-4030-4032-9acd-376c116dd419\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:17:13.001018 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:13.000987    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/594ac27f-4030-4032-9acd-376c116dd419-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mb626\" (UID: \"594ac27f-4030-4032-9acd-376c116dd419\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:17:13.001282 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:13.001045    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/594ac27f-4030-4032-9acd-376c116dd419-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mb626\" (UID: \"594ac27f-4030-4032-9acd-376c116dd419\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:17:13.001282 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:13.001078    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fqfn\" (UniqueName: \"kubernetes.io/projected/594ac27f-4030-4032-9acd-376c116dd419-kube-api-access-9fqfn\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mb626\" (UID: \"594ac27f-4030-4032-9acd-376c116dd419\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:17:13.001282 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:13.001143    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/594ac27f-4030-4032-9acd-376c116dd419-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mb626\" (UID: \"594ac27f-4030-4032-9acd-376c116dd419\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:17:13.001282 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:13.001190    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/594ac27f-4030-4032-9acd-376c116dd419-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mb626\" (UID: \"594ac27f-4030-4032-9acd-376c116dd419\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:17:13.001495 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:13.001406    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/594ac27f-4030-4032-9acd-376c116dd419-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mb626\" (UID: \"594ac27f-4030-4032-9acd-376c116dd419\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:17:13.001495 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:13.001468    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/594ac27f-4030-4032-9acd-376c116dd419-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mb626\" (UID: \"594ac27f-4030-4032-9acd-376c116dd419\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:17:13.001611 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:13.001581    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/594ac27f-4030-4032-9acd-376c116dd419-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mb626\" (UID: \"594ac27f-4030-4032-9acd-376c116dd419\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:17:13.003872 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:13.003849    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/594ac27f-4030-4032-9acd-376c116dd419-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mb626\" (UID: \"594ac27f-4030-4032-9acd-376c116dd419\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:17:13.003977 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:13.003934    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/594ac27f-4030-4032-9acd-376c116dd419-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mb626\" (UID: \"594ac27f-4030-4032-9acd-376c116dd419\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:17:13.011564 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:13.011543    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fqfn\" (UniqueName: \"kubernetes.io/projected/594ac27f-4030-4032-9acd-376c116dd419-kube-api-access-9fqfn\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mb626\" (UID: \"594ac27f-4030-4032-9acd-376c116dd419\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:17:13.060508 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:13.060480    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:17:13.215584 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:13.215554    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"]
Jul 24 17:17:13.216273 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:17:13.216214    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod594ac27f_4030_4032_9acd_376c116dd419.slice/crio-6a19e3b0fa552fa7ed5f4f9b5370a16f5dff1ef41e31f20644daec5741d2c546 WatchSource:0}: Error finding container 6a19e3b0fa552fa7ed5f4f9b5370a16f5dff1ef41e31f20644daec5741d2c546: Status 404 returned error can't find the container with id 6a19e3b0fa552fa7ed5f4f9b5370a16f5dff1ef41e31f20644daec5741d2c546
Jul 24 17:17:13.920002 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:13.919966    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626" event={"ID":"594ac27f-4030-4032-9acd-376c116dd419","Type":"ContainerStarted","Data":"7b686207881ee21f75d5f9401453dc934485ae2b0d39e0b606aee73f1ebf7bc0"}
Jul 24 17:17:13.920429 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:13.920011    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626" event={"ID":"594ac27f-4030-4032-9acd-376c116dd419","Type":"ContainerStarted","Data":"6a19e3b0fa552fa7ed5f4f9b5370a16f5dff1ef41e31f20644daec5741d2c546"}
Jul 24 17:17:13.939986 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:13.939939    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626" podStartSLOduration=1.750815619 podStartE2EDuration="1.939922898s" totalImagesPullingTime="189.107279ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:17:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:17:13.939259263 +0000 UTC m=+851.373474821" watchObservedRunningTime="2026-07-24 17:17:13.939922898 +0000 UTC m=+851.374138492"
Jul 24 17:17:23.060989 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:23.060952    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:17:23.061533 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:23.061029    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:17:23.073410 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:23.073387    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:17:23.989940 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:17:23.989906    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mb626"
Jul 24 17:18:03.050349 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:03.050264    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:18:03.053196 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:03.053174    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:18:14.904948 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:14.904912    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-69466cb798-mvfhg"]
Jul 24 17:18:14.908521 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:14.908503    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69466cb798-mvfhg"
Jul 24 17:18:14.921195 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:14.921152    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69466cb798-mvfhg"]
Jul 24 17:18:14.968014 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:14.967951    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1da27b87-3235-429f-9bf5-95004b1aa579-tls-cert\") pod \"authorino-69466cb798-mvfhg\" (UID: \"1da27b87-3235-429f-9bf5-95004b1aa579\") " pod="kuadrant-system/authorino-69466cb798-mvfhg"
Jul 24 17:18:14.968195 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:14.968024    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2tbt\" (UniqueName: \"kubernetes.io/projected/1da27b87-3235-429f-9bf5-95004b1aa579-kube-api-access-m2tbt\") pod \"authorino-69466cb798-mvfhg\" (UID: \"1da27b87-3235-429f-9bf5-95004b1aa579\") " pod="kuadrant-system/authorino-69466cb798-mvfhg"
Jul 24 17:18:15.068609 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:15.068574    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1da27b87-3235-429f-9bf5-95004b1aa579-tls-cert\") pod \"authorino-69466cb798-mvfhg\" (UID: \"1da27b87-3235-429f-9bf5-95004b1aa579\") " pod="kuadrant-system/authorino-69466cb798-mvfhg"
Jul 24 17:18:15.068786 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:15.068616    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2tbt\" (UniqueName: \"kubernetes.io/projected/1da27b87-3235-429f-9bf5-95004b1aa579-kube-api-access-m2tbt\") pod \"authorino-69466cb798-mvfhg\" (UID: \"1da27b87-3235-429f-9bf5-95004b1aa579\") " pod="kuadrant-system/authorino-69466cb798-mvfhg"
Jul 24 17:18:15.071294 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:15.071271    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1da27b87-3235-429f-9bf5-95004b1aa579-tls-cert\") pod \"authorino-69466cb798-mvfhg\" (UID: \"1da27b87-3235-429f-9bf5-95004b1aa579\") " pod="kuadrant-system/authorino-69466cb798-mvfhg"
Jul 24 17:18:15.077077 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:15.077053    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2tbt\" (UniqueName: \"kubernetes.io/projected/1da27b87-3235-429f-9bf5-95004b1aa579-kube-api-access-m2tbt\") pod \"authorino-69466cb798-mvfhg\" (UID: \"1da27b87-3235-429f-9bf5-95004b1aa579\") " pod="kuadrant-system/authorino-69466cb798-mvfhg"
Jul 24 17:18:15.218013 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:15.217933    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69466cb798-mvfhg"
Jul 24 17:18:15.377477 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:15.377452    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69466cb798-mvfhg"]
Jul 24 17:18:15.379678 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:18:15.379650    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1da27b87_3235_429f_9bf5_95004b1aa579.slice/crio-1be1c4238d262d8faaedeec58e709e92e92c9cc537cb955cfdbc98fadbc287d9 WatchSource:0}: Error finding container 1be1c4238d262d8faaedeec58e709e92e92c9cc537cb955cfdbc98fadbc287d9: Status 404 returned error can't find the container with id 1be1c4238d262d8faaedeec58e709e92e92c9cc537cb955cfdbc98fadbc287d9
Jul 24 17:18:16.288599 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:16.288553    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69466cb798-mvfhg" event={"ID":"1da27b87-3235-429f-9bf5-95004b1aa579","Type":"ContainerStarted","Data":"261c268705ad224165341fa619bd2e9e7538ab553f419069ee5e55ebb7633942"}
Jul 24 17:18:16.288599 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:16.288608    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69466cb798-mvfhg" event={"ID":"1da27b87-3235-429f-9bf5-95004b1aa579","Type":"ContainerStarted","Data":"1be1c4238d262d8faaedeec58e709e92e92c9cc537cb955cfdbc98fadbc287d9"}
Jul 24 17:18:16.310324 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:16.310220    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-69466cb798-mvfhg" podStartSLOduration=1.6460592360000001 podStartE2EDuration="2.310205436s" totalImagesPullingTime="664.1462ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:18:16.308273771 +0000 UTC m=+913.742489337" watchObservedRunningTime="2026-07-24 17:18:16.310205436 +0000 UTC m=+913.744421002"
Jul 24 17:18:16.352730 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:16.352692    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b5677c9-t6m4t"]
Jul 24 17:18:16.352952 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:16.352923    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-8b5677c9-t6m4t" podUID="1f97bd33-010a-4bd1-80d1-8b6082293c50" containerName="authorino" containerID="cri-o://c1b496f29622440df6acbe1d478f8db4d4305809ff57aff15a32613ded7c326a" gracePeriod=30
Jul 24 17:18:16.638784 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:16.638754    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b5677c9-t6m4t"
Jul 24 17:18:16.682248 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:16.682151    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1f97bd33-010a-4bd1-80d1-8b6082293c50-tls-cert\") pod \"1f97bd33-010a-4bd1-80d1-8b6082293c50\" (UID: \"1f97bd33-010a-4bd1-80d1-8b6082293c50\") "
Jul 24 17:18:16.682449 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:16.682299    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slnzf\" (UniqueName: \"kubernetes.io/projected/1f97bd33-010a-4bd1-80d1-8b6082293c50-kube-api-access-slnzf\") pod \"1f97bd33-010a-4bd1-80d1-8b6082293c50\" (UID: \"1f97bd33-010a-4bd1-80d1-8b6082293c50\") "
Jul 24 17:18:16.684921 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:16.684887    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f97bd33-010a-4bd1-80d1-8b6082293c50-kube-api-access-slnzf" (OuterVolumeSpecName: "kube-api-access-slnzf") pod "1f97bd33-010a-4bd1-80d1-8b6082293c50" (UID: "1f97bd33-010a-4bd1-80d1-8b6082293c50"). InnerVolumeSpecName "kube-api-access-slnzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:18:16.699181 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:16.699145    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f97bd33-010a-4bd1-80d1-8b6082293c50-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1f97bd33-010a-4bd1-80d1-8b6082293c50" (UID: "1f97bd33-010a-4bd1-80d1-8b6082293c50"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:18:16.783985 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:16.783943    2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1f97bd33-010a-4bd1-80d1-8b6082293c50-tls-cert\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:18:16.783985 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:16.783981    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slnzf\" (UniqueName: \"kubernetes.io/projected/1f97bd33-010a-4bd1-80d1-8b6082293c50-kube-api-access-slnzf\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:18:17.297714 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:17.297678    2572 generic.go:356] "Generic (PLEG): container finished" podID="1f97bd33-010a-4bd1-80d1-8b6082293c50" containerID="c1b496f29622440df6acbe1d478f8db4d4305809ff57aff15a32613ded7c326a" exitCode=0
Jul 24 17:18:17.298155 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:17.297732    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b5677c9-t6m4t"
Jul 24 17:18:17.298155 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:17.297757    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b5677c9-t6m4t" event={"ID":"1f97bd33-010a-4bd1-80d1-8b6082293c50","Type":"ContainerDied","Data":"c1b496f29622440df6acbe1d478f8db4d4305809ff57aff15a32613ded7c326a"}
Jul 24 17:18:17.298155 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:17.297800    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b5677c9-t6m4t" event={"ID":"1f97bd33-010a-4bd1-80d1-8b6082293c50","Type":"ContainerDied","Data":"a54dc5f4360c49894cbf5f7dbdbc1fa5d390994af28720cf0db96573953cfa9e"}
Jul 24 17:18:17.298155 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:17.297821    2572 scope.go:117] "RemoveContainer" containerID="c1b496f29622440df6acbe1d478f8db4d4305809ff57aff15a32613ded7c326a"
Jul 24 17:18:17.308298 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:17.308276    2572 scope.go:117] "RemoveContainer" containerID="c1b496f29622440df6acbe1d478f8db4d4305809ff57aff15a32613ded7c326a"
Jul 24 17:18:17.308623 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:18:17.308598    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1b496f29622440df6acbe1d478f8db4d4305809ff57aff15a32613ded7c326a\": container with ID starting with c1b496f29622440df6acbe1d478f8db4d4305809ff57aff15a32613ded7c326a not found: ID does not exist" containerID="c1b496f29622440df6acbe1d478f8db4d4305809ff57aff15a32613ded7c326a"
Jul 24 17:18:17.308718 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:17.308628    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1b496f29622440df6acbe1d478f8db4d4305809ff57aff15a32613ded7c326a"} err="failed to get container status \"c1b496f29622440df6acbe1d478f8db4d4305809ff57aff15a32613ded7c326a\": rpc error: code = NotFound desc = could not find container \"c1b496f29622440df6acbe1d478f8db4d4305809ff57aff15a32613ded7c326a\": container with ID starting with c1b496f29622440df6acbe1d478f8db4d4305809ff57aff15a32613ded7c326a not found: ID does not exist"
Jul 24 17:18:17.315661 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:17.315630    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b5677c9-t6m4t"]
Jul 24 17:18:17.320218 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:17.320191    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b5677c9-t6m4t"]
Jul 24 17:18:19.085362 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:18:19.085330    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f97bd33-010a-4bd1-80d1-8b6082293c50" path="/var/lib/kubelet/pods/1f97bd33-010a-4bd1-80d1-8b6082293c50/volumes"
Jul 24 17:23:03.097195 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:23:03.097098    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:23:03.101097 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:23:03.101077    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:25:19.418363 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:25:19.418324    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2"]
Jul 24 17:25:19.418823 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:25:19.418548    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2" podUID="4999988a-c3bc-4fc4-8c10-ccaeeb29e636" containerName="manager" containerID="cri-o://5d3188b09fef559bccc1d8b7e1f022a0a98116266760a82da88d9755535473d8" gracePeriod=10
Jul 24 17:25:22.276069 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:25:22.276042    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2"
Jul 24 17:25:22.356982 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:25:22.356954    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8z5rd\" (UniqueName: \"kubernetes.io/projected/4999988a-c3bc-4fc4-8c10-ccaeeb29e636-kube-api-access-8z5rd\") pod \"4999988a-c3bc-4fc4-8c10-ccaeeb29e636\" (UID: \"4999988a-c3bc-4fc4-8c10-ccaeeb29e636\") "
Jul 24 17:25:22.357152 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:25:22.357042    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4999988a-c3bc-4fc4-8c10-ccaeeb29e636-extensions-socket-volume\") pod \"4999988a-c3bc-4fc4-8c10-ccaeeb29e636\" (UID: \"4999988a-c3bc-4fc4-8c10-ccaeeb29e636\") "
Jul 24 17:25:22.357485 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:25:22.357459    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4999988a-c3bc-4fc4-8c10-ccaeeb29e636-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4999988a-c3bc-4fc4-8c10-ccaeeb29e636" (UID: "4999988a-c3bc-4fc4-8c10-ccaeeb29e636"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:25:22.359077 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:25:22.359052    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4999988a-c3bc-4fc4-8c10-ccaeeb29e636-kube-api-access-8z5rd" (OuterVolumeSpecName: "kube-api-access-8z5rd") pod "4999988a-c3bc-4fc4-8c10-ccaeeb29e636" (UID: "4999988a-c3bc-4fc4-8c10-ccaeeb29e636"). InnerVolumeSpecName "kube-api-access-8z5rd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:25:22.458604 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:25:22.458575    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4999988a-c3bc-4fc4-8c10-ccaeeb29e636-extensions-socket-volume\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:25:22.458741 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:25:22.458599    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8z5rd\" (UniqueName: \"kubernetes.io/projected/4999988a-c3bc-4fc4-8c10-ccaeeb29e636-kube-api-access-8z5rd\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:25:22.744326 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:25:22.744215    2572 generic.go:356] "Generic (PLEG): container finished" podID="4999988a-c3bc-4fc4-8c10-ccaeeb29e636" containerID="5d3188b09fef559bccc1d8b7e1f022a0a98116266760a82da88d9755535473d8" exitCode=0
Jul 24 17:25:22.744326 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:25:22.744285    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2"
Jul 24 17:25:22.744326 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:25:22.744304    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2" event={"ID":"4999988a-c3bc-4fc4-8c10-ccaeeb29e636","Type":"ContainerDied","Data":"5d3188b09fef559bccc1d8b7e1f022a0a98116266760a82da88d9755535473d8"}
Jul 24 17:25:22.744556 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:25:22.744362    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2" event={"ID":"4999988a-c3bc-4fc4-8c10-ccaeeb29e636","Type":"ContainerDied","Data":"9c77db1a2ae8b12185c29ac1b44b3c9c25c3d287e08403813acece31a693c661"}
Jul 24 17:25:22.744556 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:25:22.744387    2572 scope.go:117] "RemoveContainer" containerID="5d3188b09fef559bccc1d8b7e1f022a0a98116266760a82da88d9755535473d8"
Jul 24 17:25:22.754805 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:25:22.754785    2572 scope.go:117] "RemoveContainer" containerID="5d3188b09fef559bccc1d8b7e1f022a0a98116266760a82da88d9755535473d8"
Jul 24 17:25:22.755049 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:25:22.755031    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d3188b09fef559bccc1d8b7e1f022a0a98116266760a82da88d9755535473d8\": container with ID starting with 5d3188b09fef559bccc1d8b7e1f022a0a98116266760a82da88d9755535473d8 not found: ID does not exist" containerID="5d3188b09fef559bccc1d8b7e1f022a0a98116266760a82da88d9755535473d8"
Jul 24 17:25:22.755107 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:25:22.755057    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d3188b09fef559bccc1d8b7e1f022a0a98116266760a82da88d9755535473d8"} err="failed to get container status \"5d3188b09fef559bccc1d8b7e1f022a0a98116266760a82da88d9755535473d8\": rpc error: code = NotFound desc = could not find container \"5d3188b09fef559bccc1d8b7e1f022a0a98116266760a82da88d9755535473d8\": container with ID starting with 5d3188b09fef559bccc1d8b7e1f022a0a98116266760a82da88d9755535473d8 not found: ID does not exist"
Jul 24 17:25:22.766212 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:25:22.766191    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2"]
Jul 24 17:25:22.771256 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:25:22.771224    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c4xt2"]
Jul 24 17:25:23.085534 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:25:23.085460    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4999988a-c3bc-4fc4-8c10-ccaeeb29e636" path="/var/lib/kubelet/pods/4999988a-c3bc-4fc4-8c10-ccaeeb29e636/volumes"
Jul 24 17:26:20.667759 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:26:20.667725    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xcbtj"]
Jul 24 17:26:20.668223 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:26:20.668135    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4999988a-c3bc-4fc4-8c10-ccaeeb29e636" containerName="manager"
Jul 24 17:26:20.668223 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:26:20.668146    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4999988a-c3bc-4fc4-8c10-ccaeeb29e636" containerName="manager"
Jul 24 17:26:20.668223 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:26:20.668156    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f97bd33-010a-4bd1-80d1-8b6082293c50" containerName="authorino"
Jul 24 17:26:20.668223 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:26:20.668161    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f97bd33-010a-4bd1-80d1-8b6082293c50" containerName="authorino"
Jul 24 17:26:20.668429 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:26:20.668263    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4999988a-c3bc-4fc4-8c10-ccaeeb29e636" containerName="manager"
Jul 24 17:26:20.668429 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:26:20.668282    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f97bd33-010a-4bd1-80d1-8b6082293c50" containerName="authorino"
Jul 24 17:26:20.672506 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:26:20.672487    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xcbtj"
Jul 24 17:26:20.675259 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:26:20.675217    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hwmcx\""
Jul 24 17:26:20.683118 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:26:20.683094    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xcbtj"]
Jul 24 17:26:20.793828 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:26:20.793793    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae1b5d9d-049f-407f-9180-abb86b915ff4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xcbtj\" (UID: \"ae1b5d9d-049f-407f-9180-abb86b915ff4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xcbtj"
Jul 24 17:26:20.794005 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:26:20.793832    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njh4t\" (UniqueName: \"kubernetes.io/projected/ae1b5d9d-049f-407f-9180-abb86b915ff4-kube-api-access-njh4t\") pod \"kuadrant-operator-controller-manager-86878c769f-xcbtj\" (UID: \"ae1b5d9d-049f-407f-9180-abb86b915ff4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xcbtj"
Jul 24 17:26:20.895290 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:26:20.895227    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae1b5d9d-049f-407f-9180-abb86b915ff4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xcbtj\" (UID: \"ae1b5d9d-049f-407f-9180-abb86b915ff4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xcbtj"
Jul 24 17:26:20.895462 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:26:20.895300    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njh4t\" (UniqueName: \"kubernetes.io/projected/ae1b5d9d-049f-407f-9180-abb86b915ff4-kube-api-access-njh4t\") pod \"kuadrant-operator-controller-manager-86878c769f-xcbtj\" (UID: \"ae1b5d9d-049f-407f-9180-abb86b915ff4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xcbtj"
Jul 24 17:26:20.895613 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:26:20.895592    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae1b5d9d-049f-407f-9180-abb86b915ff4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xcbtj\" (UID: \"ae1b5d9d-049f-407f-9180-abb86b915ff4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xcbtj"
Jul 24 17:26:20.905520 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:26:20.905491    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njh4t\" (UniqueName: \"kubernetes.io/projected/ae1b5d9d-049f-407f-9180-abb86b915ff4-kube-api-access-njh4t\") pod \"kuadrant-operator-controller-manager-86878c769f-xcbtj\" (UID: \"ae1b5d9d-049f-407f-9180-abb86b915ff4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xcbtj"
Jul 24 17:26:20.983963 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:26:20.983889    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xcbtj"
Jul 24 17:26:21.131928 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:26:21.131904    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xcbtj"]
Jul 24 17:26:21.133500 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:26:21.133476    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae1b5d9d_049f_407f_9180_abb86b915ff4.slice/crio-a7bd202ef8db0376d211ab0cf8dd2b4d1e77ef20a3d83f1c2830807d36b4a544 WatchSource:0}: Error finding container a7bd202ef8db0376d211ab0cf8dd2b4d1e77ef20a3d83f1c2830807d36b4a544: Status 404 returned error can't find the container with id a7bd202ef8db0376d211ab0cf8dd2b4d1e77ef20a3d83f1c2830807d36b4a544
Jul 24 17:26:22.081991 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:26:22.081960    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xcbtj" event={"ID":"ae1b5d9d-049f-407f-9180-abb86b915ff4","Type":"ContainerStarted","Data":"2a440cfbf80c1b5792359eac25b55fdee551591a128723731aca9549975a0dbd"}
Jul 24 17:26:22.082407 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:26:22.082006    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xcbtj" event={"ID":"ae1b5d9d-049f-407f-9180-abb86b915ff4","Type":"ContainerStarted","Data":"a7bd202ef8db0376d211ab0cf8dd2b4d1e77ef20a3d83f1c2830807d36b4a544"}
Jul 24 17:26:22.082407 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:26:22.082035    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xcbtj"
Jul 24 17:26:22.104089 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:26:22.104045    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xcbtj" podStartSLOduration=2.104027097 podStartE2EDuration="2.104027097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:26:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:26:22.101841777 +0000 UTC m=+1399.536057342" watchObservedRunningTime="2026-07-24 17:26:22.104027097 +0000 UTC m=+1399.538242664"
Jul 24 17:26:33.090331 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:26:33.090303    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xcbtj"
Jul 24 17:28:03.134820 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:28:03.134796    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:28:03.140669 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:28:03.140643    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:33:03.169820 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:03.169788    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:33:03.178114 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:03.178094    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:33:19.969933 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:19.969898    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4"]
Jul 24 17:33:19.973679 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:19.973661    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4"
Jul 24 17:33:19.976784 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:19.976765    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-f231d414-serving-cert\""
Jul 24 17:33:19.984986 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:19.984965    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4"]
Jul 24 17:33:20.119874 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:20.119832    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1503bedb-86f5-428e-bbad-725c2fa598df-maas-api-tls\") pod \"maas-api-e2e-ait-f231d414-77bf689958-lcpb4\" (UID: \"1503bedb-86f5-428e-bbad-725c2fa598df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4"
Jul 24 17:33:20.120087 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:20.119885    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1503bedb-86f5-428e-bbad-725c2fa598df-openshift-service-ca\") pod \"maas-api-e2e-ait-f231d414-77bf689958-lcpb4\" (UID: \"1503bedb-86f5-428e-bbad-725c2fa598df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4"
Jul 24 17:33:20.120087 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:20.120032    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4k4q\" (UniqueName: \"kubernetes.io/projected/1503bedb-86f5-428e-bbad-725c2fa598df-kube-api-access-t4k4q\") pod \"maas-api-e2e-ait-f231d414-77bf689958-lcpb4\" (UID: \"1503bedb-86f5-428e-bbad-725c2fa598df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4"
Jul 24 17:33:20.221387 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:20.221273    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1503bedb-86f5-428e-bbad-725c2fa598df-maas-api-tls\") pod \"maas-api-e2e-ait-f231d414-77bf689958-lcpb4\" (UID: \"1503bedb-86f5-428e-bbad-725c2fa598df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4"
Jul 24 17:33:20.221387 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:20.221360    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1503bedb-86f5-428e-bbad-725c2fa598df-openshift-service-ca\") pod \"maas-api-e2e-ait-f231d414-77bf689958-lcpb4\" (UID: \"1503bedb-86f5-428e-bbad-725c2fa598df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4"
Jul 24 17:33:20.221642 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:33:20.221430    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-serving-cert: secret "maas-api-e2e-ait-f231d414-serving-cert" not found
Jul 24 17:33:20.221642 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:33:20.221515    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1503bedb-86f5-428e-bbad-725c2fa598df-maas-api-tls podName:1503bedb-86f5-428e-bbad-725c2fa598df nodeName:}" failed. No retries permitted until 2026-07-24 17:33:20.721491793 +0000 UTC m=+1818.155707337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1503bedb-86f5-428e-bbad-725c2fa598df-maas-api-tls") pod "maas-api-e2e-ait-f231d414-77bf689958-lcpb4" (UID: "1503bedb-86f5-428e-bbad-725c2fa598df") : secret "maas-api-e2e-ait-f231d414-serving-cert" not found
Jul 24 17:33:20.221642 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:20.221548    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4k4q\" (UniqueName: \"kubernetes.io/projected/1503bedb-86f5-428e-bbad-725c2fa598df-kube-api-access-t4k4q\") pod \"maas-api-e2e-ait-f231d414-77bf689958-lcpb4\" (UID: \"1503bedb-86f5-428e-bbad-725c2fa598df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4"
Jul 24 17:33:20.222097 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:20.222076    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1503bedb-86f5-428e-bbad-725c2fa598df-openshift-service-ca\") pod \"maas-api-e2e-ait-f231d414-77bf689958-lcpb4\" (UID: \"1503bedb-86f5-428e-bbad-725c2fa598df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4"
Jul 24 17:33:20.238303 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:20.238281    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4k4q\" (UniqueName: \"kubernetes.io/projected/1503bedb-86f5-428e-bbad-725c2fa598df-kube-api-access-t4k4q\") pod \"maas-api-e2e-ait-f231d414-77bf689958-lcpb4\" (UID: \"1503bedb-86f5-428e-bbad-725c2fa598df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4"
Jul 24 17:33:20.726964 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:20.726928    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1503bedb-86f5-428e-bbad-725c2fa598df-maas-api-tls\") pod \"maas-api-e2e-ait-f231d414-77bf689958-lcpb4\" (UID: \"1503bedb-86f5-428e-bbad-725c2fa598df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4"
Jul 24 17:33:20.729671 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:20.729644    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1503bedb-86f5-428e-bbad-725c2fa598df-maas-api-tls\") pod \"maas-api-e2e-ait-f231d414-77bf689958-lcpb4\" (UID: \"1503bedb-86f5-428e-bbad-725c2fa598df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4"
Jul 24 17:33:20.884939 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:20.884900    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4"
Jul 24 17:33:21.037470 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:21.037443    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4"]
Jul 24 17:33:21.039181 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:33:21.039154    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1503bedb_86f5_428e_bbad_725c2fa598df.slice/crio-6f380d250781cdbbdd822bab0e5d5ac320f6cb27e8e69596536c35756665dd56 WatchSource:0}: Error finding container 6f380d250781cdbbdd822bab0e5d5ac320f6cb27e8e69596536c35756665dd56: Status 404 returned error can't find the container with id 6f380d250781cdbbdd822bab0e5d5ac320f6cb27e8e69596536c35756665dd56
Jul 24 17:33:21.040569 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:21.040552    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:33:21.528964 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:21.528928    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4" event={"ID":"1503bedb-86f5-428e-bbad-725c2fa598df","Type":"ContainerStarted","Data":"6f380d250781cdbbdd822bab0e5d5ac320f6cb27e8e69596536c35756665dd56"}
Jul 24 17:33:22.538575 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:22.538534    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4" event={"ID":"1503bedb-86f5-428e-bbad-725c2fa598df","Type":"ContainerStarted","Data":"a14c60806ccb5b45cdc6cdbec71a38e7d0f6559da5bc0144cfb57a81c95742f6"}
Jul 24 17:33:22.539013 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:22.538618    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4"
Jul 24 17:33:22.556833 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:22.556789    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4" podStartSLOduration=3.048297262 podStartE2EDuration="3.556773727s" totalImagesPullingTime="508.476465ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:33:22.555656897 +0000 UTC m=+1819.989872464" watchObservedRunningTime="2026-07-24 17:33:22.556773727 +0000 UTC m=+1819.990989294"
Jul 24 17:33:28.549416 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:28.549381    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4"
Jul 24 17:33:55.810272 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:55.810221    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4"]
Jul 24 17:33:55.811168 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:55.811130    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4" podUID="1503bedb-86f5-428e-bbad-725c2fa598df" containerName="maas-api" containerID="cri-o://a14c60806ccb5b45cdc6cdbec71a38e7d0f6559da5bc0144cfb57a81c95742f6" gracePeriod=30
Jul 24 17:33:56.077558 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:56.077528    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4"
Jul 24 17:33:56.157453 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:56.157420    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1503bedb-86f5-428e-bbad-725c2fa598df-openshift-service-ca\") pod \"1503bedb-86f5-428e-bbad-725c2fa598df\" (UID: \"1503bedb-86f5-428e-bbad-725c2fa598df\") "
Jul 24 17:33:56.157622 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:56.157496    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1503bedb-86f5-428e-bbad-725c2fa598df-maas-api-tls\") pod \"1503bedb-86f5-428e-bbad-725c2fa598df\" (UID: \"1503bedb-86f5-428e-bbad-725c2fa598df\") "
Jul 24 17:33:56.157622 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:56.157523    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4k4q\" (UniqueName: \"kubernetes.io/projected/1503bedb-86f5-428e-bbad-725c2fa598df-kube-api-access-t4k4q\") pod \"1503bedb-86f5-428e-bbad-725c2fa598df\" (UID: \"1503bedb-86f5-428e-bbad-725c2fa598df\") "
Jul 24 17:33:56.157898 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:56.157861    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1503bedb-86f5-428e-bbad-725c2fa598df-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1503bedb-86f5-428e-bbad-725c2fa598df" (UID: "1503bedb-86f5-428e-bbad-725c2fa598df"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:33:56.159953 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:56.159925    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1503bedb-86f5-428e-bbad-725c2fa598df-kube-api-access-t4k4q" (OuterVolumeSpecName: "kube-api-access-t4k4q") pod "1503bedb-86f5-428e-bbad-725c2fa598df" (UID: "1503bedb-86f5-428e-bbad-725c2fa598df"). InnerVolumeSpecName "kube-api-access-t4k4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:33:56.160070 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:56.160051    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1503bedb-86f5-428e-bbad-725c2fa598df-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1503bedb-86f5-428e-bbad-725c2fa598df" (UID: "1503bedb-86f5-428e-bbad-725c2fa598df"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:33:56.258477 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:56.258443    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1503bedb-86f5-428e-bbad-725c2fa598df-maas-api-tls\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:33:56.258477 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:56.258471    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4k4q\" (UniqueName: \"kubernetes.io/projected/1503bedb-86f5-428e-bbad-725c2fa598df-kube-api-access-t4k4q\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:33:56.258477 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:56.258481    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1503bedb-86f5-428e-bbad-725c2fa598df-openshift-service-ca\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:33:56.726083 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:56.726044    2572 generic.go:356] "Generic (PLEG): container finished" podID="1503bedb-86f5-428e-bbad-725c2fa598df" containerID="a14c60806ccb5b45cdc6cdbec71a38e7d0f6559da5bc0144cfb57a81c95742f6" exitCode=0
Jul 24 17:33:56.726285 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:56.726112    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4"
Jul 24 17:33:56.726285 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:56.726150    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4" event={"ID":"1503bedb-86f5-428e-bbad-725c2fa598df","Type":"ContainerDied","Data":"a14c60806ccb5b45cdc6cdbec71a38e7d0f6559da5bc0144cfb57a81c95742f6"}
Jul 24 17:33:56.726285 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:56.726257    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4" event={"ID":"1503bedb-86f5-428e-bbad-725c2fa598df","Type":"ContainerDied","Data":"6f380d250781cdbbdd822bab0e5d5ac320f6cb27e8e69596536c35756665dd56"}
Jul 24 17:33:56.726401 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:56.726289    2572 scope.go:117] "RemoveContainer" containerID="a14c60806ccb5b45cdc6cdbec71a38e7d0f6559da5bc0144cfb57a81c95742f6"
Jul 24 17:33:56.736386 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:56.736367    2572 scope.go:117] "RemoveContainer" containerID="a14c60806ccb5b45cdc6cdbec71a38e7d0f6559da5bc0144cfb57a81c95742f6"
Jul 24 17:33:56.736615 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:33:56.736596    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a14c60806ccb5b45cdc6cdbec71a38e7d0f6559da5bc0144cfb57a81c95742f6\": container with ID starting with a14c60806ccb5b45cdc6cdbec71a38e7d0f6559da5bc0144cfb57a81c95742f6 not found: ID does not exist" containerID="a14c60806ccb5b45cdc6cdbec71a38e7d0f6559da5bc0144cfb57a81c95742f6"
Jul 24 17:33:56.736676 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:56.736622    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a14c60806ccb5b45cdc6cdbec71a38e7d0f6559da5bc0144cfb57a81c95742f6"} err="failed to get container status \"a14c60806ccb5b45cdc6cdbec71a38e7d0f6559da5bc0144cfb57a81c95742f6\": rpc error: code = NotFound desc = could not find container \"a14c60806ccb5b45cdc6cdbec71a38e7d0f6559da5bc0144cfb57a81c95742f6\": container with ID starting with a14c60806ccb5b45cdc6cdbec71a38e7d0f6559da5bc0144cfb57a81c95742f6 not found: ID does not exist"
Jul 24 17:33:56.750980 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:56.750956    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4"]
Jul 24 17:33:56.756518 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:56.756498    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f231d414-77bf689958-lcpb4"]
Jul 24 17:33:57.085715 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:33:57.085636    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1503bedb-86f5-428e-bbad-725c2fa598df" path="/var/lib/kubelet/pods/1503bedb-86f5-428e-bbad-725c2fa598df/volumes"
Jul 24 17:34:01.629342 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.629313    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"]
Jul 24 17:34:01.634651 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.634593    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1503bedb-86f5-428e-bbad-725c2fa598df" containerName="maas-api"
Jul 24 17:34:01.634651 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.634627    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1503bedb-86f5-428e-bbad-725c2fa598df" containerName="maas-api"
Jul 24 17:34:01.634873 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.634852    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1503bedb-86f5-428e-bbad-725c2fa598df" containerName="maas-api"
Jul 24 17:34:01.640451 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.640423    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.643221 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.643198    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-3f26bc98-gw-openshift-default-dockercfg-hlrm5\""
Jul 24 17:34:01.650149 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.650123    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"]
Jul 24 17:34:01.812197 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.812142    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0726deee-5435-46dd-80ca-9cce8573397f-istio-podinfo\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.812197 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.812203    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-istio-data\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.812463 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.812224    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-workload-certs\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.812463 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.812327    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8876q\" (UniqueName: \"kubernetes.io/projected/0726deee-5435-46dd-80ca-9cce8573397f-kube-api-access-8876q\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.812463 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.812358    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-istio-envoy\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.812463 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.812390    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0726deee-5435-46dd-80ca-9cce8573397f-istiod-ca-cert\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.812463 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.812447    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-credential-socket\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.812648 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.812481    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-workload-socket\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.812648 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.812497    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0726deee-5435-46dd-80ca-9cce8573397f-istio-token\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.913543 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.913456    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-credential-socket\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.913543 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.913508    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-workload-socket\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.913543 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.913527    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0726deee-5435-46dd-80ca-9cce8573397f-istio-token\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.913787 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.913571    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0726deee-5435-46dd-80ca-9cce8573397f-istio-podinfo\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.913787 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.913593    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-istio-data\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.913787 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.913608    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-workload-certs\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.913787 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.913646    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8876q\" (UniqueName: \"kubernetes.io/projected/0726deee-5435-46dd-80ca-9cce8573397f-kube-api-access-8876q\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.913787 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.913675    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-istio-envoy\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.913787 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.913713    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0726deee-5435-46dd-80ca-9cce8573397f-istiod-ca-cert\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.914088 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.913922    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-credential-socket\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.914088 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.913934    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-workload-socket\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.914208 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.914174    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-workload-certs\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.914311 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.914286    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-istio-data\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.914546 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.914530    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0726deee-5435-46dd-80ca-9cce8573397f-istiod-ca-cert\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.916199 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.916177    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-istio-envoy\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.916453 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.916436    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0726deee-5435-46dd-80ca-9cce8573397f-istio-podinfo\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.922737 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.922708    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0726deee-5435-46dd-80ca-9cce8573397f-istio-token\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.922936 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.922919    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8876q\" (UniqueName: \"kubernetes.io/projected/0726deee-5435-46dd-80ca-9cce8573397f-kube-api-access-8876q\") pod \"e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") " pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:01.953082 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:01.953049    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:02.115991 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:02.115963    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"]
Jul 24 17:34:02.117356 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:34:02.117326    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0726deee_5435_46dd_80ca_9cce8573397f.slice/crio-2fb06e2cf0486b518e0315c656c6c650be231635c263e021423078535514e461 WatchSource:0}: Error finding container 2fb06e2cf0486b518e0315c656c6c650be231635c263e021423078535514e461: Status 404 returned error can't find the container with id 2fb06e2cf0486b518e0315c656c6c650be231635c263e021423078535514e461
Jul 24 17:34:02.119379 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:02.119348    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:34:02.119439 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:02.119413    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:34:02.119487 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:02.119444    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:34:02.762678 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:02.762640    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6" event={"ID":"0726deee-5435-46dd-80ca-9cce8573397f","Type":"ContainerStarted","Data":"0e574809c777f9860ec3e27a3e69db58ebddca5a2c6ce81161d3e79f5c19d66d"}
Jul 24 17:34:02.763079 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:02.762699    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6" event={"ID":"0726deee-5435-46dd-80ca-9cce8573397f","Type":"ContainerStarted","Data":"2fb06e2cf0486b518e0315c656c6c650be231635c263e021423078535514e461"}
Jul 24 17:34:02.790785 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:02.790731    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6" podStartSLOduration=1.7907131870000002 podStartE2EDuration="1.790713187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:34:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:34:02.78950021 +0000 UTC m=+1860.223715789" watchObservedRunningTime="2026-07-24 17:34:02.790713187 +0000 UTC m=+1860.224928753"
Jul 24 17:34:02.953787 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:02.953757    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:03.958048 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:03.958018    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:04.366145 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:04.366113    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb"]
Jul 24 17:34:04.369516 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:04.369500    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb"
Jul 24 17:34:04.371814 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:04.371797    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-3f26bc98-serving-cert\""
Jul 24 17:34:04.378735 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:04.378709    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb"]
Jul 24 17:34:04.542217 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:04.542182    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66f8d9e7-9fab-49bd-91ad-4d3ea929c091-openshift-service-ca\") pod \"maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb\" (UID: \"66f8d9e7-9fab-49bd-91ad-4d3ea929c091\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb"
Jul 24 17:34:04.542385 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:04.542253    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66f8d9e7-9fab-49bd-91ad-4d3ea929c091-maas-api-tls\") pod \"maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb\" (UID: \"66f8d9e7-9fab-49bd-91ad-4d3ea929c091\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb"
Jul 24 17:34:04.542385 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:04.542282    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gws9d\" (UniqueName: \"kubernetes.io/projected/66f8d9e7-9fab-49bd-91ad-4d3ea929c091-kube-api-access-gws9d\") pod \"maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb\" (UID: \"66f8d9e7-9fab-49bd-91ad-4d3ea929c091\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb"
Jul 24 17:34:04.643039 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:04.642961    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66f8d9e7-9fab-49bd-91ad-4d3ea929c091-openshift-service-ca\") pod \"maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb\" (UID: \"66f8d9e7-9fab-49bd-91ad-4d3ea929c091\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb"
Jul 24 17:34:04.643039 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:04.643018    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66f8d9e7-9fab-49bd-91ad-4d3ea929c091-maas-api-tls\") pod \"maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb\" (UID: \"66f8d9e7-9fab-49bd-91ad-4d3ea929c091\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb"
Jul 24 17:34:04.643261 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:04.643042    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gws9d\" (UniqueName: \"kubernetes.io/projected/66f8d9e7-9fab-49bd-91ad-4d3ea929c091-kube-api-access-gws9d\") pod \"maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb\" (UID: \"66f8d9e7-9fab-49bd-91ad-4d3ea929c091\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb"
Jul 24 17:34:04.643261 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:34:04.643125    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-serving-cert: secret "maas-api-e2e-migrate-3f26bc98-serving-cert" not found
Jul 24 17:34:04.643261 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:34:04.643186    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66f8d9e7-9fab-49bd-91ad-4d3ea929c091-maas-api-tls podName:66f8d9e7-9fab-49bd-91ad-4d3ea929c091 nodeName:}" failed. No retries permitted until 2026-07-24 17:34:05.143172226 +0000 UTC m=+1862.577387774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/66f8d9e7-9fab-49bd-91ad-4d3ea929c091-maas-api-tls") pod "maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb" (UID: "66f8d9e7-9fab-49bd-91ad-4d3ea929c091") : secret "maas-api-e2e-migrate-3f26bc98-serving-cert" not found
Jul 24 17:34:04.643634 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:04.643615    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66f8d9e7-9fab-49bd-91ad-4d3ea929c091-openshift-service-ca\") pod \"maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb\" (UID: \"66f8d9e7-9fab-49bd-91ad-4d3ea929c091\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb"
Jul 24 17:34:04.651895 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:04.651868    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gws9d\" (UniqueName: \"kubernetes.io/projected/66f8d9e7-9fab-49bd-91ad-4d3ea929c091-kube-api-access-gws9d\") pod \"maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb\" (UID: \"66f8d9e7-9fab-49bd-91ad-4d3ea929c091\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb"
Jul 24 17:34:04.775167 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:04.775134    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:04.776142 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:04.776121    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:05.150186 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:05.150154    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66f8d9e7-9fab-49bd-91ad-4d3ea929c091-maas-api-tls\") pod \"maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb\" (UID: \"66f8d9e7-9fab-49bd-91ad-4d3ea929c091\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb"
Jul 24 17:34:05.152764 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:05.152739    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66f8d9e7-9fab-49bd-91ad-4d3ea929c091-maas-api-tls\") pod \"maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb\" (UID: \"66f8d9e7-9fab-49bd-91ad-4d3ea929c091\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb"
Jul 24 17:34:05.281055 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:05.281022    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb"
Jul 24 17:34:05.432666 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:05.432643    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb"]
Jul 24 17:34:05.434584 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:34:05.434557    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f8d9e7_9fab_49bd_91ad_4d3ea929c091.slice/crio-4e986701188ae349b3931f48e8261dcd209183337a805e4af6285ba986602e93 WatchSource:0}: Error finding container 4e986701188ae349b3931f48e8261dcd209183337a805e4af6285ba986602e93: Status 404 returned error can't find the container with id 4e986701188ae349b3931f48e8261dcd209183337a805e4af6285ba986602e93
Jul 24 17:34:05.782310 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:05.782212    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb" event={"ID":"66f8d9e7-9fab-49bd-91ad-4d3ea929c091","Type":"ContainerStarted","Data":"4e986701188ae349b3931f48e8261dcd209183337a805e4af6285ba986602e93"}
Jul 24 17:34:06.789087 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:06.789046    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb" event={"ID":"66f8d9e7-9fab-49bd-91ad-4d3ea929c091","Type":"ContainerStarted","Data":"12dfa1d42c617ecf59aca959946d28cbe97dc471131dcb1e93d53b75145b48b7"}
Jul 24 17:34:06.807258 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:06.807189    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb" podStartSLOduration=2.449613507 podStartE2EDuration="2.807173964s" totalImagesPullingTime="357.560457ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:34:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:34:06.806227782 +0000 UTC m=+1864.240443349" watchObservedRunningTime="2026-07-24 17:34:06.807173964 +0000 UTC m=+1864.241389531"
Jul 24 17:34:07.795687 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:07.795658    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb"
Jul 24 17:34:13.810796 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:13.810761    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb"
Jul 24 17:34:17.857406 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:17.857377    2572 generic.go:356] "Generic (PLEG): container finished" podID="0726deee-5435-46dd-80ca-9cce8573397f" containerID="0e574809c777f9860ec3e27a3e69db58ebddca5a2c6ce81161d3e79f5c19d66d" exitCode=0
Jul 24 17:34:17.857800 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:17.857443    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6" event={"ID":"0726deee-5435-46dd-80ca-9cce8573397f","Type":"ContainerDied","Data":"0e574809c777f9860ec3e27a3e69db58ebddca5a2c6ce81161d3e79f5c19d66d"}
Jul 24 17:34:17.857920 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:17.857903    2572 scope.go:117] "RemoveContainer" containerID="0e574809c777f9860ec3e27a3e69db58ebddca5a2c6ce81161d3e79f5c19d66d"
Jul 24 17:34:17.859095 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:17.859065    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:34:17.859192 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:17.859172    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:34:17.859246 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:17.859219    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:34:18.864913 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:18.864880    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6" event={"ID":"0726deee-5435-46dd-80ca-9cce8573397f","Type":"ContainerStarted","Data":"0e728bca1e32d84b34e085a877058713b012c65d5f1507a30a9e20315e1797c9"}
Jul 24 17:34:18.953542 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:18.953511    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:18.954561 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:18.954539    2572 patch_prober.go:28] interesting pod/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 24 17:34:18.954613 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:18.954593    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6" podUID="0726deee-5435-46dd-80ca-9cce8573397f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 24 17:34:19.775339 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:19.775298    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:19.954212 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:19.954177    2572 patch_prober.go:28] interesting pod/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 24 17:34:19.954630 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:19.954257    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6" podUID="0726deee-5435-46dd-80ca-9cce8573397f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 24 17:34:20.954061 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:20.954027    2572 patch_prober.go:28] interesting pod/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 24 17:34:20.954244 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:20.954083    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6" podUID="0726deee-5435-46dd-80ca-9cce8573397f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 24 17:34:21.953667 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:21.953627    2572 patch_prober.go:28] interesting pod/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 24 17:34:21.954064 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:21.953686    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6" podUID="0726deee-5435-46dd-80ca-9cce8573397f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 24 17:34:22.957728 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:22.957695    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:22.958827 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:22.958808    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:39.935513 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:39.935477    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb"]
Jul 24 17:34:39.936377 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:39.935750    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb" podUID="66f8d9e7-9fab-49bd-91ad-4d3ea929c091" containerName="maas-api" containerID="cri-o://12dfa1d42c617ecf59aca959946d28cbe97dc471131dcb1e93d53b75145b48b7" gracePeriod=30
Jul 24 17:34:40.199632 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:40.199562    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb"
Jul 24 17:34:40.289278 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:40.289216    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66f8d9e7-9fab-49bd-91ad-4d3ea929c091-openshift-service-ca\") pod \"66f8d9e7-9fab-49bd-91ad-4d3ea929c091\" (UID: \"66f8d9e7-9fab-49bd-91ad-4d3ea929c091\") "
Jul 24 17:34:40.289278 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:40.289280    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66f8d9e7-9fab-49bd-91ad-4d3ea929c091-maas-api-tls\") pod \"66f8d9e7-9fab-49bd-91ad-4d3ea929c091\" (UID: \"66f8d9e7-9fab-49bd-91ad-4d3ea929c091\") "
Jul 24 17:34:40.289525 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:40.289302    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gws9d\" (UniqueName: \"kubernetes.io/projected/66f8d9e7-9fab-49bd-91ad-4d3ea929c091-kube-api-access-gws9d\") pod \"66f8d9e7-9fab-49bd-91ad-4d3ea929c091\" (UID: \"66f8d9e7-9fab-49bd-91ad-4d3ea929c091\") "
Jul 24 17:34:40.289748 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:40.289720    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66f8d9e7-9fab-49bd-91ad-4d3ea929c091-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "66f8d9e7-9fab-49bd-91ad-4d3ea929c091" (UID: "66f8d9e7-9fab-49bd-91ad-4d3ea929c091"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:34:40.292084 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:40.292050    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66f8d9e7-9fab-49bd-91ad-4d3ea929c091-kube-api-access-gws9d" (OuterVolumeSpecName: "kube-api-access-gws9d") pod "66f8d9e7-9fab-49bd-91ad-4d3ea929c091" (UID: "66f8d9e7-9fab-49bd-91ad-4d3ea929c091"). InnerVolumeSpecName "kube-api-access-gws9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:34:40.292206 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:40.292149    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66f8d9e7-9fab-49bd-91ad-4d3ea929c091-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "66f8d9e7-9fab-49bd-91ad-4d3ea929c091" (UID: "66f8d9e7-9fab-49bd-91ad-4d3ea929c091"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:34:40.391153 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:40.391116    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66f8d9e7-9fab-49bd-91ad-4d3ea929c091-maas-api-tls\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:34:40.391153 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:40.391154    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gws9d\" (UniqueName: \"kubernetes.io/projected/66f8d9e7-9fab-49bd-91ad-4d3ea929c091-kube-api-access-gws9d\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:34:40.391351 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:40.391170    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66f8d9e7-9fab-49bd-91ad-4d3ea929c091-openshift-service-ca\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:34:40.999862 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:40.999828    2572 generic.go:356] "Generic (PLEG): container finished" podID="66f8d9e7-9fab-49bd-91ad-4d3ea929c091" containerID="12dfa1d42c617ecf59aca959946d28cbe97dc471131dcb1e93d53b75145b48b7" exitCode=0
Jul 24 17:34:41.000322 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:40.999874    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb"
Jul 24 17:34:41.000322 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:40.999906    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb" event={"ID":"66f8d9e7-9fab-49bd-91ad-4d3ea929c091","Type":"ContainerDied","Data":"12dfa1d42c617ecf59aca959946d28cbe97dc471131dcb1e93d53b75145b48b7"}
Jul 24 17:34:41.000322 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:40.999965    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb" event={"ID":"66f8d9e7-9fab-49bd-91ad-4d3ea929c091","Type":"ContainerDied","Data":"4e986701188ae349b3931f48e8261dcd209183337a805e4af6285ba986602e93"}
Jul 24 17:34:41.000322 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:40.999989    2572 scope.go:117] "RemoveContainer" containerID="12dfa1d42c617ecf59aca959946d28cbe97dc471131dcb1e93d53b75145b48b7"
Jul 24 17:34:41.010138 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:41.010120    2572 scope.go:117] "RemoveContainer" containerID="12dfa1d42c617ecf59aca959946d28cbe97dc471131dcb1e93d53b75145b48b7"
Jul 24 17:34:41.010399 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:34:41.010377    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12dfa1d42c617ecf59aca959946d28cbe97dc471131dcb1e93d53b75145b48b7\": container with ID starting with 12dfa1d42c617ecf59aca959946d28cbe97dc471131dcb1e93d53b75145b48b7 not found: ID does not exist" containerID="12dfa1d42c617ecf59aca959946d28cbe97dc471131dcb1e93d53b75145b48b7"
Jul 24 17:34:41.010475 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:41.010408    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12dfa1d42c617ecf59aca959946d28cbe97dc471131dcb1e93d53b75145b48b7"} err="failed to get container status \"12dfa1d42c617ecf59aca959946d28cbe97dc471131dcb1e93d53b75145b48b7\": rpc error: code = NotFound desc = could not find container \"12dfa1d42c617ecf59aca959946d28cbe97dc471131dcb1e93d53b75145b48b7\": container with ID starting with 12dfa1d42c617ecf59aca959946d28cbe97dc471131dcb1e93d53b75145b48b7 not found: ID does not exist"
Jul 24 17:34:41.025218 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:41.025194    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb"]
Jul 24 17:34:41.030830 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:41.030810    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3f26bc98-b59d4c645-dbqvb"]
Jul 24 17:34:41.086211 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:41.086191    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66f8d9e7-9fab-49bd-91ad-4d3ea929c091" path="/var/lib/kubelet/pods/66f8d9e7-9fab-49bd-91ad-4d3ea929c091/volumes"
Jul 24 17:34:44.547047 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:44.547005    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"]
Jul 24 17:34:44.547838 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:44.547805    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6" podUID="0726deee-5435-46dd-80ca-9cce8573397f" containerName="istio-proxy" containerID="cri-o://0e728bca1e32d84b34e085a877058713b012c65d5f1507a30a9e20315e1797c9" gracePeriod=30
Jul 24 17:34:48.410252 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:48.410209    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp"]
Jul 24 17:34:48.410658 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:48.410643    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66f8d9e7-9fab-49bd-91ad-4d3ea929c091" containerName="maas-api"
Jul 24 17:34:48.410705 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:48.410661    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="66f8d9e7-9fab-49bd-91ad-4d3ea929c091" containerName="maas-api"
Jul 24 17:34:48.410767 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:48.410758    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="66f8d9e7-9fab-49bd-91ad-4d3ea929c091" containerName="maas-api"
Jul 24 17:34:48.415352 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:48.415335    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp"
Jul 24 17:34:48.418289 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:48.418269    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-74f5d728-serving-cert\""
Jul 24 17:34:48.431111 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:48.431085    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp"]
Jul 24 17:34:48.473511 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:48.473483    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-452lk\" (UniqueName: \"kubernetes.io/projected/e99adc20-20b3-4307-bb42-540d25b9905b-kube-api-access-452lk\") pod \"maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp\" (UID: \"e99adc20-20b3-4307-bb42-540d25b9905b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp"
Jul 24 17:34:48.473632 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:48.473547    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e99adc20-20b3-4307-bb42-540d25b9905b-maas-api-tls\") pod \"maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp\" (UID: \"e99adc20-20b3-4307-bb42-540d25b9905b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp"
Jul 24 17:34:48.473632 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:48.473576    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e99adc20-20b3-4307-bb42-540d25b9905b-openshift-service-ca\") pod \"maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp\" (UID: \"e99adc20-20b3-4307-bb42-540d25b9905b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp"
Jul 24 17:34:48.574452 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:48.574421    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-452lk\" (UniqueName: \"kubernetes.io/projected/e99adc20-20b3-4307-bb42-540d25b9905b-kube-api-access-452lk\") pod \"maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp\" (UID: \"e99adc20-20b3-4307-bb42-540d25b9905b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp"
Jul 24 17:34:48.574651 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:48.574488    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e99adc20-20b3-4307-bb42-540d25b9905b-maas-api-tls\") pod \"maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp\" (UID: \"e99adc20-20b3-4307-bb42-540d25b9905b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp"
Jul 24 17:34:48.574651 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:48.574514    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e99adc20-20b3-4307-bb42-540d25b9905b-openshift-service-ca\") pod \"maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp\" (UID: \"e99adc20-20b3-4307-bb42-540d25b9905b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp"
Jul 24 17:34:48.574651 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:34:48.574588    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-serving-cert: secret "maas-api-e2e-ait-74f5d728-serving-cert" not found
Jul 24 17:34:48.574838 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:34:48.574659    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e99adc20-20b3-4307-bb42-540d25b9905b-maas-api-tls podName:e99adc20-20b3-4307-bb42-540d25b9905b nodeName:}" failed. No retries permitted until 2026-07-24 17:34:49.074642214 +0000 UTC m=+1906.508857758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e99adc20-20b3-4307-bb42-540d25b9905b-maas-api-tls") pod "maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp" (UID: "e99adc20-20b3-4307-bb42-540d25b9905b") : secret "maas-api-e2e-ait-74f5d728-serving-cert" not found
Jul 24 17:34:48.575224 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:48.575197    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e99adc20-20b3-4307-bb42-540d25b9905b-openshift-service-ca\") pod \"maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp\" (UID: \"e99adc20-20b3-4307-bb42-540d25b9905b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp"
Jul 24 17:34:48.590429 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:48.590405    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-452lk\" (UniqueName: \"kubernetes.io/projected/e99adc20-20b3-4307-bb42-540d25b9905b-kube-api-access-452lk\") pod \"maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp\" (UID: \"e99adc20-20b3-4307-bb42-540d25b9905b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp"
Jul 24 17:34:49.079547 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.079505    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e99adc20-20b3-4307-bb42-540d25b9905b-maas-api-tls\") pod \"maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp\" (UID: \"e99adc20-20b3-4307-bb42-540d25b9905b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp"
Jul 24 17:34:49.082116 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.082085    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e99adc20-20b3-4307-bb42-540d25b9905b-maas-api-tls\") pod \"maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp\" (UID: \"e99adc20-20b3-4307-bb42-540d25b9905b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp"
Jul 24 17:34:49.325716 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.325679    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp"
Jul 24 17:34:49.496351 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.496319    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp"]
Jul 24 17:34:49.497366 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:34:49.497342    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode99adc20_20b3_4307_bb42_540d25b9905b.slice/crio-eee0fc290e9a9845ea60f8cd62eb6bdef42111a3fe46d72ac23c8df7e3f09a9e WatchSource:0}: Error finding container eee0fc290e9a9845ea60f8cd62eb6bdef42111a3fe46d72ac23c8df7e3f09a9e: Status 404 returned error can't find the container with id eee0fc290e9a9845ea60f8cd62eb6bdef42111a3fe46d72ac23c8df7e3f09a9e
Jul 24 17:34:49.810007 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.809983    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:49.900891 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.900791    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-istio-envoy\") pod \"0726deee-5435-46dd-80ca-9cce8573397f\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") "
Jul 24 17:34:49.900891 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.900872    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0726deee-5435-46dd-80ca-9cce8573397f-istiod-ca-cert\") pod \"0726deee-5435-46dd-80ca-9cce8573397f\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") "
Jul 24 17:34:49.900891 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.900889    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-workload-socket\") pod \"0726deee-5435-46dd-80ca-9cce8573397f\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") "
Jul 24 17:34:49.901141 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.900908    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-credential-socket\") pod \"0726deee-5435-46dd-80ca-9cce8573397f\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") "
Jul 24 17:34:49.901141 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.900965    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0726deee-5435-46dd-80ca-9cce8573397f-istio-token\") pod \"0726deee-5435-46dd-80ca-9cce8573397f\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") "
Jul 24 17:34:49.901141 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.901020    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-istio-data\") pod \"0726deee-5435-46dd-80ca-9cce8573397f\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") "
Jul 24 17:34:49.901141 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.901054    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0726deee-5435-46dd-80ca-9cce8573397f-istio-podinfo\") pod \"0726deee-5435-46dd-80ca-9cce8573397f\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") "
Jul 24 17:34:49.901141 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.901117    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-workload-certs\") pod \"0726deee-5435-46dd-80ca-9cce8573397f\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") "
Jul 24 17:34:49.901416 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.901151    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8876q\" (UniqueName: \"kubernetes.io/projected/0726deee-5435-46dd-80ca-9cce8573397f-kube-api-access-8876q\") pod \"0726deee-5435-46dd-80ca-9cce8573397f\" (UID: \"0726deee-5435-46dd-80ca-9cce8573397f\") "
Jul 24 17:34:49.901416 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.901205    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0726deee-5435-46dd-80ca-9cce8573397f" (UID: "0726deee-5435-46dd-80ca-9cce8573397f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:34:49.901529 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.901444    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0726deee-5435-46dd-80ca-9cce8573397f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0726deee-5435-46dd-80ca-9cce8573397f" (UID: "0726deee-5435-46dd-80ca-9cce8573397f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:34:49.901529 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.901214    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0726deee-5435-46dd-80ca-9cce8573397f" (UID: "0726deee-5435-46dd-80ca-9cce8573397f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:34:49.901639 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.901530    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0726deee-5435-46dd-80ca-9cce8573397f-istiod-ca-cert\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:34:49.901639 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.901548    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-workload-socket\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:34:49.901639 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.901567    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-credential-socket\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:34:49.901639 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.901608    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0726deee-5435-46dd-80ca-9cce8573397f" (UID: "0726deee-5435-46dd-80ca-9cce8573397f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:34:49.902328 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.902297    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-istio-data" (OuterVolumeSpecName: "istio-data") pod "0726deee-5435-46dd-80ca-9cce8573397f" (UID: "0726deee-5435-46dd-80ca-9cce8573397f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:34:49.903274 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.903248    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0726deee-5435-46dd-80ca-9cce8573397f" (UID: "0726deee-5435-46dd-80ca-9cce8573397f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:34:49.903441 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.903426    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0726deee-5435-46dd-80ca-9cce8573397f-kube-api-access-8876q" (OuterVolumeSpecName: "kube-api-access-8876q") pod "0726deee-5435-46dd-80ca-9cce8573397f" (UID: "0726deee-5435-46dd-80ca-9cce8573397f"). InnerVolumeSpecName "kube-api-access-8876q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:34:49.903487 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.903459    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0726deee-5435-46dd-80ca-9cce8573397f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0726deee-5435-46dd-80ca-9cce8573397f" (UID: "0726deee-5435-46dd-80ca-9cce8573397f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:34:49.903664 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:49.903648    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0726deee-5435-46dd-80ca-9cce8573397f-istio-token" (OuterVolumeSpecName: "istio-token") pod "0726deee-5435-46dd-80ca-9cce8573397f" (UID: "0726deee-5435-46dd-80ca-9cce8573397f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:34:50.002212 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:50.002186    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0726deee-5435-46dd-80ca-9cce8573397f-istio-token\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:34:50.002212 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:50.002210    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-istio-data\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:34:50.002212 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:50.002219    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0726deee-5435-46dd-80ca-9cce8573397f-istio-podinfo\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:34:50.002425 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:50.002227    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-workload-certs\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:34:50.002425 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:50.002258    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8876q\" (UniqueName: \"kubernetes.io/projected/0726deee-5435-46dd-80ca-9cce8573397f-kube-api-access-8876q\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:34:50.002425 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:50.002268    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0726deee-5435-46dd-80ca-9cce8573397f-istio-envoy\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:34:50.054044 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:50.053992    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp" event={"ID":"e99adc20-20b3-4307-bb42-540d25b9905b","Type":"ContainerStarted","Data":"f5fde5e55077359ab64e1dd20ef07f42ce6851ec964f390785532c2f3668c27d"}
Jul 24 17:34:50.054220 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:50.054069    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp" event={"ID":"e99adc20-20b3-4307-bb42-540d25b9905b","Type":"ContainerStarted","Data":"eee0fc290e9a9845ea60f8cd62eb6bdef42111a3fe46d72ac23c8df7e3f09a9e"}
Jul 24 17:34:50.054318 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:50.054224    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp"
Jul 24 17:34:50.055814 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:50.055791    2572 generic.go:356] "Generic (PLEG): container finished" podID="0726deee-5435-46dd-80ca-9cce8573397f" containerID="0e728bca1e32d84b34e085a877058713b012c65d5f1507a30a9e20315e1797c9" exitCode=0
Jul 24 17:34:50.055921 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:50.055833    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"
Jul 24 17:34:50.055921 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:50.055868    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6" event={"ID":"0726deee-5435-46dd-80ca-9cce8573397f","Type":"ContainerDied","Data":"0e728bca1e32d84b34e085a877058713b012c65d5f1507a30a9e20315e1797c9"}
Jul 24 17:34:50.055921 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:50.055919    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6" event={"ID":"0726deee-5435-46dd-80ca-9cce8573397f","Type":"ContainerDied","Data":"2fb06e2cf0486b518e0315c656c6c650be231635c263e021423078535514e461"}
Jul 24 17:34:50.056022 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:50.055941    2572 scope.go:117] "RemoveContainer" containerID="0e728bca1e32d84b34e085a877058713b012c65d5f1507a30a9e20315e1797c9"
Jul 24 17:34:50.065893 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:50.065877    2572 scope.go:117] "RemoveContainer" containerID="0e574809c777f9860ec3e27a3e69db58ebddca5a2c6ce81161d3e79f5c19d66d"
Jul 24 17:34:50.074340 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:50.074320    2572 scope.go:117] "RemoveContainer" containerID="0e728bca1e32d84b34e085a877058713b012c65d5f1507a30a9e20315e1797c9"
Jul 24 17:34:50.074616 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:34:50.074598    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e728bca1e32d84b34e085a877058713b012c65d5f1507a30a9e20315e1797c9\": container with ID starting with 0e728bca1e32d84b34e085a877058713b012c65d5f1507a30a9e20315e1797c9 not found: ID does not exist" containerID="0e728bca1e32d84b34e085a877058713b012c65d5f1507a30a9e20315e1797c9"
Jul 24 17:34:50.074679 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:50.074625    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e728bca1e32d84b34e085a877058713b012c65d5f1507a30a9e20315e1797c9"} err="failed to get container status \"0e728bca1e32d84b34e085a877058713b012c65d5f1507a30a9e20315e1797c9\": rpc error: code = NotFound desc = could not find container \"0e728bca1e32d84b34e085a877058713b012c65d5f1507a30a9e20315e1797c9\": container with ID starting with 0e728bca1e32d84b34e085a877058713b012c65d5f1507a30a9e20315e1797c9 not found: ID does not exist"
Jul 24 17:34:50.074679 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:50.074642    2572 scope.go:117] "RemoveContainer" containerID="0e574809c777f9860ec3e27a3e69db58ebddca5a2c6ce81161d3e79f5c19d66d"
Jul 24 17:34:50.074886 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:34:50.074866    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e574809c777f9860ec3e27a3e69db58ebddca5a2c6ce81161d3e79f5c19d66d\": container with ID starting with 0e574809c777f9860ec3e27a3e69db58ebddca5a2c6ce81161d3e79f5c19d66d not found: ID does not exist" containerID="0e574809c777f9860ec3e27a3e69db58ebddca5a2c6ce81161d3e79f5c19d66d"
Jul 24 17:34:50.074954 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:50.074896    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e574809c777f9860ec3e27a3e69db58ebddca5a2c6ce81161d3e79f5c19d66d"} err="failed to get container status \"0e574809c777f9860ec3e27a3e69db58ebddca5a2c6ce81161d3e79f5c19d66d\": rpc error: code = NotFound desc = could not find container \"0e574809c777f9860ec3e27a3e69db58ebddca5a2c6ce81161d3e79f5c19d66d\": container with ID starting with 0e574809c777f9860ec3e27a3e69db58ebddca5a2c6ce81161d3e79f5c19d66d not found: ID does not exist"
Jul 24 17:34:50.075518 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:50.075481    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp" podStartSLOduration=1.6579514290000001 podStartE2EDuration="2.075467664s" totalImagesPullingTime="417.516235ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:34:50.072655858 +0000 UTC m=+1907.506871430" watchObservedRunningTime="2026-07-24 17:34:50.075467664 +0000 UTC m=+1907.509683270"
Jul 24 17:34:50.096774 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:50.094784    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"]
Jul 24 17:34:50.105200 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:50.105158    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6"]
Jul 24 17:34:51.087492 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:51.087451    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0726deee-5435-46dd-80ca-9cce8573397f" path="/var/lib/kubelet/pods/0726deee-5435-46dd-80ca-9cce8573397f/volumes"
Jul 24 17:34:56.068781 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:34:56.068755    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp"
Jul 24 17:35:24.724450 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:24.724408    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp"]
Jul 24 17:35:24.724966 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:24.724657    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp" podUID="e99adc20-20b3-4307-bb42-540d25b9905b" containerName="maas-api" containerID="cri-o://f5fde5e55077359ab64e1dd20ef07f42ce6851ec964f390785532c2f3668c27d" gracePeriod=30
Jul 24 17:35:24.981831 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:24.981769    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp"
Jul 24 17:35:25.029273 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:25.029211    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e99adc20-20b3-4307-bb42-540d25b9905b-openshift-service-ca\") pod \"e99adc20-20b3-4307-bb42-540d25b9905b\" (UID: \"e99adc20-20b3-4307-bb42-540d25b9905b\") "
Jul 24 17:35:25.029273 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:25.029273    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e99adc20-20b3-4307-bb42-540d25b9905b-maas-api-tls\") pod \"e99adc20-20b3-4307-bb42-540d25b9905b\" (UID: \"e99adc20-20b3-4307-bb42-540d25b9905b\") "
Jul 24 17:35:25.029522 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:25.029304    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-452lk\" (UniqueName: \"kubernetes.io/projected/e99adc20-20b3-4307-bb42-540d25b9905b-kube-api-access-452lk\") pod \"e99adc20-20b3-4307-bb42-540d25b9905b\" (UID: \"e99adc20-20b3-4307-bb42-540d25b9905b\") "
Jul 24 17:35:25.029593 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:25.029566    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e99adc20-20b3-4307-bb42-540d25b9905b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e99adc20-20b3-4307-bb42-540d25b9905b" (UID: "e99adc20-20b3-4307-bb42-540d25b9905b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:35:25.031667 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:25.031634    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e99adc20-20b3-4307-bb42-540d25b9905b-kube-api-access-452lk" (OuterVolumeSpecName: "kube-api-access-452lk") pod "e99adc20-20b3-4307-bb42-540d25b9905b" (UID: "e99adc20-20b3-4307-bb42-540d25b9905b"). InnerVolumeSpecName "kube-api-access-452lk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:35:25.031784 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:25.031675    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e99adc20-20b3-4307-bb42-540d25b9905b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e99adc20-20b3-4307-bb42-540d25b9905b" (UID: "e99adc20-20b3-4307-bb42-540d25b9905b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:35:25.130632 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:25.130600    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-452lk\" (UniqueName: \"kubernetes.io/projected/e99adc20-20b3-4307-bb42-540d25b9905b-kube-api-access-452lk\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:35:25.130632 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:25.130629    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e99adc20-20b3-4307-bb42-540d25b9905b-openshift-service-ca\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:35:25.130632 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:25.130638    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e99adc20-20b3-4307-bb42-540d25b9905b-maas-api-tls\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:35:25.252449 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:25.252360    2572 generic.go:356] "Generic (PLEG): container finished" podID="e99adc20-20b3-4307-bb42-540d25b9905b" containerID="f5fde5e55077359ab64e1dd20ef07f42ce6851ec964f390785532c2f3668c27d" exitCode=0
Jul 24 17:35:25.252449 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:25.252419    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp"
Jul 24 17:35:25.252651 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:25.252444    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp" event={"ID":"e99adc20-20b3-4307-bb42-540d25b9905b","Type":"ContainerDied","Data":"f5fde5e55077359ab64e1dd20ef07f42ce6851ec964f390785532c2f3668c27d"}
Jul 24 17:35:25.252651 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:25.252497    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp" event={"ID":"e99adc20-20b3-4307-bb42-540d25b9905b","Type":"ContainerDied","Data":"eee0fc290e9a9845ea60f8cd62eb6bdef42111a3fe46d72ac23c8df7e3f09a9e"}
Jul 24 17:35:25.252651 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:25.252521    2572 scope.go:117] "RemoveContainer" containerID="f5fde5e55077359ab64e1dd20ef07f42ce6851ec964f390785532c2f3668c27d"
Jul 24 17:35:25.262006 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:25.261984    2572 scope.go:117] "RemoveContainer" containerID="f5fde5e55077359ab64e1dd20ef07f42ce6851ec964f390785532c2f3668c27d"
Jul 24 17:35:25.262301 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:35:25.262280    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5fde5e55077359ab64e1dd20ef07f42ce6851ec964f390785532c2f3668c27d\": container with ID starting with f5fde5e55077359ab64e1dd20ef07f42ce6851ec964f390785532c2f3668c27d not found: ID does not exist" containerID="f5fde5e55077359ab64e1dd20ef07f42ce6851ec964f390785532c2f3668c27d"
Jul 24 17:35:25.262389 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:25.262313    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5fde5e55077359ab64e1dd20ef07f42ce6851ec964f390785532c2f3668c27d"} err="failed to get container status \"f5fde5e55077359ab64e1dd20ef07f42ce6851ec964f390785532c2f3668c27d\": rpc error: code = NotFound desc = could not find container \"f5fde5e55077359ab64e1dd20ef07f42ce6851ec964f390785532c2f3668c27d\": container with ID starting with f5fde5e55077359ab64e1dd20ef07f42ce6851ec964f390785532c2f3668c27d not found: ID does not exist"
Jul 24 17:35:25.270047 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:25.270021    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp"]
Jul 24 17:35:25.273887 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:25.273867    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-74f5d728-7496cd4998-jnhzp"]
Jul 24 17:35:27.086111 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:27.086075    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e99adc20-20b3-4307-bb42-540d25b9905b" path="/var/lib/kubelet/pods/e99adc20-20b3-4307-bb42-540d25b9905b/volumes"
Jul 24 17:35:31.137997 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.137968    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"]
Jul 24 17:35:31.138383 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.138371    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0726deee-5435-46dd-80ca-9cce8573397f" containerName="istio-proxy"
Jul 24 17:35:31.138383 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.138383    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0726deee-5435-46dd-80ca-9cce8573397f" containerName="istio-proxy"
Jul 24 17:35:31.138467 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.138393    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0726deee-5435-46dd-80ca-9cce8573397f" containerName="istio-proxy"
Jul 24 17:35:31.138467 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.138400    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0726deee-5435-46dd-80ca-9cce8573397f" containerName="istio-proxy"
Jul 24 17:35:31.138467 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.138416    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e99adc20-20b3-4307-bb42-540d25b9905b" containerName="maas-api"
Jul 24 17:35:31.138467 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.138422    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e99adc20-20b3-4307-bb42-540d25b9905b" containerName="maas-api"
Jul 24 17:35:31.138597 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.138481    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0726deee-5435-46dd-80ca-9cce8573397f" containerName="istio-proxy"
Jul 24 17:35:31.138597 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.138488    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e99adc20-20b3-4307-bb42-540d25b9905b" containerName="maas-api"
Jul 24 17:35:31.138597 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.138495    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0726deee-5435-46dd-80ca-9cce8573397f" containerName="istio-proxy"
Jul 24 17:35:31.143071 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.143056    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.145685 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.145667    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-72534233-openshift-default-dockercfg-8zb5x\""
Jul 24 17:35:31.153750 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.153732    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"]
Jul 24 17:35:31.176607 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.176585    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-data\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.176753 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.176619    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-envoy\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.176753 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.176637    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-workload-socket\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.176753 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.176665    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-token\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.176753 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.176713    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-podinfo\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.176753 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.176746    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vntm\" (UniqueName: \"kubernetes.io/projected/fd7abda6-5132-4470-a12d-7cd345f79fb7-kube-api-access-2vntm\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.177033 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.176781    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-credential-socket\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.177033 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.176810    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-workload-certs\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.177033 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.176884    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd7abda6-5132-4470-a12d-7cd345f79fb7-istiod-ca-cert\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.278332 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.278300    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-envoy\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.278332 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.278334    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-workload-socket\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.278805 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.278775    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-token\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.278910 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.278839    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-podinfo\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.278910 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.278880    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vntm\" (UniqueName: \"kubernetes.io/projected/fd7abda6-5132-4470-a12d-7cd345f79fb7-kube-api-access-2vntm\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.279031 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.278922    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-credential-socket\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.279031 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.278960    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-workload-certs\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.279031 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.279018    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd7abda6-5132-4470-a12d-7cd345f79fb7-istiod-ca-cert\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.279198 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.279092    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-workload-socket\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.279198 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.279108    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-data\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.279431 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.279405    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-data\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.279696 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.279651    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-workload-certs\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.285078 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.280044    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-credential-socket\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.285078 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.280115    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd7abda6-5132-4470-a12d-7cd345f79fb7-istiod-ca-cert\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.285078 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.282550    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-podinfo\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.292664 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.292575    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-envoy\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.292844 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.292687    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-token\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.293931 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.293909    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vntm\" (UniqueName: \"kubernetes.io/projected/fd7abda6-5132-4470-a12d-7cd345f79fb7-kube-api-access-2vntm\") pod \"e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") " pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.453834 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.453753    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:31.599377 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.599350    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"]
Jul 24 17:35:31.600831 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:35:31.600799    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd7abda6_5132_4470_a12d_7cd345f79fb7.slice/crio-7c877b4fbb4f98ef1a236536e77cd21b47c4c0ea107ed1a14548f6ce81a0922c WatchSource:0}: Error finding container 7c877b4fbb4f98ef1a236536e77cd21b47c4c0ea107ed1a14548f6ce81a0922c: Status 404 returned error can't find the container with id 7c877b4fbb4f98ef1a236536e77cd21b47c4c0ea107ed1a14548f6ce81a0922c
Jul 24 17:35:31.603003 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.602967    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:35:31.603081 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.603035    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:35:31.603081 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:31.603067    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:35:32.302845 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:32.302813    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv" event={"ID":"fd7abda6-5132-4470-a12d-7cd345f79fb7","Type":"ContainerStarted","Data":"2b8a3a690c1cc09f6a731f132b21fad5aec71a0e60c19c8a89c1a7770eb30488"}
Jul 24 17:35:32.303250 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:32.302872    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv" event={"ID":"fd7abda6-5132-4470-a12d-7cd345f79fb7","Type":"ContainerStarted","Data":"7c877b4fbb4f98ef1a236536e77cd21b47c4c0ea107ed1a14548f6ce81a0922c"}
Jul 24 17:35:32.454938 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:32.454903    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:32.459875 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:32.459851    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:32.496918 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:32.496865    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv" podStartSLOduration=1.496849989 podStartE2EDuration="1.496849989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:35:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:35:32.381741948 +0000 UTC m=+1949.815957514" watchObservedRunningTime="2026-07-24 17:35:32.496849989 +0000 UTC m=+1949.931065555"
Jul 24 17:35:33.308609 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:33.308567    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:33.309737 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:33.309715    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:33.890326 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:33.890290    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz"]
Jul 24 17:35:33.893951 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:33.893934    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz"
Jul 24 17:35:33.896736 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:33.896717    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-72534233-serving-cert\""
Jul 24 17:35:33.908449 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:33.908426    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz"]
Jul 24 17:35:34.006543 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:34.006501    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0e698dd-9792-4280-83b4-10fd71290f5c-maas-api-tls\") pod \"maas-api-e2e-derive-72534233-989f445d5-h4lxz\" (UID: \"e0e698dd-9792-4280-83b4-10fd71290f5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz"
Jul 24 17:35:34.006748 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:34.006551    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4lck\" (UniqueName: \"kubernetes.io/projected/e0e698dd-9792-4280-83b4-10fd71290f5c-kube-api-access-r4lck\") pod \"maas-api-e2e-derive-72534233-989f445d5-h4lxz\" (UID: \"e0e698dd-9792-4280-83b4-10fd71290f5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz"
Jul 24 17:35:34.006748 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:34.006636    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0e698dd-9792-4280-83b4-10fd71290f5c-openshift-service-ca\") pod \"maas-api-e2e-derive-72534233-989f445d5-h4lxz\" (UID: \"e0e698dd-9792-4280-83b4-10fd71290f5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz"
Jul 24 17:35:34.107937 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:34.107898    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0e698dd-9792-4280-83b4-10fd71290f5c-maas-api-tls\") pod \"maas-api-e2e-derive-72534233-989f445d5-h4lxz\" (UID: \"e0e698dd-9792-4280-83b4-10fd71290f5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz"
Jul 24 17:35:34.108121 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:34.107946    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4lck\" (UniqueName: \"kubernetes.io/projected/e0e698dd-9792-4280-83b4-10fd71290f5c-kube-api-access-r4lck\") pod \"maas-api-e2e-derive-72534233-989f445d5-h4lxz\" (UID: \"e0e698dd-9792-4280-83b4-10fd71290f5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz"
Jul 24 17:35:34.108121 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:34.108001    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0e698dd-9792-4280-83b4-10fd71290f5c-openshift-service-ca\") pod \"maas-api-e2e-derive-72534233-989f445d5-h4lxz\" (UID: \"e0e698dd-9792-4280-83b4-10fd71290f5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz"
Jul 24 17:35:34.108121 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:35:34.108056    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-72534233-serving-cert: secret "maas-api-e2e-derive-72534233-serving-cert" not found
Jul 24 17:35:34.108270 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:35:34.108133    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0e698dd-9792-4280-83b4-10fd71290f5c-maas-api-tls podName:e0e698dd-9792-4280-83b4-10fd71290f5c nodeName:}" failed. No retries permitted until 2026-07-24 17:35:34.608110275 +0000 UTC m=+1952.042325819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e0e698dd-9792-4280-83b4-10fd71290f5c-maas-api-tls") pod "maas-api-e2e-derive-72534233-989f445d5-h4lxz" (UID: "e0e698dd-9792-4280-83b4-10fd71290f5c") : secret "maas-api-e2e-derive-72534233-serving-cert" not found
Jul 24 17:35:34.108608 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:34.108590    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0e698dd-9792-4280-83b4-10fd71290f5c-openshift-service-ca\") pod \"maas-api-e2e-derive-72534233-989f445d5-h4lxz\" (UID: \"e0e698dd-9792-4280-83b4-10fd71290f5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz"
Jul 24 17:35:34.118874 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:34.118850    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4lck\" (UniqueName: \"kubernetes.io/projected/e0e698dd-9792-4280-83b4-10fd71290f5c-kube-api-access-r4lck\") pod \"maas-api-e2e-derive-72534233-989f445d5-h4lxz\" (UID: \"e0e698dd-9792-4280-83b4-10fd71290f5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz"
Jul 24 17:35:34.612411 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:34.612373    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0e698dd-9792-4280-83b4-10fd71290f5c-maas-api-tls\") pod \"maas-api-e2e-derive-72534233-989f445d5-h4lxz\" (UID: \"e0e698dd-9792-4280-83b4-10fd71290f5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz"
Jul 24 17:35:34.614921 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:34.614895    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0e698dd-9792-4280-83b4-10fd71290f5c-maas-api-tls\") pod \"maas-api-e2e-derive-72534233-989f445d5-h4lxz\" (UID: \"e0e698dd-9792-4280-83b4-10fd71290f5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz"
Jul 24 17:35:34.805274 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:34.805223    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz"
Jul 24 17:35:34.947479 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:34.947456    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz"]
Jul 24 17:35:34.949052 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:35:34.949021    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0e698dd_9792_4280_83b4_10fd71290f5c.slice/crio-efac90108c6cb34faee5ad37e538ef76aa3ba81faddc87f3c45e39d1be358384 WatchSource:0}: Error finding container efac90108c6cb34faee5ad37e538ef76aa3ba81faddc87f3c45e39d1be358384: Status 404 returned error can't find the container with id efac90108c6cb34faee5ad37e538ef76aa3ba81faddc87f3c45e39d1be358384
Jul 24 17:35:35.320753 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:35.320675    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz" event={"ID":"e0e698dd-9792-4280-83b4-10fd71290f5c","Type":"ContainerStarted","Data":"efac90108c6cb34faee5ad37e538ef76aa3ba81faddc87f3c45e39d1be358384"}
Jul 24 17:35:36.327901 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:36.327864    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz" event={"ID":"e0e698dd-9792-4280-83b4-10fd71290f5c","Type":"ContainerStarted","Data":"ba1736fec59299ede998e8ff3c941a3ef749596fe8ac39a7593174070da4b586"}
Jul 24 17:35:36.328318 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:36.327992    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz"
Jul 24 17:35:36.350410 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:36.350362    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz" podStartSLOduration=2.949674226 podStartE2EDuration="3.350348625s" totalImagesPullingTime="400.674399ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:35:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:35:36.348580118 +0000 UTC m=+1953.782795686" watchObservedRunningTime="2026-07-24 17:35:36.350348625 +0000 UTC m=+1953.784564190"
Jul 24 17:35:42.339196 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:42.339167    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz"
Jul 24 17:35:47.392563 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:47.392524    2572 generic.go:356] "Generic (PLEG): container finished" podID="fd7abda6-5132-4470-a12d-7cd345f79fb7" containerID="2b8a3a690c1cc09f6a731f132b21fad5aec71a0e60c19c8a89c1a7770eb30488" exitCode=0
Jul 24 17:35:47.392991 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:47.392603    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv" event={"ID":"fd7abda6-5132-4470-a12d-7cd345f79fb7","Type":"ContainerDied","Data":"2b8a3a690c1cc09f6a731f132b21fad5aec71a0e60c19c8a89c1a7770eb30488"}
Jul 24 17:35:47.393170 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:47.393153    2572 scope.go:117] "RemoveContainer" containerID="2b8a3a690c1cc09f6a731f132b21fad5aec71a0e60c19c8a89c1a7770eb30488"
Jul 24 17:35:47.394257 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:47.394211    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:35:47.394363 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:47.394320    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:35:47.394453 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:47.394367    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:35:48.309350 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:48.309313    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:48.410260 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:48.409572    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv" event={"ID":"fd7abda6-5132-4470-a12d-7cd345f79fb7","Type":"ContainerStarted","Data":"3c5e5ac984bc6bc0861a8f2ca784b3261be7e52cab18114bdcaeedd8d178e644"}
Jul 24 17:35:48.454163 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:48.454125    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:48.455313 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:48.455286    2572 patch_prober.go:28] interesting pod/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 24 17:35:48.455466 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:48.455340    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv" podUID="fd7abda6-5132-4470-a12d-7cd345f79fb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 24 17:35:49.454989 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:49.454953    2572 patch_prober.go:28] interesting pod/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 24 17:35:49.455424 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:49.455009    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv" podUID="fd7abda6-5132-4470-a12d-7cd345f79fb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 24 17:35:50.454151 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:50.454112    2572 patch_prober.go:28] interesting pod/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 24 17:35:50.454332 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:50.454180    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv" podUID="fd7abda6-5132-4470-a12d-7cd345f79fb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 24 17:35:51.454540 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:51.454500    2572 patch_prober.go:28] interesting pod/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 24 17:35:51.454933 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:51.454562    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv" podUID="fd7abda6-5132-4470-a12d-7cd345f79fb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 24 17:35:52.457978 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:52.457947    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:52.458457 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:52.458260    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:35:52.458952 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:35:52.458937    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:36:14.166960 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:14.166906    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz"]
Jul 24 17:36:14.167492 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:14.167199    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz" podUID="e0e698dd-9792-4280-83b4-10fd71290f5c" containerName="maas-api" containerID="cri-o://ba1736fec59299ede998e8ff3c941a3ef749596fe8ac39a7593174070da4b586" gracePeriod=30
Jul 24 17:36:14.428841 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:14.428782    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz"
Jul 24 17:36:14.498030 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:14.497995    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0e698dd-9792-4280-83b4-10fd71290f5c-maas-api-tls\") pod \"e0e698dd-9792-4280-83b4-10fd71290f5c\" (UID: \"e0e698dd-9792-4280-83b4-10fd71290f5c\") "
Jul 24 17:36:14.498210 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:14.498077    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0e698dd-9792-4280-83b4-10fd71290f5c-openshift-service-ca\") pod \"e0e698dd-9792-4280-83b4-10fd71290f5c\" (UID: \"e0e698dd-9792-4280-83b4-10fd71290f5c\") "
Jul 24 17:36:14.498210 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:14.498120    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4lck\" (UniqueName: \"kubernetes.io/projected/e0e698dd-9792-4280-83b4-10fd71290f5c-kube-api-access-r4lck\") pod \"e0e698dd-9792-4280-83b4-10fd71290f5c\" (UID: \"e0e698dd-9792-4280-83b4-10fd71290f5c\") "
Jul 24 17:36:14.498485 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:14.498462    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0e698dd-9792-4280-83b4-10fd71290f5c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e0e698dd-9792-4280-83b4-10fd71290f5c" (UID: "e0e698dd-9792-4280-83b4-10fd71290f5c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:36:14.500438 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:14.500406    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0e698dd-9792-4280-83b4-10fd71290f5c-kube-api-access-r4lck" (OuterVolumeSpecName: "kube-api-access-r4lck") pod "e0e698dd-9792-4280-83b4-10fd71290f5c" (UID: "e0e698dd-9792-4280-83b4-10fd71290f5c"). InnerVolumeSpecName "kube-api-access-r4lck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:36:14.500559 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:14.500411    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0e698dd-9792-4280-83b4-10fd71290f5c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e0e698dd-9792-4280-83b4-10fd71290f5c" (UID: "e0e698dd-9792-4280-83b4-10fd71290f5c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:36:14.565495 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:14.565465    2572 generic.go:356] "Generic (PLEG): container finished" podID="e0e698dd-9792-4280-83b4-10fd71290f5c" containerID="ba1736fec59299ede998e8ff3c941a3ef749596fe8ac39a7593174070da4b586" exitCode=0
Jul 24 17:36:14.565681 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:14.565513    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz"
Jul 24 17:36:14.565681 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:14.565541    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz" event={"ID":"e0e698dd-9792-4280-83b4-10fd71290f5c","Type":"ContainerDied","Data":"ba1736fec59299ede998e8ff3c941a3ef749596fe8ac39a7593174070da4b586"}
Jul 24 17:36:14.565681 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:14.565585    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz" event={"ID":"e0e698dd-9792-4280-83b4-10fd71290f5c","Type":"ContainerDied","Data":"efac90108c6cb34faee5ad37e538ef76aa3ba81faddc87f3c45e39d1be358384"}
Jul 24 17:36:14.565681 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:14.565607    2572 scope.go:117] "RemoveContainer" containerID="ba1736fec59299ede998e8ff3c941a3ef749596fe8ac39a7593174070da4b586"
Jul 24 17:36:14.575274 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:14.575255    2572 scope.go:117] "RemoveContainer" containerID="ba1736fec59299ede998e8ff3c941a3ef749596fe8ac39a7593174070da4b586"
Jul 24 17:36:14.575524 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:36:14.575505    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba1736fec59299ede998e8ff3c941a3ef749596fe8ac39a7593174070da4b586\": container with ID starting with ba1736fec59299ede998e8ff3c941a3ef749596fe8ac39a7593174070da4b586 not found: ID does not exist" containerID="ba1736fec59299ede998e8ff3c941a3ef749596fe8ac39a7593174070da4b586"
Jul 24 17:36:14.575594 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:14.575537    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba1736fec59299ede998e8ff3c941a3ef749596fe8ac39a7593174070da4b586"} err="failed to get container status \"ba1736fec59299ede998e8ff3c941a3ef749596fe8ac39a7593174070da4b586\": rpc error: code = NotFound desc = could not find container \"ba1736fec59299ede998e8ff3c941a3ef749596fe8ac39a7593174070da4b586\": container with ID starting with ba1736fec59299ede998e8ff3c941a3ef749596fe8ac39a7593174070da4b586 not found: ID does not exist"
Jul 24 17:36:14.588054 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:14.588030    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz"]
Jul 24 17:36:14.591928 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:14.591905    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-72534233-989f445d5-h4lxz"]
Jul 24 17:36:14.599083 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:14.599065    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4lck\" (UniqueName: \"kubernetes.io/projected/e0e698dd-9792-4280-83b4-10fd71290f5c-kube-api-access-r4lck\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:36:14.599156 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:14.599087    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0e698dd-9792-4280-83b4-10fd71290f5c-maas-api-tls\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:36:14.599156 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:14.599104    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0e698dd-9792-4280-83b4-10fd71290f5c-openshift-service-ca\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:36:15.085898 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:15.085863    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0e698dd-9792-4280-83b4-10fd71290f5c" path="/var/lib/kubelet/pods/e0e698dd-9792-4280-83b4-10fd71290f5c/volumes"
Jul 24 17:36:18.968632 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:18.968591    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"]
Jul 24 17:36:18.969106 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:18.968910    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv" podUID="fd7abda6-5132-4470-a12d-7cd345f79fb7" containerName="istio-proxy" containerID="cri-o://3c5e5ac984bc6bc0861a8f2ca784b3261be7e52cab18114bdcaeedd8d178e644" gracePeriod=30
Jul 24 17:36:22.460485 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:22.460451    2572 patch_prober.go:28] interesting pod/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 17:36:22.460934 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:22.460512    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv" podUID="fd7abda6-5132-4470-a12d-7cd345f79fb7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:36:24.236344 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.236284    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:36:24.289381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.289352    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-workload-certs\") pod \"fd7abda6-5132-4470-a12d-7cd345f79fb7\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") "
Jul 24 17:36:24.289542 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.289387    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-envoy\") pod \"fd7abda6-5132-4470-a12d-7cd345f79fb7\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") "
Jul 24 17:36:24.289542 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.289422    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vntm\" (UniqueName: \"kubernetes.io/projected/fd7abda6-5132-4470-a12d-7cd345f79fb7-kube-api-access-2vntm\") pod \"fd7abda6-5132-4470-a12d-7cd345f79fb7\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") "
Jul 24 17:36:24.289542 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.289455    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-workload-socket\") pod \"fd7abda6-5132-4470-a12d-7cd345f79fb7\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") "
Jul 24 17:36:24.289542 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.289499    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd7abda6-5132-4470-a12d-7cd345f79fb7-istiod-ca-cert\") pod \"fd7abda6-5132-4470-a12d-7cd345f79fb7\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") "
Jul 24 17:36:24.289751 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.289552    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-data\") pod \"fd7abda6-5132-4470-a12d-7cd345f79fb7\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") "
Jul 24 17:36:24.289751 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.289594    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-token\") pod \"fd7abda6-5132-4470-a12d-7cd345f79fb7\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") "
Jul 24 17:36:24.289751 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.289640    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-credential-socket\") pod \"fd7abda6-5132-4470-a12d-7cd345f79fb7\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") "
Jul 24 17:36:24.289751 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.289646    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fd7abda6-5132-4470-a12d-7cd345f79fb7" (UID: "fd7abda6-5132-4470-a12d-7cd345f79fb7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:36:24.289751 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.289689    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-podinfo\") pod \"fd7abda6-5132-4470-a12d-7cd345f79fb7\" (UID: \"fd7abda6-5132-4470-a12d-7cd345f79fb7\") "
Jul 24 17:36:24.290013 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.289753    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fd7abda6-5132-4470-a12d-7cd345f79fb7" (UID: "fd7abda6-5132-4470-a12d-7cd345f79fb7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:36:24.290013 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.289986    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fd7abda6-5132-4470-a12d-7cd345f79fb7" (UID: "fd7abda6-5132-4470-a12d-7cd345f79fb7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:36:24.290228 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.290102    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-workload-certs\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:36:24.290431 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.290414    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-workload-socket\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:36:24.290708 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.290679    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd7abda6-5132-4470-a12d-7cd345f79fb7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fd7abda6-5132-4470-a12d-7cd345f79fb7" (UID: "fd7abda6-5132-4470-a12d-7cd345f79fb7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:36:24.290809 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.290766    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-data" (OuterVolumeSpecName: "istio-data") pod "fd7abda6-5132-4470-a12d-7cd345f79fb7" (UID: "fd7abda6-5132-4470-a12d-7cd345f79fb7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:36:24.291967 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.291936    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fd7abda6-5132-4470-a12d-7cd345f79fb7" (UID: "fd7abda6-5132-4470-a12d-7cd345f79fb7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:36:24.292059 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.291995    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-token" (OuterVolumeSpecName: "istio-token") pod "fd7abda6-5132-4470-a12d-7cd345f79fb7" (UID: "fd7abda6-5132-4470-a12d-7cd345f79fb7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:36:24.292526 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.292500    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fd7abda6-5132-4470-a12d-7cd345f79fb7" (UID: "fd7abda6-5132-4470-a12d-7cd345f79fb7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:36:24.292615 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.292595    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd7abda6-5132-4470-a12d-7cd345f79fb7-kube-api-access-2vntm" (OuterVolumeSpecName: "kube-api-access-2vntm") pod "fd7abda6-5132-4470-a12d-7cd345f79fb7" (UID: "fd7abda6-5132-4470-a12d-7cd345f79fb7"). InnerVolumeSpecName "kube-api-access-2vntm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:36:24.391131 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.391091    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-data\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:36:24.391131 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.391118    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-token\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:36:24.391131 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.391128    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-credential-socket\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:36:24.391131 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.391136    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-podinfo\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:36:24.391425 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.391145    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd7abda6-5132-4470-a12d-7cd345f79fb7-istio-envoy\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:36:24.391425 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.391153    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vntm\" (UniqueName: \"kubernetes.io/projected/fd7abda6-5132-4470-a12d-7cd345f79fb7-kube-api-access-2vntm\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:36:24.391425 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.391161    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd7abda6-5132-4470-a12d-7cd345f79fb7-istiod-ca-cert\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:36:24.625918 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.625888    2572 generic.go:356] "Generic (PLEG): container finished" podID="fd7abda6-5132-4470-a12d-7cd345f79fb7" containerID="3c5e5ac984bc6bc0861a8f2ca784b3261be7e52cab18114bdcaeedd8d178e644" exitCode=0
Jul 24 17:36:24.626127 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.625952    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"
Jul 24 17:36:24.626127 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.625976    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv" event={"ID":"fd7abda6-5132-4470-a12d-7cd345f79fb7","Type":"ContainerDied","Data":"3c5e5ac984bc6bc0861a8f2ca784b3261be7e52cab18114bdcaeedd8d178e644"}
Jul 24 17:36:24.626127 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.626036    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv" event={"ID":"fd7abda6-5132-4470-a12d-7cd345f79fb7","Type":"ContainerDied","Data":"7c877b4fbb4f98ef1a236536e77cd21b47c4c0ea107ed1a14548f6ce81a0922c"}
Jul 24 17:36:24.626127 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.626062    2572 scope.go:117] "RemoveContainer" containerID="3c5e5ac984bc6bc0861a8f2ca784b3261be7e52cab18114bdcaeedd8d178e644"
Jul 24 17:36:24.635849 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.635828    2572 scope.go:117] "RemoveContainer" containerID="2b8a3a690c1cc09f6a731f132b21fad5aec71a0e60c19c8a89c1a7770eb30488"
Jul 24 17:36:24.644533 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.644513    2572 scope.go:117] "RemoveContainer" containerID="3c5e5ac984bc6bc0861a8f2ca784b3261be7e52cab18114bdcaeedd8d178e644"
Jul 24 17:36:24.644772 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:36:24.644754    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c5e5ac984bc6bc0861a8f2ca784b3261be7e52cab18114bdcaeedd8d178e644\": container with ID starting with 3c5e5ac984bc6bc0861a8f2ca784b3261be7e52cab18114bdcaeedd8d178e644 not found: ID does not exist" containerID="3c5e5ac984bc6bc0861a8f2ca784b3261be7e52cab18114bdcaeedd8d178e644"
Jul 24 17:36:24.644837 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.644780    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c5e5ac984bc6bc0861a8f2ca784b3261be7e52cab18114bdcaeedd8d178e644"} err="failed to get container status \"3c5e5ac984bc6bc0861a8f2ca784b3261be7e52cab18114bdcaeedd8d178e644\": rpc error: code = NotFound desc = could not find container \"3c5e5ac984bc6bc0861a8f2ca784b3261be7e52cab18114bdcaeedd8d178e644\": container with ID starting with 3c5e5ac984bc6bc0861a8f2ca784b3261be7e52cab18114bdcaeedd8d178e644 not found: ID does not exist"
Jul 24 17:36:24.644837 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.644795    2572 scope.go:117] "RemoveContainer" containerID="2b8a3a690c1cc09f6a731f132b21fad5aec71a0e60c19c8a89c1a7770eb30488"
Jul 24 17:36:24.645032 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:36:24.645013    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b8a3a690c1cc09f6a731f132b21fad5aec71a0e60c19c8a89c1a7770eb30488\": container with ID starting with 2b8a3a690c1cc09f6a731f132b21fad5aec71a0e60c19c8a89c1a7770eb30488 not found: ID does not exist" containerID="2b8a3a690c1cc09f6a731f132b21fad5aec71a0e60c19c8a89c1a7770eb30488"
Jul 24 17:36:24.645068 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.645039    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b8a3a690c1cc09f6a731f132b21fad5aec71a0e60c19c8a89c1a7770eb30488"} err="failed to get container status \"2b8a3a690c1cc09f6a731f132b21fad5aec71a0e60c19c8a89c1a7770eb30488\": rpc error: code = NotFound desc = could not find container \"2b8a3a690c1cc09f6a731f132b21fad5aec71a0e60c19c8a89c1a7770eb30488\": container with ID starting with 2b8a3a690c1cc09f6a731f132b21fad5aec71a0e60c19c8a89c1a7770eb30488 not found: ID does not exist"
Jul 24 17:36:24.648793 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.648771    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"]
Jul 24 17:36:24.653446 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:24.653427    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv"]
Jul 24 17:36:25.086204 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:36:25.086116    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd7abda6-5132-4470-a12d-7cd345f79fb7" path="/var/lib/kubelet/pods/fd7abda6-5132-4470-a12d-7cd345f79fb7/volumes"
Jul 24 17:38:00.955466 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:00.955375    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng"]
Jul 24 17:38:00.956045 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:00.955982    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd7abda6-5132-4470-a12d-7cd345f79fb7" containerName="istio-proxy"
Jul 24 17:38:00.956045 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:00.955997    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd7abda6-5132-4470-a12d-7cd345f79fb7" containerName="istio-proxy"
Jul 24 17:38:00.956045 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:00.956012    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0e698dd-9792-4280-83b4-10fd71290f5c" containerName="maas-api"
Jul 24 17:38:00.956045 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:00.956020    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0e698dd-9792-4280-83b4-10fd71290f5c" containerName="maas-api"
Jul 24 17:38:00.956045 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:00.956040    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd7abda6-5132-4470-a12d-7cd345f79fb7" containerName="istio-proxy"
Jul 24 17:38:00.956045 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:00.956050    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd7abda6-5132-4470-a12d-7cd345f79fb7" containerName="istio-proxy"
Jul 24 17:38:00.956398 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:00.956139    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0e698dd-9792-4280-83b4-10fd71290f5c" containerName="maas-api"
Jul 24 17:38:00.956398 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:00.956151    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd7abda6-5132-4470-a12d-7cd345f79fb7" containerName="istio-proxy"
Jul 24 17:38:00.956398 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:00.956163    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd7abda6-5132-4470-a12d-7cd345f79fb7" containerName="istio-proxy"
Jul 24 17:38:00.959784 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:00.959766    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng"
Jul 24 17:38:00.962354 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:00.962332    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-4ba182d6-serving-cert\""
Jul 24 17:38:00.969041 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:00.968094    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng"]
Jul 24 17:38:01.093703 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:01.093658    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca9b6f4a-9df0-428e-a2fd-3b53ede0533b-maas-api-tls\") pod \"maas-api-e2e-mt-4ba182d6-945cb8794-c8kng\" (UID: \"ca9b6f4a-9df0-428e-a2fd-3b53ede0533b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng"
Jul 24 17:38:01.093882 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:01.093767    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn275\" (UniqueName: \"kubernetes.io/projected/ca9b6f4a-9df0-428e-a2fd-3b53ede0533b-kube-api-access-sn275\") pod \"maas-api-e2e-mt-4ba182d6-945cb8794-c8kng\" (UID: \"ca9b6f4a-9df0-428e-a2fd-3b53ede0533b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng"
Jul 24 17:38:01.093882 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:01.093802    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca9b6f4a-9df0-428e-a2fd-3b53ede0533b-openshift-service-ca\") pod \"maas-api-e2e-mt-4ba182d6-945cb8794-c8kng\" (UID: \"ca9b6f4a-9df0-428e-a2fd-3b53ede0533b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng"
Jul 24 17:38:01.195043 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:01.195008    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca9b6f4a-9df0-428e-a2fd-3b53ede0533b-maas-api-tls\") pod \"maas-api-e2e-mt-4ba182d6-945cb8794-c8kng\" (UID: \"ca9b6f4a-9df0-428e-a2fd-3b53ede0533b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng"
Jul 24 17:38:01.195218 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:01.195067    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn275\" (UniqueName: \"kubernetes.io/projected/ca9b6f4a-9df0-428e-a2fd-3b53ede0533b-kube-api-access-sn275\") pod \"maas-api-e2e-mt-4ba182d6-945cb8794-c8kng\" (UID: \"ca9b6f4a-9df0-428e-a2fd-3b53ede0533b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng"
Jul 24 17:38:01.195218 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:38:01.195170    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-serving-cert: secret "maas-api-e2e-mt-4ba182d6-serving-cert" not found
Jul 24 17:38:01.195335 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:38:01.195255    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca9b6f4a-9df0-428e-a2fd-3b53ede0533b-maas-api-tls podName:ca9b6f4a-9df0-428e-a2fd-3b53ede0533b nodeName:}" failed. No retries permitted until 2026-07-24 17:38:01.695217013 +0000 UTC m=+2099.129432558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ca9b6f4a-9df0-428e-a2fd-3b53ede0533b-maas-api-tls") pod "maas-api-e2e-mt-4ba182d6-945cb8794-c8kng" (UID: "ca9b6f4a-9df0-428e-a2fd-3b53ede0533b") : secret "maas-api-e2e-mt-4ba182d6-serving-cert" not found
Jul 24 17:38:01.195335 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:01.195297    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca9b6f4a-9df0-428e-a2fd-3b53ede0533b-openshift-service-ca\") pod \"maas-api-e2e-mt-4ba182d6-945cb8794-c8kng\" (UID: \"ca9b6f4a-9df0-428e-a2fd-3b53ede0533b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng"
Jul 24 17:38:01.196066 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:01.196042    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca9b6f4a-9df0-428e-a2fd-3b53ede0533b-openshift-service-ca\") pod \"maas-api-e2e-mt-4ba182d6-945cb8794-c8kng\" (UID: \"ca9b6f4a-9df0-428e-a2fd-3b53ede0533b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng"
Jul 24 17:38:01.206180 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:01.206121    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn275\" (UniqueName: \"kubernetes.io/projected/ca9b6f4a-9df0-428e-a2fd-3b53ede0533b-kube-api-access-sn275\") pod \"maas-api-e2e-mt-4ba182d6-945cb8794-c8kng\" (UID: \"ca9b6f4a-9df0-428e-a2fd-3b53ede0533b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng"
Jul 24 17:38:01.700662 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:01.700625    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca9b6f4a-9df0-428e-a2fd-3b53ede0533b-maas-api-tls\") pod \"maas-api-e2e-mt-4ba182d6-945cb8794-c8kng\" (UID: \"ca9b6f4a-9df0-428e-a2fd-3b53ede0533b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng"
Jul 24 17:38:01.703208 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:01.703174    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca9b6f4a-9df0-428e-a2fd-3b53ede0533b-maas-api-tls\") pod \"maas-api-e2e-mt-4ba182d6-945cb8794-c8kng\" (UID: \"ca9b6f4a-9df0-428e-a2fd-3b53ede0533b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng"
Jul 24 17:38:01.872660 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:01.872616    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng"
Jul 24 17:38:02.018529 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:02.018504    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng"]
Jul 24 17:38:02.020163 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:38:02.020136    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca9b6f4a_9df0_428e_a2fd_3b53ede0533b.slice/crio-da152e8d8726eaad478320e087dd9bf4d05350d5749e2382b2547b6468fd80d8 WatchSource:0}: Error finding container da152e8d8726eaad478320e087dd9bf4d05350d5749e2382b2547b6468fd80d8: Status 404 returned error can't find the container with id da152e8d8726eaad478320e087dd9bf4d05350d5749e2382b2547b6468fd80d8
Jul 24 17:38:02.194596 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:02.194557    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng" event={"ID":"ca9b6f4a-9df0-428e-a2fd-3b53ede0533b","Type":"ContainerStarted","Data":"da152e8d8726eaad478320e087dd9bf4d05350d5749e2382b2547b6468fd80d8"}
Jul 24 17:38:03.202456 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:03.202413    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng" event={"ID":"ca9b6f4a-9df0-428e-a2fd-3b53ede0533b","Type":"ContainerStarted","Data":"79dd7cf0ffb33c040ced2c6744f58aa83a25ab129c1555b6261d55cdaf94e659"}
Jul 24 17:38:03.202928 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:03.202508    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng"
Jul 24 17:38:03.210982 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:03.210955    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:38:03.216460 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:03.216439    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:38:03.222063 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:03.222027    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng" podStartSLOduration=2.779259693 podStartE2EDuration="3.222011661s" totalImagesPullingTime="442.751968ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:38:03.220197389 +0000 UTC m=+2100.654412967" watchObservedRunningTime="2026-07-24 17:38:03.222011661 +0000 UTC m=+2100.656227227"
Jul 24 17:38:09.214511 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:09.214482    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng"
Jul 24 17:38:23.314773 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:23.314738    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng"]
Jul 24 17:38:23.315368 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:23.315334    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng" podUID="ca9b6f4a-9df0-428e-a2fd-3b53ede0533b" containerName="maas-api" containerID="cri-o://79dd7cf0ffb33c040ced2c6744f58aa83a25ab129c1555b6261d55cdaf94e659" gracePeriod=30
Jul 24 17:38:23.576681 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:23.576617    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng"
Jul 24 17:38:23.717106 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:23.717070    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca9b6f4a-9df0-428e-a2fd-3b53ede0533b-maas-api-tls\") pod \"ca9b6f4a-9df0-428e-a2fd-3b53ede0533b\" (UID: \"ca9b6f4a-9df0-428e-a2fd-3b53ede0533b\") "
Jul 24 17:38:23.717106 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:23.717113    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sn275\" (UniqueName: \"kubernetes.io/projected/ca9b6f4a-9df0-428e-a2fd-3b53ede0533b-kube-api-access-sn275\") pod \"ca9b6f4a-9df0-428e-a2fd-3b53ede0533b\" (UID: \"ca9b6f4a-9df0-428e-a2fd-3b53ede0533b\") "
Jul 24 17:38:23.717341 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:23.717274    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca9b6f4a-9df0-428e-a2fd-3b53ede0533b-openshift-service-ca\") pod \"ca9b6f4a-9df0-428e-a2fd-3b53ede0533b\" (UID: \"ca9b6f4a-9df0-428e-a2fd-3b53ede0533b\") "
Jul 24 17:38:23.717588 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:23.717563    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca9b6f4a-9df0-428e-a2fd-3b53ede0533b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ca9b6f4a-9df0-428e-a2fd-3b53ede0533b" (UID: "ca9b6f4a-9df0-428e-a2fd-3b53ede0533b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:38:23.717671 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:23.717649    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca9b6f4a-9df0-428e-a2fd-3b53ede0533b-openshift-service-ca\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:38:23.719278 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:23.719253    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca9b6f4a-9df0-428e-a2fd-3b53ede0533b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ca9b6f4a-9df0-428e-a2fd-3b53ede0533b" (UID: "ca9b6f4a-9df0-428e-a2fd-3b53ede0533b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:38:23.719383 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:23.719355    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca9b6f4a-9df0-428e-a2fd-3b53ede0533b-kube-api-access-sn275" (OuterVolumeSpecName: "kube-api-access-sn275") pod "ca9b6f4a-9df0-428e-a2fd-3b53ede0533b" (UID: "ca9b6f4a-9df0-428e-a2fd-3b53ede0533b"). InnerVolumeSpecName "kube-api-access-sn275". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:38:23.819000 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:23.818968    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sn275\" (UniqueName: \"kubernetes.io/projected/ca9b6f4a-9df0-428e-a2fd-3b53ede0533b-kube-api-access-sn275\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:38:23.819000 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:23.818996    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca9b6f4a-9df0-428e-a2fd-3b53ede0533b-maas-api-tls\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:38:24.320677 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:24.320639    2572 generic.go:356] "Generic (PLEG): container finished" podID="ca9b6f4a-9df0-428e-a2fd-3b53ede0533b" containerID="79dd7cf0ffb33c040ced2c6744f58aa83a25ab129c1555b6261d55cdaf94e659" exitCode=0
Jul 24 17:38:24.321150 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:24.320688    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng"
Jul 24 17:38:24.321150 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:24.320727    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng" event={"ID":"ca9b6f4a-9df0-428e-a2fd-3b53ede0533b","Type":"ContainerDied","Data":"79dd7cf0ffb33c040ced2c6744f58aa83a25ab129c1555b6261d55cdaf94e659"}
Jul 24 17:38:24.321150 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:24.320785    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng" event={"ID":"ca9b6f4a-9df0-428e-a2fd-3b53ede0533b","Type":"ContainerDied","Data":"da152e8d8726eaad478320e087dd9bf4d05350d5749e2382b2547b6468fd80d8"}
Jul 24 17:38:24.321150 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:24.320811    2572 scope.go:117] "RemoveContainer" containerID="79dd7cf0ffb33c040ced2c6744f58aa83a25ab129c1555b6261d55cdaf94e659"
Jul 24 17:38:24.330921 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:24.330900    2572 scope.go:117] "RemoveContainer" containerID="79dd7cf0ffb33c040ced2c6744f58aa83a25ab129c1555b6261d55cdaf94e659"
Jul 24 17:38:24.331173 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:38:24.331154    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79dd7cf0ffb33c040ced2c6744f58aa83a25ab129c1555b6261d55cdaf94e659\": container with ID starting with 79dd7cf0ffb33c040ced2c6744f58aa83a25ab129c1555b6261d55cdaf94e659 not found: ID does not exist" containerID="79dd7cf0ffb33c040ced2c6744f58aa83a25ab129c1555b6261d55cdaf94e659"
Jul 24 17:38:24.331296 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:24.331182    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79dd7cf0ffb33c040ced2c6744f58aa83a25ab129c1555b6261d55cdaf94e659"} err="failed to get container status \"79dd7cf0ffb33c040ced2c6744f58aa83a25ab129c1555b6261d55cdaf94e659\": rpc error: code = NotFound desc = could not find container \"79dd7cf0ffb33c040ced2c6744f58aa83a25ab129c1555b6261d55cdaf94e659\": container with ID starting with 79dd7cf0ffb33c040ced2c6744f58aa83a25ab129c1555b6261d55cdaf94e659 not found: ID does not exist"
Jul 24 17:38:24.342591 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:24.342570    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng"]
Jul 24 17:38:24.347832 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:24.347813    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4ba182d6-945cb8794-c8kng"]
Jul 24 17:38:25.085472 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:25.085441    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca9b6f4a-9df0-428e-a2fd-3b53ede0533b" path="/var/lib/kubelet/pods/ca9b6f4a-9df0-428e-a2fd-3b53ede0533b/volumes"
Jul 24 17:38:57.160630 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:57.160547    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4"]
Jul 24 17:38:57.161105 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:57.160992    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca9b6f4a-9df0-428e-a2fd-3b53ede0533b" containerName="maas-api"
Jul 24 17:38:57.161105 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:57.161004    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca9b6f4a-9df0-428e-a2fd-3b53ede0533b" containerName="maas-api"
Jul 24 17:38:57.161105 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:57.161086    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca9b6f4a-9df0-428e-a2fd-3b53ede0533b" containerName="maas-api"
Jul 24 17:38:57.164463 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:57.164444    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4"
Jul 24 17:38:57.166796 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:57.166774    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-47dfc7db-serving-cert\""
Jul 24 17:38:57.175074 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:57.175048    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4"]
Jul 24 17:38:57.342691 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:57.342656    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe0f3a6a-e7de-45a9-a117-8f38a5d67f19-maas-api-tls\") pod \"maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4\" (UID: \"fe0f3a6a-e7de-45a9-a117-8f38a5d67f19\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4"
Jul 24 17:38:57.342691 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:57.342696    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe0f3a6a-e7de-45a9-a117-8f38a5d67f19-openshift-service-ca\") pod \"maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4\" (UID: \"fe0f3a6a-e7de-45a9-a117-8f38a5d67f19\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4"
Jul 24 17:38:57.342905 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:57.342843    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqf4b\" (UniqueName: \"kubernetes.io/projected/fe0f3a6a-e7de-45a9-a117-8f38a5d67f19-kube-api-access-vqf4b\") pod \"maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4\" (UID: \"fe0f3a6a-e7de-45a9-a117-8f38a5d67f19\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4"
Jul 24 17:38:57.444193 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:57.444113    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe0f3a6a-e7de-45a9-a117-8f38a5d67f19-maas-api-tls\") pod \"maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4\" (UID: \"fe0f3a6a-e7de-45a9-a117-8f38a5d67f19\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4"
Jul 24 17:38:57.444193 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:57.444153    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe0f3a6a-e7de-45a9-a117-8f38a5d67f19-openshift-service-ca\") pod \"maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4\" (UID: \"fe0f3a6a-e7de-45a9-a117-8f38a5d67f19\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4"
Jul 24 17:38:57.444414 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:57.444261    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqf4b\" (UniqueName: \"kubernetes.io/projected/fe0f3a6a-e7de-45a9-a117-8f38a5d67f19-kube-api-access-vqf4b\") pod \"maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4\" (UID: \"fe0f3a6a-e7de-45a9-a117-8f38a5d67f19\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4"
Jul 24 17:38:57.444414 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:38:57.444337    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-serving-cert: secret "maas-api-e2e-mt-47dfc7db-serving-cert" not found
Jul 24 17:38:57.444491 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:38:57.444415    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe0f3a6a-e7de-45a9-a117-8f38a5d67f19-maas-api-tls podName:fe0f3a6a-e7de-45a9-a117-8f38a5d67f19 nodeName:}" failed. No retries permitted until 2026-07-24 17:38:57.944394432 +0000 UTC m=+2155.378609977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fe0f3a6a-e7de-45a9-a117-8f38a5d67f19-maas-api-tls") pod "maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4" (UID: "fe0f3a6a-e7de-45a9-a117-8f38a5d67f19") : secret "maas-api-e2e-mt-47dfc7db-serving-cert" not found
Jul 24 17:38:57.444907 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:57.444887    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe0f3a6a-e7de-45a9-a117-8f38a5d67f19-openshift-service-ca\") pod \"maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4\" (UID: \"fe0f3a6a-e7de-45a9-a117-8f38a5d67f19\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4"
Jul 24 17:38:57.453598 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:57.453572    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqf4b\" (UniqueName: \"kubernetes.io/projected/fe0f3a6a-e7de-45a9-a117-8f38a5d67f19-kube-api-access-vqf4b\") pod \"maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4\" (UID: \"fe0f3a6a-e7de-45a9-a117-8f38a5d67f19\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4"
Jul 24 17:38:57.950046 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:57.950006    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe0f3a6a-e7de-45a9-a117-8f38a5d67f19-maas-api-tls\") pod \"maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4\" (UID: \"fe0f3a6a-e7de-45a9-a117-8f38a5d67f19\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4"
Jul 24 17:38:57.952761 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:57.952725    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe0f3a6a-e7de-45a9-a117-8f38a5d67f19-maas-api-tls\") pod \"maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4\" (UID: \"fe0f3a6a-e7de-45a9-a117-8f38a5d67f19\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4"
Jul 24 17:38:58.076631 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:58.076598    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4"
Jul 24 17:38:58.218998 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:58.218967    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4"]
Jul 24 17:38:58.219368 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:38:58.219027    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe0f3a6a_e7de_45a9_a117_8f38a5d67f19.slice/crio-b9886457fe9c1410af7d3506fc63a44a247089bd719dd3abad9b09f72740bbc5 WatchSource:0}: Error finding container b9886457fe9c1410af7d3506fc63a44a247089bd719dd3abad9b09f72740bbc5: Status 404 returned error can't find the container with id b9886457fe9c1410af7d3506fc63a44a247089bd719dd3abad9b09f72740bbc5
Jul 24 17:38:58.220385 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:58.220367    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:38:58.531999 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:58.531970    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4" event={"ID":"fe0f3a6a-e7de-45a9-a117-8f38a5d67f19","Type":"ContainerStarted","Data":"b9886457fe9c1410af7d3506fc63a44a247089bd719dd3abad9b09f72740bbc5"}
Jul 24 17:38:59.540722 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:59.540679    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4" event={"ID":"fe0f3a6a-e7de-45a9-a117-8f38a5d67f19","Type":"ContainerStarted","Data":"193104261d65761ac2d882f127f4f782c773e6418393e763ff4206c1a18467c1"}
Jul 24 17:38:59.541119 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:59.540829    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4"
Jul 24 17:38:59.557062 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:38:59.557005    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4" podStartSLOduration=2.265947613 podStartE2EDuration="2.556990195s" totalImagesPullingTime="291.042582ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:38:59.555526353 +0000 UTC m=+2156.989741932" watchObservedRunningTime="2026-07-24 17:38:59.556990195 +0000 UTC m=+2156.991205762"
Jul 24 17:39:05.552430 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:39:05.552399    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4"
Jul 24 17:40:32.614328 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:40:32.614223    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4"]
Jul 24 17:40:32.614894 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:40:32.614505    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4" podUID="fe0f3a6a-e7de-45a9-a117-8f38a5d67f19" containerName="maas-api" containerID="cri-o://193104261d65761ac2d882f127f4f782c773e6418393e763ff4206c1a18467c1" gracePeriod=30
Jul 24 17:40:32.870802 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:40:32.870736    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4"
Jul 24 17:40:33.008924 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:40:33.008889    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe0f3a6a-e7de-45a9-a117-8f38a5d67f19-openshift-service-ca\") pod \"fe0f3a6a-e7de-45a9-a117-8f38a5d67f19\" (UID: \"fe0f3a6a-e7de-45a9-a117-8f38a5d67f19\") "
Jul 24 17:40:33.009132 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:40:33.008965    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqf4b\" (UniqueName: \"kubernetes.io/projected/fe0f3a6a-e7de-45a9-a117-8f38a5d67f19-kube-api-access-vqf4b\") pod \"fe0f3a6a-e7de-45a9-a117-8f38a5d67f19\" (UID: \"fe0f3a6a-e7de-45a9-a117-8f38a5d67f19\") "
Jul 24 17:40:33.009132 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:40:33.009039    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe0f3a6a-e7de-45a9-a117-8f38a5d67f19-maas-api-tls\") pod \"fe0f3a6a-e7de-45a9-a117-8f38a5d67f19\" (UID: \"fe0f3a6a-e7de-45a9-a117-8f38a5d67f19\") "
Jul 24 17:40:33.009320 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:40:33.009295    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe0f3a6a-e7de-45a9-a117-8f38a5d67f19-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fe0f3a6a-e7de-45a9-a117-8f38a5d67f19" (UID: "fe0f3a6a-e7de-45a9-a117-8f38a5d67f19"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:40:33.009412 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:40:33.009396    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe0f3a6a-e7de-45a9-a117-8f38a5d67f19-openshift-service-ca\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:40:33.011207 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:40:33.011176    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe0f3a6a-e7de-45a9-a117-8f38a5d67f19-kube-api-access-vqf4b" (OuterVolumeSpecName: "kube-api-access-vqf4b") pod "fe0f3a6a-e7de-45a9-a117-8f38a5d67f19" (UID: "fe0f3a6a-e7de-45a9-a117-8f38a5d67f19"). InnerVolumeSpecName "kube-api-access-vqf4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:40:33.011358 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:40:33.011207    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe0f3a6a-e7de-45a9-a117-8f38a5d67f19-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fe0f3a6a-e7de-45a9-a117-8f38a5d67f19" (UID: "fe0f3a6a-e7de-45a9-a117-8f38a5d67f19"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:40:33.086109 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:40:33.086077    2572 generic.go:356] "Generic (PLEG): container finished" podID="fe0f3a6a-e7de-45a9-a117-8f38a5d67f19" containerID="193104261d65761ac2d882f127f4f782c773e6418393e763ff4206c1a18467c1" exitCode=0
Jul 24 17:40:33.086304 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:40:33.086114    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4"
Jul 24 17:40:33.086304 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:40:33.086162    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4" event={"ID":"fe0f3a6a-e7de-45a9-a117-8f38a5d67f19","Type":"ContainerDied","Data":"193104261d65761ac2d882f127f4f782c773e6418393e763ff4206c1a18467c1"}
Jul 24 17:40:33.086304 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:40:33.086214    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4" event={"ID":"fe0f3a6a-e7de-45a9-a117-8f38a5d67f19","Type":"ContainerDied","Data":"b9886457fe9c1410af7d3506fc63a44a247089bd719dd3abad9b09f72740bbc5"}
Jul 24 17:40:33.086304 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:40:33.086251    2572 scope.go:117] "RemoveContainer" containerID="193104261d65761ac2d882f127f4f782c773e6418393e763ff4206c1a18467c1"
Jul 24 17:40:33.098386 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:40:33.098363    2572 scope.go:117] "RemoveContainer" containerID="193104261d65761ac2d882f127f4f782c773e6418393e763ff4206c1a18467c1"
Jul 24 17:40:33.098916 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:40:33.098894    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"193104261d65761ac2d882f127f4f782c773e6418393e763ff4206c1a18467c1\": container with ID starting with 193104261d65761ac2d882f127f4f782c773e6418393e763ff4206c1a18467c1 not found: ID does not exist" containerID="193104261d65761ac2d882f127f4f782c773e6418393e763ff4206c1a18467c1"
Jul 24 17:40:33.099009 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:40:33.098930    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"193104261d65761ac2d882f127f4f782c773e6418393e763ff4206c1a18467c1"} err="failed to get container status \"193104261d65761ac2d882f127f4f782c773e6418393e763ff4206c1a18467c1\": rpc error: code = NotFound desc = could not find container \"193104261d65761ac2d882f127f4f782c773e6418393e763ff4206c1a18467c1\": container with ID starting with 193104261d65761ac2d882f127f4f782c773e6418393e763ff4206c1a18467c1 not found: ID does not exist"
Jul 24 17:40:33.110649 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:40:33.110623    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe0f3a6a-e7de-45a9-a117-8f38a5d67f19-maas-api-tls\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:40:33.110649 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:40:33.110650    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqf4b\" (UniqueName: \"kubernetes.io/projected/fe0f3a6a-e7de-45a9-a117-8f38a5d67f19-kube-api-access-vqf4b\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:40:33.116360 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:40:33.116335    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4"]
Jul 24 17:40:33.123250 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:40:33.123173    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-47dfc7db-657c54ff5c-j9kb4"]
Jul 24 17:40:35.086319 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:40:35.086282    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe0f3a6a-e7de-45a9-a117-8f38a5d67f19" path="/var/lib/kubelet/pods/fe0f3a6a-e7de-45a9-a117-8f38a5d67f19/volumes"
Jul 24 17:42:42.412485 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:42.412451    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg"]
Jul 24 17:42:42.412953 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:42.412873    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe0f3a6a-e7de-45a9-a117-8f38a5d67f19" containerName="maas-api"
Jul 24 17:42:42.412953 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:42.412887    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe0f3a6a-e7de-45a9-a117-8f38a5d67f19" containerName="maas-api"
Jul 24 17:42:42.413028 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:42.412981    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe0f3a6a-e7de-45a9-a117-8f38a5d67f19" containerName="maas-api"
Jul 24 17:42:42.416157 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:42.416141    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg"
Jul 24 17:42:42.419376 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:42.419354    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-5e8b71-serving-cert\""
Jul 24 17:42:42.435381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:42.435360    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg"]
Jul 24 17:42:42.499824 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:42.499794    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2brl\" (UniqueName: \"kubernetes.io/projected/3af5d5f8-5d1f-4623-ab20-c3794b720484-kube-api-access-w2brl\") pod \"maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg\" (UID: \"3af5d5f8-5d1f-4623-ab20-c3794b720484\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg"
Jul 24 17:42:42.499984 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:42.499848    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3af5d5f8-5d1f-4623-ab20-c3794b720484-maas-api-tls\") pod \"maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg\" (UID: \"3af5d5f8-5d1f-4623-ab20-c3794b720484\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg"
Jul 24 17:42:42.499984 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:42.499940    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3af5d5f8-5d1f-4623-ab20-c3794b720484-openshift-service-ca\") pod \"maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg\" (UID: \"3af5d5f8-5d1f-4623-ab20-c3794b720484\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg"
Jul 24 17:42:42.601141 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:42.601088    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2brl\" (UniqueName: \"kubernetes.io/projected/3af5d5f8-5d1f-4623-ab20-c3794b720484-kube-api-access-w2brl\") pod \"maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg\" (UID: \"3af5d5f8-5d1f-4623-ab20-c3794b720484\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg"
Jul 24 17:42:42.601375 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:42.601179    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3af5d5f8-5d1f-4623-ab20-c3794b720484-maas-api-tls\") pod \"maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg\" (UID: \"3af5d5f8-5d1f-4623-ab20-c3794b720484\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg"
Jul 24 17:42:42.601375 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:42.601304    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3af5d5f8-5d1f-4623-ab20-c3794b720484-openshift-service-ca\") pod \"maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg\" (UID: \"3af5d5f8-5d1f-4623-ab20-c3794b720484\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg"
Jul 24 17:42:42.602096 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:42.602028    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3af5d5f8-5d1f-4623-ab20-c3794b720484-openshift-service-ca\") pod \"maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg\" (UID: \"3af5d5f8-5d1f-4623-ab20-c3794b720484\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg"
Jul 24 17:42:42.603928 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:42.603905    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3af5d5f8-5d1f-4623-ab20-c3794b720484-maas-api-tls\") pod \"maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg\" (UID: \"3af5d5f8-5d1f-4623-ab20-c3794b720484\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg"
Jul 24 17:42:42.613461 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:42.613441    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2brl\" (UniqueName: \"kubernetes.io/projected/3af5d5f8-5d1f-4623-ab20-c3794b720484-kube-api-access-w2brl\") pod \"maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg\" (UID: \"3af5d5f8-5d1f-4623-ab20-c3794b720484\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg"
Jul 24 17:42:42.727166 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:42.727074    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg"
Jul 24 17:42:43.084435 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:42:43.084404    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3af5d5f8_5d1f_4623_ab20_c3794b720484.slice/crio-7f54e2be231d29349e56afdd4764e6745d1a8b40de9d7c93c6f41c9f32b0d7da WatchSource:0}: Error finding container 7f54e2be231d29349e56afdd4764e6745d1a8b40de9d7c93c6f41c9f32b0d7da: Status 404 returned error can't find the container with id 7f54e2be231d29349e56afdd4764e6745d1a8b40de9d7c93c6f41c9f32b0d7da
Jul 24 17:42:43.087581 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:43.087556    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg"]
Jul 24 17:42:43.827671 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:43.827567    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg" event={"ID":"3af5d5f8-5d1f-4623-ab20-c3794b720484","Type":"ContainerStarted","Data":"ca90c490443abdb4c54ca25658ca6ed3e0e9a753e9ea0200dee61234007298d2"}
Jul 24 17:42:43.827671 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:43.827663    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg" event={"ID":"3af5d5f8-5d1f-4623-ab20-c3794b720484","Type":"ContainerStarted","Data":"7f54e2be231d29349e56afdd4764e6745d1a8b40de9d7c93c6f41c9f32b0d7da"}
Jul 24 17:42:43.828100 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:43.827689    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg"
Jul 24 17:42:43.843250 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:43.843185    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg" podStartSLOduration=1.4650513840000001 podStartE2EDuration="1.843169289s" totalImagesPullingTime="378.117905ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:42:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:42:43.842843416 +0000 UTC m=+2381.277058983" watchObservedRunningTime="2026-07-24 17:42:43.843169289 +0000 UTC m=+2381.277384855"
Jul 24 17:42:49.839078 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:49.839049    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg"
Jul 24 17:42:50.307929 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:50.307892    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8"]
Jul 24 17:42:50.312071 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:50.312048    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8"
Jul 24 17:42:50.315045 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:50.315019    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-368755-serving-cert\""
Jul 24 17:42:50.341650 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:50.341620    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8"]
Jul 24 17:42:50.379057 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:50.379027    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba59b00b-90fc-418f-8b39-b1004b9ee0f1-maas-api-tls\") pod \"maas-api-e2e-inf-b-368755-648dccc89f-wlcj8\" (UID: \"ba59b00b-90fc-418f-8b39-b1004b9ee0f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8"
Jul 24 17:42:50.379057 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:50.379061    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba59b00b-90fc-418f-8b39-b1004b9ee0f1-openshift-service-ca\") pod \"maas-api-e2e-inf-b-368755-648dccc89f-wlcj8\" (UID: \"ba59b00b-90fc-418f-8b39-b1004b9ee0f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8"
Jul 24 17:42:50.379350 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:50.379163    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxzq6\" (UniqueName: \"kubernetes.io/projected/ba59b00b-90fc-418f-8b39-b1004b9ee0f1-kube-api-access-lxzq6\") pod \"maas-api-e2e-inf-b-368755-648dccc89f-wlcj8\" (UID: \"ba59b00b-90fc-418f-8b39-b1004b9ee0f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8"
Jul 24 17:42:50.480704 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:50.480664    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba59b00b-90fc-418f-8b39-b1004b9ee0f1-maas-api-tls\") pod \"maas-api-e2e-inf-b-368755-648dccc89f-wlcj8\" (UID: \"ba59b00b-90fc-418f-8b39-b1004b9ee0f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8"
Jul 24 17:42:50.480704 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:50.480704    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba59b00b-90fc-418f-8b39-b1004b9ee0f1-openshift-service-ca\") pod \"maas-api-e2e-inf-b-368755-648dccc89f-wlcj8\" (UID: \"ba59b00b-90fc-418f-8b39-b1004b9ee0f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8"
Jul 24 17:42:50.480922 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:50.480767    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxzq6\" (UniqueName: \"kubernetes.io/projected/ba59b00b-90fc-418f-8b39-b1004b9ee0f1-kube-api-access-lxzq6\") pod \"maas-api-e2e-inf-b-368755-648dccc89f-wlcj8\" (UID: \"ba59b00b-90fc-418f-8b39-b1004b9ee0f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8"
Jul 24 17:42:50.480922 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:42:50.480831    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-serving-cert: secret "maas-api-e2e-inf-b-368755-serving-cert" not found
Jul 24 17:42:50.480991 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:42:50.480944    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba59b00b-90fc-418f-8b39-b1004b9ee0f1-maas-api-tls podName:ba59b00b-90fc-418f-8b39-b1004b9ee0f1 nodeName:}" failed. No retries permitted until 2026-07-24 17:42:50.980923587 +0000 UTC m=+2388.415139148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ba59b00b-90fc-418f-8b39-b1004b9ee0f1-maas-api-tls") pod "maas-api-e2e-inf-b-368755-648dccc89f-wlcj8" (UID: "ba59b00b-90fc-418f-8b39-b1004b9ee0f1") : secret "maas-api-e2e-inf-b-368755-serving-cert" not found
Jul 24 17:42:50.481435 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:50.481416    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba59b00b-90fc-418f-8b39-b1004b9ee0f1-openshift-service-ca\") pod \"maas-api-e2e-inf-b-368755-648dccc89f-wlcj8\" (UID: \"ba59b00b-90fc-418f-8b39-b1004b9ee0f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8"
Jul 24 17:42:50.490937 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:50.490898    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxzq6\" (UniqueName: \"kubernetes.io/projected/ba59b00b-90fc-418f-8b39-b1004b9ee0f1-kube-api-access-lxzq6\") pod \"maas-api-e2e-inf-b-368755-648dccc89f-wlcj8\" (UID: \"ba59b00b-90fc-418f-8b39-b1004b9ee0f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8"
Jul 24 17:42:50.985908 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:50.985871    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba59b00b-90fc-418f-8b39-b1004b9ee0f1-maas-api-tls\") pod \"maas-api-e2e-inf-b-368755-648dccc89f-wlcj8\" (UID: \"ba59b00b-90fc-418f-8b39-b1004b9ee0f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8"
Jul 24 17:42:50.988922 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:50.988889    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba59b00b-90fc-418f-8b39-b1004b9ee0f1-maas-api-tls\") pod \"maas-api-e2e-inf-b-368755-648dccc89f-wlcj8\" (UID: \"ba59b00b-90fc-418f-8b39-b1004b9ee0f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8"
Jul 24 17:42:51.222825 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:51.222790    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8"
Jul 24 17:42:51.370442 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:51.370414    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8"]
Jul 24 17:42:51.371938 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:42:51.371911    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba59b00b_90fc_418f_8b39_b1004b9ee0f1.slice/crio-b0aeb639d049736e5745be18e8d7b0fd8beb41981a239024859bbbe72a863e0b WatchSource:0}: Error finding container b0aeb639d049736e5745be18e8d7b0fd8beb41981a239024859bbbe72a863e0b: Status 404 returned error can't find the container with id b0aeb639d049736e5745be18e8d7b0fd8beb41981a239024859bbbe72a863e0b
Jul 24 17:42:51.877133 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:51.877079    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8" event={"ID":"ba59b00b-90fc-418f-8b39-b1004b9ee0f1","Type":"ContainerStarted","Data":"b0aeb639d049736e5745be18e8d7b0fd8beb41981a239024859bbbe72a863e0b"}
Jul 24 17:42:52.884953 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:52.884913    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8" event={"ID":"ba59b00b-90fc-418f-8b39-b1004b9ee0f1","Type":"ContainerStarted","Data":"c2f265ffc79bae1c6f1a917c6022deaa078c14f5985e9b5e1247fd0b225e97ec"}
Jul 24 17:42:52.885384 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:52.885043    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8"
Jul 24 17:42:52.905391 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:52.905316    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8" podStartSLOduration=2.370859549 podStartE2EDuration="2.905295406s" totalImagesPullingTime="534.435857ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:42:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:42:52.901701307 +0000 UTC m=+2390.335916875" watchObservedRunningTime="2026-07-24 17:42:52.905295406 +0000 UTC m=+2390.339510970"
Jul 24 17:42:58.898105 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:42:58.898072    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8"
Jul 24 17:43:03.254414 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:43:03.254380    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:43:03.262873 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:43:03.262846    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:44:21.204191 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:21.204153    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8b71-d4msg"]
Jul 24 17:44:21.207339 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:21.207323    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8b71-d4msg"
Jul 24 17:44:21.209826 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:21.209804    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8llqd\""
Jul 24 17:44:21.217209 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:21.217186    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8b71-d4msg"]
Jul 24 17:44:21.321621 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:21.321590    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6c06cdf-8512-42a8-ac67-76f6e0c7d8b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5e8b71-d4msg\" (UID: \"b6c06cdf-8512-42a8-ac67-76f6e0c7d8b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8b71-d4msg"
Jul 24 17:44:21.422402 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:21.422373    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6c06cdf-8512-42a8-ac67-76f6e0c7d8b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5e8b71-d4msg\" (UID: \"b6c06cdf-8512-42a8-ac67-76f6e0c7d8b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8b71-d4msg"
Jul 24 17:44:21.422987 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:21.422967    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6c06cdf-8512-42a8-ac67-76f6e0c7d8b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5e8b71-d4msg\" (UID: \"b6c06cdf-8512-42a8-ac67-76f6e0c7d8b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8b71-d4msg"
Jul 24 17:44:21.519727 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:21.519638    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8b71-d4msg"
Jul 24 17:44:21.662810 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:21.662782    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8b71-d4msg"]
Jul 24 17:44:21.664993 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:44:21.664965    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6c06cdf_8512_42a8_ac67_76f6e0c7d8b2.slice/crio-2d74258a8349f22756d9ec8847ad8c4df095ad998facca1b5656315661405d23 WatchSource:0}: Error finding container 2d74258a8349f22756d9ec8847ad8c4df095ad998facca1b5656315661405d23: Status 404 returned error can't find the container with id 2d74258a8349f22756d9ec8847ad8c4df095ad998facca1b5656315661405d23
Jul 24 17:44:21.666927 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:21.666908    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:44:22.429896 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:22.429859    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8b71-d4msg" event={"ID":"b6c06cdf-8512-42a8-ac67-76f6e0c7d8b2","Type":"ContainerStarted","Data":"2d74258a8349f22756d9ec8847ad8c4df095ad998facca1b5656315661405d23"}
Jul 24 17:44:24.444008 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:24.443967    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8b71-d4msg" event={"ID":"b6c06cdf-8512-42a8-ac67-76f6e0c7d8b2","Type":"ContainerStarted","Data":"d2ab61b2483cb9694989833a3cd50ddfc659152c5ece8044f6b06de42ee78ffe"}
Jul 24 17:44:24.460667 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:24.460622    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8b71-d4msg" podStartSLOduration=1.292877361 podStartE2EDuration="3.460606972s" totalImagesPullingTime="2.167729611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:44:24.459419083 +0000 UTC m=+2481.893634649" watchObservedRunningTime="2026-07-24 17:44:24.460606972 +0000 UTC m=+2481.894822543"
Jul 24 17:44:25.451987 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:25.451950    2572 generic.go:356] "Generic (PLEG): container finished" podID="b6c06cdf-8512-42a8-ac67-76f6e0c7d8b2" containerID="d2ab61b2483cb9694989833a3cd50ddfc659152c5ece8044f6b06de42ee78ffe" exitCode=0
Jul 24 17:44:25.452462 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:25.452035    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8b71-d4msg" event={"ID":"b6c06cdf-8512-42a8-ac67-76f6e0c7d8b2","Type":"ContainerDied","Data":"d2ab61b2483cb9694989833a3cd50ddfc659152c5ece8044f6b06de42ee78ffe"}
Jul 24 17:44:26.602433 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:26.602406    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8b71-d4msg"
Jul 24 17:44:26.670991 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:26.670959    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6c06cdf-8512-42a8-ac67-76f6e0c7d8b2-maas-api-service-ca\") pod \"b6c06cdf-8512-42a8-ac67-76f6e0c7d8b2\" (UID: \"b6c06cdf-8512-42a8-ac67-76f6e0c7d8b2\") "
Jul 24 17:44:26.671319 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:26.671297    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6c06cdf-8512-42a8-ac67-76f6e0c7d8b2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b6c06cdf-8512-42a8-ac67-76f6e0c7d8b2" (UID: "b6c06cdf-8512-42a8-ac67-76f6e0c7d8b2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:44:26.771954 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:26.771863    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6c06cdf-8512-42a8-ac67-76f6e0c7d8b2-maas-api-service-ca\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:44:27.464097 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:27.464072    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8b71-d4msg"
Jul 24 17:44:27.464293 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:27.464105    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8b71-d4msg" event={"ID":"b6c06cdf-8512-42a8-ac67-76f6e0c7d8b2","Type":"ContainerDied","Data":"2d74258a8349f22756d9ec8847ad8c4df095ad998facca1b5656315661405d23"}
Jul 24 17:44:27.464293 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:27.464155    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d74258a8349f22756d9ec8847ad8c4df095ad998facca1b5656315661405d23"
Jul 24 17:44:31.826760 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:31.826722    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg"]
Jul 24 17:44:31.827193 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:31.827007    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg" podUID="3af5d5f8-5d1f-4623-ab20-c3794b720484" containerName="maas-api" containerID="cri-o://ca90c490443abdb4c54ca25658ca6ed3e0e9a753e9ea0200dee61234007298d2" gracePeriod=30
Jul 24 17:44:32.282903 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:32.282879    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg"
Jul 24 17:44:32.428010 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:32.427969    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2brl\" (UniqueName: \"kubernetes.io/projected/3af5d5f8-5d1f-4623-ab20-c3794b720484-kube-api-access-w2brl\") pod \"3af5d5f8-5d1f-4623-ab20-c3794b720484\" (UID: \"3af5d5f8-5d1f-4623-ab20-c3794b720484\") "
Jul 24 17:44:32.428010 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:32.428019    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3af5d5f8-5d1f-4623-ab20-c3794b720484-maas-api-tls\") pod \"3af5d5f8-5d1f-4623-ab20-c3794b720484\" (UID: \"3af5d5f8-5d1f-4623-ab20-c3794b720484\") "
Jul 24 17:44:32.428269 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:32.428072    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3af5d5f8-5d1f-4623-ab20-c3794b720484-openshift-service-ca\") pod \"3af5d5f8-5d1f-4623-ab20-c3794b720484\" (UID: \"3af5d5f8-5d1f-4623-ab20-c3794b720484\") "
Jul 24 17:44:32.428505 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:32.428482    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3af5d5f8-5d1f-4623-ab20-c3794b720484-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3af5d5f8-5d1f-4623-ab20-c3794b720484" (UID: "3af5d5f8-5d1f-4623-ab20-c3794b720484"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:44:32.430393 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:32.430369    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3af5d5f8-5d1f-4623-ab20-c3794b720484-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3af5d5f8-5d1f-4623-ab20-c3794b720484" (UID: "3af5d5f8-5d1f-4623-ab20-c3794b720484"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:44:32.430494 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:32.430478    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3af5d5f8-5d1f-4623-ab20-c3794b720484-kube-api-access-w2brl" (OuterVolumeSpecName: "kube-api-access-w2brl") pod "3af5d5f8-5d1f-4623-ab20-c3794b720484" (UID: "3af5d5f8-5d1f-4623-ab20-c3794b720484"). InnerVolumeSpecName "kube-api-access-w2brl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:44:32.502248 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:32.502201    2572 generic.go:356] "Generic (PLEG): container finished" podID="3af5d5f8-5d1f-4623-ab20-c3794b720484" containerID="ca90c490443abdb4c54ca25658ca6ed3e0e9a753e9ea0200dee61234007298d2" exitCode=0
Jul 24 17:44:32.502389 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:32.502271    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg"
Jul 24 17:44:32.502389 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:32.502272    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg" event={"ID":"3af5d5f8-5d1f-4623-ab20-c3794b720484","Type":"ContainerDied","Data":"ca90c490443abdb4c54ca25658ca6ed3e0e9a753e9ea0200dee61234007298d2"}
Jul 24 17:44:32.502389 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:32.502337    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg" event={"ID":"3af5d5f8-5d1f-4623-ab20-c3794b720484","Type":"ContainerDied","Data":"7f54e2be231d29349e56afdd4764e6745d1a8b40de9d7c93c6f41c9f32b0d7da"}
Jul 24 17:44:32.502389 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:32.502367    2572 scope.go:117] "RemoveContainer" containerID="ca90c490443abdb4c54ca25658ca6ed3e0e9a753e9ea0200dee61234007298d2"
Jul 24 17:44:32.513277 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:32.513257    2572 scope.go:117] "RemoveContainer" containerID="ca90c490443abdb4c54ca25658ca6ed3e0e9a753e9ea0200dee61234007298d2"
Jul 24 17:44:32.513529 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:44:32.513510    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca90c490443abdb4c54ca25658ca6ed3e0e9a753e9ea0200dee61234007298d2\": container with ID starting with ca90c490443abdb4c54ca25658ca6ed3e0e9a753e9ea0200dee61234007298d2 not found: ID does not exist" containerID="ca90c490443abdb4c54ca25658ca6ed3e0e9a753e9ea0200dee61234007298d2"
Jul 24 17:44:32.513591 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:32.513540    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca90c490443abdb4c54ca25658ca6ed3e0e9a753e9ea0200dee61234007298d2"} err="failed to get container status \"ca90c490443abdb4c54ca25658ca6ed3e0e9a753e9ea0200dee61234007298d2\": rpc error: code = NotFound desc = could not find container \"ca90c490443abdb4c54ca25658ca6ed3e0e9a753e9ea0200dee61234007298d2\": container with ID starting with ca90c490443abdb4c54ca25658ca6ed3e0e9a753e9ea0200dee61234007298d2 not found: ID does not exist"
Jul 24 17:44:32.525795 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:32.525768    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg"]
Jul 24 17:44:32.529382 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:32.529361    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3af5d5f8-5d1f-4623-ab20-c3794b720484-openshift-service-ca\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:44:32.529382 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:32.529382    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2brl\" (UniqueName: \"kubernetes.io/projected/3af5d5f8-5d1f-4623-ab20-c3794b720484-kube-api-access-w2brl\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:44:32.529527 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:32.529393    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3af5d5f8-5d1f-4623-ab20-c3794b720484-maas-api-tls\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:44:32.529970 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:32.529948    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5e8b71-6699dbcf86-84tsg"]
Jul 24 17:44:33.085841 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:33.085812    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3af5d5f8-5d1f-4623-ab20-c3794b720484" path="/var/lib/kubelet/pods/3af5d5f8-5d1f-4623-ab20-c3794b720484/volumes"
Jul 24 17:44:36.301596 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:36.301538    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8b71-d4msg"]
Jul 24 17:44:36.303988 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:36.303962    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8b71-d4msg"]
Jul 24 17:44:37.086214 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:37.086178    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6c06cdf-8512-42a8-ac67-76f6e0c7d8b2" path="/var/lib/kubelet/pods/b6c06cdf-8512-42a8-ac67-76f6e0c7d8b2/volumes"
Jul 24 17:44:43.417331 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:43.417291    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-368755-dsx4s"]
Jul 24 17:44:43.417939 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:43.417920    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3af5d5f8-5d1f-4623-ab20-c3794b720484" containerName="maas-api"
Jul 24 17:44:43.418020 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:43.417940    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3af5d5f8-5d1f-4623-ab20-c3794b720484" containerName="maas-api"
Jul 24 17:44:43.418020 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:43.417963    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6c06cdf-8512-42a8-ac67-76f6e0c7d8b2" containerName="revoke-keys"
Jul 24 17:44:43.418020 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:43.417971    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6c06cdf-8512-42a8-ac67-76f6e0c7d8b2" containerName="revoke-keys"
Jul 24 17:44:43.418167 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:43.418091    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6c06cdf-8512-42a8-ac67-76f6e0c7d8b2" containerName="revoke-keys"
Jul 24 17:44:43.418167 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:43.418109    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3af5d5f8-5d1f-4623-ab20-c3794b720484" containerName="maas-api"
Jul 24 17:44:43.424280 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:43.424259    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-368755-dsx4s"
Jul 24 17:44:43.427432 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:43.427408    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8llqd\""
Jul 24 17:44:43.429359 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:43.429334    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-368755-dsx4s"]
Jul 24 17:44:43.535432 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:43.535395    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba9fc75c-8e26-4c77-b9f0-43f3e239d634-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-368755-dsx4s\" (UID: \"ba9fc75c-8e26-4c77-b9f0-43f3e239d634\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-368755-dsx4s"
Jul 24 17:44:43.636811 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:43.636777    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba9fc75c-8e26-4c77-b9f0-43f3e239d634-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-368755-dsx4s\" (UID: \"ba9fc75c-8e26-4c77-b9f0-43f3e239d634\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-368755-dsx4s"
Jul 24 17:44:43.637430 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:43.637411    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba9fc75c-8e26-4c77-b9f0-43f3e239d634-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-368755-dsx4s\" (UID: \"ba9fc75c-8e26-4c77-b9f0-43f3e239d634\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-368755-dsx4s"
Jul 24 17:44:43.738092 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:43.738013    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-368755-dsx4s"
Jul 24 17:44:43.896217 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:43.896189    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-368755-dsx4s"]
Jul 24 17:44:43.897109 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:44:43.897053    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba9fc75c_8e26_4c77_b9f0_43f3e239d634.slice/crio-86f29a00d30e8d153ef7b58f76e5f4fa86efa9c6b9744abce334a769357e1a44 WatchSource:0}: Error finding container 86f29a00d30e8d153ef7b58f76e5f4fa86efa9c6b9744abce334a769357e1a44: Status 404 returned error can't find the container with id 86f29a00d30e8d153ef7b58f76e5f4fa86efa9c6b9744abce334a769357e1a44
Jul 24 17:44:44.574247 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:44.574192    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-368755-dsx4s" event={"ID":"ba9fc75c-8e26-4c77-b9f0-43f3e239d634","Type":"ContainerStarted","Data":"dafcee7ceb4087f3ee1f8b0c0fab00a3eaf80fb0b8edc0eae3d0e7200dc2c121"}
Jul 24 17:44:44.574684 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:44.574288    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-368755-dsx4s" event={"ID":"ba9fc75c-8e26-4c77-b9f0-43f3e239d634","Type":"ContainerStarted","Data":"86f29a00d30e8d153ef7b58f76e5f4fa86efa9c6b9744abce334a769357e1a44"}
Jul 24 17:44:44.611711 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:44.611661    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-368755-dsx4s" podStartSLOduration=1.6116444300000001 podStartE2EDuration="1.61164443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:44:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:44:44.610299571 +0000 UTC m=+2502.044515140" watchObservedRunningTime="2026-07-24 17:44:44.61164443 +0000 UTC m=+2502.045860015"
Jul 24 17:44:45.581720 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:45.581686    2572 generic.go:356] "Generic (PLEG): container finished" podID="ba9fc75c-8e26-4c77-b9f0-43f3e239d634" containerID="dafcee7ceb4087f3ee1f8b0c0fab00a3eaf80fb0b8edc0eae3d0e7200dc2c121" exitCode=0
Jul 24 17:44:45.582111 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:45.581769    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-368755-dsx4s" event={"ID":"ba9fc75c-8e26-4c77-b9f0-43f3e239d634","Type":"ContainerDied","Data":"dafcee7ceb4087f3ee1f8b0c0fab00a3eaf80fb0b8edc0eae3d0e7200dc2c121"}
Jul 24 17:44:46.728247 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:46.728212    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-368755-dsx4s"
Jul 24 17:44:46.766160 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:46.766123    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba9fc75c-8e26-4c77-b9f0-43f3e239d634-maas-api-service-ca\") pod \"ba9fc75c-8e26-4c77-b9f0-43f3e239d634\" (UID: \"ba9fc75c-8e26-4c77-b9f0-43f3e239d634\") "
Jul 24 17:44:46.766589 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:46.766561    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba9fc75c-8e26-4c77-b9f0-43f3e239d634-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ba9fc75c-8e26-4c77-b9f0-43f3e239d634" (UID: "ba9fc75c-8e26-4c77-b9f0-43f3e239d634"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:44:46.867800 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:46.867758    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba9fc75c-8e26-4c77-b9f0-43f3e239d634-maas-api-service-ca\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:44:47.594415 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:47.594383    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-368755-dsx4s"
Jul 24 17:44:47.594597 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:47.594410    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-368755-dsx4s" event={"ID":"ba9fc75c-8e26-4c77-b9f0-43f3e239d634","Type":"ContainerDied","Data":"86f29a00d30e8d153ef7b58f76e5f4fa86efa9c6b9744abce334a769357e1a44"}
Jul 24 17:44:47.594597 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:47.594467    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86f29a00d30e8d153ef7b58f76e5f4fa86efa9c6b9744abce334a769357e1a44"
Jul 24 17:44:53.985372 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:53.985270    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8"]
Jul 24 17:44:53.985929 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:53.985720    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8" podUID="ba59b00b-90fc-418f-8b39-b1004b9ee0f1" containerName="maas-api" containerID="cri-o://c2f265ffc79bae1c6f1a917c6022deaa078c14f5985e9b5e1247fd0b225e97ec" gracePeriod=30
Jul 24 17:44:54.257843 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:54.257819    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8"
Jul 24 17:44:54.339101 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:54.339070    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxzq6\" (UniqueName: \"kubernetes.io/projected/ba59b00b-90fc-418f-8b39-b1004b9ee0f1-kube-api-access-lxzq6\") pod \"ba59b00b-90fc-418f-8b39-b1004b9ee0f1\" (UID: \"ba59b00b-90fc-418f-8b39-b1004b9ee0f1\") "
Jul 24 17:44:54.339303 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:54.339173    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba59b00b-90fc-418f-8b39-b1004b9ee0f1-openshift-service-ca\") pod \"ba59b00b-90fc-418f-8b39-b1004b9ee0f1\" (UID: \"ba59b00b-90fc-418f-8b39-b1004b9ee0f1\") "
Jul 24 17:44:54.339303 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:54.339203    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba59b00b-90fc-418f-8b39-b1004b9ee0f1-maas-api-tls\") pod \"ba59b00b-90fc-418f-8b39-b1004b9ee0f1\" (UID: \"ba59b00b-90fc-418f-8b39-b1004b9ee0f1\") "
Jul 24 17:44:54.339595 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:54.339559    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba59b00b-90fc-418f-8b39-b1004b9ee0f1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ba59b00b-90fc-418f-8b39-b1004b9ee0f1" (UID: "ba59b00b-90fc-418f-8b39-b1004b9ee0f1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:44:54.341461 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:54.341429    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba59b00b-90fc-418f-8b39-b1004b9ee0f1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ba59b00b-90fc-418f-8b39-b1004b9ee0f1" (UID: "ba59b00b-90fc-418f-8b39-b1004b9ee0f1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:44:54.341582 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:54.341520    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba59b00b-90fc-418f-8b39-b1004b9ee0f1-kube-api-access-lxzq6" (OuterVolumeSpecName: "kube-api-access-lxzq6") pod "ba59b00b-90fc-418f-8b39-b1004b9ee0f1" (UID: "ba59b00b-90fc-418f-8b39-b1004b9ee0f1"). InnerVolumeSpecName "kube-api-access-lxzq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:44:54.440742 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:54.440707    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba59b00b-90fc-418f-8b39-b1004b9ee0f1-openshift-service-ca\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:44:54.440742 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:54.440737    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba59b00b-90fc-418f-8b39-b1004b9ee0f1-maas-api-tls\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:44:54.440742 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:54.440747    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxzq6\" (UniqueName: \"kubernetes.io/projected/ba59b00b-90fc-418f-8b39-b1004b9ee0f1-kube-api-access-lxzq6\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:44:54.634675 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:54.634640    2572 generic.go:356] "Generic (PLEG): container finished" podID="ba59b00b-90fc-418f-8b39-b1004b9ee0f1" containerID="c2f265ffc79bae1c6f1a917c6022deaa078c14f5985e9b5e1247fd0b225e97ec" exitCode=0
Jul 24 17:44:54.634876 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:54.634688    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8"
Jul 24 17:44:54.634876 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:54.634688    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8" event={"ID":"ba59b00b-90fc-418f-8b39-b1004b9ee0f1","Type":"ContainerDied","Data":"c2f265ffc79bae1c6f1a917c6022deaa078c14f5985e9b5e1247fd0b225e97ec"}
Jul 24 17:44:54.634876 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:54.634817    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8" event={"ID":"ba59b00b-90fc-418f-8b39-b1004b9ee0f1","Type":"ContainerDied","Data":"b0aeb639d049736e5745be18e8d7b0fd8beb41981a239024859bbbe72a863e0b"}
Jul 24 17:44:54.634876 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:54.634839    2572 scope.go:117] "RemoveContainer" containerID="c2f265ffc79bae1c6f1a917c6022deaa078c14f5985e9b5e1247fd0b225e97ec"
Jul 24 17:44:54.645385 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:54.645369    2572 scope.go:117] "RemoveContainer" containerID="c2f265ffc79bae1c6f1a917c6022deaa078c14f5985e9b5e1247fd0b225e97ec"
Jul 24 17:44:54.645656 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:44:54.645638    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2f265ffc79bae1c6f1a917c6022deaa078c14f5985e9b5e1247fd0b225e97ec\": container with ID starting with c2f265ffc79bae1c6f1a917c6022deaa078c14f5985e9b5e1247fd0b225e97ec not found: ID does not exist" containerID="c2f265ffc79bae1c6f1a917c6022deaa078c14f5985e9b5e1247fd0b225e97ec"
Jul 24 17:44:54.645696 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:54.645665    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2f265ffc79bae1c6f1a917c6022deaa078c14f5985e9b5e1247fd0b225e97ec"} err="failed to get container status \"c2f265ffc79bae1c6f1a917c6022deaa078c14f5985e9b5e1247fd0b225e97ec\": rpc error: code = NotFound desc = could not find container \"c2f265ffc79bae1c6f1a917c6022deaa078c14f5985e9b5e1247fd0b225e97ec\": container with ID starting with c2f265ffc79bae1c6f1a917c6022deaa078c14f5985e9b5e1247fd0b225e97ec not found: ID does not exist"
Jul 24 17:44:54.671071 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:54.671044    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8"]
Jul 24 17:44:54.678572 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:54.678551    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-368755-648dccc89f-wlcj8"]
Jul 24 17:44:55.085821 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:55.085742    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba59b00b-90fc-418f-8b39-b1004b9ee0f1" path="/var/lib/kubelet/pods/ba59b00b-90fc-418f-8b39-b1004b9ee0f1/volumes"
Jul 24 17:44:58.528886 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:58.528854    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-368755-dsx4s"]
Jul 24 17:44:58.535994 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:58.535965    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-368755-dsx4s"]
Jul 24 17:44:59.086106 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:44:59.086075    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba9fc75c-8e26-4c77-b9f0-43f3e239d634" path="/var/lib/kubelet/pods/ba9fc75c-8e26-4c77-b9f0-43f3e239d634/volumes"
Jul 24 17:45:06.094386 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.094352    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"]
Jul 24 17:45:06.094994 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.094973    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba9fc75c-8e26-4c77-b9f0-43f3e239d634" containerName="revoke-keys"
Jul 24 17:45:06.095085 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.094997    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba9fc75c-8e26-4c77-b9f0-43f3e239d634" containerName="revoke-keys"
Jul 24 17:45:06.095085 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.095024    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba59b00b-90fc-418f-8b39-b1004b9ee0f1" containerName="maas-api"
Jul 24 17:45:06.095085 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.095033    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba59b00b-90fc-418f-8b39-b1004b9ee0f1" containerName="maas-api"
Jul 24 17:45:06.095348 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.095152    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba59b00b-90fc-418f-8b39-b1004b9ee0f1" containerName="maas-api"
Jul 24 17:45:06.095348 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.095166    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba9fc75c-8e26-4c77-b9f0-43f3e239d634" containerName="revoke-keys"
Jul 24 17:45:06.100342 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.100321    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.103344 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.103321    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-ac84f7-openshift-default-dockercfg-99j8b\""
Jul 24 17:45:06.118992 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.118967    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"]
Jul 24 17:45:06.158191 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.158147    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-envoy\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.158381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.158200    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcvqn\" (UniqueName: \"kubernetes.io/projected/657b4592-9af3-435f-90d3-b11c592e1bfc-kube-api-access-hcvqn\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.158381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.158288    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-workload-socket\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.158381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.158322    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-credential-socket\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.158496 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.158383    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/657b4592-9af3-435f-90d3-b11c592e1bfc-istiod-ca-cert\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.158496 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.158407    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-data\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.158496 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.158430    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-workload-certs\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.158496 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.158451    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-token\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.158622 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.158513    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-podinfo\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.259502 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.259468    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-envoy\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.259687 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.259516    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcvqn\" (UniqueName: \"kubernetes.io/projected/657b4592-9af3-435f-90d3-b11c592e1bfc-kube-api-access-hcvqn\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.259687 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.259551    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-workload-socket\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.259687 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.259569    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-credential-socket\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.259687 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.259602    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/657b4592-9af3-435f-90d3-b11c592e1bfc-istiod-ca-cert\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.259918 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.259766    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-data\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.259918 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.259811    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-workload-certs\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.259918 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.259842    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-token\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.259918 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.259893    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-podinfo\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.260134 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.260031    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-workload-socket\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.260134 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.260087    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-credential-socket\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.260225 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.260136    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-data\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.260225 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.260198    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-workload-certs\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.260389 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.260371    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/657b4592-9af3-435f-90d3-b11c592e1bfc-istiod-ca-cert\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.261933 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.261917    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-envoy\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.262671 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.262651    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-podinfo\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.268246 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.268205    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcvqn\" (UniqueName: \"kubernetes.io/projected/657b4592-9af3-435f-90d3-b11c592e1bfc-kube-api-access-hcvqn\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.268339 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.268326    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-token\") pod \"e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") " pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.410561 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.410525    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:06.559505 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.559475    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"]
Jul 24 17:45:06.561207 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:45:06.561182    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod657b4592_9af3_435f_90d3_b11c592e1bfc.slice/crio-2b062348f44adfe4a52670d4a2fa62ab59d9c252c28a248907a5d41664e49b8a WatchSource:0}: Error finding container 2b062348f44adfe4a52670d4a2fa62ab59d9c252c28a248907a5d41664e49b8a: Status 404 returned error can't find the container with id 2b062348f44adfe4a52670d4a2fa62ab59d9c252c28a248907a5d41664e49b8a
Jul 24 17:45:06.563734 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.563697    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:45:06.563820 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.563770    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:45:06.563820 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.563805    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:45:06.718926 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.718836    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq" event={"ID":"657b4592-9af3-435f-90d3-b11c592e1bfc","Type":"ContainerStarted","Data":"bccffbaf162a4e2758020d9676c7faca0677c9e2e86e815612c7745cbd3311e9"}
Jul 24 17:45:06.718926 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.718902    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq" event={"ID":"657b4592-9af3-435f-90d3-b11c592e1bfc","Type":"ContainerStarted","Data":"2b062348f44adfe4a52670d4a2fa62ab59d9c252c28a248907a5d41664e49b8a"}
Jul 24 17:45:06.744914 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:06.744865    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq" podStartSLOduration=0.744849297 podStartE2EDuration="744.849297ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:45:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:45:06.740114584 +0000 UTC m=+2524.174330151" watchObservedRunningTime="2026-07-24 17:45:06.744849297 +0000 UTC m=+2524.179064864"
Jul 24 17:45:07.410964 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:07.410925    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:07.416028 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:07.416002    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:07.725117 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:07.725012    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:07.725966 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:07.725949    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:16.964633 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:16.964597    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv"]
Jul 24 17:45:16.968303 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:16.968283    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv"
Jul 24 17:45:16.971341 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:16.971318    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-94ab01-serving-cert\""
Jul 24 17:45:16.983646 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:16.983619    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv"]
Jul 24 17:45:17.071492 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:17.071461    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65b3b1c8-e1de-48c5-8754-550166a57361-maas-api-tls\") pod \"maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv\" (UID: \"65b3b1c8-e1de-48c5-8754-550166a57361\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv"
Jul 24 17:45:17.071703 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:17.071553    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pntl2\" (UniqueName: \"kubernetes.io/projected/65b3b1c8-e1de-48c5-8754-550166a57361-kube-api-access-pntl2\") pod \"maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv\" (UID: \"65b3b1c8-e1de-48c5-8754-550166a57361\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv"
Jul 24 17:45:17.071703 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:17.071607    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b3b1c8-e1de-48c5-8754-550166a57361-openshift-service-ca\") pod \"maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv\" (UID: \"65b3b1c8-e1de-48c5-8754-550166a57361\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv"
Jul 24 17:45:17.172439 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:17.172404    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b3b1c8-e1de-48c5-8754-550166a57361-openshift-service-ca\") pod \"maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv\" (UID: \"65b3b1c8-e1de-48c5-8754-550166a57361\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv"
Jul 24 17:45:17.172623 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:17.172448    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65b3b1c8-e1de-48c5-8754-550166a57361-maas-api-tls\") pod \"maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv\" (UID: \"65b3b1c8-e1de-48c5-8754-550166a57361\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv"
Jul 24 17:45:17.172623 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:17.172549    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pntl2\" (UniqueName: \"kubernetes.io/projected/65b3b1c8-e1de-48c5-8754-550166a57361-kube-api-access-pntl2\") pod \"maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv\" (UID: \"65b3b1c8-e1de-48c5-8754-550166a57361\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv"
Jul 24 17:45:17.172746 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:45:17.172648    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-serving-cert: secret "maas-api-e2e-api-b-94ab01-serving-cert" not found
Jul 24 17:45:17.172746 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:45:17.172732    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65b3b1c8-e1de-48c5-8754-550166a57361-maas-api-tls podName:65b3b1c8-e1de-48c5-8754-550166a57361 nodeName:}" failed. No retries permitted until 2026-07-24 17:45:17.672712087 +0000 UTC m=+2535.106927654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/65b3b1c8-e1de-48c5-8754-550166a57361-maas-api-tls") pod "maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv" (UID: "65b3b1c8-e1de-48c5-8754-550166a57361") : secret "maas-api-e2e-api-b-94ab01-serving-cert" not found
Jul 24 17:45:17.173165 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:17.173142    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b3b1c8-e1de-48c5-8754-550166a57361-openshift-service-ca\") pod \"maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv\" (UID: \"65b3b1c8-e1de-48c5-8754-550166a57361\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv"
Jul 24 17:45:17.185340 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:17.185320    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pntl2\" (UniqueName: \"kubernetes.io/projected/65b3b1c8-e1de-48c5-8754-550166a57361-kube-api-access-pntl2\") pod \"maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv\" (UID: \"65b3b1c8-e1de-48c5-8754-550166a57361\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv"
Jul 24 17:45:17.678391 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:17.678348    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65b3b1c8-e1de-48c5-8754-550166a57361-maas-api-tls\") pod \"maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv\" (UID: \"65b3b1c8-e1de-48c5-8754-550166a57361\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv"
Jul 24 17:45:17.681121 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:17.681096    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65b3b1c8-e1de-48c5-8754-550166a57361-maas-api-tls\") pod \"maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv\" (UID: \"65b3b1c8-e1de-48c5-8754-550166a57361\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv"
Jul 24 17:45:17.881839 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:17.881810    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv"
Jul 24 17:45:18.085799 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:18.085766    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv"]
Jul 24 17:45:18.086503 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:45:18.086457    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65b3b1c8_e1de_48c5_8754_550166a57361.slice/crio-270dd6f43b353fff66741a609f16847c28dda856611f097482f094a6fe7b345c WatchSource:0}: Error finding container 270dd6f43b353fff66741a609f16847c28dda856611f097482f094a6fe7b345c: Status 404 returned error can't find the container with id 270dd6f43b353fff66741a609f16847c28dda856611f097482f094a6fe7b345c
Jul 24 17:45:18.794762 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:18.794715    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv" event={"ID":"65b3b1c8-e1de-48c5-8754-550166a57361","Type":"ContainerStarted","Data":"be98cf36871bcbfd1086c36f0bdc405bdb0274f54a3802e8f8054851aef79dbb"}
Jul 24 17:45:18.794971 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:18.794791    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv" event={"ID":"65b3b1c8-e1de-48c5-8754-550166a57361","Type":"ContainerStarted","Data":"270dd6f43b353fff66741a609f16847c28dda856611f097482f094a6fe7b345c"}
Jul 24 17:45:18.795669 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:18.795638    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv"
Jul 24 17:45:18.816143 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:18.816004    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv" podStartSLOduration=2.362618704 podStartE2EDuration="2.815981703s" totalImagesPullingTime="453.362999ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:45:18.813109165 +0000 UTC m=+2536.247324733" watchObservedRunningTime="2026-07-24 17:45:18.815981703 +0000 UTC m=+2536.250197272"
Jul 24 17:45:23.768412 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:23.768372    2572 patch_prober.go:28] interesting pod/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 17:45:23.768894 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:23.768443    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq" podUID="657b4592-9af3-435f-90d3-b11c592e1bfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 17:45:24.841711 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:24.841612    2572 generic.go:356] "Generic (PLEG): container finished" podID="657b4592-9af3-435f-90d3-b11c592e1bfc" containerID="bccffbaf162a4e2758020d9676c7faca0677c9e2e86e815612c7745cbd3311e9" exitCode=0
Jul 24 17:45:24.841711 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:24.841685    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq" event={"ID":"657b4592-9af3-435f-90d3-b11c592e1bfc","Type":"ContainerDied","Data":"bccffbaf162a4e2758020d9676c7faca0677c9e2e86e815612c7745cbd3311e9"}
Jul 24 17:45:24.842293 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:24.842281    2572 scope.go:117] "RemoveContainer" containerID="bccffbaf162a4e2758020d9676c7faca0677c9e2e86e815612c7745cbd3311e9"
Jul 24 17:45:24.843454 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:24.843420    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:45:24.843568 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:24.843491    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:45:24.843568 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:24.843527    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:45:25.820215 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:25.820182    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv"
Jul 24 17:45:25.851409 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:25.851368    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq" event={"ID":"657b4592-9af3-435f-90d3-b11c592e1bfc","Type":"ContainerStarted","Data":"8557686ab9fc7aa01435ebb1d128702f76b15739963cfcf94e7e96d8dc3274ca"}
Jul 24 17:45:26.411845 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:26.411795    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:26.412062 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:26.411934    2572 patch_prober.go:28] interesting pod/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 24 17:45:26.412062 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:26.411978    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq" podUID="657b4592-9af3-435f-90d3-b11c592e1bfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 24 17:45:27.411028 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:27.410992    2572 patch_prober.go:28] interesting pod/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 24 17:45:27.411651 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:27.411618    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq" podUID="657b4592-9af3-435f-90d3-b11c592e1bfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 24 17:45:28.412044 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:28.412005    2572 patch_prober.go:28] interesting pod/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 24 17:45:28.412682 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:28.412648    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq" podUID="657b4592-9af3-435f-90d3-b11c592e1bfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 24 17:45:29.411844 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:29.411810    2572 patch_prober.go:28] interesting pod/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 24 17:45:29.412070 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:29.412044    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq" podUID="657b4592-9af3-435f-90d3-b11c592e1bfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 24 17:45:30.414371 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:30.414344    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:30.414762 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:30.414743    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:30.415375 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:30.415354    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:45:56.105446 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:56.105405    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"]
Jul 24 17:45:56.105998 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:45:56.105743    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq" podUID="657b4592-9af3-435f-90d3-b11c592e1bfc" containerName="istio-proxy" containerID="cri-o://8557686ab9fc7aa01435ebb1d128702f76b15739963cfcf94e7e96d8dc3274ca" gracePeriod=30
Jul 24 17:46:00.416993 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:00.416951    2572 patch_prober.go:28] interesting pod/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 17:46:00.417386 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:00.417007    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq" podUID="657b4592-9af3-435f-90d3-b11c592e1bfc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:46:01.380854 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.380796    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:46:01.416035 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.415991    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/657b4592-9af3-435f-90d3-b11c592e1bfc-istiod-ca-cert\") pod \"657b4592-9af3-435f-90d3-b11c592e1bfc\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") "
Jul 24 17:46:01.416035 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.416041    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-envoy\") pod \"657b4592-9af3-435f-90d3-b11c592e1bfc\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") "
Jul 24 17:46:01.416300 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.416072    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-token\") pod \"657b4592-9af3-435f-90d3-b11c592e1bfc\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") "
Jul 24 17:46:01.416300 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.416110    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-podinfo\") pod \"657b4592-9af3-435f-90d3-b11c592e1bfc\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") "
Jul 24 17:46:01.416300 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.416177    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-workload-certs\") pod \"657b4592-9af3-435f-90d3-b11c592e1bfc\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") "
Jul 24 17:46:01.416300 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.416202    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcvqn\" (UniqueName: \"kubernetes.io/projected/657b4592-9af3-435f-90d3-b11c592e1bfc-kube-api-access-hcvqn\") pod \"657b4592-9af3-435f-90d3-b11c592e1bfc\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") "
Jul 24 17:46:01.416300 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.416296    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-credential-socket\") pod \"657b4592-9af3-435f-90d3-b11c592e1bfc\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") "
Jul 24 17:46:01.416585 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.416336    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-workload-socket\") pod \"657b4592-9af3-435f-90d3-b11c592e1bfc\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") "
Jul 24 17:46:01.416585 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.416383    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-data\") pod \"657b4592-9af3-435f-90d3-b11c592e1bfc\" (UID: \"657b4592-9af3-435f-90d3-b11c592e1bfc\") "
Jul 24 17:46:01.416585 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.416398    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/657b4592-9af3-435f-90d3-b11c592e1bfc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "657b4592-9af3-435f-90d3-b11c592e1bfc" (UID: "657b4592-9af3-435f-90d3-b11c592e1bfc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:46:01.416736 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.416711    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "657b4592-9af3-435f-90d3-b11c592e1bfc" (UID: "657b4592-9af3-435f-90d3-b11c592e1bfc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:46:01.416792 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.416731    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "657b4592-9af3-435f-90d3-b11c592e1bfc" (UID: "657b4592-9af3-435f-90d3-b11c592e1bfc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:46:01.416851 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.416792    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-credential-socket\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:46:01.416851 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.416811    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/657b4592-9af3-435f-90d3-b11c592e1bfc-istiod-ca-cert\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:46:01.417498 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.417046    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "657b4592-9af3-435f-90d3-b11c592e1bfc" (UID: "657b4592-9af3-435f-90d3-b11c592e1bfc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:46:01.417856 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.417824    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-data" (OuterVolumeSpecName: "istio-data") pod "657b4592-9af3-435f-90d3-b11c592e1bfc" (UID: "657b4592-9af3-435f-90d3-b11c592e1bfc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:46:01.418760 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.418733    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "657b4592-9af3-435f-90d3-b11c592e1bfc" (UID: "657b4592-9af3-435f-90d3-b11c592e1bfc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:46:01.419143 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.419116    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-token" (OuterVolumeSpecName: "istio-token") pod "657b4592-9af3-435f-90d3-b11c592e1bfc" (UID: "657b4592-9af3-435f-90d3-b11c592e1bfc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:46:01.419286 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.419266    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/657b4592-9af3-435f-90d3-b11c592e1bfc-kube-api-access-hcvqn" (OuterVolumeSpecName: "kube-api-access-hcvqn") pod "657b4592-9af3-435f-90d3-b11c592e1bfc" (UID: "657b4592-9af3-435f-90d3-b11c592e1bfc"). InnerVolumeSpecName "kube-api-access-hcvqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:46:01.419506 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.419483    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "657b4592-9af3-435f-90d3-b11c592e1bfc" (UID: "657b4592-9af3-435f-90d3-b11c592e1bfc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:46:01.518203 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.518166    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-workload-socket\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:46:01.518203 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.518195    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-data\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:46:01.518203 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.518204    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-envoy\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:46:01.518203 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.518212    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-token\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:46:01.518500 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.518219    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/657b4592-9af3-435f-90d3-b11c592e1bfc-istio-podinfo\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:46:01.518500 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.518227    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/657b4592-9af3-435f-90d3-b11c592e1bfc-workload-certs\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:46:01.518500 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:01.518255    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcvqn\" (UniqueName: \"kubernetes.io/projected/657b4592-9af3-435f-90d3-b11c592e1bfc-kube-api-access-hcvqn\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:46:02.067888 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:02.067853    2572 generic.go:356] "Generic (PLEG): container finished" podID="657b4592-9af3-435f-90d3-b11c592e1bfc" containerID="8557686ab9fc7aa01435ebb1d128702f76b15739963cfcf94e7e96d8dc3274ca" exitCode=0
Jul 24 17:46:02.068062 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:02.067905    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"
Jul 24 17:46:02.068062 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:02.067942    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq" event={"ID":"657b4592-9af3-435f-90d3-b11c592e1bfc","Type":"ContainerDied","Data":"8557686ab9fc7aa01435ebb1d128702f76b15739963cfcf94e7e96d8dc3274ca"}
Jul 24 17:46:02.068062 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:02.068006    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq" event={"ID":"657b4592-9af3-435f-90d3-b11c592e1bfc","Type":"ContainerDied","Data":"2b062348f44adfe4a52670d4a2fa62ab59d9c252c28a248907a5d41664e49b8a"}
Jul 24 17:46:02.068062 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:02.068032    2572 scope.go:117] "RemoveContainer" containerID="8557686ab9fc7aa01435ebb1d128702f76b15739963cfcf94e7e96d8dc3274ca"
Jul 24 17:46:02.078497 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:02.078477    2572 scope.go:117] "RemoveContainer" containerID="bccffbaf162a4e2758020d9676c7faca0677c9e2e86e815612c7745cbd3311e9"
Jul 24 17:46:02.087027 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:02.087008    2572 scope.go:117] "RemoveContainer" containerID="8557686ab9fc7aa01435ebb1d128702f76b15739963cfcf94e7e96d8dc3274ca"
Jul 24 17:46:02.087274 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:46:02.087252    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8557686ab9fc7aa01435ebb1d128702f76b15739963cfcf94e7e96d8dc3274ca\": container with ID starting with 8557686ab9fc7aa01435ebb1d128702f76b15739963cfcf94e7e96d8dc3274ca not found: ID does not exist" containerID="8557686ab9fc7aa01435ebb1d128702f76b15739963cfcf94e7e96d8dc3274ca"
Jul 24 17:46:02.087343 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:02.087283    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8557686ab9fc7aa01435ebb1d128702f76b15739963cfcf94e7e96d8dc3274ca"} err="failed to get container status \"8557686ab9fc7aa01435ebb1d128702f76b15739963cfcf94e7e96d8dc3274ca\": rpc error: code = NotFound desc = could not find container \"8557686ab9fc7aa01435ebb1d128702f76b15739963cfcf94e7e96d8dc3274ca\": container with ID starting with 8557686ab9fc7aa01435ebb1d128702f76b15739963cfcf94e7e96d8dc3274ca not found: ID does not exist"
Jul 24 17:46:02.087343 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:02.087300    2572 scope.go:117] "RemoveContainer" containerID="bccffbaf162a4e2758020d9676c7faca0677c9e2e86e815612c7745cbd3311e9"
Jul 24 17:46:02.087571 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:46:02.087554    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bccffbaf162a4e2758020d9676c7faca0677c9e2e86e815612c7745cbd3311e9\": container with ID starting with bccffbaf162a4e2758020d9676c7faca0677c9e2e86e815612c7745cbd3311e9 not found: ID does not exist" containerID="bccffbaf162a4e2758020d9676c7faca0677c9e2e86e815612c7745cbd3311e9"
Jul 24 17:46:02.087629 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:02.087577    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bccffbaf162a4e2758020d9676c7faca0677c9e2e86e815612c7745cbd3311e9"} err="failed to get container status \"bccffbaf162a4e2758020d9676c7faca0677c9e2e86e815612c7745cbd3311e9\": rpc error: code = NotFound desc = could not find container \"bccffbaf162a4e2758020d9676c7faca0677c9e2e86e815612c7745cbd3311e9\": container with ID starting with bccffbaf162a4e2758020d9676c7faca0677c9e2e86e815612c7745cbd3311e9 not found: ID does not exist"
Jul 24 17:46:02.094205 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:02.094184    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"]
Jul 24 17:46:02.101614 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:02.101594    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq"]
Jul 24 17:46:03.089847 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:03.089815    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="657b4592-9af3-435f-90d3-b11c592e1bfc" path="/var/lib/kubelet/pods/657b4592-9af3-435f-90d3-b11c592e1bfc/volumes"
Jul 24 17:46:11.962309 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:11.962276    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv"]
Jul 24 17:46:11.962782 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:11.962534    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv" podUID="65b3b1c8-e1de-48c5-8754-550166a57361" containerName="maas-api" containerID="cri-o://be98cf36871bcbfd1086c36f0bdc405bdb0274f54a3802e8f8054851aef79dbb" gracePeriod=30
Jul 24 17:46:12.137948 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:12.137911    2572 generic.go:356] "Generic (PLEG): container finished" podID="65b3b1c8-e1de-48c5-8754-550166a57361" containerID="be98cf36871bcbfd1086c36f0bdc405bdb0274f54a3802e8f8054851aef79dbb" exitCode=0
Jul 24 17:46:12.138108 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:12.137996    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv" event={"ID":"65b3b1c8-e1de-48c5-8754-550166a57361","Type":"ContainerDied","Data":"be98cf36871bcbfd1086c36f0bdc405bdb0274f54a3802e8f8054851aef79dbb"}
Jul 24 17:46:12.275455 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:12.275426    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv"
Jul 24 17:46:12.329903 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:12.329866    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pntl2\" (UniqueName: \"kubernetes.io/projected/65b3b1c8-e1de-48c5-8754-550166a57361-kube-api-access-pntl2\") pod \"65b3b1c8-e1de-48c5-8754-550166a57361\" (UID: \"65b3b1c8-e1de-48c5-8754-550166a57361\") "
Jul 24 17:46:12.330072 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:12.329922    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b3b1c8-e1de-48c5-8754-550166a57361-openshift-service-ca\") pod \"65b3b1c8-e1de-48c5-8754-550166a57361\" (UID: \"65b3b1c8-e1de-48c5-8754-550166a57361\") "
Jul 24 17:46:12.330072 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:12.330019    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65b3b1c8-e1de-48c5-8754-550166a57361-maas-api-tls\") pod \"65b3b1c8-e1de-48c5-8754-550166a57361\" (UID: \"65b3b1c8-e1de-48c5-8754-550166a57361\") "
Jul 24 17:46:12.330325 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:12.330303    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65b3b1c8-e1de-48c5-8754-550166a57361-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "65b3b1c8-e1de-48c5-8754-550166a57361" (UID: "65b3b1c8-e1de-48c5-8754-550166a57361"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:46:12.330416 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:12.330403    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b3b1c8-e1de-48c5-8754-550166a57361-openshift-service-ca\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:46:12.332144 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:12.332121    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65b3b1c8-e1de-48c5-8754-550166a57361-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "65b3b1c8-e1de-48c5-8754-550166a57361" (UID: "65b3b1c8-e1de-48c5-8754-550166a57361"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:46:12.332277 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:12.332137    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65b3b1c8-e1de-48c5-8754-550166a57361-kube-api-access-pntl2" (OuterVolumeSpecName: "kube-api-access-pntl2") pod "65b3b1c8-e1de-48c5-8754-550166a57361" (UID: "65b3b1c8-e1de-48c5-8754-550166a57361"). InnerVolumeSpecName "kube-api-access-pntl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:46:12.431362 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:12.431332    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65b3b1c8-e1de-48c5-8754-550166a57361-maas-api-tls\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:46:12.431362 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:12.431360    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pntl2\" (UniqueName: \"kubernetes.io/projected/65b3b1c8-e1de-48c5-8754-550166a57361-kube-api-access-pntl2\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:46:13.144186 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:13.144157    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv"
Jul 24 17:46:13.144585 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:13.144190    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv" event={"ID":"65b3b1c8-e1de-48c5-8754-550166a57361","Type":"ContainerDied","Data":"270dd6f43b353fff66741a609f16847c28dda856611f097482f094a6fe7b345c"}
Jul 24 17:46:13.144585 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:13.144282    2572 scope.go:117] "RemoveContainer" containerID="be98cf36871bcbfd1086c36f0bdc405bdb0274f54a3802e8f8054851aef79dbb"
Jul 24 17:46:13.167445 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:13.167423    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv"]
Jul 24 17:46:13.171566 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:13.171542    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-94ab01-79fbd4dbfc-g2xtv"]
Jul 24 17:46:15.085765 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:15.085730    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65b3b1c8-e1de-48c5-8754-550166a57361" path="/var/lib/kubelet/pods/65b3b1c8-e1de-48c5-8754-550166a57361/volumes"
Jul 24 17:46:24.228313 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.228211    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"]
Jul 24 17:46:24.228674 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.228619    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="657b4592-9af3-435f-90d3-b11c592e1bfc" containerName="istio-proxy"
Jul 24 17:46:24.228674 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.228631    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="657b4592-9af3-435f-90d3-b11c592e1bfc" containerName="istio-proxy"
Jul 24 17:46:24.228674 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.228657    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65b3b1c8-e1de-48c5-8754-550166a57361" containerName="maas-api"
Jul 24 17:46:24.228674 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.228662    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="65b3b1c8-e1de-48c5-8754-550166a57361" containerName="maas-api"
Jul 24 17:46:24.228800 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.228726    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="657b4592-9af3-435f-90d3-b11c592e1bfc" containerName="istio-proxy"
Jul 24 17:46:24.228800 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.228737    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="65b3b1c8-e1de-48c5-8754-550166a57361" containerName="maas-api"
Jul 24 17:46:24.233885 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.233855    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.237148 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.237113    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-13c2c7-openshift-default-dockercfg-vcvm6\""
Jul 24 17:46:24.244645 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.244620    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"]
Jul 24 17:46:24.338098 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.338050    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-token\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.338098 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.338097    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-envoy\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.338361 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.338336    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-workload-socket\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.338434 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.338417    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd66f318-0506-42f6-a571-fd7c3ea9f427-istiod-ca-cert\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.338474 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.338459    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-podinfo\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.338530 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.338489    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-workload-certs\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.338599 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.338555    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8j24\" (UniqueName: \"kubernetes.io/projected/cd66f318-0506-42f6-a571-fd7c3ea9f427-kube-api-access-v8j24\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.338650 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.338634    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-credential-socket\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.338702 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.338672    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-data\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.439888 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.439850    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8j24\" (UniqueName: \"kubernetes.io/projected/cd66f318-0506-42f6-a571-fd7c3ea9f427-kube-api-access-v8j24\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.440066 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.439902    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-credential-socket\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.440066 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.439999    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-data\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.440066 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.440039    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-token\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.440066 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.440060    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-envoy\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.440314 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.440136    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-workload-socket\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.440314 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.440201    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd66f318-0506-42f6-a571-fd7c3ea9f427-istiod-ca-cert\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.440314 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.440279    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-podinfo\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.440462 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.440311    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-workload-certs\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.440462 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.440391    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-data\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.440462 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.440279    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-credential-socket\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.440462 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.440454    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-workload-socket\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.440687 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.440642    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-workload-certs\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.440858 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.440838    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd66f318-0506-42f6-a571-fd7c3ea9f427-istiod-ca-cert\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.442503 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.442484    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-envoy\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.442795 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.442779    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-podinfo\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.450724 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.450700    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8j24\" (UniqueName: \"kubernetes.io/projected/cd66f318-0506-42f6-a571-fd7c3ea9f427-kube-api-access-v8j24\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.463008 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.462982    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-token\") pod \"e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") " pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.548036 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.547968    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:24.929194 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.929169    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"]
Jul 24 17:46:24.930441 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:46:24.930416    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd66f318_0506_42f6_a571_fd7c3ea9f427.slice/crio-bebf92751ac9c3e08ff910c783654b4e35fe080eb9bd8473a6d62a38cad591ec WatchSource:0}: Error finding container bebf92751ac9c3e08ff910c783654b4e35fe080eb9bd8473a6d62a38cad591ec: Status 404 returned error can't find the container with id bebf92751ac9c3e08ff910c783654b4e35fe080eb9bd8473a6d62a38cad591ec
Jul 24 17:46:24.932582 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.932548    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:46:24.932662 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.932619    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:46:24.932662 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:24.932655    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:46:25.217177 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:25.217086    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8" event={"ID":"cd66f318-0506-42f6-a571-fd7c3ea9f427","Type":"ContainerStarted","Data":"3265051409b4cf6f79bc01fe28679a89692f77ab7bd1d96ed0d608e8b521e2ea"}
Jul 24 17:46:25.217177 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:25.217150    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8" event={"ID":"cd66f318-0506-42f6-a571-fd7c3ea9f427","Type":"ContainerStarted","Data":"bebf92751ac9c3e08ff910c783654b4e35fe080eb9bd8473a6d62a38cad591ec"}
Jul 24 17:46:25.241267 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:25.241195    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8" podStartSLOduration=1.241179068 podStartE2EDuration="1.241179068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:46:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:46:25.23707014 +0000 UTC m=+2602.671285708" watchObservedRunningTime="2026-07-24 17:46:25.241179068 +0000 UTC m=+2602.675394634"
Jul 24 17:46:25.548765 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:25.548681    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:25.553399 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:25.553376    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:26.226389 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:26.226353    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:26.227380 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:26.227356    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:42.267412 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:42.267364    2572 patch_prober.go:28] interesting pod/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 17:46:42.267909 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:42.267434    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8" podUID="cd66f318-0506-42f6-a571-fd7c3ea9f427" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 17:46:43.342212 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:43.342069    2572 generic.go:356] "Generic (PLEG): container finished" podID="cd66f318-0506-42f6-a571-fd7c3ea9f427" containerID="3265051409b4cf6f79bc01fe28679a89692f77ab7bd1d96ed0d608e8b521e2ea" exitCode=0
Jul 24 17:46:43.342694 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:43.342224    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8" event={"ID":"cd66f318-0506-42f6-a571-fd7c3ea9f427","Type":"ContainerDied","Data":"3265051409b4cf6f79bc01fe28679a89692f77ab7bd1d96ed0d608e8b521e2ea"}
Jul 24 17:46:43.342694 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:43.342645    2572 scope.go:117] "RemoveContainer" containerID="3265051409b4cf6f79bc01fe28679a89692f77ab7bd1d96ed0d608e8b521e2ea"
Jul 24 17:46:43.343711 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:43.343681    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:46:43.343773 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:43.343750    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:46:43.343815 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:43.343779    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:46:44.349644 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:44.349608    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8" event={"ID":"cd66f318-0506-42f6-a571-fd7c3ea9f427","Type":"ContainerStarted","Data":"65280b55afa6085b2b54632731fa97f9dac092ecc6ee33a0e554d209b6a52c68"}
Jul 24 17:46:44.548713 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:44.548674    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:44.548922 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:44.548898    2572 patch_prober.go:28] interesting pod/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 24 17:46:44.549001 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:44.548960    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8" podUID="cd66f318-0506-42f6-a571-fd7c3ea9f427" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 24 17:46:45.548948 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:45.548908    2572 patch_prober.go:28] interesting pod/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 24 17:46:45.549378 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:45.548967    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8" podUID="cd66f318-0506-42f6-a571-fd7c3ea9f427" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 24 17:46:46.548681 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:46.548646    2572 patch_prober.go:28] interesting pod/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 24 17:46:46.548868 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:46.548702    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8" podUID="cd66f318-0506-42f6-a571-fd7c3ea9f427" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 24 17:46:47.548666 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:47.548630    2572 patch_prober.go:28] interesting pod/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 24 17:46:47.549054 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:47.548690    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8" podUID="cd66f318-0506-42f6-a571-fd7c3ea9f427" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 24 17:46:48.548483 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:48.548446    2572 patch_prober.go:28] interesting pod/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 24 17:46:48.548668 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:48.548502    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8" podUID="cd66f318-0506-42f6-a571-fd7c3ea9f427" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 24 17:46:49.552378 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:49.552349    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:49.552767 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:49.552612    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:46:49.553375 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:46:49.553359    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:48:03.293690 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:48:03.293597    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:48:03.303906 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:48:03.303877    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:51:03.445472 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:51:03.445398    2572 scope.go:117] "RemoveContainer" containerID="dafcee7ceb4087f3ee1f8b0c0fab00a3eaf80fb0b8edc0eae3d0e7200dc2c121"
Jul 24 17:51:03.454453 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:51:03.454433    2572 scope.go:117] "RemoveContainer" containerID="d2ab61b2483cb9694989833a3cd50ddfc659152c5ece8044f6b06de42ee78ffe"
Jul 24 17:52:04.164979 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:04.164947    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7614-139990905357616"]
Jul 24 17:52:04.167370 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:04.165356    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="657b4592-9af3-435f-90d3-b11c592e1bfc" containerName="istio-proxy"
Jul 24 17:52:04.167370 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:04.165369    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="657b4592-9af3-435f-90d3-b11c592e1bfc" containerName="istio-proxy"
Jul 24 17:52:04.167370 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:04.165449    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="657b4592-9af3-435f-90d3-b11c592e1bfc" containerName="istio-proxy"
Jul 24 17:52:04.168218 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:04.168202    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990905357616"
Jul 24 17:52:04.171200 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:04.171176    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xk9cn\""
Jul 24 17:52:04.178816 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:04.178791    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-139990905357616"]
Jul 24 17:52:04.240327 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:04.240294    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc7g7\" (UniqueName: \"kubernetes.io/projected/4a52f4aa-d22a-4b5f-b65d-a7f301fa7d8d-kube-api-access-qc7g7\") pod \"test-curl-7614-139990905357616\" (UID: \"4a52f4aa-d22a-4b5f-b65d-a7f301fa7d8d\") " pod="opendatahub/test-curl-7614-139990905357616"
Jul 24 17:52:04.341217 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:04.341189    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc7g7\" (UniqueName: \"kubernetes.io/projected/4a52f4aa-d22a-4b5f-b65d-a7f301fa7d8d-kube-api-access-qc7g7\") pod \"test-curl-7614-139990905357616\" (UID: \"4a52f4aa-d22a-4b5f-b65d-a7f301fa7d8d\") " pod="opendatahub/test-curl-7614-139990905357616"
Jul 24 17:52:04.350300 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:04.350280    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc7g7\" (UniqueName: \"kubernetes.io/projected/4a52f4aa-d22a-4b5f-b65d-a7f301fa7d8d-kube-api-access-qc7g7\") pod \"test-curl-7614-139990905357616\" (UID: \"4a52f4aa-d22a-4b5f-b65d-a7f301fa7d8d\") " pod="opendatahub/test-curl-7614-139990905357616"
Jul 24 17:52:04.477984 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:04.477870    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990905357616"
Jul 24 17:52:04.620250 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:04.620192    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-139990905357616"]
Jul 24 17:52:04.623455 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:52:04.623426    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a52f4aa_d22a_4b5f_b65d_a7f301fa7d8d.slice/crio-876fa318e1340c6ca45ccb4d0e74c4107efd02e0afa9d7e0080e5e7dd4eb79e4 WatchSource:0}: Error finding container 876fa318e1340c6ca45ccb4d0e74c4107efd02e0afa9d7e0080e5e7dd4eb79e4: Status 404 returned error can't find the container with id 876fa318e1340c6ca45ccb4d0e74c4107efd02e0afa9d7e0080e5e7dd4eb79e4
Jul 24 17:52:04.624870 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:04.624848    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:52:05.253782 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:05.253742    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-139990905357616" event={"ID":"4a52f4aa-d22a-4b5f-b65d-a7f301fa7d8d","Type":"ContainerStarted","Data":"876fa318e1340c6ca45ccb4d0e74c4107efd02e0afa9d7e0080e5e7dd4eb79e4"}
Jul 24 17:52:06.261246 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:06.261192    2572 generic.go:356] "Generic (PLEG): container finished" podID="4a52f4aa-d22a-4b5f-b65d-a7f301fa7d8d" containerID="b7b5c57a675ab73fed5c595ab519b3e628be4700632eb0660f4daafbc420bee2" exitCode=0
Jul 24 17:52:06.261632 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:06.261283    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-139990905357616" event={"ID":"4a52f4aa-d22a-4b5f-b65d-a7f301fa7d8d","Type":"ContainerDied","Data":"b7b5c57a675ab73fed5c595ab519b3e628be4700632eb0660f4daafbc420bee2"}
Jul 24 17:52:07.402318 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:07.402294    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990905357616"
Jul 24 17:52:07.439409 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:07.439375    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7614-139990905357616_4a52f4aa-d22a-4b5f-b65d-a7f301fa7d8d/test-curl-7614-139990905357616/0.log"
Jul 24 17:52:07.466359 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:07.466328    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7614-139990905357616"]
Jul 24 17:52:07.469712 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:07.469690    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7614-139990905357616"]
Jul 24 17:52:07.472331 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:07.472312    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qc7g7\" (UniqueName: \"kubernetes.io/projected/4a52f4aa-d22a-4b5f-b65d-a7f301fa7d8d-kube-api-access-qc7g7\") pod \"4a52f4aa-d22a-4b5f-b65d-a7f301fa7d8d\" (UID: \"4a52f4aa-d22a-4b5f-b65d-a7f301fa7d8d\") "
Jul 24 17:52:07.474609 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:07.474586    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a52f4aa-d22a-4b5f-b65d-a7f301fa7d8d-kube-api-access-qc7g7" (OuterVolumeSpecName: "kube-api-access-qc7g7") pod "4a52f4aa-d22a-4b5f-b65d-a7f301fa7d8d" (UID: "4a52f4aa-d22a-4b5f-b65d-a7f301fa7d8d"). InnerVolumeSpecName "kube-api-access-qc7g7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:52:07.573701 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:07.573597    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qc7g7\" (UniqueName: \"kubernetes.io/projected/4a52f4aa-d22a-4b5f-b65d-a7f301fa7d8d-kube-api-access-qc7g7\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:52:07.602426 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:07.602394    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7614-139990905358896"]
Jul 24 17:52:07.602801 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:07.602789    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a52f4aa-d22a-4b5f-b65d-a7f301fa7d8d" containerName="test-curl-7614-139990905357616"
Jul 24 17:52:07.602849 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:07.602804    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a52f4aa-d22a-4b5f-b65d-a7f301fa7d8d" containerName="test-curl-7614-139990905357616"
Jul 24 17:52:07.602895 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:07.602886    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a52f4aa-d22a-4b5f-b65d-a7f301fa7d8d" containerName="test-curl-7614-139990905357616"
Jul 24 17:52:07.606086 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:07.606070    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990905358896"
Jul 24 17:52:07.610461 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:07.610436    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-139990905358896"]
Jul 24 17:52:07.674140 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:07.674093    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n867q\" (UniqueName: \"kubernetes.io/projected/0ff4eeb5-44d0-494e-95d1-f6578bf23f77-kube-api-access-n867q\") pod \"test-curl-7614-139990905358896\" (UID: \"0ff4eeb5-44d0-494e-95d1-f6578bf23f77\") " pod="opendatahub/test-curl-7614-139990905358896"
Jul 24 17:52:07.775220 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:07.775185    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n867q\" (UniqueName: \"kubernetes.io/projected/0ff4eeb5-44d0-494e-95d1-f6578bf23f77-kube-api-access-n867q\") pod \"test-curl-7614-139990905358896\" (UID: \"0ff4eeb5-44d0-494e-95d1-f6578bf23f77\") " pod="opendatahub/test-curl-7614-139990905358896"
Jul 24 17:52:07.785221 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:07.785194    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n867q\" (UniqueName: \"kubernetes.io/projected/0ff4eeb5-44d0-494e-95d1-f6578bf23f77-kube-api-access-n867q\") pod \"test-curl-7614-139990905358896\" (UID: \"0ff4eeb5-44d0-494e-95d1-f6578bf23f77\") " pod="opendatahub/test-curl-7614-139990905358896"
Jul 24 17:52:07.917818 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:07.917784    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990905358896"
Jul 24 17:52:08.058648 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:08.058616    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-139990905358896"]
Jul 24 17:52:08.060187 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:52:08.060162    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ff4eeb5_44d0_494e_95d1_f6578bf23f77.slice/crio-5b2d736b6f03456ab1ae79227cb74aa136a8739b89eb0c36c49fab5e09d12a82 WatchSource:0}: Error finding container 5b2d736b6f03456ab1ae79227cb74aa136a8739b89eb0c36c49fab5e09d12a82: Status 404 returned error can't find the container with id 5b2d736b6f03456ab1ae79227cb74aa136a8739b89eb0c36c49fab5e09d12a82
Jul 24 17:52:08.274838 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:08.274757    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990905357616"
Jul 24 17:52:08.274838 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:08.274792    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="876fa318e1340c6ca45ccb4d0e74c4107efd02e0afa9d7e0080e5e7dd4eb79e4"
Jul 24 17:52:08.276085 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:08.276058    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-139990905358896" event={"ID":"0ff4eeb5-44d0-494e-95d1-f6578bf23f77","Type":"ContainerStarted","Data":"5b2d736b6f03456ab1ae79227cb74aa136a8739b89eb0c36c49fab5e09d12a82"}
Jul 24 17:52:08.285950 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:52:08.285922    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7614-139990905357616\" is forbidden: User \"system:node:ip-10-0-135-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-233.ec2.internal' and this object" podUID="4a52f4aa-d22a-4b5f-b65d-a7f301fa7d8d" pod="opendatahub/test-curl-7614-139990905357616"
Jul 24 17:52:09.086121 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:09.086088    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a52f4aa-d22a-4b5f-b65d-a7f301fa7d8d" path="/var/lib/kubelet/pods/4a52f4aa-d22a-4b5f-b65d-a7f301fa7d8d/volumes"
Jul 24 17:52:09.282960 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:09.282926    2572 generic.go:356] "Generic (PLEG): container finished" podID="0ff4eeb5-44d0-494e-95d1-f6578bf23f77" containerID="e682d31088b3eedb45c27bd151774b20b4c529cea1f6e4a6240ab12cd9536d7e" exitCode=0
Jul 24 17:52:09.283138 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:09.282972    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-139990905358896" event={"ID":"0ff4eeb5-44d0-494e-95d1-f6578bf23f77","Type":"ContainerDied","Data":"e682d31088b3eedb45c27bd151774b20b4c529cea1f6e4a6240ab12cd9536d7e"}
Jul 24 17:52:10.452931 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:10.452896    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990905358896"
Jul 24 17:52:10.475615 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:10.475583    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7614-139990905358896_0ff4eeb5-44d0-494e-95d1-f6578bf23f77/test-curl-7614-139990905358896/0.log"
Jul 24 17:52:10.499481 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:10.499447    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n867q\" (UniqueName: \"kubernetes.io/projected/0ff4eeb5-44d0-494e-95d1-f6578bf23f77-kube-api-access-n867q\") pod \"0ff4eeb5-44d0-494e-95d1-f6578bf23f77\" (UID: \"0ff4eeb5-44d0-494e-95d1-f6578bf23f77\") "
Jul 24 17:52:10.501796 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:10.501768    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ff4eeb5-44d0-494e-95d1-f6578bf23f77-kube-api-access-n867q" (OuterVolumeSpecName: "kube-api-access-n867q") pod "0ff4eeb5-44d0-494e-95d1-f6578bf23f77" (UID: "0ff4eeb5-44d0-494e-95d1-f6578bf23f77"). InnerVolumeSpecName "kube-api-access-n867q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:52:10.503378 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:10.503357    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7614-139990905358896"]
Jul 24 17:52:10.505825 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:10.505805    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7614-139990905358896"]
Jul 24 17:52:10.600454 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:10.600381    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n867q\" (UniqueName: \"kubernetes.io/projected/0ff4eeb5-44d0-494e-95d1-f6578bf23f77-kube-api-access-n867q\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:52:10.671319 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:10.671290    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7614-139990911743728"]
Jul 24 17:52:10.671737 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:10.671723    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ff4eeb5-44d0-494e-95d1-f6578bf23f77" containerName="test-curl-7614-139990905358896"
Jul 24 17:52:10.671777 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:10.671738    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ff4eeb5-44d0-494e-95d1-f6578bf23f77" containerName="test-curl-7614-139990905358896"
Jul 24 17:52:10.671828 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:10.671807    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ff4eeb5-44d0-494e-95d1-f6578bf23f77" containerName="test-curl-7614-139990905358896"
Jul 24 17:52:10.675144 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:10.675127    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990911743728"
Jul 24 17:52:10.683172 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:10.683142    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-139990911743728"]
Jul 24 17:52:10.801829 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:10.801793    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zftrc\" (UniqueName: \"kubernetes.io/projected/f97674d9-1f8c-4742-b718-1e210b65cf41-kube-api-access-zftrc\") pod \"test-curl-7614-139990911743728\" (UID: \"f97674d9-1f8c-4742-b718-1e210b65cf41\") " pod="opendatahub/test-curl-7614-139990911743728"
Jul 24 17:52:10.903316 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:10.903274    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zftrc\" (UniqueName: \"kubernetes.io/projected/f97674d9-1f8c-4742-b718-1e210b65cf41-kube-api-access-zftrc\") pod \"test-curl-7614-139990911743728\" (UID: \"f97674d9-1f8c-4742-b718-1e210b65cf41\") " pod="opendatahub/test-curl-7614-139990911743728"
Jul 24 17:52:10.911806 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:10.911773    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zftrc\" (UniqueName: \"kubernetes.io/projected/f97674d9-1f8c-4742-b718-1e210b65cf41-kube-api-access-zftrc\") pod \"test-curl-7614-139990911743728\" (UID: \"f97674d9-1f8c-4742-b718-1e210b65cf41\") " pod="opendatahub/test-curl-7614-139990911743728"
Jul 24 17:52:10.985385 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:10.985348    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990911743728"
Jul 24 17:52:11.086578 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:11.086541    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ff4eeb5-44d0-494e-95d1-f6578bf23f77" path="/var/lib/kubelet/pods/0ff4eeb5-44d0-494e-95d1-f6578bf23f77/volumes"
Jul 24 17:52:11.145909 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:11.145879    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-139990911743728"]
Jul 24 17:52:11.148554 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:52:11.148528    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf97674d9_1f8c_4742_b718_1e210b65cf41.slice/crio-b1a93c8c51049ec9d523fffa7f1b0b4579d8eaf75cc5f53382dd7c20866982cf WatchSource:0}: Error finding container b1a93c8c51049ec9d523fffa7f1b0b4579d8eaf75cc5f53382dd7c20866982cf: Status 404 returned error can't find the container with id b1a93c8c51049ec9d523fffa7f1b0b4579d8eaf75cc5f53382dd7c20866982cf
Jul 24 17:52:11.297642 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:11.297606    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-139990911743728" event={"ID":"f97674d9-1f8c-4742-b718-1e210b65cf41","Type":"ContainerStarted","Data":"b1a93c8c51049ec9d523fffa7f1b0b4579d8eaf75cc5f53382dd7c20866982cf"}
Jul 24 17:52:11.299038 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:11.299011    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990905358896"
Jul 24 17:52:11.299168 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:11.299046    2572 scope.go:117] "RemoveContainer" containerID="e682d31088b3eedb45c27bd151774b20b4c529cea1f6e4a6240ab12cd9536d7e"
Jul 24 17:52:12.306512 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:12.306475    2572 generic.go:356] "Generic (PLEG): container finished" podID="f97674d9-1f8c-4742-b718-1e210b65cf41" containerID="07220142756a0902b983f9c032fd7da59122bf532eb73f19a15ab9ee552efa81" exitCode=0
Jul 24 17:52:12.306943 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:12.306559    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-139990911743728" event={"ID":"f97674d9-1f8c-4742-b718-1e210b65cf41","Type":"ContainerDied","Data":"07220142756a0902b983f9c032fd7da59122bf532eb73f19a15ab9ee552efa81"}
Jul 24 17:52:13.463555 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:13.463530    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990911743728"
Jul 24 17:52:13.483838 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:13.483812    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7614-139990911743728_f97674d9-1f8c-4742-b718-1e210b65cf41/test-curl-7614-139990911743728/0.log"
Jul 24 17:52:13.508164 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:13.508130    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7614-139990911743728"]
Jul 24 17:52:13.510598 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:13.510576    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7614-139990911743728"]
Jul 24 17:52:13.530681 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:13.530657    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zftrc\" (UniqueName: \"kubernetes.io/projected/f97674d9-1f8c-4742-b718-1e210b65cf41-kube-api-access-zftrc\") pod \"f97674d9-1f8c-4742-b718-1e210b65cf41\" (UID: \"f97674d9-1f8c-4742-b718-1e210b65cf41\") "
Jul 24 17:52:13.532989 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:13.532955    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f97674d9-1f8c-4742-b718-1e210b65cf41-kube-api-access-zftrc" (OuterVolumeSpecName: "kube-api-access-zftrc") pod "f97674d9-1f8c-4742-b718-1e210b65cf41" (UID: "f97674d9-1f8c-4742-b718-1e210b65cf41"). InnerVolumeSpecName "kube-api-access-zftrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:52:13.632281 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:13.632211    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zftrc\" (UniqueName: \"kubernetes.io/projected/f97674d9-1f8c-4742-b718-1e210b65cf41-kube-api-access-zftrc\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:52:13.655156 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:13.655123    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7614-139990911743728"]
Jul 24 17:52:13.655557 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:13.655543    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f97674d9-1f8c-4742-b718-1e210b65cf41" containerName="test-curl-7614-139990911743728"
Jul 24 17:52:13.655599 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:13.655559    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f97674d9-1f8c-4742-b718-1e210b65cf41" containerName="test-curl-7614-139990911743728"
Jul 24 17:52:13.655648 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:13.655639    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f97674d9-1f8c-4742-b718-1e210b65cf41" containerName="test-curl-7614-139990911743728"
Jul 24 17:52:13.658435 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:13.658417    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990911743728"
Jul 24 17:52:13.664926 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:13.664896    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-139990911743728"]
Jul 24 17:52:13.733647 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:13.733609    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqkvg\" (UniqueName: \"kubernetes.io/projected/29d28bd3-febe-49e0-9efd-ae2c55603ef2-kube-api-access-jqkvg\") pod \"test-curl-7614-139990911743728\" (UID: \"29d28bd3-febe-49e0-9efd-ae2c55603ef2\") " pod="opendatahub/test-curl-7614-139990911743728"
Jul 24 17:52:13.834256 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:13.834194    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqkvg\" (UniqueName: \"kubernetes.io/projected/29d28bd3-febe-49e0-9efd-ae2c55603ef2-kube-api-access-jqkvg\") pod \"test-curl-7614-139990911743728\" (UID: \"29d28bd3-febe-49e0-9efd-ae2c55603ef2\") " pod="opendatahub/test-curl-7614-139990911743728"
Jul 24 17:52:13.843133 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:13.843104    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqkvg\" (UniqueName: \"kubernetes.io/projected/29d28bd3-febe-49e0-9efd-ae2c55603ef2-kube-api-access-jqkvg\") pod \"test-curl-7614-139990911743728\" (UID: \"29d28bd3-febe-49e0-9efd-ae2c55603ef2\") " pod="opendatahub/test-curl-7614-139990911743728"
Jul 24 17:52:13.969447 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:13.969351    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990911743728"
Jul 24 17:52:14.113910 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:14.113882    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-139990911743728"]
Jul 24 17:52:14.115621 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:52:14.115595    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29d28bd3_febe_49e0_9efd_ae2c55603ef2.slice/crio-6e23bbc5d9f5e62f4f5957ae97cd15dfae57beed62a3e633ca0138e1e4cebcf6 WatchSource:0}: Error finding container 6e23bbc5d9f5e62f4f5957ae97cd15dfae57beed62a3e633ca0138e1e4cebcf6: Status 404 returned error can't find the container with id 6e23bbc5d9f5e62f4f5957ae97cd15dfae57beed62a3e633ca0138e1e4cebcf6
Jul 24 17:52:14.327291 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:14.327169    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1a93c8c51049ec9d523fffa7f1b0b4579d8eaf75cc5f53382dd7c20866982cf"
Jul 24 17:52:14.327291 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:14.327207    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990911743728"
Jul 24 17:52:14.328495 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:14.328459    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-139990911743728" event={"ID":"29d28bd3-febe-49e0-9efd-ae2c55603ef2","Type":"ContainerStarted","Data":"6e23bbc5d9f5e62f4f5957ae97cd15dfae57beed62a3e633ca0138e1e4cebcf6"}
Jul 24 17:52:14.341417 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:14.341364    2572 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7614-139990911743728" oldPodUID="f97674d9-1f8c-4742-b718-1e210b65cf41" podUID="29d28bd3-febe-49e0-9efd-ae2c55603ef2"
Jul 24 17:52:15.086571 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:15.086536    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f97674d9-1f8c-4742-b718-1e210b65cf41" path="/var/lib/kubelet/pods/f97674d9-1f8c-4742-b718-1e210b65cf41/volumes"
Jul 24 17:52:15.336971 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:15.336879    2572 generic.go:356] "Generic (PLEG): container finished" podID="29d28bd3-febe-49e0-9efd-ae2c55603ef2" containerID="6dd656bb4b412ba92d11318e0e1ded8b40d20e20fbe7d89248f1c944635e1612" exitCode=0
Jul 24 17:52:15.336971 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:15.336963    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-139990911743728" event={"ID":"29d28bd3-febe-49e0-9efd-ae2c55603ef2","Type":"ContainerDied","Data":"6dd656bb4b412ba92d11318e0e1ded8b40d20e20fbe7d89248f1c944635e1612"}
Jul 24 17:52:16.485268 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:16.485222    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990911743728"
Jul 24 17:52:16.513389 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:16.513354    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7614-139990911743728_29d28bd3-febe-49e0-9efd-ae2c55603ef2/test-curl-7614-139990911743728/0.log"
Jul 24 17:52:16.543275 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:16.543225    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7614-139990911743728"]
Jul 24 17:52:16.547659 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:16.547628    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7614-139990911743728"]
Jul 24 17:52:16.561554 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:16.561527    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqkvg\" (UniqueName: \"kubernetes.io/projected/29d28bd3-febe-49e0-9efd-ae2c55603ef2-kube-api-access-jqkvg\") pod \"29d28bd3-febe-49e0-9efd-ae2c55603ef2\" (UID: \"29d28bd3-febe-49e0-9efd-ae2c55603ef2\") "
Jul 24 17:52:16.563722 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:16.563695    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29d28bd3-febe-49e0-9efd-ae2c55603ef2-kube-api-access-jqkvg" (OuterVolumeSpecName: "kube-api-access-jqkvg") pod "29d28bd3-febe-49e0-9efd-ae2c55603ef2" (UID: "29d28bd3-febe-49e0-9efd-ae2c55603ef2"). InnerVolumeSpecName "kube-api-access-jqkvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:52:16.662994 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:16.662960    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqkvg\" (UniqueName: \"kubernetes.io/projected/29d28bd3-febe-49e0-9efd-ae2c55603ef2-kube-api-access-jqkvg\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:52:16.679389 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:16.679359    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7614-139990905320912"]
Jul 24 17:52:16.679822 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:16.679807    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29d28bd3-febe-49e0-9efd-ae2c55603ef2" containerName="test-curl-7614-139990911743728"
Jul 24 17:52:16.679863 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:16.679824    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="29d28bd3-febe-49e0-9efd-ae2c55603ef2" containerName="test-curl-7614-139990911743728"
Jul 24 17:52:16.679898 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:16.679893    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="29d28bd3-febe-49e0-9efd-ae2c55603ef2" containerName="test-curl-7614-139990911743728"
Jul 24 17:52:16.682971 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:16.682957    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990905320912"
Jul 24 17:52:16.692171 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:16.692143    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-139990905320912"]
Jul 24 17:52:16.763991 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:16.763958    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msw75\" (UniqueName: \"kubernetes.io/projected/46f645b1-12d2-4c7a-b59c-01b6d2799911-kube-api-access-msw75\") pod \"test-curl-7614-139990905320912\" (UID: \"46f645b1-12d2-4c7a-b59c-01b6d2799911\") " pod="opendatahub/test-curl-7614-139990905320912"
Jul 24 17:52:16.865579 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:16.865543    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msw75\" (UniqueName: \"kubernetes.io/projected/46f645b1-12d2-4c7a-b59c-01b6d2799911-kube-api-access-msw75\") pod \"test-curl-7614-139990905320912\" (UID: \"46f645b1-12d2-4c7a-b59c-01b6d2799911\") " pod="opendatahub/test-curl-7614-139990905320912"
Jul 24 17:52:16.874206 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:16.874175    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msw75\" (UniqueName: \"kubernetes.io/projected/46f645b1-12d2-4c7a-b59c-01b6d2799911-kube-api-access-msw75\") pod \"test-curl-7614-139990905320912\" (UID: \"46f645b1-12d2-4c7a-b59c-01b6d2799911\") " pod="opendatahub/test-curl-7614-139990905320912"
Jul 24 17:52:16.994183 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:16.994107    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990905320912"
Jul 24 17:52:17.089979 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:17.089939    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29d28bd3-febe-49e0-9efd-ae2c55603ef2" path="/var/lib/kubelet/pods/29d28bd3-febe-49e0-9efd-ae2c55603ef2/volumes"
Jul 24 17:52:17.136794 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:17.136768    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-139990905320912"]
Jul 24 17:52:17.138247 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:52:17.138203    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46f645b1_12d2_4c7a_b59c_01b6d2799911.slice/crio-c6569f77362385a4087a23b87413deedd3871dba2e4e9b8f4848664b75c0320c WatchSource:0}: Error finding container c6569f77362385a4087a23b87413deedd3871dba2e4e9b8f4848664b75c0320c: Status 404 returned error can't find the container with id c6569f77362385a4087a23b87413deedd3871dba2e4e9b8f4848664b75c0320c
Jul 24 17:52:17.351339 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:17.351225    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-139990905320912" event={"ID":"46f645b1-12d2-4c7a-b59c-01b6d2799911","Type":"ContainerStarted","Data":"c6569f77362385a4087a23b87413deedd3871dba2e4e9b8f4848664b75c0320c"}
Jul 24 17:52:17.352741 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:17.352718    2572 scope.go:117] "RemoveContainer" containerID="6dd656bb4b412ba92d11318e0e1ded8b40d20e20fbe7d89248f1c944635e1612"
Jul 24 17:52:17.352894 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:17.352764    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990911743728"
Jul 24 17:52:18.360809 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:18.360773    2572 generic.go:356] "Generic (PLEG): container finished" podID="46f645b1-12d2-4c7a-b59c-01b6d2799911" containerID="c8f94a9dc14c0d5548718bbc3958b55551905ab66d41cfea4df9d7aa96c9ae15" exitCode=0
Jul 24 17:52:18.361203 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:18.360855    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-139990905320912" event={"ID":"46f645b1-12d2-4c7a-b59c-01b6d2799911","Type":"ContainerDied","Data":"c8f94a9dc14c0d5548718bbc3958b55551905ab66d41cfea4df9d7aa96c9ae15"}
Jul 24 17:52:19.511055 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:19.511031    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990905320912"
Jul 24 17:52:19.569002 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:19.568967    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7614-139990905320912_46f645b1-12d2-4c7a-b59c-01b6d2799911/test-curl-7614-139990905320912/0.log"
Jul 24 17:52:19.591941 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:19.591904    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msw75\" (UniqueName: \"kubernetes.io/projected/46f645b1-12d2-4c7a-b59c-01b6d2799911-kube-api-access-msw75\") pod \"46f645b1-12d2-4c7a-b59c-01b6d2799911\" (UID: \"46f645b1-12d2-4c7a-b59c-01b6d2799911\") "
Jul 24 17:52:19.594163 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:19.594129    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46f645b1-12d2-4c7a-b59c-01b6d2799911-kube-api-access-msw75" (OuterVolumeSpecName: "kube-api-access-msw75") pod "46f645b1-12d2-4c7a-b59c-01b6d2799911" (UID: "46f645b1-12d2-4c7a-b59c-01b6d2799911"). InnerVolumeSpecName "kube-api-access-msw75". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:52:19.614152 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:19.614130    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7614-139990905320912"]
Jul 24 17:52:19.616433 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:19.616413    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7614-139990905320912"]
Jul 24 17:52:19.693121 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:19.693046    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msw75\" (UniqueName: \"kubernetes.io/projected/46f645b1-12d2-4c7a-b59c-01b6d2799911-kube-api-access-msw75\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:52:19.759332 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:19.759303    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7614-139990905320912"]
Jul 24 17:52:19.759729 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:19.759717    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46f645b1-12d2-4c7a-b59c-01b6d2799911" containerName="test-curl-7614-139990905320912"
Jul 24 17:52:19.759778 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:19.759731    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="46f645b1-12d2-4c7a-b59c-01b6d2799911" containerName="test-curl-7614-139990905320912"
Jul 24 17:52:19.759818 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:19.759809    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="46f645b1-12d2-4c7a-b59c-01b6d2799911" containerName="test-curl-7614-139990905320912"
Jul 24 17:52:19.762904 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:19.762889    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990905320912"
Jul 24 17:52:19.771198 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:19.771175    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-139990905320912"]
Jul 24 17:52:19.895737 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:19.895701    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvb6g\" (UniqueName: \"kubernetes.io/projected/c24a1a4d-8349-41a9-829a-238960447c7e-kube-api-access-dvb6g\") pod \"test-curl-7614-139990905320912\" (UID: \"c24a1a4d-8349-41a9-829a-238960447c7e\") " pod="opendatahub/test-curl-7614-139990905320912"
Jul 24 17:52:19.996630 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:19.996554    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvb6g\" (UniqueName: \"kubernetes.io/projected/c24a1a4d-8349-41a9-829a-238960447c7e-kube-api-access-dvb6g\") pod \"test-curl-7614-139990905320912\" (UID: \"c24a1a4d-8349-41a9-829a-238960447c7e\") " pod="opendatahub/test-curl-7614-139990905320912"
Jul 24 17:52:20.006071 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:20.006044    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvb6g\" (UniqueName: \"kubernetes.io/projected/c24a1a4d-8349-41a9-829a-238960447c7e-kube-api-access-dvb6g\") pod \"test-curl-7614-139990905320912\" (UID: \"c24a1a4d-8349-41a9-829a-238960447c7e\") " pod="opendatahub/test-curl-7614-139990905320912"
Jul 24 17:52:20.072893 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:20.072865    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990905320912"
Jul 24 17:52:20.208748 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:20.208722    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-139990905320912"]
Jul 24 17:52:20.210183 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:52:20.210156    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc24a1a4d_8349_41a9_829a_238960447c7e.slice/crio-e14ba6195f0a2acebc22cef98691ffd5b375f49e0ecd87a07a3e79c3cb859d56 WatchSource:0}: Error finding container e14ba6195f0a2acebc22cef98691ffd5b375f49e0ecd87a07a3e79c3cb859d56: Status 404 returned error can't find the container with id e14ba6195f0a2acebc22cef98691ffd5b375f49e0ecd87a07a3e79c3cb859d56
Jul 24 17:52:20.373574 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:20.373545    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990905320912"
Jul 24 17:52:20.373763 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:20.373594    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6569f77362385a4087a23b87413deedd3871dba2e4e9b8f4848664b75c0320c"
Jul 24 17:52:20.374862 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:20.374831    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-139990905320912" event={"ID":"c24a1a4d-8349-41a9-829a-238960447c7e","Type":"ContainerStarted","Data":"e14ba6195f0a2acebc22cef98691ffd5b375f49e0ecd87a07a3e79c3cb859d56"}
Jul 24 17:52:20.385595 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:20.385566    2572 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7614-139990905320912" oldPodUID="46f645b1-12d2-4c7a-b59c-01b6d2799911" podUID="c24a1a4d-8349-41a9-829a-238960447c7e"
Jul 24 17:52:21.086391 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:21.086359    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46f645b1-12d2-4c7a-b59c-01b6d2799911" path="/var/lib/kubelet/pods/46f645b1-12d2-4c7a-b59c-01b6d2799911/volumes"
Jul 24 17:52:21.382150 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:21.382109    2572 generic.go:356] "Generic (PLEG): container finished" podID="c24a1a4d-8349-41a9-829a-238960447c7e" containerID="db70941d6703985cfc8b0b51a74a558e3696d32af00870aaf45c81dd6e275405" exitCode=0
Jul 24 17:52:21.382355 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:21.382204    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-139990905320912" event={"ID":"c24a1a4d-8349-41a9-829a-238960447c7e","Type":"ContainerDied","Data":"db70941d6703985cfc8b0b51a74a558e3696d32af00870aaf45c81dd6e275405"}
Jul 24 17:52:22.532805 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:22.532782    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990905320912"
Jul 24 17:52:22.552581 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:22.552508    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7614-139990905320912_c24a1a4d-8349-41a9-829a-238960447c7e/test-curl-7614-139990905320912/0.log"
Jul 24 17:52:22.576339 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:22.576315    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7614-139990905320912"]
Jul 24 17:52:22.579916 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:22.579895    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7614-139990905320912"]
Jul 24 17:52:22.620560 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:22.620541    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvb6g\" (UniqueName: \"kubernetes.io/projected/c24a1a4d-8349-41a9-829a-238960447c7e-kube-api-access-dvb6g\") pod \"c24a1a4d-8349-41a9-829a-238960447c7e\" (UID: \"c24a1a4d-8349-41a9-829a-238960447c7e\") "
Jul 24 17:52:22.622672 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:22.622645    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c24a1a4d-8349-41a9-829a-238960447c7e-kube-api-access-dvb6g" (OuterVolumeSpecName: "kube-api-access-dvb6g") pod "c24a1a4d-8349-41a9-829a-238960447c7e" (UID: "c24a1a4d-8349-41a9-829a-238960447c7e"). InnerVolumeSpecName "kube-api-access-dvb6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:52:22.721768 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:22.721686    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvb6g\" (UniqueName: \"kubernetes.io/projected/c24a1a4d-8349-41a9-829a-238960447c7e-kube-api-access-dvb6g\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:52:23.092593 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:23.092516    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c24a1a4d-8349-41a9-829a-238960447c7e" path="/var/lib/kubelet/pods/c24a1a4d-8349-41a9-829a-238960447c7e/volumes"
Jul 24 17:52:23.398346 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:23.398313    2572 scope.go:117] "RemoveContainer" containerID="db70941d6703985cfc8b0b51a74a558e3696d32af00870aaf45c81dd6e275405"
Jul 24 17:52:23.398552 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:23.398315    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-139990905320912"
Jul 24 17:52:26.283591 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:26.283549    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv"]
Jul 24 17:52:26.284143 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:26.284122    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c24a1a4d-8349-41a9-829a-238960447c7e" containerName="test-curl-7614-139990905320912"
Jul 24 17:52:26.284264 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:26.284146    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c24a1a4d-8349-41a9-829a-238960447c7e" containerName="test-curl-7614-139990905320912"
Jul 24 17:52:26.284364 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:26.284300    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c24a1a4d-8349-41a9-829a-238960447c7e" containerName="test-curl-7614-139990905320912"
Jul 24 17:52:26.288368 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:26.288342    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv"
Jul 24 17:52:26.299031 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:26.299011    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-92693f-serving-cert\""
Jul 24 17:52:26.314880 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:26.314857    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv"]
Jul 24 17:52:26.456647 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:26.456596    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01a5ea7a-1dc0-4453-adc0-808492868a01-maas-api-tls\") pod \"maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv\" (UID: \"01a5ea7a-1dc0-4453-adc0-808492868a01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv"
Jul 24 17:52:26.456842 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:26.456686    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01a5ea7a-1dc0-4453-adc0-808492868a01-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv\" (UID: \"01a5ea7a-1dc0-4453-adc0-808492868a01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv"
Jul 24 17:52:26.456842 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:26.456737    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgn5d\" (UniqueName: \"kubernetes.io/projected/01a5ea7a-1dc0-4453-adc0-808492868a01-kube-api-access-kgn5d\") pod \"maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv\" (UID: \"01a5ea7a-1dc0-4453-adc0-808492868a01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv"
Jul 24 17:52:26.557894 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:26.557812    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01a5ea7a-1dc0-4453-adc0-808492868a01-maas-api-tls\") pod \"maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv\" (UID: \"01a5ea7a-1dc0-4453-adc0-808492868a01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv"
Jul 24 17:52:26.557894 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:26.557865    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01a5ea7a-1dc0-4453-adc0-808492868a01-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv\" (UID: \"01a5ea7a-1dc0-4453-adc0-808492868a01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv"
Jul 24 17:52:26.557894 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:26.557882    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgn5d\" (UniqueName: \"kubernetes.io/projected/01a5ea7a-1dc0-4453-adc0-808492868a01-kube-api-access-kgn5d\") pod \"maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv\" (UID: \"01a5ea7a-1dc0-4453-adc0-808492868a01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv"
Jul 24 17:52:26.558582 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:26.558559    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01a5ea7a-1dc0-4453-adc0-808492868a01-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv\" (UID: \"01a5ea7a-1dc0-4453-adc0-808492868a01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv"
Jul 24 17:52:26.560517 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:26.560497    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01a5ea7a-1dc0-4453-adc0-808492868a01-maas-api-tls\") pod \"maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv\" (UID: \"01a5ea7a-1dc0-4453-adc0-808492868a01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv"
Jul 24 17:52:26.588809 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:26.588780    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgn5d\" (UniqueName: \"kubernetes.io/projected/01a5ea7a-1dc0-4453-adc0-808492868a01-kube-api-access-kgn5d\") pod \"maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv\" (UID: \"01a5ea7a-1dc0-4453-adc0-808492868a01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv"
Jul 24 17:52:26.598680 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:26.598661    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv"
Jul 24 17:52:26.752085 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:26.752057    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv"]
Jul 24 17:52:26.753499 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:52:26.753464    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a5ea7a_1dc0_4453_adc0_808492868a01.slice/crio-62a9c632d82974541209d2b13ceade2f686ee71cebfca74e085ccd8150c309f8 WatchSource:0}: Error finding container 62a9c632d82974541209d2b13ceade2f686ee71cebfca74e085ccd8150c309f8: Status 404 returned error can't find the container with id 62a9c632d82974541209d2b13ceade2f686ee71cebfca74e085ccd8150c309f8
Jul 24 17:52:27.425432 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:27.425393    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv" event={"ID":"01a5ea7a-1dc0-4453-adc0-808492868a01","Type":"ContainerStarted","Data":"0ced98be9d28cd2c07dba031f435285ff567637db061403d6bbae3d01e121b68"}
Jul 24 17:52:27.425844 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:27.425455    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv" event={"ID":"01a5ea7a-1dc0-4453-adc0-808492868a01","Type":"ContainerStarted","Data":"62a9c632d82974541209d2b13ceade2f686ee71cebfca74e085ccd8150c309f8"}
Jul 24 17:52:27.425844 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:27.425587    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv"
Jul 24 17:52:27.445171 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:27.445054    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv" podStartSLOduration=1.015984192 podStartE2EDuration="1.445038491s" totalImagesPullingTime="429.054299ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:52:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:52:27.443475854 +0000 UTC m=+2964.877691431" watchObservedRunningTime="2026-07-24 17:52:27.445038491 +0000 UTC m=+2964.879254117"
Jul 24 17:52:33.436640 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:33.436607    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv"
Jul 24 17:52:41.751100 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.751068    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"]
Jul 24 17:52:41.754649 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.754632    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.757342 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.757310    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-ea8b57-openshift-default-dockercfg-95pjt\""
Jul 24 17:52:41.769275 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.769218    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"]
Jul 24 17:52:41.800131 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.800095    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-credential-socket\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.800345 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.800155    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-workload-certs\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.800345 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.800226    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-podinfo\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.800345 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.800258    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-workload-socket\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.800345 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.800274    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-envoy\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.800345 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.800293    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-token\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.800518 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.800362    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgrsb\" (UniqueName: \"kubernetes.io/projected/d4f91f9a-3f15-4bea-8119-fb74a4904a16-kube-api-access-pgrsb\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.800518 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.800412    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-data\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.800518 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.800432    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istiod-ca-cert\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.901760 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.901716    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-workload-certs\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.901969 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.901792    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-podinfo\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.901969 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.901810    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-workload-socket\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.901969 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.901825    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-envoy\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.901969 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.901842    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-token\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.901969 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.901868    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgrsb\" (UniqueName: \"kubernetes.io/projected/d4f91f9a-3f15-4bea-8119-fb74a4904a16-kube-api-access-pgrsb\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.901969 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.901885    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-data\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.901969 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.901908    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istiod-ca-cert\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.901969 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.901956    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-credential-socket\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.902393 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.902199    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-workload-certs\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.902393 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.902275    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-workload-socket\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.902393 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.902300    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-credential-socket\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.902543 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.902520    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-data\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.902668 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.902647    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istiod-ca-cert\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.904369 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.904348    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-envoy\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.904746 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.904726    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-podinfo\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.911011 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.910985    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-token\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:41.911185 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:41.911167    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgrsb\" (UniqueName: \"kubernetes.io/projected/d4f91f9a-3f15-4bea-8119-fb74a4904a16-kube-api-access-pgrsb\") pod \"e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") " pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:42.065747 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:42.065658    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:42.225804 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:42.225768    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"]
Jul 24 17:52:42.227270 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:52:42.227213    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4f91f9a_3f15_4bea_8119_fb74a4904a16.slice/crio-3c93498b86aa88f4734210e6d2dde1d63c6b37cf9d7ba62796aa48bc2ac95a52 WatchSource:0}: Error finding container 3c93498b86aa88f4734210e6d2dde1d63c6b37cf9d7ba62796aa48bc2ac95a52: Status 404 returned error can't find the container with id 3c93498b86aa88f4734210e6d2dde1d63c6b37cf9d7ba62796aa48bc2ac95a52
Jul 24 17:52:42.229547 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:42.229510    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:52:42.229633 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:42.229596    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:52:42.229702 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:42.229640    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:52:42.519444 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:42.519404    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9" event={"ID":"d4f91f9a-3f15-4bea-8119-fb74a4904a16","Type":"ContainerStarted","Data":"f9fa77b7577fdba4a05e64eab84b5ba77b9ed4ecd9d169b6a3e9156ccc5f25fd"}
Jul 24 17:52:42.519704 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:42.519474    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9" event={"ID":"d4f91f9a-3f15-4bea-8119-fb74a4904a16","Type":"ContainerStarted","Data":"3c93498b86aa88f4734210e6d2dde1d63c6b37cf9d7ba62796aa48bc2ac95a52"}
Jul 24 17:52:42.540359 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:42.540310    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9" podStartSLOduration=1.5402920820000001 podStartE2EDuration="1.540292082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:52:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:52:42.539301809 +0000 UTC m=+2979.973517376" watchObservedRunningTime="2026-07-24 17:52:42.540292082 +0000 UTC m=+2979.974507666"
Jul 24 17:52:43.066663 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:43.066626    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:43.072381 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:43.072349    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:43.525122 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:43.525086    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:43.526320 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:43.526298    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:56.608797 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:56.608757    2572 generic.go:356] "Generic (PLEG): container finished" podID="d4f91f9a-3f15-4bea-8119-fb74a4904a16" containerID="f9fa77b7577fdba4a05e64eab84b5ba77b9ed4ecd9d169b6a3e9156ccc5f25fd" exitCode=0
Jul 24 17:52:56.609358 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:56.608825    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9" event={"ID":"d4f91f9a-3f15-4bea-8119-fb74a4904a16","Type":"ContainerDied","Data":"f9fa77b7577fdba4a05e64eab84b5ba77b9ed4ecd9d169b6a3e9156ccc5f25fd"}
Jul 24 17:52:56.609358 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:56.609262    2572 scope.go:117] "RemoveContainer" containerID="f9fa77b7577fdba4a05e64eab84b5ba77b9ed4ecd9d169b6a3e9156ccc5f25fd"
Jul 24 17:52:56.610409 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:56.610383    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:52:56.610483 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:56.610449    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:52:56.610526 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:56.610481    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:52:57.620984 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:57.620946    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9" event={"ID":"d4f91f9a-3f15-4bea-8119-fb74a4904a16","Type":"ContainerStarted","Data":"8a575cfdfe73d1ed8f2d1e1b3153458004c1a85c11b21acb5019ad13dee2b83c"}
Jul 24 17:52:58.066876 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:58.066786    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:58.067901 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:58.067874    2572 patch_prober.go:28] interesting pod/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Jul 24 17:52:58.068041 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:58.067932    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9" podUID="d4f91f9a-3f15-4bea-8119-fb74a4904a16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Jul 24 17:52:58.525899 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:58.525856    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:52:59.066825 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:59.066781    2572 patch_prober.go:28] interesting pod/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Jul 24 17:52:59.067287 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:52:59.066857    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9" podUID="d4f91f9a-3f15-4bea-8119-fb74a4904a16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Jul 24 17:53:00.066487 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:00.066442    2572 patch_prober.go:28] interesting pod/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Jul 24 17:53:00.066701 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:00.066531    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9" podUID="d4f91f9a-3f15-4bea-8119-fb74a4904a16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Jul 24 17:53:01.066546 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:01.066504    2572 patch_prober.go:28] interesting pod/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Jul 24 17:53:01.066945 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:01.066577    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9" podUID="d4f91f9a-3f15-4bea-8119-fb74a4904a16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Jul 24 17:53:02.070910 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:02.070878    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:53:02.072108 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:02.072088    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:53:03.334055 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:03.334028    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:53:03.345827 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:03.345804    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:53:54.508372 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.508293    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"]
Jul 24 17:53:54.511337 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.511319    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.515429 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.515406    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-201d60-openshift-default-dockercfg-5hqn8\""
Jul 24 17:53:54.535434 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.535407    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"]
Jul 24 17:53:54.625313 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.625273    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-token\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.625313 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.625311    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2trrz\" (UniqueName: \"kubernetes.io/projected/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-kube-api-access-2trrz\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.625525 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.625372    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istiod-ca-cert\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.625525 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.625396    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-workload-certs\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.625597 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.625524    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-envoy\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.625597 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.625548    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-podinfo\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.625597 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.625577    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-credential-socket\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.625697 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.625622    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-data\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.625697 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.625647    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-workload-socket\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.726711 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.726674    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-workload-socket\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.726711 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.726720    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-token\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.726983 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.726736    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2trrz\" (UniqueName: \"kubernetes.io/projected/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-kube-api-access-2trrz\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.726983 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.726774    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istiod-ca-cert\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.726983 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.726795    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-workload-certs\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.726983 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.726890    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-envoy\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.726983 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.726906    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-podinfo\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.726983 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.726940    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-credential-socket\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.727342 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.727096    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-data\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.727342 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.727216    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-workload-socket\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.727457 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.727405    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-workload-certs\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.727514 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.727477    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-credential-socket\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.727514 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.727487    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-data\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.727710 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.727688    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istiod-ca-cert\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.729420 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.729398    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-envoy\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.729618 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.729600    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-podinfo\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.736194 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.736165    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-token\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.736676 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.736656    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2trrz\" (UniqueName: \"kubernetes.io/projected/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-kube-api-access-2trrz\") pod \"e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") " pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.821775 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.821681    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:54.987292 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.987260    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"]
Jul 24 17:53:54.988956 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:53:54.988918    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6a00d22_63fd_4e0f_bbb5_a4e795ad24d3.slice/crio-76ad5cbec16611ba96c0a9a8792dcf579ae157c5486ad3c9542b74c9016a84cd WatchSource:0}: Error finding container 76ad5cbec16611ba96c0a9a8792dcf579ae157c5486ad3c9542b74c9016a84cd: Status 404 returned error can't find the container with id 76ad5cbec16611ba96c0a9a8792dcf579ae157c5486ad3c9542b74c9016a84cd
Jul 24 17:53:54.991192 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.991158    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:53:54.991317 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.991227    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:53:54.991317 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:54.991284    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:53:55.976001 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:55.975959    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft" event={"ID":"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3","Type":"ContainerStarted","Data":"52c7a50fc5af7ec041c78ce4795203d8c1f853638cc187fbe274f88bcb16b2e8"}
Jul 24 17:53:55.976421 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:55.976052    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft" event={"ID":"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3","Type":"ContainerStarted","Data":"76ad5cbec16611ba96c0a9a8792dcf579ae157c5486ad3c9542b74c9016a84cd"}
Jul 24 17:53:56.017878 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:56.017826    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft" podStartSLOduration=2.017810329 podStartE2EDuration="2.017810329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:53:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:53:56.016139642 +0000 UTC m=+3053.450355209" watchObservedRunningTime="2026-07-24 17:53:56.017810329 +0000 UTC m=+3053.452025896"
Jul 24 17:53:56.822424 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:56.822385    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:56.827613 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:56.827588    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:56.982435 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:56.982405    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:53:56.983415 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:53:56.983398    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:54:11.070887 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:11.070858    2572 generic.go:356] "Generic (PLEG): container finished" podID="a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3" containerID="52c7a50fc5af7ec041c78ce4795203d8c1f853638cc187fbe274f88bcb16b2e8" exitCode=0
Jul 24 17:54:11.071300 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:11.070924    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft" event={"ID":"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3","Type":"ContainerDied","Data":"52c7a50fc5af7ec041c78ce4795203d8c1f853638cc187fbe274f88bcb16b2e8"}
Jul 24 17:54:11.071383 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:11.071370    2572 scope.go:117] "RemoveContainer" containerID="52c7a50fc5af7ec041c78ce4795203d8c1f853638cc187fbe274f88bcb16b2e8"
Jul 24 17:54:11.072495 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:11.072467    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:54:11.072569 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:11.072539    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:54:11.072606 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:11.072571    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:54:11.982879 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:11.982840    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:54:12.080423 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:12.080389    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft" event={"ID":"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3","Type":"ContainerStarted","Data":"5737ecccb29866b78bcbd0f1c60479817691c831cfb16e50fbffb62a4496d78d"}
Jul 24 17:54:12.822296 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:12.822251    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:54:12.823516 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:12.823494    2572 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Jul 24 17:54:12.823599 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:12.823557    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft" podUID="a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Jul 24 17:54:13.822538 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:13.822499    2572 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Jul 24 17:54:13.822950 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:13.822571    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft" podUID="a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Jul 24 17:54:14.822985 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:14.822946    2572 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Jul 24 17:54:14.823412 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:14.823022    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft" podUID="a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Jul 24 17:54:15.822114 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:15.822075    2572 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Jul 24 17:54:15.822372 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:15.822147    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft" podUID="a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Jul 24 17:54:16.827065 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:16.827035    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:54:16.827511 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:16.827387    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:54:16.827978 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:16.827963    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:54:35.628279 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:35.628220    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"]
Jul 24 17:54:35.628806 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:35.628484    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft" podUID="a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3" containerName="istio-proxy" containerID="cri-o://5737ecccb29866b78bcbd0f1c60479817691c831cfb16e50fbffb62a4496d78d" gracePeriod=30
Jul 24 17:54:40.898144 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:40.898086    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:54:40.998639 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:40.998612    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istiod-ca-cert\") pod \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") "
Jul 24 17:54:40.998807 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:40.998651    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-workload-socket\") pod \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") "
Jul 24 17:54:40.998807 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:40.998683    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-token\") pod \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") "
Jul 24 17:54:40.998807 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:40.998701    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-workload-certs\") pod \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") "
Jul 24 17:54:40.998807 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:40.998718    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-podinfo\") pod \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") "
Jul 24 17:54:40.998807 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:40.998751    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2trrz\" (UniqueName: \"kubernetes.io/projected/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-kube-api-access-2trrz\") pod \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") "
Jul 24 17:54:40.999084 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:40.998855    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-data\") pod \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") "
Jul 24 17:54:40.999084 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:40.998886    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-envoy\") pod \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") "
Jul 24 17:54:40.999084 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:40.998930    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-credential-socket\") pod \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\" (UID: \"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3\") "
Jul 24 17:54:40.999084 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:40.999053    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3" (UID: "a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:54:40.999337 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:40.999076    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3" (UID: "a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:54:40.999337 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:40.999301    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3" (UID: "a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:54:40.999446 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:40.999394    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-workload-certs\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:54:40.999446 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:40.999426    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-credential-socket\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:54:40.999446 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:40.999441    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istiod-ca-cert\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:54:40.999611 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:40.999422    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3" (UID: "a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:54:41.000136 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:41.000103    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-data" (OuterVolumeSpecName: "istio-data") pod "a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3" (UID: "a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:54:41.001140 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:41.001114    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-token" (OuterVolumeSpecName: "istio-token") pod "a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3" (UID: "a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:54:41.001277 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:41.001145    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3" (UID: "a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:54:41.001277 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:41.001164    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-kube-api-access-2trrz" (OuterVolumeSpecName: "kube-api-access-2trrz") pod "a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3" (UID: "a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3"). InnerVolumeSpecName "kube-api-access-2trrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:54:41.001396 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:41.001380    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3" (UID: "a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:54:41.100585 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:41.100557    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2trrz\" (UniqueName: \"kubernetes.io/projected/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-kube-api-access-2trrz\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:54:41.100585 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:41.100585    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-data\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:54:41.100753 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:41.100598    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-envoy\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:54:41.100753 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:41.100610    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-workload-socket\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:54:41.100753 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:41.100621    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-token\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:54:41.100753 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:41.100632    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3-istio-podinfo\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:54:41.271046 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:41.270960    2572 generic.go:356] "Generic (PLEG): container finished" podID="a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3" containerID="5737ecccb29866b78bcbd0f1c60479817691c831cfb16e50fbffb62a4496d78d" exitCode=0
Jul 24 17:54:41.271046 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:41.271028    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"
Jul 24 17:54:41.271046 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:41.271026    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft" event={"ID":"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3","Type":"ContainerDied","Data":"5737ecccb29866b78bcbd0f1c60479817691c831cfb16e50fbffb62a4496d78d"}
Jul 24 17:54:41.271349 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:41.271101    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft" event={"ID":"a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3","Type":"ContainerDied","Data":"76ad5cbec16611ba96c0a9a8792dcf579ae157c5486ad3c9542b74c9016a84cd"}
Jul 24 17:54:41.271349 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:41.271134    2572 scope.go:117] "RemoveContainer" containerID="5737ecccb29866b78bcbd0f1c60479817691c831cfb16e50fbffb62a4496d78d"
Jul 24 17:54:41.281062 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:41.281043    2572 scope.go:117] "RemoveContainer" containerID="52c7a50fc5af7ec041c78ce4795203d8c1f853638cc187fbe274f88bcb16b2e8"
Jul 24 17:54:41.289823 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:41.289805    2572 scope.go:117] "RemoveContainer" containerID="5737ecccb29866b78bcbd0f1c60479817691c831cfb16e50fbffb62a4496d78d"
Jul 24 17:54:41.290095 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:54:41.290077    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5737ecccb29866b78bcbd0f1c60479817691c831cfb16e50fbffb62a4496d78d\": container with ID starting with 5737ecccb29866b78bcbd0f1c60479817691c831cfb16e50fbffb62a4496d78d not found: ID does not exist" containerID="5737ecccb29866b78bcbd0f1c60479817691c831cfb16e50fbffb62a4496d78d"
Jul 24 17:54:41.290144 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:41.290103    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5737ecccb29866b78bcbd0f1c60479817691c831cfb16e50fbffb62a4496d78d"} err="failed to get container status \"5737ecccb29866b78bcbd0f1c60479817691c831cfb16e50fbffb62a4496d78d\": rpc error: code = NotFound desc = could not find container \"5737ecccb29866b78bcbd0f1c60479817691c831cfb16e50fbffb62a4496d78d\": container with ID starting with 5737ecccb29866b78bcbd0f1c60479817691c831cfb16e50fbffb62a4496d78d not found: ID does not exist"
Jul 24 17:54:41.290144 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:41.290120    2572 scope.go:117] "RemoveContainer" containerID="52c7a50fc5af7ec041c78ce4795203d8c1f853638cc187fbe274f88bcb16b2e8"
Jul 24 17:54:41.290431 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:54:41.290410    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52c7a50fc5af7ec041c78ce4795203d8c1f853638cc187fbe274f88bcb16b2e8\": container with ID starting with 52c7a50fc5af7ec041c78ce4795203d8c1f853638cc187fbe274f88bcb16b2e8 not found: ID does not exist" containerID="52c7a50fc5af7ec041c78ce4795203d8c1f853638cc187fbe274f88bcb16b2e8"
Jul 24 17:54:41.290512 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:41.290434    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52c7a50fc5af7ec041c78ce4795203d8c1f853638cc187fbe274f88bcb16b2e8"} err="failed to get container status \"52c7a50fc5af7ec041c78ce4795203d8c1f853638cc187fbe274f88bcb16b2e8\": rpc error: code = NotFound desc = could not find container \"52c7a50fc5af7ec041c78ce4795203d8c1f853638cc187fbe274f88bcb16b2e8\": container with ID starting with 52c7a50fc5af7ec041c78ce4795203d8c1f853638cc187fbe274f88bcb16b2e8 not found: ID does not exist"
Jul 24 17:54:41.305126 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:41.305101    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"]
Jul 24 17:54:41.313050 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:41.313030    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft"]
Jul 24 17:54:43.088246 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:43.088206    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3" path="/var/lib/kubelet/pods/a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3/volumes"
Jul 24 17:54:55.191370 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:55.191330    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv"]
Jul 24 17:54:55.191796 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:55.191587    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv" podUID="01a5ea7a-1dc0-4453-adc0-808492868a01" containerName="maas-api" containerID="cri-o://0ced98be9d28cd2c07dba031f435285ff567637db061403d6bbae3d01e121b68" gracePeriod=30
Jul 24 17:54:55.366194 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:55.366160    2572 generic.go:356] "Generic (PLEG): container finished" podID="01a5ea7a-1dc0-4453-adc0-808492868a01" containerID="0ced98be9d28cd2c07dba031f435285ff567637db061403d6bbae3d01e121b68" exitCode=0
Jul 24 17:54:55.366365 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:55.366202    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv" event={"ID":"01a5ea7a-1dc0-4453-adc0-808492868a01","Type":"ContainerDied","Data":"0ced98be9d28cd2c07dba031f435285ff567637db061403d6bbae3d01e121b68"}
Jul 24 17:54:55.460434 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:55.460408    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv"
Jul 24 17:54:55.541832 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:55.541802    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01a5ea7a-1dc0-4453-adc0-808492868a01-maas-api-tls\") pod \"01a5ea7a-1dc0-4453-adc0-808492868a01\" (UID: \"01a5ea7a-1dc0-4453-adc0-808492868a01\") "
Jul 24 17:54:55.542002 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:55.541856    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01a5ea7a-1dc0-4453-adc0-808492868a01-openshift-service-ca\") pod \"01a5ea7a-1dc0-4453-adc0-808492868a01\" (UID: \"01a5ea7a-1dc0-4453-adc0-808492868a01\") "
Jul 24 17:54:55.542002 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:55.541927    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgn5d\" (UniqueName: \"kubernetes.io/projected/01a5ea7a-1dc0-4453-adc0-808492868a01-kube-api-access-kgn5d\") pod \"01a5ea7a-1dc0-4453-adc0-808492868a01\" (UID: \"01a5ea7a-1dc0-4453-adc0-808492868a01\") "
Jul 24 17:54:55.542224 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:55.542195    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01a5ea7a-1dc0-4453-adc0-808492868a01-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "01a5ea7a-1dc0-4453-adc0-808492868a01" (UID: "01a5ea7a-1dc0-4453-adc0-808492868a01"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:54:55.544193 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:55.544153    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01a5ea7a-1dc0-4453-adc0-808492868a01-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "01a5ea7a-1dc0-4453-adc0-808492868a01" (UID: "01a5ea7a-1dc0-4453-adc0-808492868a01"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:54:55.544193 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:55.544168    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01a5ea7a-1dc0-4453-adc0-808492868a01-kube-api-access-kgn5d" (OuterVolumeSpecName: "kube-api-access-kgn5d") pod "01a5ea7a-1dc0-4453-adc0-808492868a01" (UID: "01a5ea7a-1dc0-4453-adc0-808492868a01"). InnerVolumeSpecName "kube-api-access-kgn5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:54:55.642877 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:55.642852    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01a5ea7a-1dc0-4453-adc0-808492868a01-openshift-service-ca\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:54:55.642877 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:55.642877    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgn5d\" (UniqueName: \"kubernetes.io/projected/01a5ea7a-1dc0-4453-adc0-808492868a01-kube-api-access-kgn5d\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:54:55.643061 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:55.642896    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01a5ea7a-1dc0-4453-adc0-808492868a01-maas-api-tls\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:54:56.372760 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:56.372725    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv" event={"ID":"01a5ea7a-1dc0-4453-adc0-808492868a01","Type":"ContainerDied","Data":"62a9c632d82974541209d2b13ceade2f686ee71cebfca74e085ccd8150c309f8"}
Jul 24 17:54:56.372760 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:56.372754    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv"
Jul 24 17:54:56.373297 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:56.372783    2572 scope.go:117] "RemoveContainer" containerID="0ced98be9d28cd2c07dba031f435285ff567637db061403d6bbae3d01e121b68"
Jul 24 17:54:56.396314 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:56.396289    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv"]
Jul 24 17:54:56.400087 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:56.400065    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-92693f-57c665f4f-4p6mv"]
Jul 24 17:54:57.086204 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:54:57.086168    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01a5ea7a-1dc0-4453-adc0-808492868a01" path="/var/lib/kubelet/pods/01a5ea7a-1dc0-4453-adc0-808492868a01/volumes"
Jul 24 17:56:12.192519 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:12.192490    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"]
Jul 24 17:56:12.193042 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:12.192742    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9" podUID="d4f91f9a-3f15-4bea-8119-fb74a4904a16" containerName="istio-proxy" containerID="cri-o://8a575cfdfe73d1ed8f2d1e1b3153458004c1a85c11b21acb5019ad13dee2b83c" gracePeriod=30
Jul 24 17:56:17.073383 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.073337    2572 patch_prober.go:28] interesting pod/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 17:56:17.073839 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.073418    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9" podUID="d4f91f9a-3f15-4bea-8119-fb74a4904a16" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:56:17.452876 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.452853    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:56:17.640640 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.640569    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-credential-socket\") pod \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") "
Jul 24 17:56:17.640640 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.640608    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgrsb\" (UniqueName: \"kubernetes.io/projected/d4f91f9a-3f15-4bea-8119-fb74a4904a16-kube-api-access-pgrsb\") pod \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") "
Jul 24 17:56:17.640640 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.640632    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-workload-socket\") pod \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") "
Jul 24 17:56:17.640898 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.640703    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-podinfo\") pod \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") "
Jul 24 17:56:17.640898 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.640735    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-envoy\") pod \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") "
Jul 24 17:56:17.640898 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.640863    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d4f91f9a-3f15-4bea-8119-fb74a4904a16" (UID: "d4f91f9a-3f15-4bea-8119-fb74a4904a16"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:56:17.640898 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.640870    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istiod-ca-cert\") pod \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") "
Jul 24 17:56:17.641116 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.640932    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-workload-certs\") pod \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") "
Jul 24 17:56:17.641116 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.640950    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-data\") pod \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") "
Jul 24 17:56:17.641116 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.641006    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-token\") pod \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\" (UID: \"d4f91f9a-3f15-4bea-8119-fb74a4904a16\") "
Jul 24 17:56:17.641116 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.641015    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d4f91f9a-3f15-4bea-8119-fb74a4904a16" (UID: "d4f91f9a-3f15-4bea-8119-fb74a4904a16"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:56:17.641375 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.641180    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d4f91f9a-3f15-4bea-8119-fb74a4904a16" (UID: "d4f91f9a-3f15-4bea-8119-fb74a4904a16"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:56:17.641375 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.641259    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d4f91f9a-3f15-4bea-8119-fb74a4904a16" (UID: "d4f91f9a-3f15-4bea-8119-fb74a4904a16"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:56:17.641491 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.641435    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-workload-certs\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:56:17.641491 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.641456    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-credential-socket\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:56:17.641491 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.641474    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-workload-socket\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:56:17.641491 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.641492    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istiod-ca-cert\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:56:17.642200 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.642175    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-data" (OuterVolumeSpecName: "istio-data") pod "d4f91f9a-3f15-4bea-8119-fb74a4904a16" (UID: "d4f91f9a-3f15-4bea-8119-fb74a4904a16"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:56:17.643021 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.642998    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d4f91f9a-3f15-4bea-8119-fb74a4904a16" (UID: "d4f91f9a-3f15-4bea-8119-fb74a4904a16"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:56:17.643112 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.643071    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d4f91f9a-3f15-4bea-8119-fb74a4904a16" (UID: "d4f91f9a-3f15-4bea-8119-fb74a4904a16"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:56:17.643112 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.643089    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4f91f9a-3f15-4bea-8119-fb74a4904a16-kube-api-access-pgrsb" (OuterVolumeSpecName: "kube-api-access-pgrsb") pod "d4f91f9a-3f15-4bea-8119-fb74a4904a16" (UID: "d4f91f9a-3f15-4bea-8119-fb74a4904a16"). InnerVolumeSpecName "kube-api-access-pgrsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:56:17.643192 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.643153    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-token" (OuterVolumeSpecName: "istio-token") pod "d4f91f9a-3f15-4bea-8119-fb74a4904a16" (UID: "d4f91f9a-3f15-4bea-8119-fb74a4904a16"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:56:17.741901 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.741874    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgrsb\" (UniqueName: \"kubernetes.io/projected/d4f91f9a-3f15-4bea-8119-fb74a4904a16-kube-api-access-pgrsb\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:56:17.741901 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.741898    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-podinfo\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:56:17.742054 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.741909    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-envoy\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:56:17.742054 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.741950    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-data\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:56:17.742054 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.741958    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4f91f9a-3f15-4bea-8119-fb74a4904a16-istio-token\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:56:17.899276 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.899181    2572 generic.go:356] "Generic (PLEG): container finished" podID="d4f91f9a-3f15-4bea-8119-fb74a4904a16" containerID="8a575cfdfe73d1ed8f2d1e1b3153458004c1a85c11b21acb5019ad13dee2b83c" exitCode=0
Jul 24 17:56:17.899276 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.899246    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"
Jul 24 17:56:17.899499 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.899271    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9" event={"ID":"d4f91f9a-3f15-4bea-8119-fb74a4904a16","Type":"ContainerDied","Data":"8a575cfdfe73d1ed8f2d1e1b3153458004c1a85c11b21acb5019ad13dee2b83c"}
Jul 24 17:56:17.899499 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.899336    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9" event={"ID":"d4f91f9a-3f15-4bea-8119-fb74a4904a16","Type":"ContainerDied","Data":"3c93498b86aa88f4734210e6d2dde1d63c6b37cf9d7ba62796aa48bc2ac95a52"}
Jul 24 17:56:17.899499 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.899365    2572 scope.go:117] "RemoveContainer" containerID="8a575cfdfe73d1ed8f2d1e1b3153458004c1a85c11b21acb5019ad13dee2b83c"
Jul 24 17:56:17.909357 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.909342    2572 scope.go:117] "RemoveContainer" containerID="f9fa77b7577fdba4a05e64eab84b5ba77b9ed4ecd9d169b6a3e9156ccc5f25fd"
Jul 24 17:56:17.917684 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.917670    2572 scope.go:117] "RemoveContainer" containerID="8a575cfdfe73d1ed8f2d1e1b3153458004c1a85c11b21acb5019ad13dee2b83c"
Jul 24 17:56:17.917932 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:56:17.917915    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a575cfdfe73d1ed8f2d1e1b3153458004c1a85c11b21acb5019ad13dee2b83c\": container with ID starting with 8a575cfdfe73d1ed8f2d1e1b3153458004c1a85c11b21acb5019ad13dee2b83c not found: ID does not exist" containerID="8a575cfdfe73d1ed8f2d1e1b3153458004c1a85c11b21acb5019ad13dee2b83c"
Jul 24 17:56:17.917999 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.917948    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a575cfdfe73d1ed8f2d1e1b3153458004c1a85c11b21acb5019ad13dee2b83c"} err="failed to get container status \"8a575cfdfe73d1ed8f2d1e1b3153458004c1a85c11b21acb5019ad13dee2b83c\": rpc error: code = NotFound desc = could not find container \"8a575cfdfe73d1ed8f2d1e1b3153458004c1a85c11b21acb5019ad13dee2b83c\": container with ID starting with 8a575cfdfe73d1ed8f2d1e1b3153458004c1a85c11b21acb5019ad13dee2b83c not found: ID does not exist"
Jul 24 17:56:17.917999 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.917964    2572 scope.go:117] "RemoveContainer" containerID="f9fa77b7577fdba4a05e64eab84b5ba77b9ed4ecd9d169b6a3e9156ccc5f25fd"
Jul 24 17:56:17.918182 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:56:17.918164    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9fa77b7577fdba4a05e64eab84b5ba77b9ed4ecd9d169b6a3e9156ccc5f25fd\": container with ID starting with f9fa77b7577fdba4a05e64eab84b5ba77b9ed4ecd9d169b6a3e9156ccc5f25fd not found: ID does not exist" containerID="f9fa77b7577fdba4a05e64eab84b5ba77b9ed4ecd9d169b6a3e9156ccc5f25fd"
Jul 24 17:56:17.918222 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.918186    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9fa77b7577fdba4a05e64eab84b5ba77b9ed4ecd9d169b6a3e9156ccc5f25fd"} err="failed to get container status \"f9fa77b7577fdba4a05e64eab84b5ba77b9ed4ecd9d169b6a3e9156ccc5f25fd\": rpc error: code = NotFound desc = could not find container \"f9fa77b7577fdba4a05e64eab84b5ba77b9ed4ecd9d169b6a3e9156ccc5f25fd\": container with ID starting with f9fa77b7577fdba4a05e64eab84b5ba77b9ed4ecd9d169b6a3e9156ccc5f25fd not found: ID does not exist"
Jul 24 17:56:17.926538 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.926517    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"]
Jul 24 17:56:17.932753 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:17.932733    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9"]
Jul 24 17:56:19.085642 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:19.085609    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4f91f9a-3f15-4bea-8119-fb74a4904a16" path="/var/lib/kubelet/pods/d4f91f9a-3f15-4bea-8119-fb74a4904a16/volumes"
Jul 24 17:56:34.740463 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:34.740422    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"]
Jul 24 17:56:34.740936 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:34.740730    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8" podUID="cd66f318-0506-42f6-a571-fd7c3ea9f427" containerName="istio-proxy" containerID="cri-o://65280b55afa6085b2b54632731fa97f9dac092ecc6ee33a0e554d209b6a52c68" gracePeriod=30
Jul 24 17:56:40.007287 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.007200    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:56:40.034750 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.034712    2572 generic.go:356] "Generic (PLEG): container finished" podID="cd66f318-0506-42f6-a571-fd7c3ea9f427" containerID="65280b55afa6085b2b54632731fa97f9dac092ecc6ee33a0e554d209b6a52c68" exitCode=0
Jul 24 17:56:40.034911 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.034758    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"
Jul 24 17:56:40.034911 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.034782    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8" event={"ID":"cd66f318-0506-42f6-a571-fd7c3ea9f427","Type":"ContainerDied","Data":"65280b55afa6085b2b54632731fa97f9dac092ecc6ee33a0e554d209b6a52c68"}
Jul 24 17:56:40.034911 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.034831    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8" event={"ID":"cd66f318-0506-42f6-a571-fd7c3ea9f427","Type":"ContainerDied","Data":"bebf92751ac9c3e08ff910c783654b4e35fe080eb9bd8473a6d62a38cad591ec"}
Jul 24 17:56:40.034911 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.034856    2572 scope.go:117] "RemoveContainer" containerID="65280b55afa6085b2b54632731fa97f9dac092ecc6ee33a0e554d209b6a52c68"
Jul 24 17:56:40.045130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.045109    2572 scope.go:117] "RemoveContainer" containerID="3265051409b4cf6f79bc01fe28679a89692f77ab7bd1d96ed0d608e8b521e2ea"
Jul 24 17:56:40.054180 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.054161    2572 scope.go:117] "RemoveContainer" containerID="65280b55afa6085b2b54632731fa97f9dac092ecc6ee33a0e554d209b6a52c68"
Jul 24 17:56:40.054456 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:56:40.054436    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65280b55afa6085b2b54632731fa97f9dac092ecc6ee33a0e554d209b6a52c68\": container with ID starting with 65280b55afa6085b2b54632731fa97f9dac092ecc6ee33a0e554d209b6a52c68 not found: ID does not exist" containerID="65280b55afa6085b2b54632731fa97f9dac092ecc6ee33a0e554d209b6a52c68"
Jul 24 17:56:40.054526 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.054467    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65280b55afa6085b2b54632731fa97f9dac092ecc6ee33a0e554d209b6a52c68"} err="failed to get container status \"65280b55afa6085b2b54632731fa97f9dac092ecc6ee33a0e554d209b6a52c68\": rpc error: code = NotFound desc = could not find container \"65280b55afa6085b2b54632731fa97f9dac092ecc6ee33a0e554d209b6a52c68\": container with ID starting with 65280b55afa6085b2b54632731fa97f9dac092ecc6ee33a0e554d209b6a52c68 not found: ID does not exist"
Jul 24 17:56:40.054526 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.054488    2572 scope.go:117] "RemoveContainer" containerID="3265051409b4cf6f79bc01fe28679a89692f77ab7bd1d96ed0d608e8b521e2ea"
Jul 24 17:56:40.054739 ip-10-0-135-233 kubenswrapper[2572]: E0724 17:56:40.054716    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3265051409b4cf6f79bc01fe28679a89692f77ab7bd1d96ed0d608e8b521e2ea\": container with ID starting with 3265051409b4cf6f79bc01fe28679a89692f77ab7bd1d96ed0d608e8b521e2ea not found: ID does not exist" containerID="3265051409b4cf6f79bc01fe28679a89692f77ab7bd1d96ed0d608e8b521e2ea"
Jul 24 17:56:40.054788 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.054752    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3265051409b4cf6f79bc01fe28679a89692f77ab7bd1d96ed0d608e8b521e2ea"} err="failed to get container status \"3265051409b4cf6f79bc01fe28679a89692f77ab7bd1d96ed0d608e8b521e2ea\": rpc error: code = NotFound desc = could not find container \"3265051409b4cf6f79bc01fe28679a89692f77ab7bd1d96ed0d608e8b521e2ea\": container with ID starting with 3265051409b4cf6f79bc01fe28679a89692f77ab7bd1d96ed0d608e8b521e2ea not found: ID does not exist"
Jul 24 17:56:40.146125 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.146093    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd66f318-0506-42f6-a571-fd7c3ea9f427-istiod-ca-cert\") pod \"cd66f318-0506-42f6-a571-fd7c3ea9f427\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") "
Jul 24 17:56:40.146321 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.146174    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8j24\" (UniqueName: \"kubernetes.io/projected/cd66f318-0506-42f6-a571-fd7c3ea9f427-kube-api-access-v8j24\") pod \"cd66f318-0506-42f6-a571-fd7c3ea9f427\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") "
Jul 24 17:56:40.146321 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.146210    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-data\") pod \"cd66f318-0506-42f6-a571-fd7c3ea9f427\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") "
Jul 24 17:56:40.146321 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.146228    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-workload-socket\") pod \"cd66f318-0506-42f6-a571-fd7c3ea9f427\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") "
Jul 24 17:56:40.146321 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.146291    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-podinfo\") pod \"cd66f318-0506-42f6-a571-fd7c3ea9f427\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") "
Jul 24 17:56:40.146521 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.146330    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-envoy\") pod \"cd66f318-0506-42f6-a571-fd7c3ea9f427\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") "
Jul 24 17:56:40.146521 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.146378    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-workload-certs\") pod \"cd66f318-0506-42f6-a571-fd7c3ea9f427\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") "
Jul 24 17:56:40.146521 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.146423    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-credential-socket\") pod \"cd66f318-0506-42f6-a571-fd7c3ea9f427\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") "
Jul 24 17:56:40.146681 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.146547    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd66f318-0506-42f6-a571-fd7c3ea9f427-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cd66f318-0506-42f6-a571-fd7c3ea9f427" (UID: "cd66f318-0506-42f6-a571-fd7c3ea9f427"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:56:40.146681 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.146663    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cd66f318-0506-42f6-a571-fd7c3ea9f427" (UID: "cd66f318-0506-42f6-a571-fd7c3ea9f427"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:56:40.146801 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.146690    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cd66f318-0506-42f6-a571-fd7c3ea9f427" (UID: "cd66f318-0506-42f6-a571-fd7c3ea9f427"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:56:40.146801 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.146741    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-token\") pod \"cd66f318-0506-42f6-a571-fd7c3ea9f427\" (UID: \"cd66f318-0506-42f6-a571-fd7c3ea9f427\") "
Jul 24 17:56:40.146905 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.146811    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cd66f318-0506-42f6-a571-fd7c3ea9f427" (UID: "cd66f318-0506-42f6-a571-fd7c3ea9f427"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:56:40.147090 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.147034    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-data" (OuterVolumeSpecName: "istio-data") pod "cd66f318-0506-42f6-a571-fd7c3ea9f427" (UID: "cd66f318-0506-42f6-a571-fd7c3ea9f427"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:56:40.147325 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.147305    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd66f318-0506-42f6-a571-fd7c3ea9f427-istiod-ca-cert\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:56:40.147394 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.147330    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-data\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:56:40.147394 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.147344    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-workload-socket\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:56:40.147394 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.147358    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-workload-certs\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:56:40.147394 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.147373    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-credential-socket\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:56:40.148664 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.148635    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cd66f318-0506-42f6-a571-fd7c3ea9f427" (UID: "cd66f318-0506-42f6-a571-fd7c3ea9f427"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:56:40.148784 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.148713    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd66f318-0506-42f6-a571-fd7c3ea9f427-kube-api-access-v8j24" (OuterVolumeSpecName: "kube-api-access-v8j24") pod "cd66f318-0506-42f6-a571-fd7c3ea9f427" (UID: "cd66f318-0506-42f6-a571-fd7c3ea9f427"). InnerVolumeSpecName "kube-api-access-v8j24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:56:40.149214 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.149191    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cd66f318-0506-42f6-a571-fd7c3ea9f427" (UID: "cd66f318-0506-42f6-a571-fd7c3ea9f427"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:56:40.149214 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.149203    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-token" (OuterVolumeSpecName: "istio-token") pod "cd66f318-0506-42f6-a571-fd7c3ea9f427" (UID: "cd66f318-0506-42f6-a571-fd7c3ea9f427"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:56:40.248314 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.248277    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-token\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:56:40.248314 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.248307    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8j24\" (UniqueName: \"kubernetes.io/projected/cd66f318-0506-42f6-a571-fd7c3ea9f427-kube-api-access-v8j24\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:56:40.248314 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.248317    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-podinfo\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:56:40.248314 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.248326    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd66f318-0506-42f6-a571-fd7c3ea9f427-istio-envoy\") on node \"ip-10-0-135-233.ec2.internal\" DevicePath \"\""
Jul 24 17:56:40.359467 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.359435    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"]
Jul 24 17:56:40.367034 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:40.366987    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8"]
Jul 24 17:56:41.085664 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:41.085632    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd66f318-0506-42f6-a571-fd7c3ea9f427" path="/var/lib/kubelet/pods/cd66f318-0506-42f6-a571-fd7c3ea9f427/volumes"
Jul 24 17:56:58.023898 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:56:58.023806    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-69466cb798-mvfhg_1da27b87-3235-429f-9bf5-95004b1aa579/authorino/0.log"
Jul 24 17:57:03.928750 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:03.928718    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-jbbqt_fe00b76d-9b28-40f0-b92d-53ee51ed11c5/manager/0.log"
Jul 24 17:57:04.069777 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:04.069716    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-lmgvt_edcb2b5d-276c-4b17-9841-4480bb1e0814/manager/0.log"
Jul 24 17:57:04.326348 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:04.326255    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wzrk5_f73bb355-5517-498e-88d6-b2fe2282c086/server/0.log"
Jul 24 17:57:04.459984 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:04.459950    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-89xqj_aa8a48cb-3a36-41db-a32f-566d6a2feea3/manager/0.log"
Jul 24 17:57:04.764203 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:04.764174    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-645867896-hgk2p_871530fe-ba09-4793-9890-a3845f7e2ee0/copy-manifests/0.log"
Jul 24 17:57:04.772493 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:04.772469    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-645867896-hgk2p_871530fe-ba09-4793-9890-a3845f7e2ee0/manager/0.log"
Jul 24 17:57:05.294701 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:05.294666    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7b675d968d-zxw7q_4f168564-3d72-4566-8424-e189f7717396/maas-api/0.log"
Jul 24 17:57:06.522867 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:06.522837    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn_a4f9aaa6-5389-4d13-8152-3c256e9391a9/extract/0.log"
Jul 24 17:57:06.537133 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:06.537103    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn_a4f9aaa6-5389-4d13-8152-3c256e9391a9/util/0.log"
Jul 24 17:57:06.551334 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:06.551305    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn_a4f9aaa6-5389-4d13-8152-3c256e9391a9/pull/0.log"
Jul 24 17:57:06.687826 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:06.687793    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq_c552b149-78af-4ebc-bc82-aeefb7220255/util/0.log"
Jul 24 17:57:06.697202 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:06.697175    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq_c552b149-78af-4ebc-bc82-aeefb7220255/pull/0.log"
Jul 24 17:57:06.705268 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:06.705242    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq_c552b149-78af-4ebc-bc82-aeefb7220255/extract/0.log"
Jul 24 17:57:06.827911 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:06.827822    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n_e9c066fd-192f-4d8c-be57-7cea69f7d01a/util/0.log"
Jul 24 17:57:06.835332 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:06.835311    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n_e9c066fd-192f-4d8c-be57-7cea69f7d01a/pull/0.log"
Jul 24 17:57:06.842721 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:06.842698    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n_e9c066fd-192f-4d8c-be57-7cea69f7d01a/extract/0.log"
Jul 24 17:57:06.965065 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:06.965027    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95_6559a994-d707-4ab2-945f-8cc7196bde5c/pull/0.log"
Jul 24 17:57:06.972091 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:06.972072    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95_6559a994-d707-4ab2-945f-8cc7196bde5c/extract/0.log"
Jul 24 17:57:06.979544 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:06.979518    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95_6559a994-d707-4ab2-945f-8cc7196bde5c/util/0.log"
Jul 24 17:57:07.111656 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:07.111623    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-69466cb798-mvfhg_1da27b87-3235-429f-9bf5-95004b1aa579/authorino/0.log"
Jul 24 17:57:07.246533 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:07.246498    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-dqtt5_bd09bc30-0a66-4918-ac7d-51562b4a1cbc/manager/0.log"
Jul 24 17:57:07.372038 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:07.371965    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cgzfg_97fb2e6e-6748-49d9-9e04-a63e51a67337/manager/0.log"
Jul 24 17:57:07.651956 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:07.651871    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qmqrl_c317f443-a73b-4860-a72a-efebd04821ab/registry-server/0.log"
Jul 24 17:57:07.783089 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:07.783053    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xcbtj_ae1b5d9d-049f-407f-9180-abb86b915ff4/manager/0.log"
Jul 24 17:57:08.042948 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:08.042861    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-qnnx9_5f4b2492-962d-45d2-b880-d6ce8717b1f4/manager/0.log"
Jul 24 17:57:08.432757 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:08.432730    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r_176af051-6515-45d7-a5ef-7a4abcec5b06/istio-proxy/0.log"
Jul 24 17:57:08.680471 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:08.680437    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8cdf7544b-fxfn4_698b7d8f-da2d-470d-9499-f29bd91eb9ab/kube-auth-proxy/0.log"
Jul 24 17:57:08.937253 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:08.937196    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-xq45x_9ead329a-90b0-4c8b-8a97-3534ec4cbe76/istio-proxy/1.log"
Jul 24 17:57:09.329771 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:09.329684    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b8b6894cc-sf8bk_d6ad8405-43ea-45ca-8735-4ca4e9cc3350/router/0.log"
Jul 24 17:57:09.703654 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:09.703619    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-ch67m_8f9a495f-8657-4eb2-86ce-55bae56e787b/main/0.log"
Jul 24 17:57:10.097279 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:10.097162    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgzvxc_a8ed4bb8-8cdb-4f72-a733-df0b55138ac2/main/0.log"
Jul 24 17:57:10.344492 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:10.344462    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-mb626_594ac27f-4030-4032-9acd-376c116dd419/main/0.log"
Jul 24 17:57:19.135949 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:19.135893    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2dlhn_eebea2cf-2c71-48e8-bdd9-cb59bcb96fc7/global-pull-secret-syncer/0.log"
Jul 24 17:57:19.328793 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:19.328758    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lz86b_b4e94037-5cfa-4bdf-b325-58bdaa8a6bb5/konnectivity-agent/0.log"
Jul 24 17:57:19.385113 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:19.385079    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-233.ec2.internal_088a772ea827d74ea5135dd3264e29f0/haproxy/0.log"
Jul 24 17:57:24.310990 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:24.310956    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn_a4f9aaa6-5389-4d13-8152-3c256e9391a9/extract/0.log"
Jul 24 17:57:24.342455 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:24.342431    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn_a4f9aaa6-5389-4d13-8152-3c256e9391a9/util/0.log"
Jul 24 17:57:24.366970 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:24.366947    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rv2zn_a4f9aaa6-5389-4d13-8152-3c256e9391a9/pull/0.log"
Jul 24 17:57:24.407951 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:24.407926    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq_c552b149-78af-4ebc-bc82-aeefb7220255/extract/0.log"
Jul 24 17:57:24.434861 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:24.434832    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq_c552b149-78af-4ebc-bc82-aeefb7220255/util/0.log"
Jul 24 17:57:24.457743 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:24.457718    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cj6mq_c552b149-78af-4ebc-bc82-aeefb7220255/pull/0.log"
Jul 24 17:57:24.487250 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:24.487204    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n_e9c066fd-192f-4d8c-be57-7cea69f7d01a/extract/0.log"
Jul 24 17:57:24.515404 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:24.515383    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n_e9c066fd-192f-4d8c-be57-7cea69f7d01a/util/0.log"
Jul 24 17:57:24.547947 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:24.547921    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9z7n_e9c066fd-192f-4d8c-be57-7cea69f7d01a/pull/0.log"
Jul 24 17:57:24.576369 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:24.576302    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95_6559a994-d707-4ab2-945f-8cc7196bde5c/extract/0.log"
Jul 24 17:57:24.598384 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:24.598365    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95_6559a994-d707-4ab2-945f-8cc7196bde5c/util/0.log"
Jul 24 17:57:24.631982 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:24.631955    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17pf95_6559a994-d707-4ab2-945f-8cc7196bde5c/pull/0.log"
Jul 24 17:57:25.278520 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:25.278487    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-69466cb798-mvfhg_1da27b87-3235-429f-9bf5-95004b1aa579/authorino/0.log"
Jul 24 17:57:25.321076 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:25.321031    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-dqtt5_bd09bc30-0a66-4918-ac7d-51562b4a1cbc/manager/0.log"
Jul 24 17:57:25.351293 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:25.351266    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cgzfg_97fb2e6e-6748-49d9-9e04-a63e51a67337/manager/0.log"
Jul 24 17:57:25.445224 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:25.445193    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qmqrl_c317f443-a73b-4860-a72a-efebd04821ab/registry-server/0.log"
Jul 24 17:57:25.651941 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:25.651910    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xcbtj_ae1b5d9d-049f-407f-9180-abb86b915ff4/manager/0.log"
Jul 24 17:57:25.783400 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:25.783355    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-qnnx9_5f4b2492-962d-45d2-b880-d6ce8717b1f4/manager/0.log"
Jul 24 17:57:27.764016 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:27.763979    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-x62n9_d3478829-1a11-4ed0-9fa2-da1e1517869c/monitoring-plugin/0.log"
Jul 24 17:57:27.806130 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:27.806102    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5c6vr_cf2f99c8-82f2-4859-8330-c504b241f19f/node-exporter/0.log"
Jul 24 17:57:27.845811 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:27.845781    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5c6vr_cf2f99c8-82f2-4859-8330-c504b241f19f/kube-rbac-proxy/0.log"
Jul 24 17:57:27.885739 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:27.885717    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5c6vr_cf2f99c8-82f2-4859-8330-c504b241f19f/init-textfile/0.log"
Jul 24 17:57:28.521557 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:28.521523    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f86f9cff7-n56ts_4a61295f-d33e-49b5-94ed-239751e85f25/telemeter-client/0.log"
Jul 24 17:57:28.549772 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:28.549731    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f86f9cff7-n56ts_4a61295f-d33e-49b5-94ed-239751e85f25/reload/0.log"
Jul 24 17:57:28.575069 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:28.575045    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f86f9cff7-n56ts_4a61295f-d33e-49b5-94ed-239751e85f25/kube-rbac-proxy/0.log"
Jul 24 17:57:29.202358 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.202323    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq"]
Jul 24 17:57:29.202760 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.202739    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4f91f9a-3f15-4bea-8119-fb74a4904a16" containerName="istio-proxy"
Jul 24 17:57:29.202760 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.202751    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4f91f9a-3f15-4bea-8119-fb74a4904a16" containerName="istio-proxy"
Jul 24 17:57:29.202760 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.202760    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01a5ea7a-1dc0-4453-adc0-808492868a01" containerName="maas-api"
Jul 24 17:57:29.202874 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.202766    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="01a5ea7a-1dc0-4453-adc0-808492868a01" containerName="maas-api"
Jul 24 17:57:29.202874 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.202774    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3" containerName="istio-proxy"
Jul 24 17:57:29.202874 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.202781    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3" containerName="istio-proxy"
Jul 24 17:57:29.202874 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.202822    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd66f318-0506-42f6-a571-fd7c3ea9f427" containerName="istio-proxy"
Jul 24 17:57:29.202874 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.202828    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd66f318-0506-42f6-a571-fd7c3ea9f427" containerName="istio-proxy"
Jul 24 17:57:29.202874 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.202835    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3" containerName="istio-proxy"
Jul 24 17:57:29.202874 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.202841    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3" containerName="istio-proxy"
Jul 24 17:57:29.202874 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.202850    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd66f318-0506-42f6-a571-fd7c3ea9f427" containerName="istio-proxy"
Jul 24 17:57:29.202874 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.202868    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd66f318-0506-42f6-a571-fd7c3ea9f427" containerName="istio-proxy"
Jul 24 17:57:29.202874 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.202876    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4f91f9a-3f15-4bea-8119-fb74a4904a16" containerName="istio-proxy"
Jul 24 17:57:29.203276 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.202882    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4f91f9a-3f15-4bea-8119-fb74a4904a16" containerName="istio-proxy"
Jul 24 17:57:29.203276 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.202968    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd66f318-0506-42f6-a571-fd7c3ea9f427" containerName="istio-proxy"
Jul 24 17:57:29.203276 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.202975    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6a00d22-63fd-4e0f-bbb5-a4e795ad24d3" containerName="istio-proxy"
Jul 24 17:57:29.203276 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.202981    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4f91f9a-3f15-4bea-8119-fb74a4904a16" containerName="istio-proxy"
Jul 24 17:57:29.203276 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.202988    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="01a5ea7a-1dc0-4453-adc0-808492868a01" containerName="maas-api"
Jul 24 17:57:29.203276 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.202993    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd66f318-0506-42f6-a571-fd7c3ea9f427" containerName="istio-proxy"
Jul 24 17:57:29.206205 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.206188    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq"
Jul 24 17:57:29.208997 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.208973    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sr8cd\"/\"kube-root-ca.crt\""
Jul 24 17:57:29.209169 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.209071    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sr8cd\"/\"openshift-service-ca.crt\""
Jul 24 17:57:29.209941 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.209924    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sr8cd\"/\"default-dockercfg-6zpqp\""
Jul 24 17:57:29.217938 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.217910    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq"]
Jul 24 17:57:29.329451 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.329417    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3ee106b4-f73d-4057-a090-c4bb1d02c3a4-proc\") pod \"perf-node-gather-daemonset-4nnbq\" (UID: \"3ee106b4-f73d-4057-a090-c4bb1d02c3a4\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq"
Jul 24 17:57:29.329631 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.329476    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntkjn\" (UniqueName: \"kubernetes.io/projected/3ee106b4-f73d-4057-a090-c4bb1d02c3a4-kube-api-access-ntkjn\") pod \"perf-node-gather-daemonset-4nnbq\" (UID: \"3ee106b4-f73d-4057-a090-c4bb1d02c3a4\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq"
Jul 24 17:57:29.329631 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.329607    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ee106b4-f73d-4057-a090-c4bb1d02c3a4-lib-modules\") pod \"perf-node-gather-daemonset-4nnbq\" (UID: \"3ee106b4-f73d-4057-a090-c4bb1d02c3a4\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq"
Jul 24 17:57:29.329710 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.329656    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3ee106b4-f73d-4057-a090-c4bb1d02c3a4-podres\") pod \"perf-node-gather-daemonset-4nnbq\" (UID: \"3ee106b4-f73d-4057-a090-c4bb1d02c3a4\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq"
Jul 24 17:57:29.329710 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.329675    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ee106b4-f73d-4057-a090-c4bb1d02c3a4-sys\") pod \"perf-node-gather-daemonset-4nnbq\" (UID: \"3ee106b4-f73d-4057-a090-c4bb1d02c3a4\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq"
Jul 24 17:57:29.430523 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.430474    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3ee106b4-f73d-4057-a090-c4bb1d02c3a4-podres\") pod \"perf-node-gather-daemonset-4nnbq\" (UID: \"3ee106b4-f73d-4057-a090-c4bb1d02c3a4\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq"
Jul 24 17:57:29.430523 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.430521    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ee106b4-f73d-4057-a090-c4bb1d02c3a4-sys\") pod \"perf-node-gather-daemonset-4nnbq\" (UID: \"3ee106b4-f73d-4057-a090-c4bb1d02c3a4\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq"
Jul 24 17:57:29.430770 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.430552    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3ee106b4-f73d-4057-a090-c4bb1d02c3a4-proc\") pod \"perf-node-gather-daemonset-4nnbq\" (UID: \"3ee106b4-f73d-4057-a090-c4bb1d02c3a4\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq"
Jul 24 17:57:29.430770 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.430596    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntkjn\" (UniqueName: \"kubernetes.io/projected/3ee106b4-f73d-4057-a090-c4bb1d02c3a4-kube-api-access-ntkjn\") pod \"perf-node-gather-daemonset-4nnbq\" (UID: \"3ee106b4-f73d-4057-a090-c4bb1d02c3a4\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq"
Jul 24 17:57:29.430770 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.430644    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ee106b4-f73d-4057-a090-c4bb1d02c3a4-sys\") pod \"perf-node-gather-daemonset-4nnbq\" (UID: \"3ee106b4-f73d-4057-a090-c4bb1d02c3a4\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq"
Jul 24 17:57:29.430770 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.430646    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3ee106b4-f73d-4057-a090-c4bb1d02c3a4-podres\") pod \"perf-node-gather-daemonset-4nnbq\" (UID: \"3ee106b4-f73d-4057-a090-c4bb1d02c3a4\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq"
Jul 24 17:57:29.430770 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.430663    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3ee106b4-f73d-4057-a090-c4bb1d02c3a4-proc\") pod \"perf-node-gather-daemonset-4nnbq\" (UID: \"3ee106b4-f73d-4057-a090-c4bb1d02c3a4\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq"
Jul 24 17:57:29.430957 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.430847    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ee106b4-f73d-4057-a090-c4bb1d02c3a4-lib-modules\") pod \"perf-node-gather-daemonset-4nnbq\" (UID: \"3ee106b4-f73d-4057-a090-c4bb1d02c3a4\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq"
Jul 24 17:57:29.431000 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.430978    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ee106b4-f73d-4057-a090-c4bb1d02c3a4-lib-modules\") pod \"perf-node-gather-daemonset-4nnbq\" (UID: \"3ee106b4-f73d-4057-a090-c4bb1d02c3a4\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq"
Jul 24 17:57:29.440069 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.440035    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntkjn\" (UniqueName: \"kubernetes.io/projected/3ee106b4-f73d-4057-a090-c4bb1d02c3a4-kube-api-access-ntkjn\") pod \"perf-node-gather-daemonset-4nnbq\" (UID: \"3ee106b4-f73d-4057-a090-c4bb1d02c3a4\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq"
Jul 24 17:57:29.517616 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.517523    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq"
Jul 24 17:57:29.657763 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.657737    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq"]
Jul 24 17:57:29.659279 ip-10-0-135-233 kubenswrapper[2572]: W0724 17:57:29.659252    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3ee106b4_f73d_4057_a090_c4bb1d02c3a4.slice/crio-34bd95935b27df60f524413afd9834aa987f2219de68f879cd040c91029b93e9 WatchSource:0}: Error finding container 34bd95935b27df60f524413afd9834aa987f2219de68f879cd040c91029b93e9: Status 404 returned error can't find the container with id 34bd95935b27df60f524413afd9834aa987f2219de68f879cd040c91029b93e9
Jul 24 17:57:29.927814 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:29.927782    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-d9jzg_3f3ba1e9-16df-42fc-801b-822202b455d8/networking-console-plugin/0.log"
Jul 24 17:57:30.342096 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:30.342058    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq" event={"ID":"3ee106b4-f73d-4057-a090-c4bb1d02c3a4","Type":"ContainerStarted","Data":"b253f19ba25f0bf3a82e655dd5589eb8858e8dbd939b043f0fb40fbc52ea9aee"}
Jul 24 17:57:30.342638 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:30.342123    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq" event={"ID":"3ee106b4-f73d-4057-a090-c4bb1d02c3a4","Type":"ContainerStarted","Data":"34bd95935b27df60f524413afd9834aa987f2219de68f879cd040c91029b93e9"}
Jul 24 17:57:30.342638 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:30.342261    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq"
Jul 24 17:57:30.358541 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:30.358471    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq" podStartSLOduration=1.358454833 podStartE2EDuration="1.358454833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:57:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:57:30.358341135 +0000 UTC m=+3267.792556703" watchObservedRunningTime="2026-07-24 17:57:30.358454833 +0000 UTC m=+3267.792670400"
Jul 24 17:57:30.473620 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:30.473587    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/1.log"
Jul 24 17:57:30.481443 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:30.481419    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-sjgf8_a7820ccc-4ae6-492b-824f-62b30aaaf133/console-operator/2.log"
Jul 24 17:57:30.937355 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:30.937318    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55bb7fb8f8-6hvpg_75906dcb-8145-43a2-ac3d-294afcd6ea35/console/0.log"
Jul 24 17:57:32.597393 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:32.597363    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q8g77_63e25ce3-9fe4-4a91-a85c-2cf9bce6c306/dns/0.log"
Jul 24 17:57:32.624561 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:32.624516    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q8g77_63e25ce3-9fe4-4a91-a85c-2cf9bce6c306/kube-rbac-proxy/0.log"
Jul 24 17:57:32.810879 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:32.810851    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c6q8k_db2edea8-70c4-4ab5-898c-e0db3a2dacbe/dns-node-resolver/0.log"
Jul 24 17:57:33.537590 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:33.537556    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cc5xn_8ff2442b-1e6e-4d7e-9e4b-289e4b74517a/node-ca/0.log"
Jul 24 17:57:34.579490 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:34.579458    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r_176af051-6515-45d7-a5ef-7a4abcec5b06/istio-proxy/0.log"
Jul 24 17:57:34.759320 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:34.759267    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8cdf7544b-fxfn4_698b7d8f-da2d-470d-9499-f29bd91eb9ab/kube-auth-proxy/0.log"
Jul 24 17:57:34.822937 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:34.822899    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-xq45x_9ead329a-90b0-4c8b-8a97-3534ec4cbe76/istio-proxy/0.log"
Jul 24 17:57:34.875929 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:34.875889    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-xq45x_9ead329a-90b0-4c8b-8a97-3534ec4cbe76/istio-proxy/1.log"
Jul 24 17:57:34.982316 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:34.982288    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b8b6894cc-sf8bk_d6ad8405-43ea-45ca-8735-4ca4e9cc3350/router/0.log"
Jul 24 17:57:35.867076 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:35.867042    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x9wf4_c0d0a73d-6ae3-4e09-8853-510f01311e43/serve-healthcheck-canary/0.log"
Jul 24 17:57:36.359696 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:36.359669    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-4nnbq"
Jul 24 17:57:36.566044 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:36.566008    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sgb5b_c0575d1d-500e-47d7-b295-d58875e5a242/kube-rbac-proxy/0.log"
Jul 24 17:57:36.589903 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:36.589872    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sgb5b_c0575d1d-500e-47d7-b295-d58875e5a242/exporter/0.log"
Jul 24 17:57:36.621019 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:36.620943    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sgb5b_c0575d1d-500e-47d7-b295-d58875e5a242/extractor/0.log"
Jul 24 17:57:39.071585 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:39.071554    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-jbbqt_fe00b76d-9b28-40f0-b92d-53ee51ed11c5/manager/0.log"
Jul 24 17:57:39.454418 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:39.454334    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-lmgvt_edcb2b5d-276c-4b17-9841-4480bb1e0814/manager/0.log"
Jul 24 17:57:39.648087 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:39.648057    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wzrk5_f73bb355-5517-498e-88d6-b2fe2282c086/server/0.log"
Jul 24 17:57:39.769974 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:39.769895    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-89xqj_aa8a48cb-3a36-41db-a32f-566d6a2feea3/manager/0.log"
Jul 24 17:57:39.865962 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:39.865925    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-645867896-hgk2p_871530fe-ba09-4793-9890-a3845f7e2ee0/manager/0.log"
Jul 24 17:57:39.868400 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:39.868375    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r_176af051-6515-45d7-a5ef-7a4abcec5b06/istio-proxy/0.log"
Jul 24 17:57:39.894667 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:39.894635    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-645867896-hgk2p_871530fe-ba09-4793-9890-a3845f7e2ee0/copy-manifests/0.log"
Jul 24 17:57:40.033726 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:40.033639    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8cdf7544b-fxfn4_698b7d8f-da2d-470d-9499-f29bd91eb9ab/kube-auth-proxy/0.log"
Jul 24 17:57:40.094868 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:40.094446    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-xq45x_9ead329a-90b0-4c8b-8a97-3534ec4cbe76/istio-proxy/0.log"
Jul 24 17:57:40.148036 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:40.148009    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-xq45x_9ead329a-90b0-4c8b-8a97-3534ec4cbe76/istio-proxy/1.log"
Jul 24 17:57:40.230084 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:40.230056    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b8b6894cc-sf8bk_d6ad8405-43ea-45ca-8735-4ca4e9cc3350/router/0.log"
Jul 24 17:57:41.633279 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:41.633248    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r_176af051-6515-45d7-a5ef-7a4abcec5b06/istio-proxy/0.log"
Jul 24 17:57:41.804148 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:41.804119    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8cdf7544b-fxfn4_698b7d8f-da2d-470d-9499-f29bd91eb9ab/kube-auth-proxy/0.log"
Jul 24 17:57:41.848989 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:41.848955    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-xq45x_9ead329a-90b0-4c8b-8a97-3534ec4cbe76/istio-proxy/0.log"
Jul 24 17:57:41.904129 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:41.904043    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-xq45x_9ead329a-90b0-4c8b-8a97-3534ec4cbe76/istio-proxy/1.log"
Jul 24 17:57:41.977645 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:41.977613    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b8b6894cc-sf8bk_d6ad8405-43ea-45ca-8735-4ca4e9cc3350/router/0.log"
Jul 24 17:57:46.299883 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:46.299852    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-wwwb7_d21277aa-8e88-4163-8ebb-46705de9e3f0/migrator/0.log"
Jul 24 17:57:46.322420 ip-10-0-135-233 kubenswrapper[2572]: I0724 17:57:46.322389    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-wwwb7_d21277aa-8e88-4163-8ebb-46705de9e3f0/graceful-termination/0.log"